Cortex
Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.
About
Cortex by Jan AI is a local AI platform that runs language and other models on your own hardware behind an OpenAI-compatible API, with llama.cpp and ONNX backends and a model-pull command for the Hugging Face hub. It can run as a background service for integration into other applications. The repository is now archived and development has moved to the Menlo Research fork of llama.cpp. Apache 2.0 licensed.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Deployment & MLOps
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Self-hosted Go gateway that routes LLM traffic across providers with failover, caching, and guardrails.
Open-source orchestrator for AI training and inference across clouds, Kubernetes, and bare metal.
Kubernetes-native workflow orchestration platform for machine learning and data pipelines.
Open-source AI gateway that routes requests to more than 1,600 LLMs through one API with guardrails and caching.
Container tool by Replicate for packaging ML models as standard Docker images.
Framework for building production-ready AI application services.