LiteLLM
Unified API to call 100+ LLM providers with OpenAI format
About
LiteLLM is an open-source AI gateway that exposes a single OpenAI-format interface for calling more than a hundred LLM providers including OpenAI, Anthropic, Gemini, Bedrock, and Azure. It works as a Python SDK for direct integration or as a proxy server that centralizes routing, load balancing, fallbacks, and spend tracking for a team. It standardizes multi-provider access behind one API. Released under the MIT license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- LLM Inference & Serving
- Price
- Free
- Platform
- Hybrid
- Difficulty
- Easy (2/5)
- License
- MIT
- Added
- Jan 29, 2026
Related Tools
Minimalist ML framework in Rust by Hugging Face for fast inference.
Open-source ChatGPT alternative that runs 100% offline on your computer.
Port of Meta's LLaMA model in C/C++ for efficient CPU inference
Fast LLM inference on consumer GPUs using neuron-aware sparse computation.
High-throughput LLM serving engine with PagedAttention
Minimalist machine learning framework for Rust focused on performance and serverless inference.
Mentioned in
LLM Gateways in Production: LiteLLM vs Portkey vs Bifrost
A working comparison of LiteLLM, Portkey, and Bifrost on routing, caching, budgets, observability, and real...
Max P
Terminal Coding Agents in 2026: OpenCode, Crush, Goose and More
A verified 2026 comparison of terminal-native coding agents on model flexibility, sandboxing, MCP support,...
Max P
From OpenAI to LiteLLM: Cutting the AI Bill with Smart Routing
A first-person take on putting LiteLLM in front of OpenAI, Anthropic, and a local Ollama instance, with...
Billy C