Truss
Framework by Baseten for packaging and serving ML models.
About
Truss by Baseten is a Python framework and CLI for packaging machine learning models as production API endpoints. You define serving logic in Python and Truss handles containerization, dependency management, and GPU configuration, then deploys to Baseten or any environment. It works with models from vLLM, SGLang, TensorRT-LLM, Transformers, Diffusers, PyTorch, and TensorFlow. Released under the MIT license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Deployment & MLOps
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- MIT
- Added
- Apr 3, 2026
Related Tools
Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.
Self-hosted Go gateway that routes LLM traffic across providers with failover, caching, and guardrails.
Open-source orchestrator for AI training and inference across clouds, Kubernetes, and bare metal.
Kubernetes-native workflow orchestration platform for machine learning and data pipelines.
Open-source AI gateway that routes requests to more than 1,600 LLMs through one API with guardrails and caching.
Framework for building production-ready AI application services.