KServe
Kubernetes serverless inference platform for deploying ML models.
About
KServe, formerly KFServing, provides a Kubernetes custom resource for serverless inference of predictive and generative AI models across many frameworks such as TensorFlow, PyTorch, and ONNX. It standardizes deployment with autoscaling including scale-to-zero, canary rollouts, and multi-framework serving, and is a CNCF incubating project used by many organizations. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Deployment & MLOps
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Advanced (4/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.
Self-hosted Go gateway that routes LLM traffic across providers with failover, caching, and guardrails.
Open-source orchestrator for AI training and inference across clouds, Kubernetes, and bare metal.
Kubernetes-native workflow orchestration platform for machine learning and data pipelines.
Open-source AI gateway that routes requests to more than 1,600 LLMs through one API with guardrails and caching.
Framework for building production-ready AI application services.