KServe

Kubernetes serverless inference platform for deploying ML models.

Open SourceSelf HostedOffline Capable
0.0 (0)

About

KServe, formerly KFServing, provides a Kubernetes custom resource for serverless inference of predictive and generative AI models across many frameworks such as TensorFlow, PyTorch, and ONNX. It standardizes deployment with autoscaling including scale-to-zero, canary rollouts, and multi-framework serving, and is a CNCF incubating project used by many organizations. Released under the Apache 2.0 license.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Advanced (4/5)
License
Apache-2.0
Added
Apr 3, 2026

Related Tools

Featured

Framework for building production-ready AI application services.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Container tool by Replicate for packaging ML models as standard Docker images.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Production model serving system for TensorFlow models.

Open SourceSelf HostedOffline
Intermediate
0.0 (0)

PyTorch model serving framework for production deployment.

Open SourceSelf HostedOffline
Intermediate
0.0 (0)

Open-source ML deployment platform for Kubernetes.

Open SourceSelf HostedOffline
Intermediate
0.0 (0)
Browse all AI Deployment & MLOps tools