TorchServe
PyTorch model serving framework for production deployment.
About
TorchServe is a model-serving framework for PyTorch jointly developed with AWS, providing model archiving, REST and gRPC endpoints, request batching, logging, metrics, and custom handlers for multi-model serving. Recent versions enforce token authorization by default for security. The project is no longer actively maintained, so users should note that updates and security patches are not planned. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Deployment & MLOps
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Framework for building production-ready AI application services.
Container tool by Replicate for packaging ML models as standard Docker images.
Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.
Production model serving system for TensorFlow models.
NVIDIA inference serving platform for deploying AI models at scale.
Open-source ML deployment platform for Kubernetes.