Seldon Core

Seldon Core is a Kubernetes-native framework for deploying, scaling, and managing machine learning and LLM systems in production, from single models to modular, data-centric pipelines. It supports standardized deployment across many model types on-prem or in any cloud, with experiments for canary rollouts and A/B testing plus monitoring. The open-source edition is released under the Apache 2.0 license.