A lightweight inference server for your machine learning models
Specially developed Open Source tool for DevOps and ML Engineers to deploy ML models in simple environments.
Simple and Fast Implementation
Easily spin up inference servers with standardized protocols that handle the scaling challenges for production use-cases.
Built with Flexibility in Mind
MLServer works for you, by giving you the flexibility to serve models according to your requirements.
- Leverage popular frameworks including scikit-Learn, XGBoost, MLlib, LightGBM, and MLflow frameworks out of the box while also allowing you to build your own custom runtimes
- Access to over 3,000 ML developers in the Seldon community to address any challenges and learn from the collective expertise within the Seldon community.
Optimize Performance
Seldon Core comes with out-of-the-box features to enhance your deployment and optimize operations and reduce latency.
Introduction to MLServer
Watch our video introducing the capabilities of MLServer