Deploying Large Language Models in Production: Orchestrating LLMs
In our earlier blog posts in this series, you’ve explored an overview of LLMs and a deep dive into the challenges in […]
What is Multi-Model Serving and How Does it Transform your ML Infrastructure?
Multi-model serving (MMS) was a prominent part of the release of Seldon Deploy Advanced at the end of last year. This is […]
Seldon releases MLServer 1.2.0 and Seldon Core 1.15
To round off our string of recent releases, the team at Seldon is delighted to announce new releases of MLServer and Seldon […]
Seldon presents research at NeurIPS @ Cambridge
Continuous research is something that we strongly believe in at Seldon. There has been a huge increase in the publication of new […]
Introducing MLServer 1.0: Modern and flexible model serving for machine learning at scale
Introducing ML Server In our mission to democratise access to machine learning (ML) we are pleased to announce the full release of […]
Simple Production ML with Metaflow and Seldon
This article was a collaboration between Clive Cox from Seldon and Oleg Avdeev from Outerbounds. Clive is CTO of Seldon and works […]
Adaptive Batching & Kubernetes Infrastructure Robustness – Seldon Core 1.11.0 Released!
The Kubernetes MLOps ecosystem continues to evolve at breakneck speed, however it is critical to ensure the foundational features and functionality of […]
Performance Optimizations and MLFlow Integrations – Seldon Core 1.10.0 Released!
Performance of machine learning models is key when teams and organisations are looking to deploy models at scale. Achieving optimal performance for […]
Working at the forefront of AI and powering open source
Calling all software engineers – we’re hiring! Over the last month, we’ve been working hard to shape the future of Seldon by […]
New Machine Learning Monitoring & Interactive Drill-Down Features – Seldon Deploy 1.3 Released!
The lifecycle of a machine learning only begins once it’s deployed to production. This is why this release of our enterprise product […]
ML Progressive Rollouts with Seldon and Iter8
Once you have a machine learning model in production that is providing benefit one of the next challenges you will meet is […]
SLO-Driven Progressive Rollouts for Machine Learning – Seldon Core 1.9 Released!
Organisations have a growing need to adopt architectural patterns that allow them to deploy, promote and monitor their models at scale. This […]