An Essential Guide to ML Model Serving Strategies (Including LLMs)
In this developer-focused session, walk through a wide variety of model deployment strategies – from classic ML pipelines to embedded deployments, model-as-a-service, and edge use
LLMOps
DeepSeek Reasoning, the Cake Mystery
We put DeepSeek’s R1 reasoning model to the test in a live demo showcasing how context windows impact LLM performance in real-world scenarios. Using Seldon
DeepSeek R1 (14B) – Vanishing Ambassador Mystery
Dive into advanced LLM orchestration with Seldon’s on-demand demo featuring the DeepSeek 14B model designed to handle large context windows and deep reasoning tasks. In
LLM Loan Processing LLM Loan Processing Pipeline
Learn how to build a production-ready ML pipeline that combines large language models (LLMs) with traditional ML using Seldon Core 2. In this demo-led session,
Harnessing the Power of LLMs for Automated Data Extraction
In the realm of natural language processing (NLP), the advent of Large Language Models (LLMs) has revolutionized the way we approach various tasks, including automated
Revolutionizing Enterprise Solutions With Generative AI
Over the last two years, Generative AI has proven to be more than just a fad. As enterprise organizations move from simple, initial experimentation to
Introducing Seldon’s LLM Module: The Next Era in Generative AI (GenAI) Deployment
Seldon\’s LLM Module, an Innovative solution for deploying and managing Large Language Models (LLMs) in Generative AI (GenAI) applications.
Generative AI vs. Machine Learning
Generative AI has quickly become known outside of the IT landscape in the last year. But what exactly is the difference between generative AI and
Deploying Large Language Models in Production: Orchestrating LLMs
In our earlier blog posts in this series, you’ve explored an overview of LLMs and a deep dive into the challenges in deploying individual LLMs
Deploying Large Language Models in Production: LLM Deployment Challenges
In part 1 of this series, we discussed the rise of Large Language Models (LLMs) such as GPT-4 from OpenAI and the challenges associated with