Dive into advanced LLM orchestration with Seldon’s on-demand demo featuring the DeepSeek 14B model designed to handle large context windows and deep reasoning tasks. In this session, you’ll see how Seldon Core v2 can orchestrate sophisticated pipelines that combine LLMs with traditional ML models, manage GPU-intensive workloads, and scale context-aware use cases for real-world production environments.
About
Learnings
-
LLM-Enhanced Pipelines: Run DeepSeek 14B to solve complex, multi-step problems using a combination of structured logic and large-scale generative reasoning.
-
Deploy Large Context Windows: Use up to 12,000-token context windows (8,000 for generation) to manage rich inputs across temporal anomalies, multi-party narratives, and geopolitical dynamics.
-
Orchestrate at Scale: See how Seldon Core v2 handles multi-GPU LLM deployments using VLLM, persistent volumes, and memory-aware configuration.
-
Robust Observability & Control: Monitor deployments using K9s, logs, and NVIDIA SMI, and use modular manifests for reproducible, controlled testing.
-
Model Performance vs. Resource Trade-offs: Compare reasoning depth, loading times, and memory trade-offs between smaller and larger LLMs, and understand when to use which.
-
Production-Ready Engineering: Learn practical setup tips: manifests, secrets, volume claims, mesh IPs, and debugging complex deployments.
-
Real-World Applications: Explore use cases in legal reasoning, threat detection, multi-party planning, and any task requiring cross-domain context.
Alex Housley
Alex has been founding and building technology companies since 2003, specializing in mobile, data, and machine learning (ML). He experienced the challenges of scaling model deployment infrastructure whilst building a startup that served billions of personalized news article recommendations. In 2014, Alex founded Seldon with the aim of democratizing ML operations to solve the world's most pressing issues. He served as CEO until 2023, shaping the MLOps industry and delivering measurable, meaningful results for clients worldwide. As Founder and Seldon Board Member, Alex is responsible for the product and technology strategy and execution, focusing on the needs of customers today and in the future.
Complex, real-time use cases is what we do best
Talk with a expert to explore how Seldon can support more streamlined deployments for real-time, complex projects like fraud detection, personalization, and so much more.
MORE RECENT WEBINARS & EVENTS
Stay Ahead in MLOps with our
Monthly Newsletter!
Join over 25,000 MLOps professionals with Seldon’s MLOps Monthly Newsletter. Your source for industry insights, practical tips, and cutting-edge innovations to keep you informed and inspired. You can opt out anytime with just one click.