Standardize and Scale your LLMs with Seldon

About this webinar

Want to get value from your LLM strategy but not sure where to start? The Seldon team are hosting a brand new session covering all the need-to-knows around setting up a successful LLM deployment infrastructure.

Solutions Engineer Josh Goldstein will be covering essential topics, from common challenges to competitive advantages of LLMOps strategy. He’ll focus on combining these innovative solutions with an efficient approach, like how to leverage existing infrastructure to make your LLM deployments as simple as possible.

Josh’s experience working with Seldon customers all over the world means he’ll be diving into a range of use cases across various industries. Ultimately, he’ll be able to demonstrate how deploying LLMs can be not too different to deploying traditional models, as well as how to avoid the common challenges we see.

He’ll then run through an in-depth demo of how to deploy LLMs with Seldon, covering Multi-GPU Serving, State Management, Debuggling and logging, performance monitoring, Standardization and Orchestration, to name a few.

Speakers

Josh Goldstein

Solutions Engineer

What you'll learn

  • Common challenges when implementing an LLMOps infrastructure
  • How to deploy LLMs with Seldon, covering Multi-GPU Serving, State Management, Debugging, logging, monitoring etc
  • How to leverage existing infrastructure to make LLM deployments as simple as possible
  • How to set up a successful LLM deployment infrastructure

Watch the video