Seldon Blog

Contents

MLOps London Meetup November: ML Testing and Compliance in MLOps

When I launched the MLOps London Meetup in September 2021, I figured if I could get 10 or 15 people together to talk about production ML that would be a win. My expectations were completely surpassed and continue to be every time. 

Tuesday 29th November saw the MLOps community gather for our final meetup of 2022, one that clashed with England playing Wales in the football world cup. Whilst this might have deterred a few, the attendance was incredibly strong and the conversations that flowed during the networking were fantastic.

Our first speaker was Daniel Geater, VP AI Delivery at Qualitest. He spoke at length about his experiences doing testing on ML projects and how we can reuse the testing frameworks from software development to “shift left” the testing and carry out as much as possible during the early phases of our ML lifecycle. I particularly liked his mapping of machine learning testing/validation techniques to the software testing pyramid:

One of Daniel's slides during his talk titled, AI Assurance: Shift-Left and Shift-Right in Machine Learning Systems’ Testing
One of Daniel’s slides during his talk titled, AI Assurance: Shift-Left and Shift-Right in Machine Learning Systems’ Testing

You can catch the recording of Daniel’s talk here.

Next up was Neven Miculinić, experienced software and machine learning engineer. Neven had originally planned to talk about a framework he worked on but, having moved on from his previous employer, realized it gave him the freedom to talk openly about experiences he’s had throughout his engineering career. 

Neven presenting his talk at the MLOps Meetup titled, Everything is a Remix - reflections on the last 5y in my career
Neven presenting his talk titled, Everything is a Remix – reflections on the last 5y in my career

His talk covered from birth right up to now and highlighted the different books and resources he’d found useful along the way. He also pointed out some of the horrible experiences he’d had such as long release cycles with fixed delivery dates and the mess  you can get into if you don’t do trunk-based development. It was a refreshing personal perspective on the engineering industry and definitely gave us all some things to think about going into the Christmas break. You can catch Neven’s full talk here.

Speaking of which, this was the last event in 2022. We’ll be back on the 10th January so keep an eye on the meetup page and subscribe to the YouTube channel for updates. Until then, have a very merry Christmas and a happy new year.

MLOps meetup Networking at our London offices
The MLOps meetup networking at our London offices

See it for yourself

Serve, monitor, explain, and manage your models today.

© 2023 Seldon Technologies. All Rights Reserved.

Rise London
41 Luke Street
Shoreditch
EC2A 4DP

UK: +44 (20) 7193-6752
US. +1 (646) 397-9911

Email: hello@seldon.io