Episode
An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Nov 4, 2024 · 1 h 15 min
Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex…