Episode
Is It Time to Rethink LLM Pre-Training? with Aditi Raghunathan - #747
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Sep 16, 2025 · 58 min
Today, we're joined by Aditi Raghunathan, assistant professor at Carnegie Mellon University, to discuss the limitations of LLMs and how we can build more adaptable and creative models. We dig into her ICML 2025 Outstanding Paper Award winner, “Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction,” which examines why LLMs struggle with generating truly…