Skip to content
HomeVideos
AllLongsCategoriesPlaylists
BooksBlogsPodcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K

    Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI

    Dwarkesh Patel

    1 HN recommender · recommended in 5 months, 2025–2026

    YouTube

    2:15:36 · 349K views · Feb 12, 2025

    Dwarkesh Patel interviews Google's Jeff Dean and Noam Shazeer about 25 years at the company, from PageRank and MapReduce to the Transformer, mixture of experts and Gemini. They also discuss where AI is heading.

    HN cites it for insight into Google researchers' views on AI progress and publishing, though one commenter finds the interview weak.

    AI, Machine Learning & DataLLMs & generative AITech pioneers & interviewsDistributed systems
    1. 27:14
      Transformers, the tech behind LLMs | Deep Learning Chapter 53Blue1Brown12M views • 2 years ago
    2. 1:56:20
      Let's build GPT: from scratch, in code, spelled out.Andrej Karpathy8.2M views • 3 years ago
    3. 3:31:24
      Deep Dive into LLMs like ChatGPTAndrej Karpathy10M views • 1 year ago
    4. 38:59
      StrictlyVC in conversation with Sam Altman, part two (OpenAI)Connie Loizos254K views • 3 years ago
    5. 48:32
      Sparks of AGI: early experiments with GPT-4Sebastien Bubeck1.8M views • 3 years ago
    6. 1:22:45
      Building Software Systems At Google and Lessons LearnedStanford257K views • 15 years ago
    7. 52:52
      Google Developers Day US - Theorizing from DataGoogleDeveloperDay27K views • 19 years ago
    8. 1:31:13
      A Hackers' Guide to Language ModelsJeremy Howard580K views • 3 years ago
    9. 2:26:08
      Andrej Karpathy — “We’re summoning ghosts, not building animals”Dwarkesh Patel1.5M views • 1 year ago
    10. 2:23:57
      Sam Altman: OpenAI CEO on GPT-4, ChatGPT, and the Future of AI | Lex Fridman Podcast #367Lex Fridman6.8M views • 3 years ago
    11. 19:20
      GPT-4chan: This is the worst AI everYannic Kilcher1M views • 4 years ago
    12. 30:10
      The Inside Story of ChatGPT’s Astonishing Potential | Greg Brockman | TEDTED1.9M views • 3 years ago
    13. 28:48
      LSTM is dead. Long Live Transformers!Seattle Applied Deep Learning541K views • 6 years ago
    14. 36:02
      ChatGPT with Rob Miles - ComputerphileComputerphile517K views • 3 years ago
    15. 59:48
      [1hr Talk] Intro to Large Language ModelsAndrej Karpathy4.3M views • 2 years ago
    16. 42:40
      State of GPT | BRK216HFSMicrosoft Developer786K views • 3 years ago
    17. 10:34
      Google Engineer on His Sentient AI ClaimBloomberg Tech3.9M views • 4 years ago
    18. 15:49
      I tried using AI. It scared me.Tom Scott8.5M views • 3 years ago
    19. 42:30
      Full interview: "Godfather of artificial intelligence" talks impact and potential of AICBS Mornings2M views • 3 years ago
    20. 47:41
      Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligenceDwarkesh Patel790K views • 3 years ago

    5 comments from Hacker News

    1. @paulmistJun 2026· in “Noam Shazeer Joins OpenAI”

      I first saw Noam on Dwarkesh’s podcast together with Jeff Dean. Recommend if you want a taste of what’s Google’s folks take on things. this video

      RecommendsView on HN
    2. @gjm11Oct 2025· in “Andrej Karpathy – It will take a decade to work through the issues with agents”

      The context is that rwaksmunski implied that people have been saying "AGI is 10 years away" for ages, and I was pointing out that the sort of people who say "AGI is X years away" have not in fact been setting X=10 until very recently. I wasn't claiming that the people on that list are the smartest or best-informed people thinking about artificial intelligence. But, FWIW, from about 13:20 in [LINK] Ashish Vaswani (lead author on that paper) being asked what will happen in 3-5 years and if I'm understanding him right he thinks AI systems might be solving some of the Millennium Prize Problems in mathematics by then; from about 17:10 he's asked about how scientists will work ~5 years in the future and he says AI systems will be apprentices or collaborators; at any rate he's not not saying that human-level AI is likely to come in the near future. From about 1:12:40 in this video Noam Shazeer (second author on that paper), in response to a question about "fast takeoff", says that he does expect a very rapid improvement in AI capabilities; he's not explicit about when he expects that to happen or how far he expects it to go, but my impression from the other bits of that discussion I watched is that he too is not not saying that AI systems won't be at or beyond human level in the near future. From about 49:00 in [LINK] he's asked: if hardware progress stopped, would we still get to AGI? and he says he thinks yes, which in particular suggests that he does think AGI is in the foreseeable

      CitesView on HN
    3. @DarkCrusader2Feb 2026· in “Dario Amodei – "We are near the end of the exponential"”

      Yeah I also don't understand how he is able to get such high profile guests. His interview with Jeff Dean and Noam Shazeer last year[1] is so hilariously bad. Jeff and Noam kept trying to give really insightful answers on how they see AI development shaping in coming years and he was just steering the conversation to shallow and silly tabloid gossip (why don't you "just" let AI improve the next version in a loop so we can quickly have singularity, Jeff Dean AI running in a DC, evil Jeff Dean AI escaping containment and on and on). It was just embarrassing. The interview would have been so much better with just Jeff and Noam without him. [1] this video

      CriticalView on HN
    4. @sosodevNov 2025· in “Gemini 3”

      Here's some insight from Jeff Dean and Noam Shazeer's interview with Dwarkesh Patel this video > When you think about divulging this information that has been helpful to your competitors, in retrospect is it like, "Yeah, we'd still do it," or would you be like, "Ah, we didn't realize how big a deal transformer was. We should have kept it indoors." How do you think about that? > Some things we think are super critical we might not publish. Some things we think are really interesting but important for improving our products; We'll get them out into our products and then make a decision.

      CitesView on HN
    5. @itchyjunkMay 2025· in “Google is using AI to censor independent websites like mine”

      Noam Shazeer says it at some point in the Dwarkesh Patel podcast. Edit : Saw multiple people comment by the time I hit sent. Was it also memorable for you guys? I think it was just the way he said it or something. this video

      CitesView on HN