Skip to content
HomeVideos
AllLongsCategoriesPlaylists
BooksBlogsPodcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K

    Lecture 1: Introduction to Information Theory

    Jakob Foerster

    3 HN recommenders · recommended in 5 months, 2018–2024

    YouTube

    1:01:51 · 411K views · Apr 26, 2014

    The first lecture of David MacKay's Cambridge course on information theory, pattern recognition and neural networks. It introduces the core ideas of his book Information Theory, Inference, and Learning Algorithms.

    Recommended as an enjoyable, clear introduction to information theory that pairs well with MacKay's free textbook.

    Mathematics & Theoretical CSInformation theory & signal processingUniversity lectures & coursesMachine learning & deep learning
    1. 1:08:40
      Lecture 1 | Machine Learning (Stanford)Stanford2.7M views • 18 years ago
    2. 1:21:28
      Lecture 01 - The Learning Problemcaltech1.5M views • 14 years ago
    3. 1:20:33
      Lecture 1 | Convex Optimization I (Stanford)Stanford754K views • 18 years ago
    4. 57:57
      Lecture 1 | Introduction to Convolutional Neural Networks for Visual RecognitionStanford University School of Engineering2.9M views • 9 years ago
    5. 1:28:13
      RL Course by David Silver - Lecture 1: Introduction to Reinforcement LearningGoogle DeepMind1.9M views • 11 years ago
    6. 1:19:08
      CS231n Winter 2016: Lecture1: Introduction and Historical ContextAndrej Karpathy463K views • 10 years ago
    7. 2:25:52
      The spelled-out intro to neural networks and backpropagation: building microgradAndrej Karpathy4.4M views • 4 years ago
    8. 1:22:38
      CS480/680 Lecture 19: Attention and Transformer NetworksPascal Poupart374K views • 7 years ago
    9. 1:11:41
      Lecture 1 | Natural Language Processing with Deep LearningStanford University School of Engineering821K views • 9 years ago
    10. 1:12:56
      Lecture 1A: Overview and Introduction to LispMIT OpenCourseWare421K views • 7 years ago
    11. 57:15
      1. Introduction to Human Behavioral BiologyStanford21M views • 15 years ago
    12. 1:00:34
      1. Introduction, Finite Automata, Regular ExpressionsMIT OpenCourseWare628K views • 5 years ago
    13. 30:38
      Solving Wordle using information theory3Blue1Brown12M views • 4 years ago
    14. 1:02:57
      Peter Norvig - The Unreasonable Effectiveness of DataUBC Computer Science74K views • 15 years ago
    15. 1:22:56
      Practical Deep Learning for Coders: Lesson 1Jeremy Howard611K views • 4 years ago
    16. 3:07
      Neural Networks Demystified [Part 1: Data and Architecture]Welch Labs839K views • 12 years ago
    17. 1:30:50
      Lecture 7: Introduction to Galois Fields for the AES by Christof PaarIntroduction to Cryptography by Christof Paar278K views • 12 years ago
    18. 57:21
      An Observation on GeneralizationSimons Institute for the Theory of Computing210K views • 3 years ago
    19. 1:12:56
      Lecture 1A | MIT 6.001 Structure and Interpretation, 1986MIT OpenCourseWare995K views • 17 years ago
    20. 14:36
      Distributed Systems 1.1: IntroductionMartin Kleppmann383K views • 6 years ago

    6 comments from Hacker News

    1. @samch93Oct 2021· in “Sustainable Energy without the Hot Air (Revised, Community Edition)”

      It‘s such a tragedy that he died so young. Prof Mackay was a role model who impacted our world in many positive ways (e.g. his work in information theory, Bayesian statistics, environmental science). I recommend his lecture on information theory which is available on youtube [1]. He also documented the progress of his cancer very detailed on his blog [2], which is a very interesting (and sad) read. [1] this video [2] [LINK]

      RecommendsView on HN
    2. @maxovJun 2020· in “Ask HN: What, in your opinion, are the greatest and most useful textbooks?”

      Had . Unfortunately Professor MacKay passed away from cancer in 2016. We lost a great soul. I concur that his textbook and sense of humor were fantastic. It was very enjoyable for me to learn the material from his lectures. They are a great supplement to the textbook (or maybe vice versa?) and you can find them here: this video

      RecommendsView on HN
    3. @swframe2Feb 2018· in “Probabilistic Programming and Bayesian Methods for Hackers (2013)”

      I recommend David MacKay's Intro to Info Theory class: this video There is a free book for it at: [LINK] Daphne Koller's 3 coursara classes on Probabilistic Graphical Models are also really good.

      RecommendsView on HN
    4. @teleforceMay 2024· in “Reading list to join AI field from Hugging Face cofounder”

      Thanks for the list. Interesting to see that the book by the late David MacKay made it to the list, it is available to download in several formats from the book's website. Information Theory, Inference, and Learning Algorithms: [LINK] The lectures based on the book by David MacKay himself: this video Probably it's not a surprise that the father of information theory Claude Shannon is the earliest one to propose stochastic LLM based on Markov chain.

      CitesView on HN
    5. @noudFeb 2023· in “David MacKay: Information Theory, Inference, and Learning Algorithms: The Book”

      "Your browser does not support playback of available video formats. Please install Adobe Flash player or upgrade to a more modern browser." ...Okay? I found the videos on youtube as well: this video

      CitesView on HN