Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    D

    David MacKay

    inference.phy.cam.ac.uk · Personal blog · on HN since 2007

    David MacKay, the late Cambridge physicist, wrote a free textbook on information theory, inference and learning algorithms, and made the Dasher text-entry tool.

    Visit blogHN submissions
    MathAI & Machine LearningScience
    What HN says

    Commenters call his book excellent and the best resource for the math behind modern machine learning, and also recommend his YouTube lectures.

    Stats for nerds
    131HN people shared it
    17linked in comments
    311story points
    Sep 2018last shared
    2009people per year2018

    Top posts on HN

    1. 1
      Information Theory, Inference, and Learning Algorithms (2003) [pdf]
      9 people · 111 points · first shared 2011 · 9 comments on HN
    2. 2
      A Critical Look at Salaried Professionals and the Soul-Battering System (2001)
      1 person · 88 points · first shared 2014 · 28 comments on HN
    3. 3
      Information Theory, Inference, and Learning Algorithms (free ebook edition)
      11 people · 72 points · first shared 2007 · 21 comments on HN
    4. 4
      Everyone Should Get an A
      3 people · 12 points · first shared 2009 · 2 comments on HN
    5. 5
      Phone chargers - the truth
      3 people · 8 points · first shared 2008 · 8 comments on HN
    6. 6
      Information Theory, Inference, and Learning Algorithms
      18 people · 6 points · first shared 2007 · Discussion on HN
    7. 7
      Order of Magnitude Physics Material
      1 person · 5 points · first shared 2008 · 1 comments on HN
    8. 8
      Encyclopedia of Sparse Graph Codes
      1 person · 3 points · first shared 2017 · Discussion on HN
    9. 9
      David MacKay: Information Theory, Inference, and Learning Algorithms: Home
      7 people · 2 points · first shared 2013 · Discussion on HN
    10. 10
      Comparison of Information Theory and Learning Algorithms with Harry Potter
      4 people · 2 points · first shared 2007 · Discussion on HN

    What HN people wrote when they linked it

    • jsrnAug 2009

      > New solar cells can sometimes take greater than the life of the product to recoup the energy spent on creating them. If you live in, say, Massachusetts [...] you'll probably never net an energy savings.

      "False. The energy yield ratio (the ratio of energy delivered by a system
      over its lifetime, to the energy required to make it) of a roof-mounted,
      grid-connected solar system in Central Northern Europe is 4, for a system
      with a lifetime of 20 years (Richards and Watt, 2007); and more than 7 in a sunnier spot such as Australia. (An energy yield ratio bigger than one
      means that a system is A Good Thing, energy-wise.) Wind turbines with a
      lifetime of 20 years have an energy yield ratio of 80."

      source:
      http://www.inference.phy.cam.ac.uk/withouthotair/c6/page_41.shtml

      (I assumed that the sun in Central Northern Europe shines with an intensity similar to the intensity in Massachusetts.)

    • drothlisOct 2010

      Do windmills kill “huge numbers” of birds? Wind farms recently got adverse publicity from Norway, where the wind turbines on Smola, a set of islands off the north-west coast, killed 9 white-tailed eagles in 10 months.
      I share the concern of BirdLife International for the welfare of rare birds. But I think, as always, it’s important to do the numbers. It’s been estimated that 30 000 birds per year are killed by wind turbines in Denmark,
      where windmills generate 9% of the electricity. Horror! Ban windmills! We also learn, moreover, that traffic kills one million birds per year in Denmark. Thirty-times-greater horror! Thirty-times-greater incentive to ban cars! And in Britain, 55 million birds per year are killed by cats.

      --David MacKay, "Sustainable Energy -- without the hot air".

      http://www.inference.phy.cam.ac.uk/withouthotair/c10/page_63.shtml

    • TeMPOraLMar 2012

      > Thus solar and wind fit in with our natural rhythm quite nicely.

      It's not that nice, because power output from wind/solar plants is random (depends on things like cloud cover or wind strength) and it causes problems in power grid, where power demand must meet the supply exactly, or bad things will happen.

      "Without Hot Air"[1] covers this, and other renewable-related issues quite nicely and with real data. I recommend it, it's a good read. It has some good ideas on how to solve power supply/demand problems.

      On TED2012 there was a talk about a new kind of batteries designed to solve those kind of problems in the power grid; the video from the talk is not yet up, though (but I think it should be soon, at [2]).

      [1] - http://www.inference.phy.cam.ac.uk/withouthotair/

      [2] - http://www.ted.com/talks?lang=en&event=2012&duration=&sort=newest&tag=

    • kristjankalmSep 2015

      some useful books available as a PDF:

      David Barber "Bayesian Reasoning and Machine Learning"
      http://web4.cs.ucl.ac.uk/staff/D.Barber/pmwiki/pmwiki.php?n=Brml.HomePage
      -- Thorough and systematic, accompanied by a Matlab library

      Marc Steyvers "Computational Statistics with Matlab"
      http://psiexp.ss.uci.edu/research/teachingP205C/205C.pdf
      -- Somewhat unfinished but very good hands-on guide for a total novice

      David Draper "Bayesian Modeling, Inference and Prediction"
      https://users.soe.ucsc.edu/~draper/draper-BMIP-dec2005.pdf
      -- Quite good if you're already familiar with a field, might be slightly daunting for a beginner

      and the classic, David MacKay's
      "Information Theory, Inference, and Learning Algorithms"
      http://www.inference.phy.cam.ac.uk/itprnn/book.html

    • andrewcookeNov 2012

      i'm not going to argue here because http://www.withouthotair.com/ makes the point better than i ever could.

      see, for example, http://www.inference.phy.cam.ac.uk/withouthotair/c19/page_114.shtml - Don’t be distracted
      by the myth that “every little helps.” If everyone does a little, we’ll
      achieve only a little. We must do a lot. What’s required are big changes in
      demand and in supply.

      and, of course, we may be talking at cross purposes - there is some middle ground where a large-ish number of small-ish things can help. i am not arguing against maths, but i am saying that our natural assessment of what is significant without actually doing the maths is often misled by absolute values, as here.

      anyway, if you haven't read that book, i recommend it.

    • BromsklossApr 2013

      As a rather short (9 pages) introduction to Bayesian inference, I remember greatly appreciating an extract from the book "Information Theory, Inference, and Learning Algorithms" by David MacKay.

      The relevant part is on PDF pages 469 to 477 here: <http://www.inference.phy.cam.ac.uk/itprnn/book.pdf>

      It explains how Bayesian inference works (which is intuitive and not strange at all) and gives examples of absurdities that comes upon you when you don't do it this way.

      Highlights:

      • "Let me through, I’m a Bayesian" (When analysing the effectivness of a vaccine)

      • "I have no problem with the idea that there is only one answer to a well-posed problem" (In response to sampling theorists wide selection of ad hoc procedures)

    Related

    Sanjoy Mahajanitila.blogspot.com15 people

    David J.C. MacKay, Machine Learning pioneer, dies

    Sanjoy Mahajan
    Personal · last shared 2025
    inFERENCeinference.vc50 people

    ML Beyond Curve Fitting: An Intro to Causal Inference and Do-Calculus

    inFERENCe
    Personal · last shared 2026
    The Morning Paperblog.acolyer.org606 people

    Local-first software: you own your data, in spite of the cloud

    The Morning Paper
    Personal · last shared 2026
    LessWronglesswrong.com2.4k people

    The Best Textbooks on Every Subject

    LessWrong
    Publication · last shared 2026
    Statistical Modeling, Causal Inference, and Social Sciencestatmodeling.stat.columbia.edu350 people

    Suspicious data pattern in recent Venezuelan election

    Statistical Modeling, Causal Inference, and Social Science
    Publication · last shared 2026
    Gödel's Lost Letterrjlipton.wordpress.com185 people

    Mihai Pătraşcu 1982–2012

    Gödel's Lost Letter
    Personal · last shared 2021
    Rodney Brooksrodneybrooks.com117 people

    Patrick Winston Explains Deep Learning

    Rodney Brooks
    Personal · last shared 2026
    Divided by Zerodivisbyzero.com32 people

    The Unknotting Number Is Not Additive

    Divided by Zero
    Personal · last shared 2025