Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    P

    Patrick Craig

    patrickcraig.co.uk · Personal blog · on HN since 2011

    Patrick Craig tells the story of the $5000 compression challenge, in which a challenge to compress random data was gamed.

    Visit blogHN submissions
    ProgrammingHistory
    What HN says

    HN links it whenever data compression or storing data in metadata comes up, and one commenter ranks it as an excellent computer story.

    Stats for nerds
    24HN people shared it
    13linked in comments
    665story points
    Jan 2023last shared
    2012people per year2023

    Top posts on HN

    1. 1
      The $5000 Compression Challenge
      14 people · 658 points · first shared 2011 · 185 comments on HN
    2. 2
      The $5000 Compression Challenge
      10 people · 7 points · first shared 2015 · Discussion on HN

    What HN people wrote when they linked it

    • DanBCOct 2012

      Here's a mildly amusing challenge and response to that challenge:

      (http://www.patrickcraig.co.uk/other/compression.htm)

      This page has some nice compression gimmicks (a file that compresses well with one algorithm but hardly at all with another; a file that uncompresses to itself)

      (http://www.maximumcompression.com/compression_fun.php)

      The large text compression benchmark has some nice finely tuned compression software and statistics.

      (http://mattmahoney.net/dc/text.html)

      And the Hutter prize is interesting. (Get the 100 Mb file of enwiki8 and the de-compressor to under 16 Mb)

      (http://prize.hutter1.net/)

    • btillyMar 2020

      Same problem. The amount of information that you need to specify a compressible offset plus the compressibility of said offset adds up to at least the amount of information you were trying to encode, and no compression happens.

      If you ignore either half of the information problem, you can get what looks like compression but really isn't.

      See https://www.patrickcraig.co.uk/other/compression.php for a fun story about "data hiding" to show exactly how sneaky the data hiding can be.

    • abhghSep 2018

      Do you mean this - [1]? Yes, this was pretty cool! I esp liked how Mike, the person initiating the bet, initially was super-confident he'd win:

      It would be very easy to point out to him the impossibility of his task, but far more interesting to see how long he will struggle with the problem before realizing it for himself.

      [1] http://www.patrickcraig.co.uk/other/compression.php

    • fogofMar 2021

      He did not,

      full story, for the perspective of the metadata guy is here

      https://www.patrickcraig.co.uk/other/compression.htm

      Excellent computer story, on a par with "We can't send email more than 500 miles" IMO.

    • gameshot911Mar 2017

      Somewhat off topic, but this reminded me of one of my favorite HN submissions:

      Link - http://www.patrickcraig.co.uk/other/compression.php

      Previous commentary - https://news.ycombinator.com/item?id=9163782

    • jlgrecoApr 2013

      Reminds me of the infamous compression challenge where one person tried to cheat and win the prize by storing data in filenames: http://www.patrickcraig.co.uk/other/compression.htm

    Related

    Bits about Moneybitsaboutmoney.com224 people

    Anatomy of a credit card rewards program

    Bits about Money
    Personal · last shared 2026
    Towards Data Sciencemedium.com/towards-data-science90 people

    Audio processing in TensorFlow

    Towards Data Science
    Publication · last shared 2025
    Aphyraphyr.com551 people

    Hexing the technical interview (2017)

    Aphyr
    Personal · last shared 2026
    Matt Mahoneymattmahoney.net133 people

    Large Text Compression Benchmark

    Matt Mahoney
    Personal · last shared 2026
    freeCodeCampmedium.freecodecamp.org582 people

    A hacker stole $31M of Ether – how it happened, and what it means for Ethereum

    freeCodeCamp
    Publication · last shared 2025
    Ken Shirriffrighto.com560 people

    Mining Bitcoin with pencil and paper: 0.67 hashes per day

    Ken Shirriff
    Personal · last shared 2026
    Yann Colletfastcompression.blogspot.com59 people

    XXH3 – a new speed-optimized hash algorithm

    Yann Collet
    Personal · last shared 2025
    Coding Confessionsblog.codingconfessions.com34 people

    How simultaneous multithreading works under the hood

    Coding Confessions
    Personal · last shared 2026