Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    M

    Mark Nelson

    marknelson.us · Personal blog · on HN since 2007

    Mark Nelson is a programmer who writes on data compression, arithmetic coding, string searching and other software topics.

    Visit blogHN submissions
    ProgrammingSystems & PerformanceMath
    What HN says

    HN commenters credit his compression articles with opening up the field, and link his post on the random compression challenge.

    Stats for nerds
    27HN people shared it
    20linked in comments
    78story points
    Jun 2023last shared
    2010people per year2023

    Top posts on HN

    1. 1
      Data Compression with Arithmetic Coding
      4 people · 16 points · first shared 2020 · Discussion on HN
    2. 2
      Cruelty Redefined: Undergraduates vs. C++ on Linux
      1 person · 10 points · first shared 2011 · 2 comments on HN
    3. 3
      Fast String Searching With Suffix Trees
      4 people · 9 points · first shared 2007 · 1 comments on HN
    4. 4
      The Byzantine Generals Problem
      2 people · 8 points · first shared 2010 · 1 comments on HN
    5. 5
      The Multicore Kerfuffle and a Dose of Reality
      1 person · 8 points · first shared 2007 · 3 comments on HN
    6. 6
      The Never-ending Awesomeness of Bash
      1 person · 7 points · first shared 2010 · 1 comments on HN
    7. 7
      An introduction to data compression with arithmetic coding
      3 people · 5 points · first shared 2011 · 1 comments on HN
    8. 8
      C++11 – Threading Made Easy
      1 person · 4 points · first shared 2012 · Discussion on HN
    9. 9
      Gawker Considered Stupid – Criminally Stupid
      2 people · 3 points · first shared 2011 · 4 comments on HN
    10. 10
      Data Compression with the Burrows-Wheeler Transform (1996)
      1 person · 2 points · first shared 2013 · Discussion on HN

    What HN people wrote when they linked it

    • fhoxhJun 2011

      It is one of your primary duties to safeguard the best interest of your organization. Incontrovertibly, the best interest is not served by storing passwords in plaintext as this can result in grave harm to your organization.

      Accordingly, while I would not share any details with the outside world, I would advise you to strongly push the issue internally, from the position of an educator.

      Here are four articles that may assist you in composing a stronger series of arguments:

      https://www.owasp.org/index.php/Broken_Authentication_and_Session_Management

      http://cwe.mitre.org/data/definitions/256.html

      http://blog.moertel.com/articles/2006/12/15/never-store-passwords-in-a-database

      http://marknelson.us/2011/02/06/gawker-considered-stupid-criminally-stupid/

      You will want to further notate that the effort of implementing non-plaintext authentication really isn't terribly significant.

      What troubles me is this "most senior" programmer of yours. If storing passwords in plaintext is OK with him/her, meaning that he/she has a weak background in security engineering, I can't imagine that there aren't many additional severe security issues (SQL injection, XSS, CSRF, etc...). Most concerning of all though is that this "most senior" programmer seems disinterested in due diligence and is instead actively arguing against widely known best practices.

      If, after your strong push, management still is not motivated, personally, I would resign. I would not want to be professionally affiliated…

    • thristianJul 2016

      I once found a really great article explaining arithmetic encoding¹, and I felt I understood what was going on and managed to re-implement the article's example from MS-DOS-era C to modern Python, but when I tried to use it for anything else it didn't work and I wasn't smart enough to debug it.

      The claim that asymmetric numeral systems are simpler than arithmetic encoding is quite interesting, but as a working programmer, I have difficulty with the academic language and mathematical generality used in papers like this. Does anybody have a more approachable explanation of what's going on?

      ¹: http://marknelson.us/1991/02/01/arithmetic-coding-statistical-modeling-data-compression/

    • jereJun 2020

      I'm fairly certain compressing random data is nonsensical. In fact there's a cash prize challenge for doing it that has been unmet for 20 years. https://marknelson.us/posts/2012/10/09/the-random-compression-challenge-turns-ten.html

      Not sure I can explain it properly myself but it think it's impossible by definition. Intuitively, if you could compress any random data then you should be able to compress 2 bits into 1, which is clearly impossible.

    • otJun 2023

      Was it maybe Dr Dobb's? Mark Nelson had an excellent series of articles about compression which opened up that world for me. I ended up working on compression for my PhD many years later.

      I can't find any archives for Dr Dobb's, but some articles are in his personal site, for example this one about arithmetic coding:
      https://marknelson.us/posts/1991/02/01/arithmetic-coding-statistical-modeling-data-compression.html

    • dreamcompilerOct 2020

      I should clarify: There's still room for improvement in the speed of lossless compression/decompression operations, and that's where most improvements happen nowadays. But there's little room for improvement in compression ratio, because most modern algorithms produce outputs that are very close to random already.

      More background:
      https://marknelson.us/posts/2006/06/20/million-digit-challenge.html

    • 0x0Apr 2014

      There's a challenge posted online to compress a file of one million presumably random digits, and it's been running for 10+ years without anyone claiming the prize:

      http://marknelson.us/2012/10/09/the-random-compression-challenge-turns-ten/

    Related

    Coding Horrorblog.codinghorror.com2.1k people

    Farewell Stack Exchange

    Coding Horror
    Personal · last shared 2026
    Paul Khuongpvk.ca106 people

    SBCL: The Ultimate Assembly Code Breadboard

    Paul Khuong
    Personal · last shared 2026
    Mark J. Nelsonkmjn.org20 people

    This Message Does Not Exist

    Mark J. Nelson
    Personal · last shared 2026
    Nelson Elhageblog.nelhage.com147 people

    Performance of the Python 3.14 tail-call interpreter

    Nelson Elhage
    Personal · last shared 2026
    Yann Colletfastcompression.blogspot.com59 people

    XXH3 – a new speed-optimized hash algorithm

    Yann Collet
    Personal · last shared 2025
    Mark Seemannblog.ploeh.dk171 people

    From Design Patterns to Category Theory (2017)

    Mark Seemann
    Personal · last shared 2026
    Random ASCIIrandomascii.wordpress.com274 people

    There are only four billion floats, so test them all (2014)

    Random ASCII
    Personal · last shared 2026
    Jeremy Kunjeremykun.com194 people

    A Programmer's Introduction to Mathematics

    Jeremy Kun
    Personal · last shared 2026