Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    H

    Highly Scalable Blog

    highlyscalable.wordpress.com · Personal blog · on HN since 2012

    Highly Scalable Blog covers NoSQL data modeling, distributed algorithms, probabilistic data structures, and big data processing for backend engineers.

    Visit blogHN submissions
    DatabasesDistributed SystemsData & Visualization
    What HN says

    Commenters recommend its NoSQL data modeling and probabilistic data structures articles as good reading, and one lists it among the blogs they subscribe to.

    Stats for nerds
    38HN people shared it
    33linked in comments
    1.2Kstory points
    Dec 2023last shared
    2012people per year2023

    Top posts on HN

    1. 1
      NoSQL Data Modeling Techniques
      10 people · 537 points · first shared 2012 · 30 comments on HN
    2. 2
      Probabilistic Data Structures For Web Analytics And Data Mining
      8 people · 247 points · first shared 2012 · 8 comments on HN
    3. 3
      MapReduce Patterns, Algorithms, and Use Cases
      3 people · 226 points · first shared 2012 · 5 comments on HN
    4. 4
      Distributed algorithms in NoSQL databases
      7 people · 112 points · first shared 2012 · 12 comments on HN
    5. 5
      In-Stream Big Data Processing (2013)
      5 people · 37 points · first shared 2013 · 3 comments on HN
    6. 6
      The Architecture of One High-Performance Back-End for eCommerce Site
      1 person · 12 points · first shared 2012 · Discussion on HN
    7. 7
      Tricks with Direct Memory Access in Java
      3 people · 9 points · first shared 2012 · Discussion on HN
    8. 8
      Fast Intersection of Sorted Lists Using SSE Instructions
      3 people · 8 points · first shared 2012 · 1 comments on HN
    9. 9
      Speeding Up Hadoop Builds Using Distributed Unit Tests
      1 person · 1 points · first shared 2012 · Discussion on HN
    10. 10
      Performance of Priority Queue Sorting with Pagination
      1 person · 1 points · first shared 2012 · Discussion on HN

    What HN people wrote when they linked it

    • sargstuffDec 2023

      NIST Dictionary of Algorithms and Data Structures[0]

      Is there a specific subject area(s) of application? aka big data analytics[a] / data mining and web analytics[b] / streaming applications[c] / other

      Random picks with mix of tutorials/examples/explainations/resouces from search engine term "probabilistic data structures": [1][2][3][4], probabilistic DS vs. postgresql[4]

      ---

      [0] : https://xlinux.nist.gov/dads/

      [1] : https://www.geeksforgeeks.org/introduction-to-the-probabilistic-data-structure/

      [2] : https://iq.opengenus.org/applications-of-different-data-structures/

      [3] : https://dzone.com/articles/introduction-probabilistic-0

      [4] : https://blog.devgenius.io/probabilistic-data-structures-1-definition-and-bloom-filter-431e5cbfb934

      [5] : https://www.postgresql.eu/events/fosdem2020/sessions/session/2934/slides/279/pg-probabilistic-structs.pdf

      ----

      [a] big data : https://www.researchgate.net/publication/335418069_Probabilistic_data_structures_for_big_data_analytics_A_comprehensive_review

      [b] data mining / web analytics : https://highlyscalable.wordpress.com/2012/05/01/probabilistic-structures-web-analytics-data-mining/

      [c] streaming : https://www.usaclouds.org/blog/streaming-with-probabilistic-data-structures-why-how

    • zarothJun 2015

      I read about an interesting technique, an "all-or-nothing tracker" in a blog post from an Apache Spark engineer.

      You dispatch n jobs, where n is quite large, and you want to know; have all n jobs have completed, or has less than n jobs have completed. How to do so with a small fixed number of bytes with very high probability?

      Give each job a random 128-bit ID number. XOR each ID number together as you start each job, and XOR into the same value as each job completes. If all the jobs have completed, the result is 0. The chance of zero turning up randomly if all jobs are not complete is negligible.

      The technique is mentioned here under 'Lineage Tracking': https://highlyscalable.wordpress.com/2013/08/20/in-stream-big-data-processing/ but there's a better blog post I remembered reading but can't find at the moment...

    • smanekDec 2012

      Unknown is relative, but here are some of the rss feeds I'm subscribed too:

      http://nosql.mypopescu.com/

      http://lambda-the-ultimate.org/

      http://eli.thegreenplace.net/

      http://www.stefankrause.net/wp/

      http://mechanical-sympathy.blogspot.com/

      http://www.cowtowncoder.com/blog/blog.html

      http://highlyscalable.wordpress.com/

      http://hunch.net/

      http://perspectives.mvdirona.com/

      http://www.scottaaronson.com/blog/

      http://www.softwarebyrob.com/

      http://blog.mikemccandless.com/

    • SkyMarshalMar 2012

      As a fan of Codd/Date/Pascal, relational algebra, and ACID, I used to feel the same about NoSQL, but have since come to appreciate it as an option. Schemaless is nicer for exploratory programming with frequent data model changes, for one example.

      Here's a good article on NoSQL data modeling that covers it better, along with some good discussion in the comments:

      http://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/

    • virmundiNov 2014

      I don't think this addresses your question directly, but there is always Unsafe. You can do a lot of direct memory manipulations through it. http://highlyscalable.wordpress.com/2012/02/02/direct-memory-access-in-java/

    • mynegationApr 2018

      Because I like to learn by example: http://www.databaseanswers.org/data_models/index.htm
      If you meant NoSql but even if you did not: https://highlyscalable.wordpress.com/2012/03/01/nosql-data-modeling-techniques/

    Related

    High Scalabilityhighscalability.com922 people

    A Beginner's Guide to Scaling to 11M+ Users on Amazon's AWS

    High Scalability
    Publication · last shared 2026
    Highgo Bloghighgo.ca17 people

    Bulk loading into PostgreSQL: Options and comparison

    Highgo Blog
    Company · last shared 2024
    Dataspora Blogdataspora.com20 people

    The Three Sexy Skills of Data Geeks

    Dataspora Blog
    Company · last shared 2013
    Aggregate Knowledge Blogblog.aggregateknowledge.com15 people

    AWS Redshift: How Amazon Changed The Game

    Aggregate Knowledge Blog
    Company · last shared 2014
    MyNoSQLnosql.mypopescu.com66 people

    Attacking NoSQL and Node.js: Server-Side JavaScript Injection (SSJS)

    MyNoSQL
    Publication · last shared 2016
    Citus Data Blogcitusdata.com224 people

    Citus Unforks from PostgreSQL, Goes Open Source

    Citus Data Blog
    Company · last shared 2026
    Nati Shalomnatishalom.typepad.com22 people

    Designing a Scalable Twitter

    Nati Shalom
    Personal · last shared 2014
    Discord Blogdiscord.com728 people

    How Discord Stores Billions of Messages (2017)

    Discord Blog
    Company · last shared 2026