Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    I

    Instagram Engineering

    engineering.instagram.com · Company blog · on HN since 2015

    Instagram's engineering team writes about scaling, Python and Django, infrastructure, and mobile and open-source tools.

    Visit blogHN submissions
    Systems & PerformanceWeb DevelopmentDistributed Systems
    What HN says

    HN lists it among respected engineering blogs, and commenters cite it for Python at scale, PgQ cache invalidation and Cassandra latency work.

    Stats for nerds
    51HN people shared it
    40linked in comments
    3Kstory points
    Mar 2018last shared
    2016people per year2018

    Top posts on HN

    1. 1
      React Native at Instagram
      2 people · 589 points · first shared 2017 · 233 comments on HN
    2. 2
      Open-sourcing MonkeyType – Let your Python code type-hint itself
      5 people · 443 points · first shared 2017 · 229 comments on HN
    3. 3
      Open-sourcing a 10x reduction in Apache Cassandra tail latency
      2 people · 408 points · first shared 2018 · 164 comments on HN
    4. 4
      Bringing Wide Color to Instagram
      6 people · 396 points · first shared 2017 · 117 comments on HN
    5. 5
      Dismissing Python Garbage Collection at Instagram
      6 people · 265 points · first shared 2017 · 85 comments on HN
    6. 6
      Continuous Deployment at Instagram
      1 person · 239 points · first shared 2016 · 91 comments on HN
    7. 7
      Web Service Efficiency at Instagram with Python
      5 people · 200 points · first shared 2016 · 51 comments on HN
    8. 8
      Copy-on-write friendly Python garbage collection
      3 people · 198 points · first shared 2017 · 52 comments on HN
    9. 9
      Performance and Usage at Instagram
      1 person · 87 points · first shared 2016 · 29 comments on HN
    10. 10
      Flexible Feature Control at Instagram
      2 people · 51 points · first shared 2015 · 11 comments on HN

    What HN people wrote when they linked it

    • dimitri-gnidashJan 2017

      Python is a wonderful language where the speed of development and maintainability is concerned.

      Django is a great framework for getting your web application and/or APIs built. The library support is also phenomenal (looking at Django Rest Framework for API development)

      It is also unlikely you will outgrow Python/Django stack as Instagram and Pintereset are doing fine. https://engineering.instagram.com/what-powers-instagram-hundreds-of-instances-dozens-of-technologies-adf2e22da2ad#.nq4iq5lms

      Rarely does the stack matter to startup success, why not pick up Steve Blank's
      The Startup Owner's Manual about building THE RIGHT thing? Building the wrong product is the number one killer of startups why not focus there?

    • bpicoloJan 2018

      Memory is typically the scaling bottleneck for Python workers for web servers. One way to cut back drastically on this is to load as much as possible in startup and then fork for request serving processes. The problem is that python refcounting causes a lot of copy-on-writes for data that's really just used as read-only data.

      This change allows you to run more workers with less memory.

      Instagram has had a few good posts about how they've approached this problem, here's another:
      https://engineering.instagram.com/dismissing-python-garbage-collection-at-instagram-4dca40b29172

    • tedmistonAug 2016

      I have met some members of Instagram's engineering team at Python conferences. They also run a dedicated engineering blog (https://engineering.instagram.com).

      Despite the fact that they use an old version of Django, and the product has not exactly changed drastically since it became popular, they don't seem jaded.

      Sometimes it's fun to build your own version of something regardless of what exists in the rest of the world. I'm sure nuances will become more prominent in time.

    • rbransonApr 2016

      There is also PgQ from the https://wiki.postgresql.org/wiki/SkyTools package, which is fantastic and mature. It's like Kafka inside your PostgreSQL. When I was at Instagram, we implemented a multi-region cache invalidation system using PgQ that took advantage of atomicity between PgQ and writes to the source-of-truth data table. http://engineering.instagram.com/posts/548723638608102/

    • SEJeffApr 2017

      Honestly I think Uber switching was more of a business decision as their employees had trouble figuring out how to properly use Postgres. Instagram definitely has different data needs, but is probably much bigger than Uber wrt data. They use Postgres successfully via Django no less!

      https://engineering.instagram.com/sharding-ids-at-instagram-1cf5a71e5a5c

    • paultelaJan 2016

      There's a mention of Facebook regularly doing this in the summary section of this instagram engineering post: http://engineering.instagram.com/posts/548723638608102/

      EDIT: Here's more info: http://www.datacenterknowledge.com/archives/2014/09/15/facebook-turned-off-entire-data-center-to-test-resiliency/

    Related

    Facebook Engineeringcode.facebook.com552 people

    Relicensing React, Jest, Flow, and Immutable.js

    Facebook Engineering
    Company · last shared 2021
    Pinterest Engineeringengineering.pinterest.com95 people

    Demystifying SEO with experiments

    Pinterest Engineering
    Company · last shared 2017
    LinkedIn Engineeringengineering.linkedin.com415 people

    LinkedIn Intro: Doing the Impossible on iOS

    LinkedIn Engineering
    Company · last shared 2025
    Airbnb Engineeringnerds.airbnb.com110 people

    We've Open-sourced Rendr

    Airbnb Engineering
    Company · last shared 2017
    Shopify Engineeringshopify.engineering268 people

    Building all of our new mobile apps using React Native

    Shopify Engineering
    Company · last shared 2026
    Engineering at Metaengineering.fb.com657 people

    Sapling: A new source control system with Git-compatible client

    Engineering at Meta
    Company · last shared 2026
    Twitter Engineering Blogengineering.twitter.com121 people

    Twitter Rolls Twitter.com Back to a Server-Side Architecture

    Twitter Engineering Blog
    Company · last shared 2017
    WebKit Blogwebkit.org723 people

    Face ID and Touch ID for the Web

    WebKit Blog
    Company · last shared 2026