Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    T

    Tumblr Engineering

    engineering.tumblr.com · Company blog · on HN since 2011

    Tumblr's engineering team posts about its infrastructure, including MySQL sharding, PHP 7, notifications, GIF handling and file copying.

    Visit blogHN submissions
    Distributed SystemsDatabasesWeb Development
    What HN says

    HN commenters cite it for a useful MySQL sharding talk, a fast file-copy technique with pigz and netcat, and its PHP 7 move.

    Stats for nerds
    36HN people shared it
    36linked in comments
    1.3Kstory points
    Oct 2022last shared
    2012people per year2022

    Top posts on HN

    1. 1
      PHP 7 at Tumblr
      2 people · 303 points · first shared 2016 · 51 comments on HN
    2. 2
      How I review code
      1 person · 234 points · first shared 2018 · 138 comments on HN
    3. 3
      Jetpants: a MySQL toolkit for managing billions of rows and hundreds of DBs
      1 person · 191 points · first shared 2012 · 23 comments on HN
    4. 4
      Flow and TypeScript
      1 person · 146 points · first shared 2017 · 97 comments on HN
    5. 5
      Colossus: A New Service Framework from Tumblr
      1 person · 77 points · first shared 2014 · 27 comments on HN
    6. 6
      Tumblr Opensources Kubernetes Utilities
      1 person · 72 points · first shared 2019 · 17 comments on HN
    7. 7
      Memcache top
      1 person · 67 points · first shared 2013 · 11 comments on HN
    8. 8
      Staircar: Redis-powered notifications
      2 people · 55 points · first shared 2011 · 15 comments on HN
    9. 9
      Categorizing Posts on Tumblr
      1 person · 43 points · first shared 2016 · 5 comments on HN
    10. 10
      Everything that went wrong while building the Tumblr iOS share extension
      1 person · 19 points · first shared 2014 · Discussion on HN

    What HN people wrote when they linked it

    • iuguyJun 2012

      It looks interesting but one small thing. I looked into the transferring large files quickly link[1] and saw that they were using netcat and tar to transfer files. This is not necessarily optimal[2], and applying some compression can go a long way, although this will be dependent on the use case. Compression also has the added bonus of transferring less data across the network and (if you don't uncompress) less space at the other end.

      SSH is also an option (a slow option, but an option) that provides certain things (encryption, authentication) that make it ideally suited for transfers across network boundaries.

      [1] - http://engineering.tumblr.com/post/7658008285/efficiently-copying-files-to-multiple-destinations

      [2] - http://www.ndchost.com/wiki/server-administration/netcat-over-ssh

    • versteegenMar 2017

      Use gifsicle. It's excellent and very fast, I don't think there's anything that produces smaller gifs than it. [0]

      You can also use ImageMagick to produce optimised gifs (it has about 4 different options for that, eg -layers OptimizeTransparency). See [1]. But in my own tests, gifsicle always beats it (often by a huge margin) and is vastly faster. That ImageMagick page may be out of date. Also, Tumblr contracted the author of gifsicle, Dr. Eddie Kohler, to make some improvement for them, hopefully that made it back into gifsicle [2].

      [0] https://www.lcdf.org/gifsicle/
      [1] http://www.imagemagick.org/Usage/anim_opt/#compress_opt
      [2] https://engineering.tumblr.com/post/80003435120/who-doesnt-love-animated-gifs-believe-it-or

    • cmelbyeDec 2012

      Add Tumblr to that list as well. They recently converted their iOS app from essentially pure HTML5 to pure native, which was no easy feat considering the dynamic nature of blog posts on Tumblr, which can contain almost arbitrary HTML content.

      http://engineering.tumblr.com/post/35271768127/tumblr-for-iphone-is-now-100-native

      Of course, HTML5 proponents will continue to ignore these major data points.

    • kkoppenhaverDec 2016

      DailyMotion[1] and Tumblr[2] have recently moved to PHP7. In addition, WordPress[3] is moving towards PHP7 as well.

      [1] http://engineering.dailymotion.com/php-7-deployment-at-dailymotion/

      [2] https://engineering.tumblr.com/post/152998126990/php-7-at-tumblr

      [3] (from 2015) https://make.wordpress.org/core/2015/09/10/wordpress-and-php7/

    • XorlevOct 2022

      Pretty similar to that, we used pigz and netcat to bring up new MySQL read replicas in a chain at line speeds.

      I recall learning the technique from Tumblr's eng blog.

      https://engineering.tumblr.com/post/7658008285/efficiently-copying-files-to-multiple-destinations

    • notJimJun 2012

      Slightly OT, but Tumblr gave a great talk about their sharding architecture here: http://engineering.tumblr.com/post/12652551894/slides-from-our-velocity-europe-talk-on-mysql-sharding.

      It's really quite a good intro to the subject, I think.

    Related

    Slack Engineeringslack.engineering281 people

    Taking PHP Seriously

    Slack Engineering
    Company · last shared 2026
    High Scalabilityhighscalability.com922 people

    A Beginner's Guide to Scaling to 11M+ Users on Amazon's AWS

    High Scalability
    Publication · last shared 2026
    Twitter Engineering Blogengineering.twitter.com121 people

    Twitter Rolls Twitter.com Back to a Server-Side Architecture

    Twitter Engineering Blog
    Company · last shared 2017
    Foursquare Engineeringengineering.foursquare.com47 people

    Building a recommendation engine, foursquare style

    Foursquare Engineering
    Company · last shared 2018
    Engineering at Metaengineering.fb.com657 people

    Sapling: A new source control system with Git-compatible client

    Engineering at Meta
    Company · last shared 2026
    Code as Craftcodeascraft.etsy.com73 people

    Moving from SVN to Git in 1,000 easy steps

    Code as Craft
    Company · last shared 2021
    Pinterest Engineeringengineering.pinterest.com95 people

    Demystifying SEO with experiments

    Pinterest Engineering
    Company · last shared 2017
    Discord Blogdiscord.com728 people

    How Discord Stores Billions of Messages (2017)

    Discord Blog
    Company · last shared 2026