Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    F

    Felipe Hoffa

    medium.com/@hoffa · Personal blog · on HN since 2015

    Felipe Hoffa, a Google developer advocate, uses BigQuery to analyze large public datasets like GitHub, Hacker News, and Reddit.

    Visit blogHN submissions
    Data & VisualizationProgrammingDatabases
    What HN says

    HN commenters cite his tabs-versus-spaces analysis of GitHub files and his Hacker News and Reddit datasets on BigQuery; he also appears answering questions on dataset updates.

    Stats for nerds
    29HN people shared it
    42linked in comments
    319story points
    Aug 2019last shared
    2016people per year2019

    Top posts on HN

    1. 1
      Tabs or spaces – Parsing a 1B files among 14 programming languages
      10 people · 130 points · first shared 2016 · 122 comments on HN
    2. 2
      Hacker News on BigQuery: Now with daily updates. Top domains and time to post?
      4 people · 57 points · first shared 2017 · 9 comments on HN
    3. 3
      Counting uniques faster in BigQuery with HyperLogLog++
      1 person · 20 points · first shared 2017 · Discussion on HN
    4. 4
      All the open source code in GitHub now shared in BigQuery: Analyze all the code
      3 people · 16 points · first shared 2016 · Discussion on HN
    5. 5
      The top contributors to GitHub – 2017
      1 person · 14 points · first shared 2017 · Discussion on HN
    6. 6
      Reddit’s uptime (2008–2016)
      1 person · 13 points · first shared 2016 · Discussion on HN
    7. 7
      The top GitHub projects per country
      2 people · 11 points · first shared 2017 · 1 comments on HN
    8. 8
      The top weekend languages – this time according to GitHub commits
      3 people · 9 points · first shared 2017 · 1 comments on HN
    9. 9
      Winning arguments with data
      1 person · 9 points · first shared 2017 · Discussion on HN
    10. 10
      What countries have more open source developers per capita than the US? – Medium
      2 people · 5 points · first shared 2016 · Discussion on HN

    What HN people wrote when they linked it

    • kbensonSep 2017

      I believe the number of voters in key districts needed to swing the electoral college to Clinton was in the tens of thousands. If it was targeted perfectly (which of course is impossible), that's almost two dollars a person that needed to be influenced. How many Facebook ads impressions does that buy per person? While I think it's unlikely that anyone could have accurately targeted to that degree, it does put into perspective just how important targeted advertising might be to something like this.

      Additionally (and I think more likely), the advertising might have been been used more as an agitation device, and to reduce the trust in traditional information through highly effective misinformation. If you can start viral memes, it doesn't matter how many impressions you paid for, what's important is how far the meme spreads in the end. A single shared article can lead to tens of millions of views and re-shares. In this case, money is purely a way to help get critical mass for your specially crafted meme, so it doesn't necessarily compare to candidate spending directly, which needs to both educate and counteract opponent messaging. Targeted disinformation can just ignore failed meme campaigns and counteractions to them and move onto the next meme, since it's effectively anonymous.

      1: https://medium.com/@hoffa/hillary-only-needed-to-switch-53-650-voters-to-win-94940ff263b7

    • subroutineAug 2017

      I recently wrote a little Python script to scrape the url from top submissions to Reddit's /r/The_Donald vs. /r/EnoughTrumpSpam to get an idea of the most conservative-leaning and liberal-leaning news outlets (e.g. more specifically which news sites conservative-leaning and liberal-leaning redditors use to support their respective narratives). Here are the results:

      https://i.redd.it/45ezt3j9hziy.png

      Edit: Oh and I almost forgot (and to bring this full circle) a Googler saw my post about this and made an interactive version:

      https://medium.com/@hoffa/reddit-favorite-sources-the-most-linked-sites-expanded-and-interactive-79070d648573

      Edit: and to really bring this full circle, this Googler made an interactive version about HN:

      https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-daily-updates-so-what-are-the-top-domains-963d3c68b2e2

    • minimaxirJun 2016

      The GitHub Archive dataset was updated as well. Example BigQuery to get the Top Repositories from 2015-2016 YTD, by the number of Stars given during that time:

      SELECT repo.id, repo.name, COUNT(*) as num_stars
      FROM TABLE_DATE_RANGE([githubarchive:day.], TIMESTAMP('2015-01-01'), TIMESTAMP('2016-12-31'))
      WHERE type = "WatchEvent"
      GROUP BY repo.id, repo.name
      ORDER BY num_stars DESC
      LIMIT 1000

      Which results in this output: https://docs.google.com/spreadsheets/d/16yDS2wDdDOTxjVsjGvWmpHVsOIU65wLEjXFHDtDeKU4/edit?usp=sharing

      Since the query only hits 3 columns, it only uses 15.4GB of data (out of a 1TB allowance)

      More information on the GitHub Archive changes: https://medium.com/@hoffa/github-archive-fully-updated-notice-some-breaking-changes-64e7e7cd0967

    • rhackerAug 2019

      Wouldn't this make sense?

      https://medium.com/@hoffa/400-000-github-repositories-1-billion-files-14-terabytes-of-code-spaces-or-tabs-7cfe0b5dd7fd#.j6ki2b7og

      So the number of people that prefer spaces far outweighs the tabbers.

      Now, take the pool of people that use spaces and tabs and let them compete for a 100k job. 9 times out of 10 even if randomly hired it will be a space person.

      Also, as a by the way, on the medium post. The reason Java has so much tabs is specifically due to the default Eclipse formatting that prefers a mix Tab/Space approach. Which is absolutely horrifying in my personal opinion. I don't have any numbers but Eclipse probably holds 80%, followed by Netbeans and/or IntelliJ. (both of which default to spaces)

    • fhoffaMar 2019

      Hi, Felipe Hoffa at Google here.

      We're aware the dataset hasn't been updated since a month ago, and we are working to fix it. You can track the issue here:

      - https://issuetracker.google.com/issues/127132286

      In the meantime you can still play with the dataset, and dig into the full history of Hacker News - less this last month. I left some interesting queries to get you started here:

      - https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-daily-updates-so-what-are-the-top-domains-963d3c68b2e2

    • ConfusionJun 2017

      By popular vote: spaces. See https://medium.com/@hoffa/400-000-github-repositories-1-billion-files-14-terabytes-of-code-spaces-or-tabs-7cfe0b5dd7fd. Previous discussion: https://news.ycombinator.com/item?id=12397246

    Related

    Cloudera Blogblog.cloudera.com86 people

    Cloudera taken private for $5.3B, acquires Datacoral and Cazena

    Cloudera Blog
    Company · last shared 2023
    Aphyraphyr.com551 people

    Hexing the technical interview (2017)

    Aphyr
    Personal · last shared 2026
    Uber Engineering Blogeng.uber.com525 people

    Why Uber Engineering Switched from Postgres to MySQL

    Uber Engineering Blog
    Company · last shared 2025
    Russ Coxswtch.com/~rsc284 people

    How Google Code Search Worked: Regex Matching with a Trigram Index (2012)

    Russ Cox
    Personal · last shared 2026
    Damien Katzdamienkatz.net71 people

    The Unreasonable Effectiveness of C

    Damien Katz
    Personal · last shared 2020
    Felipe Contrerasfelipec.wordpress.com51 people

    Another user/developer banned from GNOME's bugzilla without any warning

    Felipe Contreras
    Personal · last shared 2025
    Ben Boyterboyter.org47 people

    Fix it, Fork it, Fuck off (2019)

    Ben Boyter
    Personal · last shared 2026
    Ricky Hohoricky.blogspot.com31 people

    Scalable System Design Patterns

    Ricky Ho
    Personal · last shared 2016