Skip to content
HomeVideosBooksBlogs
AllTop postsTopics
Podcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K
    A

    Andrey Kurenkov

    andreykurenkov.com · Personal blog · on HN since 2016

    Andrey Kurenkov's blog, written as a grad student in AI, with a history of neural nets and deep learning and notes on research life.

    Visit blogHN submissions
    AI & Machine LearningHistory
    What HN says

    Commenters repeatedly recommend his multi-part history of neural nets and deep learning as a great write-up, with references to the key publications.

    Stats for nerds
    17HN people shared it
    49linked in comments
    849story points
    Sep 2019last shared
    2016people per year2019

    Top posts on HN

    1. 1
      A 'Brief' History of Neural Nets and Deep Learning
      8 people · 255 points · first shared 2016 · 20 comments on HN
    2. 2
      Organizing My Emails with a Neural Net
      1 person · 147 points · first shared 2016 · 32 comments on HN
    3. 3
      A 'Brief' History of Neural Nets and Deep Learning, Part 4 (2015)
      2 people · 145 points · first shared 2016 · 7 comments on HN
    4. 4
      A 'Brief' History of Game AI Up to AlphaGo
      1 person · 71 points · first shared 2018 · 18 comments on HN
    5. 5
      Lessons learned the hard way in grad school (so far)
      2 people · 60 points · first shared 2020 · 15 comments on HN
    6. 6
      A 'Brief' History of Neural Nets and Deep Learning (2015)
      3 people · 47 points · first shared 2018 · 1 comments on HN
    7. 7
      The Sickness That Is Depression
      1 person · 41 points · first shared 2018 · 4 comments on HN
    8. 8
      Show HN: ObjectCropBot – Interactively Crop Objects from Photos with AI
      1 person · 33 points · first shared 2017 · 7 comments on HN
    9. 9
      Effective Teamwork – A One Page Guide
      2 people · 14 points · first shared 2018 · Discussion on HN
    10. 10
      A 'Brief' History of Game AI
      3 people · 8 points · first shared 2016 · Discussion on HN

    What HN people wrote when they linked it

    • withfries2Jun 2016

      cs702, this deck started as a short talk so I didn't have time to acknowledge all the great work leading up to the Google YouTube experiment. Your list is good, and I'd add Rosenblatt for the first perceptron, Rumelhart & McClelland for applying techniques to perception, Werbos for backpropogation, Fukushima for convolutional networks, and so many more.

      I found these helpful while researching the history:
      http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning/
      http://www.scholarpedia.org/article/Deep_Learning

      What else have you found particularly useful?

    • andreykSep 2019

      I really like this quote from this article:

      “I love writing. I get a kick out of sharing my thoughts with others. The act of transforming ideas into words is an amazingly efficient way to solidify and refine your thoughts about a given topic. “

      So much so that it is quoted on my own Jekyll-based personal website (http://www.andreykurenkov.com/). I have set up 3 additional site since with Jekyll, all hosted on GitHub, and it's super easy every time.

    • davidcuddebackMar 2018

      Assuming you're asking specifically about the history of DL/ML, I can recommend this (4-part) blog series: http://www.andreykurenkov.com/writing/ai/a-brief-history-of-neural-nets-and-deep-learning/. It includes references for the relevant publications that identify problems (e.g., exploding gradients) and their solutions.

    • lovelearningJan 2017

      I remember an informative article series [1] that was posted here some months ago. Previous discussion on it [2].

      [1]: http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning/

      [2]: https://news.ycombinator.com/item?id=10910887

    • bpesquetAug 2016

      Great writeup about how deep learning came to be: http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning/ (posted here a few months ago).

    • mellingMar 2018

      The idea of neural networks go back a lot further than CMU.

      http://www.andreykurenkov.com/writing/ai/a-brief-history-of-neural-nets-and-deep-learning/

    Related

    Victor Zhouvictorzhou.com28 people

    Implementing a Neural Network from Scratch in Python

    Victor Zhou
    Personal · last shared 2023
    Google Research Bloggoogleresearch.blogspot.com303 people

    Announcing SyntaxNet: The World’s Most Accurate Natural Language Parser

    Google Research Blog
    Company · last shared 2017
    Stanford AI Lab Blogai.stanford.edu45 people

    An Introduction to Knowledge Graphs

    Stanford AI Lab Blog
    Company · last shared 2026
    Berkeley ML Blogml.berkeley.edu21 people

    Machine Learning Crash Course: The Bias-Variance Dilemma

    Berkeley ML Blog
    Company · last shared 2023
    BAIR Blogbair.berkeley.edu102 people

    Does GPT-2 Know Your Phone Number?

    BAIR Blog
    Company · last shared 2026
    Nanonets Blognanonets.com27 people

    Building a license plate reader from scratch with deep learning

    Nanonets Blog
    Company · last shared 2026
    OpenAI Blogblog.openai.com174 people

    OpenAI Five

    OpenAI Blog
    Company · last shared 2022
    LessWronglesswrong.com2.4k people

    The Best Textbooks on Every Subject

    LessWrong
    Publication · last shared 2026