Stats for nerds
3recommend
5mentions
5people
2014–2021years
60% recommend40% neutral
Mentions per year
What Hacker News says
- The book I used to learn the basics many years ago was "An Introduction to Neural Networks", by Kevin Gurney. It's a bit outdated now, but I still consider it valuable.
- This is the most accessible introduction to Neural Networks I've found. The interactive bits really help as does the concrete example.
- There is a nice tutorial here [1] about max-ent classifiers. Ultimately in neural networks there are usually a number of cost functions you can use for the last layer - softmax or cross-entropy are other possibilities that may be easier to understand, though possibly less performant for NLP tasks.
I thought the introduction to neural networks from Andrew Ng's coursera course (even though it meant writing MATLAB) was quite good, and allows you to implement backprop, cost functions, etc. while still having some other helper code to make things easier. I highly recommend working through that course if you are intersted in ML in general [2].
[1] http://www.cs.berkeley.edu/~klein/papers/maxent-tutorial-sli...
- There are lots of deep learning books on the market. The vast majority of them are presenting practical examples using some Python (or whatever) deep learning framework. Such books don't interest me at all. If I wanted to learn some particular framework, I would just look up the documentation for that framework.
I'm looking for two types of books:
1. A technical, math-heavy introduction to neural networks and deep learning, with little or no actual code (except possibly some pseudocode). The often recommended book by Goodfellow et al resembles what I'm looking for, but unfortunately, it completely lacks exercises.
2. An entertaining pop science like book which takes a more philosophical and cross disciplinary look at neural networks as well as their inspirations and applications. I haven't been able to find a single book like this, but surely it has to exist?
Recommendations, anyone?
- Hey, author here. Any/all feedback is welcome, and I'm happy to answer questions.
Previous discussion on HN of the "introduction to Neural Networks" referenced in this article: https://news.ycombinator.com/item?id=19320217
Runnable code from the article: https://repl.it/@vzhou842/A-CNN-from-scratch-Part-1
Related
Neural networks
3 recommend · 4
Neural Networks and Deep Learning
72 recommend · 94
Introduction to Statistical Learning
85 recommend · 120
Neural networks and learning machines
2 recommend · 2
Pattern Recognition and Machine Learning
80 recommend · 121
Machine learning
15 recommend · 31
