Stats for nerds
4recommend
12mentions
9people
2019–2024years
42% recommend50% neutral8% critical
Mentions per year
What Hacker News says
- I am/was in this scenario. I'm sure there are other resources out there specifically aimed at developers, but a book I'm reading now is "Deep Learning From Scratch" by Seth Weidman. He takes a different approach, by explaining concepts in three distinct methods: a mathematical way, by using diagrams and by showing the code.
I like this approach because it allows me to connect the math to the problem, whereas otherwise you wouldn't have.
In the book, you're slowly creating a DL framework, as the title says, from scratch. He also has all the code on GitHub: https://github.com/SethHWeidman/DLFS_code
I think if you are truly trying to understand deep learning, you will never get to avoid the math because that's really what it is at it's core, a couple of (non-linear) functions chained together (obvious gross oversimplification).
- The handouts at https://fleuret.org/dlc/ are fantastic.
Also two books: Data Science from Scratch and Deep Learning from Scratch. They are more hand-on, but you'll build all the low-level things in Python and learn a lot.
- I think all serious researchers have implemented core Deep Learning algorithms from scratch. I know I have.
There are two books that do exactly this:
1. Deep Learning from Scratch
2. Data Science from Scratch
In these books, you implement each part of the ML/DL pipeline, from scratch, in Python.
There is also a GitHub project call Minitorch that teaches you the inner workings of a framework like PyTorch.
And then there are several other good resources for exactly this.
What he claims to have as a content is neithet new nor unique.
- 1. Nature of Code- simulating and modeling many things in nature.
2. Data Science from Scratch- building a Data Science library from scratch.
3. Deep Learning from Scratch- building a Deep Learning library from scratch.
4. Realm of Racket and 5. Land of Lisp- developing games with Racket and Lisp.
6. The Little Schemer- not only teaches you to think recursively, but also how to implement basic functions like addition, multiplication, list-related function from using Scheme for Scheme.
7. Genetic Algorithms in Elixir
8. Genetic Algorithms and Machine Learning for Programmers
- If you want just one book to learn all things deep learning from scratch with coding including the latest techniques, it should be Dive into deep learning [0]. Really underrated and not well-known.
[0] https://d2l.ai/
- The last commit in the repo of "Deep Learning from Scratch" was 5 years ago. It is hopelessly outdated. The field is changing very fast.
Related
Machine Learning For Absolute Beginners
2 recommend · 3
2019–2025
Dive into Deep Learning
30 recommend · 42
2020–2023
Deep Learning for Coders with fastai and Pytorch
4 recommend · 8
Data science from scratch
22 recommend · 48
Deep Learning
44 recommend · 86
Introduction to Statistical Learning
85 recommend · 120
