Giles Thomas writes about programming and machine learning, including a long series on building an LLM from scratch and training hardware.
HN commenters point newcomers to his LLM-from-scratch series, with links to part 1, the tag listing, and his post on the math needed.
Alright I'm going to stop replying to these, I'm starting feel attacked.
8. All of my code is not on Github, and there is no reason for me to learn a language simply because I have previous knowledge in Ruby. I chose to learn Crystal because of it's elegance and speed.
9. I wrote that reverse proxy based on a variety of online tutorials[1], but used my knowledge of threads to make it multithreaded.
[1] http://www.gilesthomas.com/2013/08/writing-a-reverse-proxyloadbalancer-from-the-ground-up-in-c-part-0/
This looks very interesting. The easiest way to navigate to the start of this series of articles seems to be https://www.gilesthomas.com/til-deep-dives/page/2
Now if I only could find some time...
maybe it renders differently on mobile but this was the first entry for me. you can use the nav at the end to continue to the next part
https://www.gilesthomas.com/2024/12/llm-from-scratch-1
Here's part 1 [1]. Since his archive goes by date, it makes it a bit easier to guestimate which part is made in which month.
[1] https://www.gilesthomas.com/2024/12/llm-from-scratch-1
OP here -- agreed! I tried to summarise (at least to my current level of knowledge) those 12-18 hours here: https://www.gilesthomas.com/2025/09/maths-for-llms
The full list of articles is at https://www.gilesthomas.com/llm-from-scratch for anyone who's interested but wants to start at the beginning.