
The fifth edition of this text offers a careful presentation of the probability needed for mathematical statistics and the mathematics of statistical inference.
Here’s what I did to learn math. I wouldn’t recommend this path. You will have a much easier time getting a job with a quantitative degree. You’re only 26, so you can go back to school without really losing much time. If you must do it this way, do the exercises, do the exercises, do the exercises, build a portfolio, and do the exercises.
Calculus/Analysis
Stewart single var calculus, then the multivar book. These are easy starters
Real analysis: Series, Functions of Several Variables, and Applications. Miklós Laczkovich, Vera T. Sós
Spivak Calc and Calc on Manifolds books
Bonus: Advanced Calculus A Geometric View, Callahan. This is what I turn to when I want to punish myself or remind myself how certain analysis proofs go.
Linear Algebra
Strang, Intro to LA is great. Start with this one
Strang, LA and learning from data. Will be tough without the first book
Stats
Hogg, Introduction to Mathematical Statistics
Gelman et al, BDA3 for Bayes
ML
Bishop PRML and Elements of statistical learning. Do the exercises. Build the algos in Python.
But if you're looking to learn prob/stats for applications to ML, most ML textbooks have a chapter or two reviewing the relevant stuff. I liked the first two chapters of Bishop's PRML for that.
Data Analysis... https://sites.stat.columbia.edu/gelman/arm/ Regression and Other Stories: https://avehtari.github.io/ROS-Examples/
Wasserman's All of Statistics is a really good introduction to mathematical statistics (the Gelman stuff above are more practically and analytically focused).
But yeah, it would probably be easier to find a good statistics course at a local university and try to audit it or do it at night.
Probability: Introduction to Probability - Blitzstein & Hwang.
Statistics: Introduction to Mathematical Statistics - Hogg & al.
Calculus: Calculus, Early Transcendentals - James Stewart & al.
Linear Algebra: Introduction to Linear Algebra - Gilbert Strang.
What are your picks in those subject? Are these enough?
Edit: preferably books that use the metric system.