
"Understanding Digital Computers : A Self-learning Programmed Text That Will Teach You the Basics for the Microcomputer Revolution" by Forrest M. Mims III.
It's dated, but the core material is still relevant. Even the dated sections might suit you if you're interested in the history.
In a similar same vein, a few years ago I wrote a course which starts with the idea of a bit and ends with the student programming a computer that they built themselves in a logic simulator.
https://john.daltons.info/teaching/engineering/
The first few lessons meander, as I was still figuring out a direction, so the meat starts at lesson 3. The last lessons are missing (roundtoit), but if there is interest I can put them on-line. From memory all the examples are on-line. Here is the final computer:
https://john.daltons.info/teaching/engineering/simcirjs/comp...
In this example a program is already in memory, so just push "run/stop" to make it run. The instruction set isn't on-line, as it's in the later lessons, which I haven't gotten around to uploading.
I can think of no better way to grok the underlying hardware. Write a simple assembler. Next, begin writing an OS.
I read this book as a teenager and I remember it giving me my first "aha!" moment of understanding how computers really work. In my experience, the prerequisites for understanding the book are pretty low, but the knowledge within is sophisticated.
Those books are a great start to this kind of hobby.
Quoting from the project history:
In the beginning....
Magic-1 really began during a lunchtime discussion with Ken Sumrall at Vito's Pizza in Sunnyvale, CA sometime in the Spring of 2001. I was complaining to Ken about how as a compiler writer I was woefully ignorant about how CPU hardware really worked. I hadn't taken any electronics classes in college, and was only vaguely aware of what transistors, resistors and capacitors were. Ken recalled an old series of magazine articles by Forrest Mims on building a very simple CPU from TTL parts, and suggested I read it. Over the next few weeks, I tracked down those articles, as well as Mims' "Understanding Digital Computers" and a textbook by Albert Paul Malvino, "Digital Computer Electronics."
I read them all, and when I next had lunch with Ken at Vito's I reported back that it all seemed much clearer now - so much so that I thought I could even build a CPU myself. Then Ken said, "well, why don't you?".
Why not, indeed?
And so the Magic-1 project began.
[0] - http://www.homebrewcpu.com/
[1] - http://www.homebrewcpu.com/construction.htm
[2] - http://www.magic-1.org/