Name: Analogy-making as perception
ISBN: 9780262132893

Analogy-making as perception

The psychologist William James observed that "a native talent for perceiving analogies is... the leading fact in genius of every order." The centrality and the ubiquity of analogy in creative thought have been noted again and again by scientists, artists, and writers, and understanding and modeling analogical thought have emerged as two of the most important challenges for cognitive science. Analogy-Making as Perception is based on the premise that analogy-making is fundamentally a high-level perceptual process in which the interaction of perception and concepts gives rise to "conceptual slippages" which allow analogies to be made. It describes Copycat - a computer model of analogy making, developed by the author with Douglas Hofstadter, that models the complex, subconscious interaction between perception and concepts that underlies the creation of analogies. In Copycat, both concepts and high-level perception are emergent phenomena, arising from large numbers of low-level, parallel, non-deterministic activities. In the spectrum of cognitive modeling approaches, Copycat occupies a unique intermediate position between symbolic systems and connectionist systems a position that is at present the most useful one for understanding the fluidity of concepts and high-level perception. -- Publisher description.

What Hacker News says

mindcrimeSep 2022

That would be a long list, given that I read a lot of books and would generally say that most of the books I've read were worth investing time in to some extent. But for what it's worth, here's a subset, cribbed from my previous HN comments:

Something Deeply Hidden - Sean Carroll

The Universe Speaks in Numbers: How Modern Math Reveals Nature's Deepest Secrets - Graham Farmelo

The Man Who Loved Only Numbers: The Story of Paul Erdos and the Search for Mathematical Truth - Paul Hoffman

The Man Who Knew Infinity: A Life of the Genius Ramanujan - Robert Kanigel

Lost in Math - Sabine Hossenfelder

The First Three Minutes - Steven Weinberg

Hyperspace - Michio Kaku

Not Even Wrong - Peter Woit

The Trouble With Physics - Lee Smolin

About Time - Paul Davies

Time Reborn - Lee Smolin

The Elegant Universe - Brian Greene

The Hidden Reality - Brian Greene

The Fabric of the Cosmos - Brian Greene

Quantum Space: Loop Quantum Gravity and the Search for the Structure of Space, Time, and the Universe - Jim Baggott

The Universe Speaks in Numbers: How Modern Math Reveals Nature's Deepest Secrets - Graham Farmelo

Three Roads To Quantum Gravity - Lee Smolin

Programming the Universe: A Quantum Computer Scientist Takes on the Cosmos - Seth Lloyd

Higgs - The invention and discovery of the 'God Particle' - Jim Baggott

Analogy Making As Perception - Melanie Mitchell

Society of Mind - Marvin Minsky

Engineering General Intelligence, Part 1 - Ben Goertzel

Engineering General Intelligence, Part 2 - Ben Goertzel

The AGI Revolution - Ben Goertzel

Hackers & Painters by our very own Paul "pg" Graham

Hackers: Heroes of the Computer Revolution - Steven Levy

The Soul of a New Machine - Tracy Kidder

Cyberpunk: Outlaws and Hackers on the Computer Frontier - Katie Hafner & John Markoff

Artificial Life: A Report from the Frontier Where Computers Meet Biology - Steven Levy

Ghost In The Wires - Kevin Mitnick

The Art of Deception - Kevin Mitnick

The Art of Intrusion - Kevin Mitnick

Godel, Escher, Bach: An Eternal Golden Braid by Douglas Hofstadter

The Fountainhead - Ayn Rand

It's Not About The Bike - Lance Armstrong

Ultramarathon Man - Dean Karnazes

Charles Proteus Steinmetz: The Electrical Wizard of Schenectady - Robert Bly

Report From Engine Co 82 - Dennis Smith

Positioning: The Battle for Your Mind - Al Ries, Jack Trout and Philip Kotler

The 22 Immutable Laws of Marketing: Violate Them at Your Own Risk! - Al Ries and Jack Trout

Re-Positioning: Marketing in an Era of Competition, Change and Crisis by Jack Trout and Steve Rivkin

The 22 Immutable Laws of Branding - Al Ries and Laura Ries

Differentiate or Die: Survival in Our Era of Killer Competition - Jack Trout and Steve Rivkin

Marketing High Technology - William H. Davidow

Marketing Warfare - Al Ries

The Discipline of Market Leaders - Michael Treacy and Fred Wiersema

Crossing The Chasm - Geoffrey Moore

How to Measure Anything - Douglas Hubbard

Fooled by Randomness - Nassim Nicholas Taleb

The Black Swan - Nassim Nicholas Taleb

thread

mindcrimeDec 2020

I read about 20% of the titles I wanted to

I can relate. My goal for this year was to read 75 books, and I think I'm at 33 or 34 right now. The main one that has stood out to me so far was The Universe Speaks In Numbers by Graham Farmelo. Explaining why this book stood out to me would take a lot of words, and I plan to write a blog post on it at some point. But briefly, it comes down to it getting me excited about math again.

And as something of a counter-point to that book, I also read Lost in Math by Sabine Hossenfelder, which was also very good.

Others that were definitely worth reading:

Analogy Making As Perception by Melanie Mitchell

Society of Mind by Marvin Minsky (re-read)

Engineering General Intelligence, Part 1 by Ben Goertzel

The AGI Revolution by Ben Goertzel

And on a lighter note, some fun - if bizarre - cyberpunk styled novels I read were Necrotech and Nanoshock by K.C. Alexander.

thread

mindcrimeMay 2020

Derp, derp... I meant to write "Analogy-Making as Perception by Melanie Mitchell". I blame lack of coffee.

thread

mindcrimeMar 2020

OK, here ya go. This list is, for now, just a raw dump of titles and authors. When I have some more time, I'll turn this into a proper blog post with more commentary, sorting / grouping of the titles, links to complementary resources etc.

One bit of warning... the first half of this list includes everything "AI" related I've read (or am currently reading) for about the past two years. I say "AI" and not "AGI" because I haven't always bothered to make the distinction. So some of this stuff may not be relevant to you.

FYI, this list (especially the first half) is a heterogeneous lot that varies considerably along the "pop sci" to "academic" axis, as well as the "applied" to "theoretical" axis.

I'm also leaving off (for now anyway) most the "related, but not specifically about AI" stuff, like books on Probability, Bayesian Statistics, Graph Theory, etc., and books that are more about contemporary "Machine Learning" and "Deep Learning" topics. I do believe that there is a connection though, and that DL may play a role in building a truly intelligent system, so when I write the expanded blog post, I'll include more of that stuff.

OK, With no further ado, the "AI stuff I've read recently" list.

0. Blackboard Systems - Robert Engelmore & Tony Morgan

1. The Age of Spiritual Machines - Ray Kurzweil

2. The Emotion Machine - Marvin Minsky

3. The Society of Mind - Marvin Minsky

4. Possible Minds: 25 Ways of Looking at AI - John Brockman (ed)

5. AI Super-Powers: China, Silicon Valley and the New World Order - Kai-Fu Lee (more meta than actually about AI per-se)

6. Artificial Intelligence In Practice - Bernard Marr

7. Architects of Intelligence - Martin Ford

8. Gödel, Escher, Bach - Douglas Hofstadter

9. Superintelligence - Nick Bostrom

10. The Master Algorithm - Pedro Domingos

11. On Intelligence - Jeff Hawkins

12. Unified Theories of Cognition - Alan Newell

13. The AGI Revolution - Ben Goertzel

14. How To Create A Mind - Ray Kurzweil

15. Case-Based Reasoning: A Textbook - Michael M. Richter & Rosina O. Weber

16. The Age of Intelligent Machines - Ray Kurzweil

17. The Singularity is Near - Ray Kurzweil

18. An Introduction to MultiAgent Systems - Michael J. Wooldridge

19. Engineering General Intelligence - Volume 1 - Ben Goertzel

20. Artificial Intelligence: A Modern Approach - Peter Norvig & Stuart Russell

----

Below here is the stuff that is in the "to read" queue. This part tends to run more to textbooks and more academic material and less of the "pop sci" stuff. The choices on this list were inspired by other reading and research I've done, which led me to believe this group of titles includes material that will be useful. YMMV.

21. Cause Effect Pairs in Machine Learning - Isabelle Guyon, Alexander Statnikov, & Berna Bakir Batu (eds)

22. Propositional, Probabilistic, and Evidential Reasoning: Integrating Numerical and Symbolic Approaches - Weiru Liu

23. Human Compatible - Stuart Russell

23. Rebooting AI - Gary Marcus & Ernest Davis

24. Artificial Intelligence - Melanie Mitchell

25. Protocol Analysis - K. Anders Ericsson & Herbert A. Simon

26. The Robot's Dilemma: The Frame Problem in Artificial Intelligence - Zenon W. Pylyshyn

27. Image and Mind - Stephen Michael Kosslyn

28. Elements of Episodic Memory - Endel Tulving

29. Things and Places: How The Mind Connects With The World - Zenon W. Pylyshyn

30. Information Algebras: Generic Structures for Inference - Jurg Kohlas

31. Probabilistic Logics and Probabilistic Networks - Rolf Haenni, Jan-Willem Romeijn, Gregory Wheeler & Jon Williamson

32. Knowledge-Based Systems in Artificial Intelligence - Randall Davis & Douglas B. Lenat

33. Building Large Knowledge-Based Systems - Douglas B. Lenat & R.V. Guha

34. Elements of Information Theory - Thomas M. Cover & Joy A. Thomas

35. The Bayesian Choice - Christian P. Robert

35. Machine Learning for Commonsense Reasoning Processes - Xenia Naidenova

36. Reinforcement Learning and Optimal Control - Dimitri P. Bertsekas

37. An Introduction to Kolmogorov Complexity and Its Applications - Ming Li & Paul Vitanyi

38. The Mechanical Mind: A Philosophical Introduction to Minds, Machines, and Mental Representation - Tim Crane

39. Constraining Cognitive Theories - Zenon W. Pylyshyn

40. Neuro-Dynamic Programming - Dimitri P. Bertsekas & John Tsitsiklis

41. The Language Instinct - Steven Pinker

42. How The Mind Works - Steven Pinker

43. Images and Words - Steven Pinker

44. Words and Rules - Steven Pinker

45. The Blank Slate - Steven Pinker

46. Consciousness Explained - Daniel Dennett

47. How to Build a Brain: A Neural Architecture for Biological Cognition - Chris Eliasmith

48. Introduction to Artificial Intelligence - Eugene Charniak & Drew McDermott

49. Metamagical Themas - Douglas Hofstadter

50. I Am A Strange Loop - Douglas Hofstadter

51. Fluid Concepts And Creative Analogies: Computer Models Of The Fundamental Mechanisms Of Thought - Douglas Hofstadter

52. Principles of Synthetic Intelligence - Joshua Bach

53. Anatomy of the Mind - Ron Sun

54. Generic Inference: A Unifying Theory for Automated Reasoning - Marc Pouly & Jurg Kohlas

55. Knowledge Representation, Reasoning, and the Design of Intelligent Agents: The Answer-Set Programming Approach - Michael Gelfond & Yulia Kahl

56. Semantic Networks: An Evidential Formalization and its Connectionist Realization - Lockendra Shastri

57. Automated Planning and Acting - Malik Ghallab, Dana Nau, & Paolo Traverso

58. How Can The Human Mind Occur in the Physical Universe? - John Anderson

59. Spiking Neuron Models - Wulfram Gerstner & Werner Kistler

60. Neural Engineering - Chris Eliasmith & Charles H. Anderson

61. Principles of Neural Design - Peter Sterling & Simon Laughlin

62. Semantic Information Processing - Marvin Minsky

63. The SOAR Cognitive Architecture - John Laird

64. The Architecture of Cognition - John Anderson

65. Human Associative Memory - John Anderson & Gordon E. Bower

66. Knowledge Representation & Reasoning - Ronald J. Brachman & Hector J. Levesque

67. Cognitive Architectures - Maria Isabel Aldinhas Ferreira, Joao Silva Sequeira, & Rodrigo Ventura (eds)

68. Scripts, Goals, and Planning - Roger C. Schank & Robert P. Abelson

69. Reasoning About Plans - James F. Allen, Henry A. Kautz, Richard N. Pelavin, & Josh D. Tenenberg

70. Generating Abstraction Hierarchies: An Automated Approach to Reducing Search in Planning - Craig A. Knoblock

71. Representations of Commonsense Knowledge - Ernest Davis

72. Approaches to Knowledge Representation - G.A. Ringland & D.A. Duce

73. Knowledge Representation - John F. Sowa

74. Conceptual Structures: Information Processing in Mind and Machine - John F. Sowa

75. Inside Computer Understanding - Roger C. Schank & Christopher K. Riesbeck

76. Integrating Rules and Connectionism for Robust Commonsense Reasoning - Ron Sun

77. Probabilistic Logic Networks - Ben Goertzel, et al.

78. The Subtlety of Sameness: A Theory and Computer Model of Analogy Making - Robert M. French

79. Analogy Making as Perception - Melanie Mitchell

80. Real World Reasoning - Ben Goertzel, et al.

81. Artificial General Intelligence - Ben Goertzel & Cassio Pennachin

82. The Hidden Pattern: A Patternist Philosophy of Mind - Ben Goertzel

83. Engineering General Intelligence - Volume 2 - Ben Goertzel, Cassio Pennachin, & Nil Geisweiller

84. Computation and Cognition - Zenon W. Pylyshyn

85. Universal Artificial Intelligence - Marcus Hutter

86. The Cambridge Handbook of Computational Psychology - Ron Sun

87. Handbook of Neuroevolution Through Erlang - Gene I. Sher

88. Readings in Cognitive Science: A Perspective from Psychology and Artificial Intelligence - Allan Collins & Edward E. Smith -- this one contains a LOT of seminal papers in the field, including one of the earliest papers on Semantic Networks by Ross Quillian. I actually put this on the wrong part of the list, as I'm about halfway through reading this one, but just remembered it and didn't want to renumber everything. Heh.

Eh, that's a pretty good chunk of the stuff I've got lying around here, waiting to be read. There's a handful of others, but my fingers are getting numb.

thread

jalanbMar 2017

I implemented it in Python (while reading from that LISP version, a Java version, and Melanie Mitchell's "Analogy-Making as Perception"): https://github.com/jalanb/co.py.cat

thread