Our book with Wiley on AI

Thanks, Nisha. Thanks for your kind words. I learned a lot from you, Wil and Michael. I enjoyed being your editor! I benefited greatly from ...

Tuesday, June 11, 2024

AI and the elusive explanation

 It has been spinning in my mind for sometime. I thought I would blog it. In a way, similar to how quantum physics grapples with the measurement problem, ChatGPT faces challenges with weights influencing its intelligence. No matter where we go it looks like man's reason is stumped. Quantum physicist are quite confused about the measurement issue. There appears multiple explanations of measurement and wave collapsing into particle. For me at least it appears varying. Trust me, I have been reading about it long enough to be an old patient to a doctor. I had a chance to read about parellel universe theory explained for the general audience by an Australian physicist some Dr.Wolf or someone three decades ago. Now chatGPT is much more intriguing than indeterminate and entangled atoms. As far as I am concerned nothing is more mystical than this. Quantum particle or wave felt like far off somewhere in the Nasa Lab. This is right here on your screen. You can run Karpathy's GPT right on your laptop to feel the magic. Magic wears out of course over a period like the radio wave of the mobile phone. But still it can be felt. You convert first the words into some numbers and then add them all up a billion times, stacked in 150 odd layers. Then you decode them back to words, and voila, you have meaningful, godlike intelligence. How is that possible? Numbers have some strange mystery hidden in them. We have been hearing that often. Some like Max Tegmark are saying math is basic unit of matter? Descartes said it long before them anyway. Ramanujam saw goddess Sarasvati in that equation where infinity turns into - 1/12. Jewish math genius Edward Frenkel says so. But that is not what the scientist in us was hoping to encounter. At least Geoff Hinton, the father of NeuralNet, does not claim to know how NeuralNet or ChatGPT really works. That is much like the Schrödinger equation. You know something but the essence remains unexplained. A similar pattern is observed in genes turning into a human or a rat! Some scientists claim, and maybe rightly so, that we share 80% of our genes with rats. ..