Contacts
Info
EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization:...
show more
EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.
show less
Episodes & Posts
Episodes
Posts
23 JUN 2026 · Why does the human brain operate on roughly twenty watts while modern artificial intelligence systems consume megawatts?The answer begins with an unexpected claim: information is physical.For decades, information was treated as an abstract mathematical object—a sequence of symbols detached from the material world. But twentieth-century physics revealed something deeper. Every bit of information must be embodied in a physical system: a neuron, a transistor, a magnetic domain, a molecule of DNA.Once information becomes physical, it must obey the laws of physics.In this episode, we trace the surprising connection between information, entropy, memory, and energy. We explore how Claude Shannon transformed information into a measurable quantity, how Maxwell's Demon challenged the Second Law of Thermodynamics, and how Rolf Landauer discovered the hidden thermodynamic cost of erasing information.Along the way, we connect these ideas directly to modern artificial intelligence. Training a neural network is not simply a computational process—it is a continuous cycle of correction, revision, and controlled forgetting. Every update rewrites internal states. Every rewrite has a physical cost.The result is a startling conclusion:"The universe does not charge for knowing. It charges for forgetting."Estimated Difficulty: IntermediatePrerequisites: NoneHelpful Background: Basic familiarity with AI, computers, or high-school physics will enhance the experience, but all major concepts are introduced from first principles.Topics Covered
- Information Theory
- Entropy
- Thermodynamics
- Claude Shannon
- Maxwell's Demon
- Leó Szilárd
- Rolf Landauer
- Charles Bennett
- Landauer's Principle
- Artificial Intelligence
- Neural Networks
- Backpropagation
- Gradient Descent
- GPU Architecture
- Data Center Energy Consumption
- Silicon vs Biology
- Reversible Computing
- Neuromorphic Computing
- Physics of Intelligence
People Mentioned
- Claude Shannon (1916-2001) - Founder of modern information theory.
- James Clerk Maxwell (1831–1879) - Creator of Maxwell's Demon.
- Leó Szilárd (1898–1964) - Connected information and thermodynamics in 1929.
- Rolf Landauer (1927–1999) - IBM physicist.
- Charles Bennett - Extended Landauer's work and helped resolve Maxwell's Demon.
Recommended ReadingBeginnerThe Information - James GleickA narrative history of information theory and communication.Link: https://eigenstate.captivate.fm/the-information-james-gleickHow to Create a Mind - Ray KurzweilExplores intelligence from biological and computational perspectives.Link: https://eigenstate.captivate.fm/how-to-create-a-mind-ray-kurzweilIntermediateGödel, Escher, Bach - Douglas HofstadterOne of the deepest explorations of information, intelligence, and self-reference ever written.Link: https://eigenstate.captivate.fm/godel-escher-bach-douglas-hofstadterThe Emperor's New Mind - Roger PenroseA physicist's critique of computational theories of mind.Link: https://eigenstate.captivate.fm/the-emperors-new-mind-roger-penroseAdvanced5. Information Theory, Inference and Learning Algorithms - David MacKayOne of the definitive texts connecting information theory and machine learning.Link: https://eigenstate.captivate.fm/information-theory-david-mackayPRIMARY SOURCES
- Claude Shannon (1948) - A Mathematical Theory of Communication
- Rolf Landauer (1961) - Irreversibility and Heat Generation in the Computing Process
- Charles Bennett (1982) - The Thermodynamics of Computation
- Leó Szilárd (1929) - On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings
These papers form the historical foundation of modern information theory, thermodynamics of computation, and the physics of intelligence.Support EigenStateEigenState is independently researched, written, recorded, and produced.If you would like to support future episodes:
- Support the podcast
- Sponsor EigenState: https://eigenstate.captivate.fm/sponsor-kit
- Share the episode
- Leave a rating on Spotify or Apple Podcasts
- Send the episode to someone who enjoys physics, mathematics, or AI
Next EpisodeThe Geometry of Intelligence: Why Thoughts Need CoordinatesIn the next episode, we move from the laws of thermodynamics to the laws of geometry and explore why linear algebra became the language of intelligence itself.Website: https://www.eigenstate.devNewsletter: https://www.eigenstate.dev/newsletterContact: aditya@eigenstate.dev
EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization:...
show more
EigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.
show less
Information
| Author | Shinde Aditya |
| Organization | Shinde Aditya |
| Categories | Physics , Technology , Mathematics |
| Website | www.eigenstate.dev |
| - |
Copyright 2026 - Spreaker Inc. an iHeartMedia Company
