Did you know? · Science & Medicine

Leo Szilard linked information and thermodynamics

In his Berlin research of the 1920s, Leo Szilard showed a deep connection between information and entropy, making him a founding figure of information theory.

Leo Szilard
Leo Szilard · 1898–1964
Person
Leo Szilard
Lived
1898–1964
Field
Nuclear physics
From
Hungarian-American

The story

Maxwell's demon is a famous thought experiment devised by the physicist James Clerk Maxwell in the nineteenth century. A tiny being sorts fast and slow gas molecules between two chambers, seemingly creating order for free and defying the second law of thermodynamics, which says that disorder, or entropy, in a closed system never decreases. Many physicists thought the puzzle insoluble.

Leo Szilard, a young Hungarian Jewish student in Berlin who attended lectures by Albert Einstein, Max Planck and Max von Laue, took it on. His doctoral thesis on thermodynamic fluctuations, praised by Einstein, won top honours in 1922. Soon afterwards he wrote a second paper, On the reduction of entropy in a thermodynamic system by the intervention of intelligent beings, which he used for his habilitation lecture in 1927 and published in 1929.

That paper introduced a thought experiment now called the Szilard engine, in which a single gas molecule in a box is used to do work once its position is known. Szilard showed that a real demon must measure the molecules, and that acquiring and using that information has an unavoidable cost in entropy, enough to save the second law. The paper also contained the first equation linking information with negative entropy.

This was the first time anyone of note had recognised the connection between thermodynamics and information. Szilard did not pursue the topic further, but the idea fed into the cybernetics of Norbert Wiener and the information theory of Claude Shannon in the 1940s and 1950s. John von Neumann pointed out that Szilard had been the first to equate information with entropy.

Later physicists, including Léon Brillouin, Rolf Landauer and Charles Bennett, refined the argument, showing in particular that erasing information carries a minimum energy cost. In 2012 experimenters measured that limit using a tiny particle, and in 2014 a team led by the physicist Pekola built a working Szilard engine.

The insight is central to modern research on the physical limits of computation, explaining why a computer must release at least a minimum amount of heat whenever it erases information.

Why it matters

Szilard's insight underlies today's understanding of the energy cost of computing and the physics of information.

About Leo Szilard

Physicist who conceived the nuclear chain reaction in 1933, drafted Einstein’s letter to Roosevelt, co-built the first reactor, then campaigned for the rest of his life against nuclear war.

Read the full profile
Leo Szilard
1898–1964 · Nuclear physics
View profile →

More about Leo Szilard

Sources

Another act of tikkun olam. This is part of tikkun olam, the Jewish idea of repairing the world, and every one of us can add to it.

More in Science & Medicine

On kindness & the treatment of others
“A friend is devoted at all times; a brother is born to share adversity.”
Proverbs 17:17