The Most Misunderstood Concept in Physics
Veritasium27:142023-07-01English
Chapters
This Veritasium video uses heat engines, sunlight, and the evolution of the universe to explain entropy. The key thing Earth gets from the Sun isn't a net gain in energy, but a steady supply of low-entropy energy that can do more work than the energy Earth radiates away.
Overview
The Most Misunderstood Concept in Physics
- Street interviews raise the puzzle of why Earth still depends on the Sun even though its energy budget balances. The video then looks back at what motivated Sadi Carnot to study steam engines and shows how an ideal heat engine runs forward and in reverse.
- The video first explains why even a frictionless heat engine has to release heat, then introduces entropy and uses a model with metal rods and a Rubik's Cube to show why energy is more likely to spread out.
- An air conditioner shows how a local decrease in entropy is offset by a larger increase elsewhere. Earth's photon budget then explains why life depends on a low-entropy input and leads to the hypothesis that life may be an efficient energy-dissipating structure.
- The video explains why gravity makes the uniform early universe a low-entropy state, then discusses how black holes account for most of today's entropy and why heat death could make the arrow of time disappear.
Key points
- An ideal Carnot heat engine can run entirely in reverse, but being reversible doesn't mean it's 100% efficient. Its efficiency depends only on the absolute temperatures of the hot and cold sides. High-pressure steam engines in Carnot's day had a theoretical limit of about 32%, but their actual efficiency was about 3%.
- When energy dissipates, the total stays the same, but less of it is available to do work. Clausius summed up the first two laws of thermodynamics this way: The energy of the universe is constant, and the entropy of the universe tends toward a maximum.
- It's not impossible for heat to flow spontaneously from cold to hot. There are simply more microscopic arrangements in which the energy is evenly distributed. In the video's model, increasing the number of atoms in each metal rod from 8 to 80 reduces the probability that the hot rod becomes hotter than it was at the start from 10.5% to 0.05%.
- Entropy can decrease locally as long as it increases by more somewhere else. An air conditioner makes the indoors cooler and the outdoors warmer, but the energy dissipated in supplying power and running the unit still makes total entropy increase.
- Over the long term, Earth absorbs and radiates roughly equal amounts of energy. But for about every 1 high-energy photon it receives from the Sun, it emits about 20 lower-energy photons. Life depends both on this supply of low-entropy energy and on Earth's ability to release the dissipated energy into space.
- Once gravity is taken into account, the nearly uniform distribution of matter in the early universe turns out to be a low-entropy state, because gravity tends to draw matter together. According to the video's estimate, almost all of the entropy in the universe today is concentrated in black holes.
- The arrow of time comes from the tendency of systems to move from less probable states to more probable ones. But neither the lowest-entropy nor the highest-entropy state is necessarily complex, just as the patterns formed by milk in tea appear only briefly while the two are mixing.
Chapter notes
The puzzle of sunlight and Carnot's ideal heat engine
- In the street interviews, most people guess that Earth radiates less energy into space than it receives from the Sun. Some estimate it radiates 70%, while others think it's only 20%, because Earth uses some of it up. But energy doesn't get used up: For most of Earth's history, the energy absorbed and radiated should have been equal, or Earth would have kept getting hotter. So what exactly does the Sun give Earth?
- In the winter of 1813, 17-year-old Sadi Carnot wrote to Napoleon asking to join the fighting, but received no reply. A few months later, he joined a group of students defending a castle on the east side of Paris. Paris fell in just one day, and he was forced to retreat.
- Seven years later, Sadi Carnot went to Prussia to visit his father, who was both a general and a physicist. They discussed in depth the steam engines already being used to power ships, work mines, and excavate harbors. Steam engines were important to the future industrial and military strength of nations, and French designs lagged behind those of Britain and other countries. Sadi Carnot decided to find out why.
- Even the best steam engines of the day could turn only about 3% of their thermal energy into useful mechanical work. Sadi Carnot spent three years studying heat engines to improve their efficiency and imagined an ideal heat engine with no friction and no energy loss to the surroundings. The device uses two large metal blocks, one hot and one cold, as the heat source and heat sink. The air chamber can exchange heat only through its base, and the piston inside it is connected to a flywheel.
- When the chamber touches the hot metal block, the air absorbs heat and expands at a constant temperature, pushing the piston and turning the flywheel. Once the hot block is removed, the air keeps expanding without absorbing any more heat, and its temperature drops to match the cold block's. When the cold block is brought into contact with the chamber, the flywheel drives the piston to compress the air, which releases heat into the cold block. After the cold block is removed, the air is compressed further until its temperature is just below that of the hot block, which is then brought back into contact to start the next cycle.
- In the forward cycle, some of the heat supplied by the hot block becomes energy in the flywheel. In reverse, the air first expands and cools, then touches the cold block and keeps expanding while absorbing heat. The flywheel then drives the compression, raising the air's temperature, and finally the air comes into contact with the hot block and sends heat back into it. The engine can run backward for as many cycles as it ran forward, restoring everything to its original state without any extra energy input.
From heat engine efficiency to the probability of increasing entropy
- Even if the heat engine is completely reversible, the energy the flywheel gains in each cycle is only the heat absorbed at the hot side minus the heat released at the cold side. The efficiency is that difference divided by the heat absorbed. The gas on the hot side exerts more pressure on the piston, so it does more work as it expands than is needed to compress it on the cold side. Raising the hot-side temperature or lowering the cold-side temperature increases efficiency.
- When temperatures are measured in kelvins, the efficiency of an ideal heat engine is 1 minus the cold-side temperature divided by the hot-side temperature, regardless of the materials or design. Even without friction or heat loss to the surroundings, resetting the piston requires releasing heat to the cold side. Reaching 100% efficiency would require an infinitely hot hot side or a cold side at absolute zero. High-pressure steam engines in Carnot's day reached about 160°C at most, giving them a theoretical efficiency limit of 32%, while their actual efficiency was only about 3%.
- In real heat engines, friction, heat loss to the surroundings, and heat transfer at changing temperatures leave less energy in the flywheel and dissipate more into the cylinder walls, the flywheel shaft, and the surroundings. Total energy stays the same, but less is available to do work, and the process is irreversible. Rudolf Clausius called the measure of how spread out energy is entropy: Entropy is low when energy is concentrated in the hot rod and increases when the energy spreads into the surroundings.
- In 1865, Clausius summed up the first two laws of thermodynamics this way: The energy of the universe stays constant, and the entropy of the universe tends toward a maximum. Entropy is often described as a measure of disorder, but the video puts more emphasis on the tendency of energy to spread out over time. It uses that idea to explain why hot and cold objects tend to reach the same temperature, why gas fills its container, and why perpetual motion machines are impossible.
- In the model, there are 8 atoms in each metal rod. The left rod starts with 7 units of energy and the right with 3. Once the rods touch, units of energy can jump randomly between atoms in the two rods. Each specific arrangement is equally likely, and the total energy doesn't change. One snapshot shows 9 units on the left and 1 on the right, demonstrating that heat flowing from the cold side to the hot side isn't impossible, just unlikely. There are 91,520 arrangements for a 9:1 split and 627,264 for a 5:5 split, making an even split more than 6 times as likely.
- In the small model, the probability that the left rod ends up with more energy than it started with is 10.5%. Increasing each rod to 80 atoms and the starting energy to 70 units on the left and 30 on the right drops that probability to 0.05%. The same idea applies to a Rubik's Cube: There is only one solved state, few nearly solved states, and far more nearly completely scrambled states, so random turns are more likely to scramble a solved cube.
Air conditioning, sunlight, and life's source of low entropy
- An air conditioner moves heat from the cooler indoors to the warmer outdoors, reducing entropy indoors. But this requires a larger increase in entropy elsewhere. The concentrated chemical energy released by coal gradually spreads out as electricity is generated, transmitted, and used to run the air conditioner. The increase in entropy from waste heat produced by the power plant, wires, fans, and compressor exceeds the decrease indoors.
- If Earth were a closed system, energy would eventually spread out completely, everything would reach the same temperature, and life would stop. Instead, the Sun supplies a steady stream of concentrated, low-entropy energy. Plants use it to grow and make sugars, and animals get energy by eating to maintain their bodies and stay active. At every step in the food chain, the energy becomes more spread out.
- The solar energy Earth absorbs eventually turns into thermal energy, and an equal amount of energy is radiated back into space. The increase in entropy shows up in the photon count: For every 1 high-energy photon Earth receives, it emits about 20 low-energy photons. Life needs both a source of concentrated energy and a way to release the energy once it has spread out.
- One hypothesis is that life may be a result of the second law of thermodynamics: Life is good at turning low entropy into high entropy, speeding up the increase in entropy. For example, the surface layer of seawater produces 30% to 680% more entropy when cyanobacteria and other organic matter are present than when they are absent.
- Jeremy England goes further, suggesting that a steady supply of concentrated energy may favor the formation of structures that are good at dissipating energy. Over time, structures that dissipate energy more and more efficiently could emerge, eventually giving rise to life. Life on Earth depends on the low entropy supplied by the Sun, and the Sun's low entropy can in turn be traced back to the universe.
From the universe's initial state to black holes and heat death
- If the total entropy of the universe increases over time, working backward implies that entropy was lowest just after the Big Bang. The “Past Hypothesis” treats low entropy as an initial condition needed for the universe to evolve as it did, but it doesn't explain why that condition held. The early universe was hot and dense, with temperature differences of no more than 0.001%. But because gravity tends to draw matter together, an almost uniform distribution of matter was actually an extremely improbable, low-entropy state.
- As the universe expanded and cooled, gravity drew matter together, converting large amounts of potential energy into kinetic energy. Collisions then turned some of that kinetic energy into heat, reducing the energy available to do work and increasing entropy. Stars, planets, galaxies, and life formed in the process. In units of the Boltzmann constant, the early universe had an entropy of about 10⁸⁸. The combined entropy of all stars in today's observable universe is about 9.5×10⁸⁰. The interstellar and intergalactic media together have about 10 times as much entropy as the stars, while neutrinos and cosmic microwave background photons have even more.
- Jacob Bekenstein proposed that a black hole's entropy is proportional to its surface area. Critics argued that if a black hole had entropy, it should have a temperature and emit radiation, in which case it shouldn't be black. Stephen Hawking set out to disprove the proposal but found that black holes really do have a temperature and emit what is now called Hawking radiation. The radiation from the black hole at the center of the Milky Way, however, is too faint to detect. He also went on to determine the entropy of black holes.
- The supermassive black hole at the center of the Milky Way alone has an entropy of about 10⁹¹ times the Boltzmann constant. That's 1,000 times the entropy of the early observable universe and 10 times the combined entropy of all other particles. The combined entropy of all black holes is about 3×10¹⁰⁴ times the Boltzmann constant, accounting for almost all the entropy in the universe today.
- The universe moves from less probable states to more probable ones. Increasing entropy distinguishes the past from the future, creating the arrow of time. The last black hole is expected to evaporate more than 10¹⁰⁰ years from now, leaving energy fully spread out and the universe in its most probable state, known as heat death. At that point, even on large scales, there will be no way to tell whether time is moving forward or backward, and the arrow of time will disappear.
- Both low-entropy and high-entropy states have low complexity. There's not much of a pattern when the tea and milk are separate, but patterns appear when they first start to mix and disappear again once they're fully mixed. Complex structures appear and develop in the stage between low and high entropy.
What it answers
- If Earth radiates the energy it absorbs back into space, what exactly does the Sun give us?
- The Sun provides a steady supply of low-entropy energy that is more concentrated and can do more work than the energy Earth radiates away. Earth turns a smaller number of high-energy photons into about 20 times as many low-energy photons and emits them back into space.
- Why can't even a frictionless, ideal heat engine turn all the heat it absorbs into work?
- To return the piston to its original position and complete the cycle, the engine has to release heat to the cold side. To reach 100% efficiency, the hot side would have to be infinitely hot or the cold side would have to reach absolute zero.
- Why does heat almost always flow spontaneously from hot to cold?
- There are more microscopic arrangements in which energy is spread across the hot and cold sides, so those states are more likely to occur. Heat can flow the other way in a small model, but the probability drops steeply as the system gets larger.
- Why did the early universe have low entropy even though it was hot and uniform?
- Uniformity doesn't always mean high entropy. Under gravity, matter tends to clump together, so a nearly uniform distribution is highly unusual. The Past Hypothesis proposes that the universe began in a low-entropy state, but it doesn't explain why it started that way.
- Why might the heat death of the universe mean the arrow of time disappears?
- The video predicts that after the last black hole evaporates, energy will spread out to the point where the universe is in its most probable state. At that point, even on a macroscopic scale, there will be no way to tell from changes whether time is moving forward or backward.
Quotes
Energy is most usable when it is concentrated and less usable when it's spread out.
Heat flowing from cold to hot is not impossible, it's just improbable.
Without a source of concentrated energy and a way to discard the spread-out energy, life on Earth would not be possible.
The fact that we are going from unlikely to more likely states is why there is an arrow of time.
Mentioned
- Veritasium — The channel behind the video, whose host uses street interviews to introduce the question of Earth's energy budget.
- Sadi Carnot — Studied heat engines to understand steam engine efficiency and imagined a reversible, ideal heat engine.
- Lord Kelvin — Recognized that Carnot's ideal heat engine could serve as the basis for an absolute temperature scale.
- Rudolf Clausius — Introduced entropy after studying the Carnot heat engine and summed up the first two laws of thermodynamics in 1865.
- Ludwig Boltzmann — The video draws on his statistical perspective to explain why a decrease in entropy isn't impossible, just highly unlikely.
- Jeremy England — Suggested that a steady supply of concentrated energy may favor structures that are better at dissipating energy, and used that idea to propose a possible origin for life.
- Jacob Bekenstein — Proposed in 1972 that a black hole's entropy should be proportional to its surface area.
- Stephen Hawking — Set out to refute Bekenstein but discovered that black holes emit radiation and went on to determine their entropy.
- 熵 — The video uses it to describe how spread out energy is and explains its tendency to increase by counting microscopic arrangements.
- 过去假说 — Holds that the universe began in an extremely low-entropy state but doesn't explain where that initial condition came from.
- 时间箭头 — The macroscopic direction of time that arises as the universe moves from less probable states to more probable ones.
- 宇宙热寂 — The distant future described in the video: The last black hole evaporates, energy spreads out fully, and there is no longer any way to distinguish forward from backward in time on a macroscopic scale.