
One of the world's leading astronomers, Robert Kirshner, takes readers inside a lively research team on the quest that led them to an extraordinary cosmological discovery: the expansion of the universe is accelerating under the influence of a dark energy that makes space itself expand. In addition to sharing the story of this exciting discovery, Kirshner also brings the science up-to-date in a new epilogue. He explains how the idea of an accelerating universe -- once a daring interpretation of sketchy data -- is now the standard assumption in cosmology today. This measurement of dark energy -- a quality of space itself that causes cosmic acceleration -- points to a gaping hole in our understanding of fundamental physics. In 1917, Einstein proposed the "cosmological constant" to explain a static universe. When observations proved that the universe was expanding, he cast this early form of dark energy aside. But recent observations described first-hand in this book show that the cosmological constant -- or something just like it -- dominates the universe's mass and energy budget and determines its fate and shape. Warned by Einstein's blunder, and contradicted by the initial results of a competing research team, Kirshner and his colleagues were reluctant to accept their own result. But, convinced by evidence built on their hard-earned understanding of exploding stars, they announced their conclusion that the universe is accelerating in February 1998.
One of my favorite books from the past few decades is The Extravagant Universe, written by one of the astronomers who helped discover dark energy and develop the current most-accepted model of cosmology. I love this book because of the emphasis on physical process in astronomy. Part of the reason it took decades to study this problem is they need to collect data from supernovae. Those only happen so often in places we're looking. You can't automate alignment of the heavens. It happens when it happens.
To (1), he's talking about the distance ladder. Distances to various galaxies were computed by the teams involved in developing the LCDM model by scouring the skies for instances of type IA supernovae in this galaxies. When these are called "standard candles," what that means is that the luminosity is known and thus the distance can be computed using the inverse square law by comparing the observed brightness to the known luminosity. Historically, this wasn't a super-reliable method and yielded some bounded error rate for various reasons, including dust causing some reddening of the light that could be mistaken for redshift, as well as the fact that type IA supernovae are not all collapsing stars of exactly equal mass and you might catch them at different times after the initial supernova.
What Wheeler probably didn't realize at that point was the methods and frankly just downright tedious repeated measurement work over the course of decades that astronomers had been doing to make this more reliable and accurate. If you want to know all about this via first-hand account from one of the astronomers credited with the dark energy discovery, read The Extravagant Universe by Robert Kirschner. It's very accessible, not super-technical, but goes into painstaking detail on exactly how astronomers made the type IA work as a standard candle.
It's also just a great testament to the work involved in experimental astronomy, down to the logistics of convincing a scheduling committee for the various telescopes capable of seeing that far that what you're looking for is worth looking for.
I really, really wish science journalists could be as intellectually humble and conservative as the actual scientists.
Read The Extravagant Universe if you want one of the great all-time tales of experimental physics, describing the lengths to which astronomers go to collect data, how long it takes, and how reluctant they were to even claim they were explaining anything until they were absolutely sure, straight from the hand of one of the astronomers leading the collection team that discovered dark energy.
