Robert Shiller

Robert Shiller proved through data that stock market prices exhibit far more volatility than fundamental values can explain — evidence that psychology and emotion drive markets more than pure rationality.

The volatility puzzle

In 1981, Shiller published a landmark paper showing that stock market prices are far too volatile to be justified by changes in expected future dividends. If markets were rational and efficient, stock price volatility should match the volatility of dividend expectations. Yet actual prices moved far more than fundamentals could explain.

This finding challenged the efficient market hypothesis. If prices were simply rational expectations of future cash flows, they shouldn’t fluctuate so wildly. The excess volatility suggested that psychology, speculation, and narrative were driving prices beyond what rational analysis justified.

Irrational exuberance and bubbles

Shiller’s book Irrational Exuberance, published in 2000, described how investor psychology drives asset bubbles. He identified patterns in bubble cycles: initial innovation, investor enthusiasm, prices rising far beyond fundamentals, speculation by unsophisticated investors, and eventual crash.

The book was prescient — it was published just before the bursting of the dot-com bubble. Shiller’s framework seemed to perfectly explain what had happened: internet companies with no profits had been bid to absurd valuations, then crashed when reality set in.

The CAPE ratio and valuation metrics

Shiller developed the CAPE (Cyclically Adjusted Price-to-Earnings Ratio), which smooths out short-term earnings volatility to provide a longer-term valuation measure. The CAPE has become a widely-used tool for assessing whether markets are overvalued or undervalued relative to history.

By tracking the CAPE over decades, Shiller has documented when markets reached peaks associated with crashes (2000, 2007) and when they reached bottoms associated with subsequent recoveries (2009).

Behavioral economics and psychology

Shiller’s work contributed to the rise of behavioral economics, which studies how psychology affects economic decisions. He demonstrated that investors are not the rational agents assumed in traditional finance but are subject to herd behavior, overconfidence, and narrative-driven thinking.

This opened a new research agenda: understanding investor psychology and how it affects prices. Work by Shiller and others showed that investors anchor to past prices, extrapolate recent trends, and are overconfident in their predictions.

The challenge to efficient markets

Shiller’s work provided evidence against the efficient market hypothesis. If markets were efficient, prices shouldn’t exhibit such irrational volatility, and bubbles shouldn’t occur. The existence of bubbles — periods when prices diverge sharply from fundamentals — was evidence of market inefficiency.

Yet even Shiller acknowledges that the efficient market hypothesis is not entirely wrong. Markets are reasonably efficient most of the time; it’s during bubbles that psychology dominates and rationality breaks down.

The 2020s and recent work

Shiller has continued to analyze market bubbles and valuations. He warned of overvaluation in the 2010s. When the pandemic hit in 2020, he was cautious about the rapid recovery, seeing speculative excess. His approach remains consistent: identify when narratives have driven prices far from fundamentals, and recognize that crashes eventually occur.

Nobel Prize and legacy

Shiller shared the Nobel Prize in Economics in 2013, alongside Eugene Fama (whose efficient market hypothesis Shiller had challenged) and Richard Thaler (a behavioral economist). The award recognized that understanding markets requires incorporating behavioral and psychological factors, not just assuming rationality.

His influence on investing is substantial. Many value investors use his CAPE ratio or similar metrics to assess market valuation. Investors consider behavioral factors when making decisions. Regulators have incorporated behavioral insights into financial regulation.

See also