The original long form post can be found here:
Model Risk: When Your Mental Map Becomes the Failure Point
In 2008, financial institutions discovered that their risk models, sophisticated mathematical frameworks built by the brightest quantitative minds, had catastrophically failed. The models said the portfolios were safe. Reality disagreed. The mismatch didn’t come from calculation errors or data problems. It came from the models themselves: they were buil…
In 2008, financial institutions learned a hard lesson about model risk. Their risk models, built by elite quantitative teams, said portfolios were safe. Reality disagreed. The failure did not come from bad arithmetic or faulty data. It came from assumptions embedded in the models that quietly stopped being true. When those assumptions broke, the system collapsed, and the Great Recession followed.
This is model risk. It is not the risk of executing the wrong plan, or even measuring poorly. It is the risk of measuring the wrong thing altogether. The failure is not that the arrow missed the target, but that the archer was playing a different game.
Every system runs on models. Organizations, technologies, movements, and institutions all operate with assumptions about what success means, how it is achieved, and how progress will be measured. Most of these models are implicit. They live in habits, procedures, spreadsheets, and mental shortcuts. All are simplifications of reality. When those simplifications diverge too far from what is actually happening, systems fail, often without warning.
Model risk shows up everywhere. Mental models shape how managers motivate, how doctors diagnose, how engineers design, and how leaders decide. Operational models encode assumptions into processes that often outlive their usefulness. Analytical models, wrapped in the appearance of rigor and precision, are especially dangerous. They look authoritative even when they are confidently wrong.
The most dangerous assumptions are invisible ones. Models assume stability where none exists, linearity where systems are nonlinear, and tidy distributions where reality has fat tails. Parameters drift slowly until forecasts degrade, or they break suddenly when shocks occur. Overfitting creates the illusion of accuracy by perfectly explaining the past while failing the future.
Organizations run on forecasts, and forecasts are models. Budgeting, staffing, and capital planning all depend on assumptions about a future that will not arrive as expected. When organizations are designed to require accurate forecasts in order to function, model error becomes organizational fragility.
The solution is not better prediction. It is better systems. Make models explicit. Track which decisions depend on which assumptions. Monitor for signs that models are breaking. Build slack, flexibility, and feedback. Favor robustness over optimization. Above all, maintain epistemic humility.
All models are wrong. Some are useful. The danger begins when we mistake the map for the territory and follow it even as the ground shifts beneath our feet. Models will fail. The real question is whether the system collapses when they do, or adapts.
The territory keeps changing. The map must change with it. And the system must survive even when it has not.