What is Base Rate Neglect?

Ask a team how long their project will take and they will talk about their project: the architecture, the people, the plan. Ask how long projects like this one usually take, and the room goes quiet. That silence is base rate neglect, and it is one of the most reliable ways a services firm misprices its own future.

The inside view and the outside view

The bias was identified in the judgement research of Daniel Kahneman and Amos Tversky in the 1970s: given a vivid description of an individual case, people largely ignore the prior probabilities, the base rates, that should anchor their answer. Kahneman and Dan Lovallo later gave the business version its enduring names. The inside view builds a forecast from the particulars of the case at hand. The outside view treats the case as one instance of a class and starts from how the class has behaved.

Kahneman tells the story on himself in Thinking, Fast and Slow. A team he belonged to estimated it would finish writing a textbook in around two years. A colleague, asked how comparable teams had fared, reported that those that finished at all had taken far longer. The team heard the base rate, wrote it down, and carried on planning from the inside view anyway. The systematic result, plans clustering near the best case while outcomes do not, is what Kahneman and Tversky called the planning fallacy.

Why the details win

The inside view feels like knowledge. The specifics of this project, this team and this client feel like information, while the base rate feels like a statistic about other people. Every project believes itself the exception: a stronger team, a clearer scope, lessons genuinely learnt from last time. Sometimes that is even true. But the projects in the reference class believed it too, and their outcomes already include the effect of everyone believing it.

In commercial settings the bias is compounded by incentives. Bent Flyvbjerg, who has studied estimation failure in large projects for decades, distinguishes optimism bias, the honest inside-view error, from strategic misrepresentation, the deliberate shading of estimates to win approval or win work. A services firm at bid time is exposed to both at once: the delivery team genuinely believes the happy path, and the pursuit team needs to.

Reference-class forecasting, the corrective

Flyvbjerg, building directly on Kahneman and Tversky, turned the outside view into a method: reference-class forecasting. Identify a class of comparable past projects. Establish the distribution of their actual outcomes: durations, costs, overruns, abandonments. Then position the current project within that distribution, adjusting only where there is strong evidence that this case genuinely differs. The method has been adopted in government appraisal of major projects precisely because it removes the estimate from the hands of the people most captivated by the particulars.

The deeper move is that the burden of proof flips. The inside view asks the sceptic to prove the plan wrong. The outside view starts from what the class did and asks the plan to earn its claimed exceptionalism. Most plans cannot, and knowing that before the commitment is signed is worth more than any amount of post-hoc explanation.

One concrete example

Clearly illustrative, with no customer implied. A mid-size integrator is bidding a fixed-price migration of a client’s claims platform. The inside view is impressive: a detailed work breakdown, named people, a plan that lands in nine months. Then a partner asks the outside question: of the comparable migrations this firm has delivered over the years, how many finished inside their original estimate, and by how much did the others miss? Nobody knows. The invoices exist. The lessons-learnt decks exist, unread. But nothing anywhere pairs what was estimated with what actually happened. The firm has run this experiment a dozen times and thrown away the results every time. The version of this firm that had kept them would open the distribution, see where nine months sits in it, and price the bid, phase it, or decline it with open eyes.

You can only consult a base rate you kept

The outside view is not a mindset, it is an asset: only a firm that keeps a record of how its projects actually went, paired against what was promised, has base rates of its own to consult. This is the working argument for an Outcomes Ledger: when every significant decision is scored against what was expected, the estimate-versus-outcome pairs accumulate, and reference classes stop being something you borrow from published studies and become something you own. It is also a question of institutional memory: a base rate that lives in one veteran’s intuition leaves with them.

The evidence hierarchy gives the distinction teeth. An inside-view estimate enters as modelled evidence at best, and as merely stated at worst. A base rate drawn from your own scored outcomes is measured. A decision layer that weights confidence by evidence quality will therefore trust the outside view more than the plan’s self-belief, which is exactly the discipline Kahneman was asking for. That, in the end, is what Decision Intelligence makes routine: the next estimate starts from what the firm has lived, not from what the room hopes.