Contents
In 1854, the British Army sent cavalry into the wrong valley at Balaclava. The officers were trained, decorated, and certain enough to act. The result was the Charge of the Light Brigade: courage applied to a mistaken model.
Expertise did not fail because the officers knew nothing. It failed because the system lacked a way to test what they thought they knew before the cost became irreversible.
Complex systems punish untested certainty.
The Story
Tim Harford’s TED talk on trial and error attacks what he calls the God complex: the belief that a sufficiently smart person can reason from the top down to the correct answer in a complex situation.
Organizations reward the God complex constantly.
A senior executive announces a new pricing strategy after weeks of internal debate. The model is elegant. The deck is persuasive. The team rolls it out across every market at once. Within a quarter, churn rises among the highest-value customers. The model had assumed price sensitivity was evenly distributed. It was not.
A smaller test would have revealed the problem. The organization skipped the test because the answer looked too coherent to question.
Three Ways This Appears
In everyday life: Someone designs the perfect productivity system over a weekend. It accounts for priorities, goals, routines, energy, and reflection. By Wednesday it has collapsed because the system was designed for an ideal week, not an actual one.
In technology: A product team debates onboarding flows for a month. The strongest voice wins. A simple prototype with ten users would have produced better evidence in two days.
In organizations: A reorg is designed by people far from the daily work. The boxes are logical. The reporting lines are clean. The handoffs become worse because the informal coordination network was never tested against the new chart.
The Pattern
Experiments are not small because the stakes are small. They are small because the stakes are large.
The purpose of an experiment is to buy information before commitment becomes expensive. It reduces the cost of being wrong. It also disciplines expertise by forcing theories to meet reality in a place where reality can still be survived.
The enemy is not expertise. The enemy is expertise without feedback.
The Cross-Domain Connection: Natural Selection
Evolution does not design organisms by committee. It tries variation against an environment. Most variations fail. The system works because failure is local and continuous, not centralized and catastrophic.
Good organizations imitate this structure. They create safe-to-fail variation where the cost of learning is bounded. Bad organizations suppress variation until the only remaining experiment is the full-scale launch.
The Framework: Reversible Learning Loop
Why This Matters Outside Technology
Public policy, education, health, relationships, and personal change all suffer from the same temptation: planning as if intelligence can substitute for feedback. It cannot.
The serious question is not “what do we believe?” It is “what is the smallest honest encounter between this belief and reality?”
The Memorable Sentence
The experiment is the place where confidence pays rent to reality.
Closing Question
What current plan in your organization is still being debated as a theory when it could already be learning as an experiment?
- Harford, T. (2011). Trial, error and the God complex. TEDGlobal 2011.
- Harford, T. (2011). Adapt: Why Success Always Starts with Failure. Farrar, Straus and Giroux.
- Popper, K. (1959). The Logic of Scientific Discovery. Hutchinson.
By 2031, expert-like answers will be cheap and abundant, but reality will remain the better judge. The teams that improve fastest will turn expert claims into small experiments quickly, then keep the discipline to abandon the answer when evidence refuses it.