How to Reduce Inconsistent Judgments in Decision-Making

You assume your judgment is stable.

It isn’t.

Even when the facts are identical, human decisions vary more than most people realize.

That variability has a name: noise.

What Is Noise in Decision-Making?

According to Daniel Kahneman and colleagues, noise is unwanted variability in judgments that should be identical when based on the same information.

Examples documented in research include:

• Two judges giving different sentences for similar crimes
• Two doctors diagnosing identical patients differently
• Two hiring panels rating the same candidate inconsistently
• Even the same professional making different judgments on different days

This variability exists not only because of bias, but because human judgment is inherently variable.

Bias pushes decisions in one direction.

Noise scatters them unpredictably.

Both create error.

Why Noise Matters in Organizations

In large “noise audits,” interchangeable professionals reviewing identical cases showed wide spreads in decisions, sometimes dramatically different outcomes.

Research summarized in Noise: A Flaw in Human Judgment shows that:

• Performance ratings vary widely across managers
• Insurance underwriters quote different premiums for identical files
• Sentencing decisions shift across judges and days

Noise often goes unmeasured.

Because inconsistency feels normal.

But over time, that variability can rival bias in its cost to organizations.

Daniel Kahneman’s Noise Reduction Framework (Decision Hygiene)

The solution is not “try harder.”

It’s structure.

Before reviewing a specific case:

1. Identify the key factors that should influence the decision
2. Assign relative weights to those factors
3. Create a simple scoring system
4. Document the criteria in advance

Then evaluate each case against those fixed criteria.

This approach often called decision hygiene, reduces both noise and bias by limiting improvisation.

Review the criteria periodically.

But don’t rewrite the rules mid-decision.

Because adjusting standards while evaluating reintroduces variability.

Why Pre-Commitment Improves Judgment

Pre-committing to structured criteria separates:

• Designing the decision process

  from

• Executing the decision itself

This reduces mood effects, contextual influence, and unintended drift.

Structure works best when applied consistently.

That requires cognitive steadiness, especially in high-stakes environments.

Numin is designed to support sustained decision clarity, helping maintain focus and consistency once criteria are set. It doesn’t replace structure, it helps you hold it.