Method 01
Poll misses move together — the simulation moves with them
Schematic · illustrative
Independent errors
Races miss on their own. The seat distribution comes out absurdly tight — and confidently wrong in years like 2016 and 2020.
Correlated errors
A national miss shifts every race together. We fit the amounts from 20,466 past polls — a national miss of about 3.3–3.8 points, and a race-specific part of about 4.0–4.6 — fitted separately for each chamber.
What Every forecast is 40,000 simulated elections. When polls miss, they miss together — in 2016 the state errors ran about five points in one direction, in 2020 about four — so the simulation moves races together instead of pretending each race misses alone. The two amounts come from the data, not our judgment: a national miss of about 3.3–3.8 points, and a race-specific part of about 4.0–4.6, fit separately for each chamber from 20,466 historical polls in the FiveThirtyEight archive.
Models that treat every race's error as independent produce seat counts that are far too tight — and get confidently wrong in years like 2016 and 2020, when the polls missed in one direction.
Why it matters
Against the field · 2 comparisons
FiveThirtyEight (classic)
whyalwaysrose / 538 methodology review
They — Also simulated correlated errors — credit where due. But the correlation scales were largely asserted judgment calls.
We — We fit the national vs. race-specific split per chamber from the archive. Independent analysts found asserted scales ran about 14% too narrow; fitting closes that gap.
The Economist
The Economist election model (open source); Linzer 2013 dynamics; Gelman martingale critique
They — Fully Bayesian and open-source (built in R and Stan): a dynamic fundamentals-plus-polls model with state-correlated errors. The principled version of this idea.
We — Ours is the simulation-based analogue — the same honest uncertainty, but with per-chamber scales fitted from history, continuous refit as polls land, and outputs you can audit race by race without statistics software.