pull down to refresh

Revisions are not a failure of economic statistics — they are the tradeoff of receiving a rough but timely signal.

Every time the government releases major revisions to employment data, a familiar chorus emerges: claims that something must be wrong, that statistics are being manipulated, or that hidden agendas are at work.

A government that is consistently mendacious — regardless of which party holds power — will, needless to say, tend to cultivate conspiratorial instincts among the public. Yet much of the commentary simply misunderstands how economic measurement actually works. Revisions are not evidence of conspiracy; they are evidence that statisticians are updating early estimates with better information.

In a world where people demand timely data, revisions are the unavoidable cost of speed. If we want to understand what is happening in the labor market right now — not a year from now — then we have to accept that the first draft of the numbers will evolve, sometimes substantially.

Revisions are the price of monthly unemployment data. Imagine being asked to give details of a boat heading to shore while you’re on the pier: at 10 miles, you ascertain very rough details; at 2 miles, more detail is seen; and at one mile, or when the ship arrives, your observations are about as good as they can get.

The United States is both a massive and a massively complex economy, and for that reason early payroll estimates rely on incomplete surveys, statistical modeling, and assumptions about seasonal patterns; later revisions incorporate more complete employer reports and administrative data. The fact that the picture becomes clearer over time is not a flaw — it is precisely what should happen when measurement improves. And just as with observations coming into focus, the updated picture may involve adding or eliminating early indications.

https://thedailyeconomy.org/article/economic-data-revisions-show-the-limits-of-real-time-measurement-not-malfeasance/

That's a good description and it can help people think about how to better criticize revisions.

For instance, if there's a regular pattern to the revisions, then the process being used to form the early estimates is biased.

reply