That being said, econ is often testing the effects of one-time events or programs that ripple through the broader economy. I don't know that you'd expect to replicate findings if you use the "same methodology on different data" -- Those new data may be generated from a completely different economic environment.
It's not like testing a new teaching method and you replicate the teaching method on other classrooms.
Still, this does feel like a black eye for econ, which often looks down on the methodological rigor of the other disciplines.
Never asked myself that! (Then again, I'm into chess... Queen most powerful piece, King sort of a wimp... Made sense to me)
Can't speak to the underlying survey/methods here, but you could consider a study to replicate if it's directionally the same as others and/or theory, e.g., minimum wage laws always resulting in negative labor outcomes — instead of, as I recall the published literature here, a whole scatterplot flurry of effect sizes and signs.
The tricky thing is what "same methodology, different data" means for economics. Replication is genuinely hard because the data sources are varied, and minimum wage applied in various settings could indeed have different effects. That wouldn't be a replication crisis, just an acknowledgment that effects are highly context dependent.
Ouuwh. Fancy... Econ, the queen of the social sciences, not doing so well??
Queen? Who's the King?
That being said, econ is often testing the effects of one-time events or programs that ripple through the broader economy. I don't know that you'd expect to replicate findings if you use the "same methodology on different data" -- Those new data may be generated from a completely different economic environment.
It's not like testing a new teaching method and you replicate the teaching method on other classrooms.
Still, this does feel like a black eye for econ, which often looks down on the methodological rigor of the other disciplines.
Never asked myself that! (Then again, I'm into chess... Queen most powerful piece, King sort of a wimp... Made sense to me)
Can't speak to the underlying survey/methods here, but you could consider a study to replicate if it's directionally the same as others and/or theory, e.g., minimum wage laws always resulting in negative labor outcomes — instead of, as I recall the published literature here, a whole scatterplot flurry of effect sizes and signs.
The tricky thing is what "same methodology, different data" means for economics. Replication is genuinely hard because the data sources are varied, and minimum wage applied in various settings could indeed have different effects. That wouldn't be a replication crisis, just an acknowledgment that effects are highly context dependent.
https://twiiit.com/kareem_carr/status/2040519504317276188