From The Chronicle of Higher Education

If you’re a psychologist, the news has to make you a little nervous—particularly if you’re a psychologist who published an article in 2008 in any of these three journals:Psychological Science, the Journal of Personality and Social Psychology,or the Journal of Experimental Psychology: Learning, Memory, and Cognition.

Because, if you did, someone is going to check your work. A group of researchers have already begun what they’ve dubbed the Reproducibility Project, which aims to replicate every study from those three journals for that one year. The project is part of Open Science Framework, a group interested in scientific values, and its stated mission is to “estimate the reproducibility of a sample of studies from the scientific literature.” This is a more polite way of saying “We want to see how much of what gets published turns out to be bunk.”

We should do this in economics.  But there is a less confrontational way to do it. Top departments in experimental economics attract PhD students who want hands on experience in the lab. These are departments like NYU and CalTech. They would benefit the profession, their students, and the reputation of their PhD programs, i.e. everybody concerned, if they were to add as a requirement that every student receiving a PhD must pick one recently published experimental article and attempt to replicate it.

Thanks to Josh Gans for the pointer.

Advertisements