-
Recent Posts
Recent Comments
Archives
- January 2026
- October 2025
- March 2020
- November 2019
- October 2019
- March 2019
- September 2018
- June 2018
- May 2017
- April 2017
- February 2017
- December 2016
- September 2016
- August 2016
- June 2016
- November 2015
- September 2015
- April 2015
- October 2014
- July 2014
- May 2014
- April 2014
- March 2014
- February 2014
- January 2014
- December 2013
- July 2013
- May 2013
- April 2013
- February 2013
- November 2012
- October 2012
- September 2012
- August 2012
- July 2012
- May 2012
- April 2012
- February 2011
- December 2010
- November 2010
Posts on reproducibility
Meta
Category Archives: Uncategorized
A Most Courageous Act
The most courageous act a modern academic can make is to say they were wrong. After all, we deal in ideas, not things. When we say we were wrong, we are saying our ideas, our products so to speak, were … Continue reading
Posted in Uncategorized
3 Comments
A Commitment to Better Research Practices (BRPs) in Psychological Science
Scientific research is an attempt to identify a working truth about the world that is as independent of ideology as possible. As we appear to be entering a time of heightened skepticism about the value of scientific information, we feel … Continue reading
Posted in Uncategorized
1 Comment
Andrew Gelman’s blog about the Fiske fiasco
Some of you might have missed the kerfuffle that erupted in the last few days over a pre-print of an editorial written by Susan Fiske for the APS Monitor about us “methodological terrorists”. Andrew Gelman’s blog reposts Fiske’s piece, puts … Continue reading
Posted in Uncategorized
Leave a comment
The Power Dialogues
The following is a hypothetical exchange between a graduate student and Professor Belfry-Roaster. The names have been changed to protect the innocent…. Budlie Bond: Professor Belfry-Roaster I was confused today in journal club when everyone started discussing power. I’ve taken … Continue reading
Posted in Uncategorized
19 Comments
Please Stop the Bleating
It has been unsettling to witness the seemingly endless stream of null effects emerging from numerous pre-registered direct replications over the past few months. Some of the outcomes were unsurprising given the low power of the original studies. But … Continue reading
Posted in Uncategorized
8 Comments
We Need Federally Funded Daisy Chains
One of the most provocative requests in the reproducibility crisis was Daniel Kahneman’s call for psychological scientists to collaborate on a “daisy chain” of research replication. He admonished proponents of priming research to step up and work together to replicate … Continue reading
Posted in Uncategorized
3 Comments
Yes or no? Are Likert scales always preferable to dichotomous rating scales?
What follows below is the result of an online discussion I had with psychologists Michael Kraus (MK) and Michael Frank (MF). We discussed scale construction, and particularly, whether items with two response options (i.e., Yes v. No) are good or bad … Continue reading
Posted in Uncategorized
2 Comments
The New Rules of Research
by Brent W. Roberts A paper on one of the most important research projects in our generation came out a few weeks ago. I’m speaking, of course, of the Reproducibility Project conducted by several hundred psychologists. It is a tour … Continue reading
Posted in Uncategorized
8 Comments
What we are reading in PIG-IE 9-14-15
Last week, we read Chabris et al (2015) The fourth law of behavior genetics another in a series of lucid papers from the GWAS consortium. This week, with Etienne LeBel in town, we are reading the OSF’s Reproducibility Report.
Posted in Uncategorized
Leave a comment
Be your own replicator
by Brent W. Roberts One of the conspicuous features of the ongoing reproducibility crisis stewing in psychology is that we have a lot of fear, loathing, defensiveness, and theorizing being expressed about direct replications. But, if the pages of our … Continue reading
Posted in Uncategorized
3 Comments