Affiliation: University of California, Davis

Co-presenter: Simine Vazire

Poster title: Quantifying credibility: Assessing quality, evidence, and claims in social and personality psychology research

Abstract: The credibility of psychology research has been questioned in recent years with increased attention to questionable practices, ‘failures’ to replicate, and the detection of errors, bias, and fraud within the published literature. Quantifying research quality presents a central challenge to metascientists, and without the ability to estimate and access quality, self-correction is unlikely to occur. This project combines a multi-method approach of webscraping, automation, human coding, and subjective ratings to broadly investigate research quality, strength of evidence, and the calibration of claims within the last 10 years of publications in several social and personality psychology journals.