Conference on Reproducibility and Replicability in Economics and Social Sciences (CRRESS)

A series of virtual and in-person panels on reproducibility, replicability, and transparency in the social sciences.

Project Information

Authors: Aleksandr Michuda (Swarthmore College) and Lars Vilhuber (Cornell University)

Funding: NSF Award #2217493

Summary

The Conference on Reproducibility and Replicability in Economics and the Social Sciences (CRRESS) was a series of virtual and in-person panels on the topics of reproducibility, replicability, and transparency in the social sciences. The purpose of scientific publishing is the dissemination of robust research findings, exposing them to the scrutiny of peers and other interested parties. Scientific articles should accurately and completely provide information on the origin and provenance of data and on the analytical and computational methods used. Yet in recent years, doubts about the adequacy of the information provided in scientific articles and their addenda have been voiced.

The conferences addressed various topics in this area: the initiation of research, the conduct of research, the preparation of research for publication, and the scrutiny after publication. Undergraduates, graduate students, and career researchers were able to learn about best practices for transparent, reproducible, and scientifically sound research in the social sciences. The materials produced during the conference series are permanently archived and freely available to all interested parties.

Outcomes

The conference series consisted of 10 webinar sessions held during the 2022-2023 academic year, with a total of 149 registered participants. Sessions covered topics including:

  • Institutional support for reproducibility verification
  • Reproducibility and ethics
  • Teaching reproducibility in undergraduate and graduate education
  • Reproducibility with confidential and proprietary data
  • Disciplinary differences in reproducibility requirements
  • Funder and institutional requirements for reproducible archives

All sessions were recorded and are available on YouTube and archived in Cornell University’s eCommons repository.

The conference resulted in multiple publications in the Harvard Data Science Review’s Special Section on Reproducibility and Replicability and the ongoing Reinforcing Reproducibility and Replicability column, edited by Lars Vilhuber.

Further Information

For complete details, including session information, recordings, publications, and references, see the full outcomes report.

Website: https://labordynamicsinstitute.github.io/crress/

Online Book: https://labordynamicsinstitute.github.io/crress-book/