1.1. Reproducibility and replicability

Scientific research practices under the microscope

About these materials

Welcome! This workshop is intended to provide learners with an introduction to key challenges and threats in scientific research. It explores different forms of research bias, statistical uncertainties, and common sources of errors that can affect the reliability and reproducibility of research findings. Through practical examples and research scenarios, the presentation encourages critical analysis of questionable research practices and their impact on scientific integrity. It also reflects on current systemic challenges in research culture and discusses the importance of developing more transparent, robust, and alternative approaches to conducting and evaluating research.

Who are these materials for?

The target audience of this workshop is twofold:

  • Self-learners with no prior experience with Open Science and/or issues around reproducibility and replicability, who are interested in diving deeper into these topics through a combination of real-world scenarios and practical exercises. You can follow these materials by chronologically going through the slides and following along the practical exercises. You go at your own pace and within your own timeframe. Presenter notes will help you to understand and reflect on the content of the materials. Note: Group exercises are not possible in this asynchronous setting.

  • Instructors in higher education (e.g., universities, colleges) aiming to convey the content of these materials to their learners in a synchronous (in-person, virtual or hybrid) class-room setting. The slides can be directly presented in full screen below, with presenter and instructor notes providing detailed information about the content of the materials and valuable pedagogical tips how to convey the materials to your learners. You can also download the PowerPoint corresponding to the materials below and adapt the materials to your learners. Make sure to give appropriate credit to the original authors.

Prerequisites

Prerequisite Description Link/Where to find it
UNESCO Recommendations on Open Science Recommended reading: pp 6-19 Download Link

Learning goals

  • Recognize different types of challenges in research: research biases, statistical insecurities, errors and where they can arise from
  • Analyze research scenarios to identify potential research biases and questionable research practices
  • Reflect on the current threats for research and on the need for alternative approaches to conducting research

Materials

Click here to see the materials in full Screen

Supplementary files - TO DO

Practical exercises - solutions

Download the solutions for the practical exercises here:

Helpfiles

Download the csv file for the example data:

Export slides

You can export these slides as PowerPoint by pressing the button below. Note that basic formatting will be applied. MAKE powerpoint template to use for export.

Contributors and licence details

Creator: Von Grebmer zu Wolfsthurn, Sarah (orcid logo 0000-0002-6413-3895)

Reviewer: Schönbrodt, Felix (orcid logo0000-0002-8282-3910)

Consultant: Ihle, Malika (orcid logo 0000-0002-3242-5981)


Creative Commons Attribution 4.0

This work was originally created by Felix Schönbrodt under a CC-BY 4.0 Creative Commons Attribution 4.0 International License. This current work by Sarah von Grebmer zu Wolfsthurn, Malika Ihle and Felix Schönbrodt is licensed under a CC-BY-SA 4.0 Creative Commons Attribution 4.0 International SA License. It permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited. If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.