Preregistration part II: benefits, barriers and building up skills

Sara Lil Middleton

26/10/2026

Prerequisites

Important

Before completing this session, please carefully read about the prerequisites.

  • Completion of preregistration training materials (preregistration part I [coming soon!]

  • Access to Build up your preregistration toolkit! [coming soon]

Your study preregistration journey



From: “I am not sure what some of the opportunities are or how to overcome some of the challenges of doing a preregistration

To: ““I feel able discuss the benefits and barriers of preregistration and identify which part of a preregistration I can improve on”

Recap of key concepts in preregistration part I

Study preregistration is an open science practice that:

  • safe guards researchers from questionable research practices and biases by making decision-making processes more explicit.

  • involves uploading a time-stamped, publicly-available* record of a research study plan onto a register, which is given a unique and permanent study identifier.

  • *Preregistrations do not need to be made public immediately and can be embargoed for a period of years (e.g. Open Science Framework preregistrations can be embargoed for 4 years from first submission)

Questions from preregistration part I

Before we start: Survey time!

What is your level of familiarity with the key components of a preregistration (e.g., elements found in a preregistration document )?

How would you rate your confidence to carry out a preregistration for your study?

(1 to 5 scale: 1 = Not confident at all, 2 = Slightly confident, 3 = Somewhat confident, 4 = Very confident, 5 = Completely confident)

Discussion of survey results

What do we see in the results?

Learning goals

Aim: Examine the benefits of preregistration to researchers and wider research ecosystem, and discuss common challenges and how to address them.

There are two sections to this submodule:

  • Section 1: Benefits and barriers of preregistration

  • Section 2: Building up skills in preregistration

Section 1: Learning goals and overview

Section 1 is all about recognizing common benefits and barriers of preregistration for researchers and wider research ecosystem.

Activities: Quiz and self-reflection exercise

After completing section 1 you should be able to:

  • Explain the perceived barriers to doing a preregistration
  • Identify key benefits of preregistration

Section 2: Learning goals and overview

Section 2 is about practicing improving a component of a study preregistration.

Activity: Build up your preregistration toolkit! (individual work)

After completing section 2 you should be able to:

  • Self-reflect on challenging parts of the preregistration process
  • Practice improving elements of a preregistration

Section 1: Benefits and barriers of preregistration

Benefits for researchers I

Improved planning and project management

  • The process of filling out preregistration document helps identify key information needed at study design stage
  • Outlining data collection methods and analysis plans which reduces ambiguity and errors during data analysis stage

Builds your reputation

  • Transparently show to the wider research community your plans and tests
  • Signal that you have taken steps to mitigate against hindsight and confirmation bias (Wagenmakers & Dutilh, 2016).

Benefits for researchers II

Easier to write up and publish findings

  • Front loading the thinking and planning makes writing up results and discussion a smoother process

  • If you preregister your analytic code on simulated data the results of your confirmatory analyses will be generated quicker once you have collected and cleaned data

  • If preregistration is approved as a registered report during stage 1 journal peer review, you have “in-principle acceptance”

Visible productivity

  • Publicly sharing outputs that others can evaluate beyond a journal article (as evaluation of outputs can be influenced by journal prestige)

Benefits for teams

Clearer involvement of collaborators/project partners

  • Provides opportunities for project partners to discuss and refine plans before data collection
  • Detailed research plans provide clarity for project partners, which is increasingly important in the era of large-scale collaborations

Benefits to wider research ecosystem

Increase research credibility and bias

  • Mitigates against questionable research practices
  • Offers more complete reporting and transparency of research project
  • Reduces publication bias, as preregistration/registered report is available to read (if not embargoed)

Check thinking

  • Other people reading your findings can follow your thought process
  • Gain a deeper understanding of a project and make an informed assessment (Binney et al., 2025)

Benefits recap

  • There are many benefits to doing a preregistration for individual researchers, teams and the wider research ecosystem.

  • Overall, by taking the time to carefully plan your study design, data collection and approach to analysis, research becomes more rigorous, transparent and credible.

Reflection point

Do you relate to the benefits of preregistration mentioned? Are there any other benefits you can think of?

Find out more

More benefits about preregistration and registered reports from a student, author and journal editor perspective are outlined by Gya et al. (2023).

Barriers to preregistration

Wider context:

  • There are significant challenges present in the current research and assessment culture (e.g. “publish or perish”) which influences the uptake of preregistration.

  • Researchers have different knowledge and experience levels with Open Science practices that reflect in attitudes and adoption of preregistration.

Challenges: time

Time: “I haven’t got time to do a preregistration”

  • Reframing: front-loaded effort during the planning stage can help later on during write up and during peer review (remember the benefits to researchers slide earlier)

Did you know?

Peer Community in Registered Reports is an initiative where the research community reviews and recommends registered reports. There is the option to speed up the Stage 1 peer review of a registered report with the ‘scheduled review’ track. Authors initially submit a one-page “snapshot” instead of a full stage 1 report.

Challenges: statistical confidence

Statistical confidence: “How do I know my planned statistical analysis is the right one?”

  • Strategy: Simulate random data with the distribution and sample size of expected real data and run the statistical test planned for the study.
  • Repeat the statistical test (e.g. 100 x) and check results are within the false-positive finding rate of 5%
  • Run a power analysis by simulating data with the expected effect size for the study and check model registers effect at least 80% of the time

Additional resource

Training materials for novices: Introduction to simulations and power analysis in R.

Challenges: inflexible

Lack of flexibility: “Preregistration keeps you in a box”

  • Reframing: Preregistrations are a “plan not a prison” as you can document any deviations from your plan when you write up the research findings (DeHaven, 2017).
  • Preregistrations can be tailored to the study type (e.g incremental
  • transparently documenting exploratory-confirmatory pathway or sequential - multi-stage contingent experiments).

Find out more

Binney et al. (2025) discuss practical guidance of balancing mitigating biases with flexibility in the research process. Lakens (2024) discusses when and how to deviate from a preregistration.

Challenges: scooping?

Fear of scooping: “What if someone steals my ideas before they are published?”

  • Counterargument: Preregistrations do not need to be made public right away and can be embargoed for a period of years (e.g. Open Science Framework preregistrations can be embargoed for 4 years from first submission)

  • The embargo period allows researchers time after preregistering their study to conduct the research, analyse, write up and publish their findings.

Challenges: incentives

Lack of incentives: “I don’t see the point”

  • Counterargument: aside from individual researcher benefits (increased reflection, better planning, reduced likelihood of systematic errors), journals are increasingly prioritizing preregistrations.

Find out more

Next time you read a journal article in your field, take a look at the journal’s webpage and see if they accept preregistered studies and if there are guidelines for publishing registered reports. This information is usually in the author resources/guidelines section.

Challenges: overwhelm

Overwhelm: “There is so much that goes into a preregistration”

  • Counterargument: templates and FAQ pages can guide you and if you are unable to officially register a study, adopting principles of study preregistration is a good step (e.g. Open Science Buffet approach (Bergmann, 2023).

Find out more

The Open Science Framework (OSF) has a frequently asked questions page on preregistrations and registered reports.

Challenges: lack of support

Lack of support: “No one in my team knows or cares about preregistration”

  • Strategy: Often a reluctance to try out preregistration comes from a place of lack of familiarity with the process.

  • Sharing resources, and suggest a group meeting to discuss/learn more about preregistration to increase familiarity.

  • Reframe preregistration as a creative opportunity to plan great science! Planning is where the science is, as other research processes, like data collection can be delegated

Additional resource

Relate to this challenge? See the preregistration case study which provides strategies.

What preregistration is not

Preregistration does not prevent fraud or research misconduct (e.g. PARKing), but it does make it harder.


Definition

PARKing: “Preregistrating after the results are known” is considered research misconduct where researchers complete an experiment before preregistering which invalidates the purpose of preregistration (Parsons et al., 2022).

Challenges recap

  • The lack of time and incentives, feelings of overwhelm and lack of support are common barriers that often overlap when in it comes to preregistration.

  • There is lots of support available and you are not alone!

Find out more

Have a browse of some of the challenges and strategies to address barriers to preregistration here [Preregistration tutorial coming soon!]

Quiz

Q1. Which options below are benefits of registered reports

A1. Which option(s) below are benefits of registered reports

Reflecting on answer

Although registered reports (and preregistrations) mitigate against questionable research practices, they do not prevent research misconduct or fraud (Yamada, 2018).

Q2. Which from the options below is an example of how preregistrations benefit the wider research ecosystem level?

A2. Which from the options below is an example of how preregistrations benefit the wider research ecosystem level?

Reflecting on answer

Improves planning and project management, building up reputation and visible productivity are examples of benefits at the individual researcher level.

Q3. What can I do if I feel overwhelmed or lack time to do a preregistration?

A3. What can I do if I feel overwhelmed or lack time to do a preregistration?

Reflecting on answer

When trying out a new way of working, it is common for things to feel overwhelming. The Open Science Framework (OSF) has a frequently asked questions page on preregistrations and registered reports.

Summary of section 1

  • Taking the time to carefully plan your study design, data collection and approach to analysis, leads to more rigorous, transparent and credible research.
  • Lack of time or incentives are two common barriers to adopting the practice of study preregistration
  • It is important to openly discuss and address challenges
  • Preregistration does not prevent fraud or research misconduct (e.g. PARKing).

Reflection point

Which benefit and barrier resonated with you most?

Break! 15 minutes

Section 2: Build up your preregistration toolkit!

Main preregistration elements

Recap of the main elements that make up a preregistration document:

Tip

If you need a reminder of the essential and recommended elements that make up a preregistration document see preregistration part I (LINK).

Exercise instructions

The objective of the build up your preregistration toolkit exercise is to:

  • Identify what makes preregistration elements vague
  • Practice improving the precision and clarity of preregistration elements

Steps:

  1. Group practice on one example preregistration snippet
  2. Work individually on worksheet with 8 snippets (40 minutes)

Group exercise

A research team wants to do a study on the topic of how indoor plants impact a person’s mood. Take a look at this research question:

How do indoor plants benefit people?

  1. On your own, think about how the question can be improved
  2. Discuss answer with neighbor and write out a joint answer
  3. We will share our answers in class

Guiding questions

What is ambiguous about this question? How would you measure “benefit”? How would you study the interaction between plants and people?

Group exercise: answer

From: How do indoor plants benefit people?


To: How does having physical contact with indoor plants reduce psychological and physiological stress in young-adult office workers?

Note

Notice how the improved answer states the type of interaction between plants and people, more specific details about types of benefits of interest and the target demographic (e.g. young-adult office workers).

Now it is your turn!

  1. Access worksheet [LINK]
  2. Read instructions
  3. Work through improving the snippets (40 minutes)

Exercise reflections

Assignment

One step at a time, then tell a buddy!

  1. Self-reflect and commit to taking one action related to the preregistration process
  2. Once you have chosen an action, tell a friend for accountability!

Possible actions

Writing out clearer hypotheses, researching a study registration template for your subject area. See “additional resources” in build up your preregistration toolkit worksheet.

To conclude: Survey time!

1. What is your level of familiarity with the key components of a preregistration (e.g., elements found in a preregistration document )?

2. How would you rate your confidence to carry out a preregistration for your study?

(1 to 5 scale: 1 = Not confident at all, 2 = Slightly confident, 3 = Somewhat confident, 4 = Very confident, 5 = Completely confident)

Final Summary

  • Preregistration and registered reports offer many benefits to researchers, teams and the wider community (e.g. building reputation and more rigorous, transparent and credible research).

  • A number of challenges exist to the wider uptake of preregistration (e.g. perceived inflexibility, time commitment, overwhelm).

  • Adopting a few elements of study preregistration at a time is good approach to working your way up completing a preregistration or registered report.

  • There are lots of places to get support (e.g. Open Science Framework community pages).

Additional resources

Discussion about merits vs limits of study preregistration from IEEE Visualization Conference 2022

References

Bergmann, C. (2023). The Buffet Approach to Open Science.
Binney, R. J., Smith, L. J., Rossit, S., Demeyere, N., Learmonth, G., Olgiati, E., Halai, A. D., Rounis, E., Evans, J., Edelstyn, N. M. J., & McIntosh, R. D. (2025). Practical routes to preregistration: A guide to enhanced transparency and rigour in neuropsychological research. Brain Communications, 7(3), fcaf162. https://doi.org/10.1093/braincomms/fcaf162
DeHaven, A. C. (2017). Preregistration: A Plan, Not a Prison. In Preregistration: A Plan, Not a Prison.
Gya, R., Birkeli, K., Dahle, I. J., Foote, C. G., Geange, S. R., Lynn, J. S., Töpper, J. P., Vandvik, V., Zernichow, C., & Jenkins, G. B. (2023). Registered Reports: A new chapter at Ecology & Evolution. Ecology and Evolution, 13(4), e10023. https://doi.org/10.1002/ece3.10023
Lakens, D. (2024). When and How to Deviate From a Preregistration. Collabra: Psychology, 10(1), 117094. https://doi.org/10.1525/collabra.117094
Parsons, S., Azevedo, F., Elsherif, M. M., Guay, S., Shahim, O. N., Govaart, G. H., Norris, E., O’Mahony, A., Parker, A. J., Todorovic, A., Pennington, C. R., Garcia-Pelegrin, E., Lazić, A., Robertson, O., Middleton, S. L., Valentini, B., McCuaig, J., Baker, B. J., Collins, E., … Aczel, B. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour, 6(3), 312–318. https://doi.org/10.1038/s41562-021-01269-4
Wagenmakers, E.-J., & Dutilh, G. (2016). Seven Selfish Reasons for Preregistration.
Yamada, Y. (2018). How to Crack Pre-registration: Toward Transparent and Open Science. Frontiers in Psychology, 9, 1831. https://doi.org/10.3389/fpsyg.2018.01831

Licence and citation statement


Creative Commons Attribution 4.0

This current work by Sara Lil Middleton and Malika Ihle is licensed under a Creative Commons Attribution 4.0 International SA License (CC-BY-SA 4.0).

Please cite these materials as: Middleton, L. S. & Ihle, M. (2026). Preregistration part II: benefits, barriers and building up skills [Quarto slides]. LMU Open Science Center and FORRT. https://lmu-osc.github.io/teaching-material-for-novices/open-research-principles/preregistration-part-II

Contribution statement

Creator: Middleton, Sara Lil (0000-0001-5307-8029)

Reviewer: Ihle, Malika (orcid logo 0000-0002-3242-5981)

Acknowledgments: Gracia Prum and Dejana Damjanovic