Preregistration part II: benefits, barriers and building up skills
Sara Lil Middleton
26/10/2026
Prerequisites
Important
Before completing this session, please carefully read about the prerequisites.
Completion of preregistration training materials (preregistration part I [coming soon!]
Access to Build up your preregistration toolkit! [coming soon]
Your study preregistration journey
From: “I am not sure what some of the opportunities are or how to overcome some of the challenges of doing a preregistration
To: ““I feel able discuss the benefits and barriers of preregistration and identify which part of a preregistration I can improve on”
Recap of key concepts in preregistration part I
Study preregistration is an open science practice that:
safe guards researchers from questionable research practices and biases by making decision-making processes more explicit.
involves uploading a time-stamped, publicly-available* record of a research study plan onto a register, which is given a unique and permanent study identifier.
*Preregistrations do not need to be made public immediately and can be embargoed for a period of years (e.g. Open Science Framework preregistrations can be embargoed for 4 years from first submission)
What is your level of familiarity with the key components of a preregistration (e.g., elements found in a preregistration document )?
How would you rate your confidence to carry out a preregistration for your study?
(1 to 5 scale: 1 = Not confident at all, 2 = Slightly confident, 3 = Somewhat confident, 4 = Very confident, 5 = Completely confident)
Discussion of survey results
What do we see in the results?
Learning goals
Aim: Examine the benefits of preregistration to researchers and wider research ecosystem, and discuss common challenges and how to address them.
There are two sections to this submodule:
Section 1: Benefits and barriers of preregistration
Section 2: Building up skills in preregistration
Section 1: Learning goals and overview
Section 1 is all about recognizing common benefits and barriers of preregistration for researchers and wider research ecosystem.
Activities: Quiz and self-reflection exercise
After completing section 1 you should be able to:
Explain the perceived barriers to doing a preregistration
Identify key benefits of preregistration
Section 2: Learning goals and overview
Section 2 is about practicing improving a component of a study preregistration.
Activity: Build up your preregistration toolkit! (individual work)
After completing section 2 you should be able to:
Self-reflect on challenging parts of the preregistration process
Practice improving elements of a preregistration
Section 1: Benefits and barriers of preregistration
Benefits for researchers I
Improved planning and project management
The process of filling out preregistration document helps identify key information needed at study design stage
Outlining data collection methods and analysis plans which reduces ambiguity and errors during data analysis stage
Builds your reputation
Transparently show to the wider research community your plans and tests
Signal that you have taken steps to mitigate against hindsight and confirmation bias(Wagenmakers & Dutilh, 2016).
Benefits for researchers II
Easier to write up and publish findings
Front loading the thinking and planning makes writing up results and discussion a smoother process
If you preregister your analytic code on simulated data the results of your confirmatory analyses will be generated quicker once you have collected and cleaned data
If preregistration is approved as a registered report during stage 1 journal peer review, you have “in-principle acceptance”
Visible productivity
Publicly sharing outputs that others can evaluate beyond a journal article (as evaluation of outputs can be influenced by journal prestige)
Benefits for teams
Clearer involvement of collaborators/project partners
Provides opportunities for project partners to discuss and refine plans before data collection
Detailed research plans provide clarity for project partners, which is increasingly important in the era of large-scale collaborations
Benefits to wider research ecosystem
Increase research credibility and bias
Mitigates against questionable research practices
Offers more complete reporting and transparency of research project
Reduces publication bias, as preregistration/registered report is available to read (if not embargoed)
Check thinking
Other people reading your findings can follow your thought process
Gain a deeper understanding of a project and make an informed assessment(Binney et al., 2025)
Benefits recap
There are many benefits to doing a preregistration for individual researchers, teams and the wider research ecosystem.
Overall, by taking the time to carefully plan your study design, data collection and approach to analysis, research becomes more rigorous, transparent and credible.
Reflection point
Do you relate to the benefits of preregistration mentioned? Are there any other benefits you can think of?
Find out more
More benefits about preregistration and registered reports from a student, author and journal editor perspective are outlined by Gya et al. (2023).
Barriers to preregistration
Wider context:
There are significant challenges present in the current research and assessmentculture (e.g. “publish or perish”) which influences the uptake of preregistration.
Researchers have different knowledge and experience levels with Open Science practices that reflect in attitudes and adoption of preregistration.
Challenges: time
Time: “I haven’t got time to do a preregistration”
Reframing: front-loaded effort during the planning stage can help later on during write up and during peer review (remember the benefits to researchers slide earlier)
Did you know?
Peer Community in Registered Reports is an initiative where the research community reviews and recommends registered reports. There is the option to speed up the Stage 1 peer review of a registered report with the ‘scheduled review’ track. Authors initially submit a one-page “snapshot” instead of a full stage 1 report.
Challenges: statistical confidence
Statistical confidence: “How do I know my planned statistical analysis is the right one?”
Strategy: Simulate random data with the distribution and sample size of expected real data and run the statistical test planned for the study.
Repeat the statistical test (e.g. 100 x) and check results are within the false-positive finding rate of 5%
Run a power analysis by simulating data with the expected effect size for the study and check model registers effect at least 80% of the time
Additional resource
Training materials for novices: Introduction to simulations and power analysis in R.
Challenges: inflexible
Lack of flexibility:“Preregistration keeps you in a box”
Reframing: Preregistrations are a “plan not a prison” as you can document any deviations from your plan when you write up the research findings (DeHaven, 2017).
Preregistrations can be tailored to the study type (e.g incremental
transparently documenting exploratory-confirmatory pathway or sequential - multi-stage contingent experiments).
Find out more
Binney et al. (2025) discuss practical guidance of balancing mitigating biases with flexibility in the research process. Lakens (2024) discusses when and how to deviate from a preregistration.
Challenges: scooping?
Fear of scooping: “What if someone steals my ideas before they are published?”
Counterargument: Preregistrations do not need to be made public right away and can be embargoed for a period of years (e.g. Open Science Framework preregistrations can be embargoed for 4 years from first submission)
The embargo period allows researchers time after preregistering their study to conduct the research, analyse, write up and publish their findings.
Challenges: incentives
Lack of incentives: “I don’t see the point”
Counterargument: aside from individual researcher benefits (increased reflection, better planning, reduced likelihood of systematic errors), journals are increasingly prioritizing preregistrations.
Find out more
Next time you read a journal article in your field, take a look at the journal’s webpage and see if they accept preregistered studies and if there are guidelines for publishing registered reports. This information is usually in the author resources/guidelines section.
Challenges: overwhelm
Overwhelm: “There is so much that goes into a preregistration”
Counterargument: templates and FAQ pages can guide you and if you are unable to officially register a study, adopting principles of study preregistration is a good step (e.g. Open Science Buffet approach (Bergmann, 2023).
Find out more
The Open Science Framework (OSF) has a frequently asked questions page on preregistrations and registered reports.
Challenges: lack of support
Lack of support: “No one in my team knows or cares about preregistration”
Strategy: Often a reluctance to try out preregistration comes from a place of lack of familiarity with the process.
Sharing resources, and suggest a group meeting to discuss/learn more about preregistration to increase familiarity.
Reframe preregistration as a creative opportunity to plan great science! Planning is where the science is, as other research processes, like data collection can be delegated
Additional resource
Relate to this challenge? See the preregistration case study which provides strategies.
What preregistration is not
Preregistration does not prevent fraud or research misconduct (e.g. PARKing), but it does make it harder.
Definition
PARKing: “Preregistrating after the results are known” is considered research misconduct where researchers complete an experiment before preregistering which invalidates the purpose of preregistration (Parsons et al., 2022).
Challenges recap
The lack of time and incentives, feelings of overwhelm and lack of support are common barriers that often overlap when in it comes to preregistration.
There is lots of support available and you are not alone!
Find out more
Have a browse of some of the challenges and strategies to address barriers to preregistration here [Preregistration tutorial coming soon!]
Quiz
Q1. Which options below are benefits of registered reports
A1. Which option(s) below are benefits of registered reports
Reflecting on answer
Although registered reports (and preregistrations) mitigate against questionable research practices, they do not prevent research misconduct or fraud (Yamada, 2018).
Q2. Which from the options below is an example of how preregistrations benefit the wider research ecosystem level?
A2. Which from the options below is an example of how preregistrations benefit the wider research ecosystem level?
Reflecting on answer
Improves planning and project management, building up reputation and visible productivity are examples of benefits at the individual researcher level.
Q3. What can I do if I feel overwhelmed or lack time to do a preregistration?
A3. What can I do if I feel overwhelmed or lack time to do a preregistration?
Reflecting on answer
When trying out a new way of working, it is common for things to feel overwhelming. The Open Science Framework (OSF) has a frequently asked questions page on preregistrations and registered reports.
Summary of section 1
Taking the time to carefully plan your study design, data collection and approach to analysis, leads to more rigorous, transparent and credible research.
Lack of time or incentives are two common barriers to adopting the practice of study preregistration
It is important to openly discuss and address challenges
Preregistration does not prevent fraud or research misconduct (e.g. PARKing).
Reflection point
Which benefit and barrier resonated with you most?
Break! 15 minutes
Section 2: Build up your preregistration toolkit!
Main preregistration elements
Recap of the main elements that make up a preregistration document:
Tip
If you need a reminder of the essential and recommended elements that make up a preregistration document see preregistration part I (LINK).
Exercise instructions
The objective of the build up your preregistration toolkit exercise is to:
Identify what makes preregistration elements vague
Practice improving the precision and clarity of preregistration elements
Steps:
Group practice on one example preregistration snippet
Work individually on worksheet with 8 snippets (40 minutes)
Group exercise
A research team wants to do a study on the topic of how indoor plants impact a person’s mood. Take a look at this research question:
How do indoor plants benefit people?
On your own, think about how the question can be improved
Discuss answer with neighbor and write out a joint answer
We will share our answers in class
Guiding questions
What is ambiguous about this question? How would you measure “benefit”? How would you study the interaction between plants and people?
Group exercise: answer
From: How do indoor plants benefit people?
To: How does having physical contact with indoor plants reduce psychological and physiological stress in young-adult office workers?
Note
Notice how the improved answer states the type of interaction between plants and people, more specific details about types of benefits of interest and the target demographic (e.g. young-adult office workers).
Now it is your turn!
Access worksheet [LINK]
Read instructions
Work through improving the snippets (40 minutes)
Exercise reflections
Assignment
One step at a time, then tell a buddy!
Self-reflect and commit to taking one action related to the preregistration process
Once you have chosen an action, tell a friend for accountability!
Possible actions
Writing out clearer hypotheses, researching a study registration template for your subject area. See “additional resources” in build up your preregistration toolkit worksheet.
To conclude: Survey time!
1. What is your level of familiarity with the key components of a preregistration (e.g., elements found in a preregistration document )?
2. How would you rate your confidence to carry out a preregistration for your study?
(1 to 5 scale: 1 = Not confident at all, 2 = Slightly confident, 3 = Somewhat confident, 4 = Very confident, 5 = Completely confident)
Final Summary
Preregistration and registered reports offer many benefits to researchers, teams and the wider community (e.g. building reputation and more rigorous, transparent and credible research).
A number of challenges exist to the wider uptake of preregistration (e.g. perceived inflexibility, time commitment, overwhelm).
Adopting a few elements of study preregistration at a time is good approach to working your way up completing a preregistration or registered report.
There are lots of places to get support (e.g. Open Science Framework community pages).
Additional resources
Discussion about merits vs limits of study preregistration from IEEE Visualization Conference 2022
References
Bergmann, C. (2023). The Buffet Approach to Open Science.
Binney, R. J., Smith, L. J., Rossit, S., Demeyere, N., Learmonth, G., Olgiati, E., Halai, A. D., Rounis, E., Evans, J., Edelstyn, N. M. J., & McIntosh, R. D. (2025). Practical routes to preregistration: A guide to enhanced transparency and rigour in neuropsychological research. Brain Communications, 7(3), fcaf162. https://doi.org/10.1093/braincomms/fcaf162
DeHaven, A. C. (2017). Preregistration: A Plan, Not a Prison. In Preregistration: A Plan, Not a Prison.
Gya, R., Birkeli, K., Dahle, I. J., Foote, C. G., Geange, S. R., Lynn, J. S., Töpper, J. P., Vandvik, V., Zernichow, C., & Jenkins, G. B. (2023). Registered Reports: A new chapter at Ecology&Evolution. Ecology and Evolution, 13(4), e10023. https://doi.org/10.1002/ece3.10023
Parsons, S., Azevedo, F., Elsherif, M. M., Guay, S., Shahim, O. N., Govaart, G. H., Norris, E., O’Mahony, A., Parker, A. J., Todorovic, A., Pennington, C. R., Garcia-Pelegrin, E., Lazić, A., Robertson, O., Middleton, S. L., Valentini, B., McCuaig, J., Baker, B. J., Collins, E., … Aczel, B. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour, 6(3), 312–318. https://doi.org/10.1038/s41562-021-01269-4
Wagenmakers, E.-J., & Dutilh, G. (2016). Seven Selfish Reasons for Preregistration.
Yamada, Y. (2018). How to Crack Pre-registration: Toward Transparent and Open Science. Frontiers in Psychology, 9, 1831. https://doi.org/10.3389/fpsyg.2018.01831