Form: Psychological Research Preregistration-Quantitative (aka PRP-QUANT) Template (v1)

This vignette shows the Psychological Research Preregistration-Quantitative (aka PRP-QUANT) Template form. It can be initialized as follows:

initialized_prpQuant_v1 <-
  preregr::prereg_initialize(
    "prpQuant_v1"
  );

After this, content can be specified with preregr::prereg_specify() or preregr::prereg_justify. To check the next field(s) for which content still has to be specified, use preregr::prereg_next_item().

The form’s metadata is:

field	content
title	Psychological Research Preregistration-Quantitative (aka PRP-QUANT) Template
author	Preregistration Task Force members from the American Psychological Association (APA): Fred Oswald - Open Science and Methodology Committee Member; Rose Sokol-Chang - Publisher, APA Journals and Books; Amanda Clinton - Director, APA International Affairs, from the British Psychological Society (BPS): Daryl O’Connor - Chair of the BPS Research Board; Lisa Coulthard - Head of Research and Impact, from the German Psychological Society (DGP): Christian Fiebach - Secretary and Open Science Committee Member, from the Leibniz Institute for Psychology (ZPID): Michael Bosnjak - Director; Stefanie Müller - Head of study planning, data collection, and data analysis services; Camila Azúa - Research Assistant, from the Center for Open Science (COS): David Mellor - Director of Policy Initiatives
date	2020-02-18
comments	NA
source	Aczel, B., Szaszi, B., Sarafoglou, A., … Wagenmakers, E.-J. (2020). A consensus-based transparency checklist. Nature Human Behaviour, 4(1), 4–6. https://doi.org/10.1038/s41562-019-0772-6

American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.). https://doi.org/10.1037/0000165-000 Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018). Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. American Psychologist, 73(1), 3–25. https://doi.org/10.1037/amp0000191
Bowman, S. D., DeHaven, A. C., Errington, T. M., Hardwicke, T. E., Mellor, D. T., Nosek, B. A., & Soderberg, C. K. (2016). OSF Prereg Template. Retrieved from osf.io/preprints/metaarxiv/epgjd Simonsohn, U., Simmons, J., & Nelson, L. (2017). AsPredicted. Retrieved from https://aspredicted.org/messages/terms.php 1/15/2020
Van den Akker, O., Weston, S. J., Campbell, L., Chopik, W. J., Damian, R. I., Davis-Kean, P., Hall, A., Kosie, J., Kruse, E., Olsen, J., Stuart, R., Valentine, K., van ’t Veer, A., & Bakker, M. (2019, November 20). Preregistration of secondary data analysis: A template and tutorial. https://doi.org/10.31234/osf.io/hvfmr | |version |1.0 |

The form is defined as follows (use preregr::form_show() to show the form in the console, instead):

preregr::form_knit(
  "prpQuant_v1"
);

Psychological Research Preregistration-Quantitative (aka PRP-QUANT) Template

Instructions

Intended Use

As an international effort toward increasing psychology’s commitment to creating a stronger culture and practice of preregistration, a multi-society Preregistration Task Force* was formed, following the 2018 meeting of the German Psychological Society in Frankfurt, Germany. The Task Force created a detailed preregistration template that benefited from the APA JARS Quantitative Research guidelines, as well as a comprehensive review of many other preregistration templates.

This entry features the template, PRP_QUANT, in its current (and previous) version. The template can be downloaded here as .xlsx (Microsoft Excel), .docx (Microsoft Word), .odt (Libre Office) or .ipynb (JupyterLab) file or it can be filled out online via https://forms.gle/9YgAoJn4ZYPXtHGk9 (a PDF will be automatically generated and send via email).

For more information about preregistration and the template in particular, we recommend watching the following webinar: https://zpid.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=10e5776c-363a-4658-b458-acae007121a2 (or browse the slides via the link under “related items”). It shows the launch of the template on October 27, 2020, featuring two keynote speakers: Simine Vazire of University of Melbourne, and E. J. Wagenmakers of University of Amsterdam.

Sections and items

Section: Title and title page

Title

The title should be focused and descriptive, using relevant key terms to reflect what will be done in the study. Use title case (hyperlink: https://apastyle.apa.org/style-grammar-guidelines/capitalization/title-case).

Contributors, Affiliations, and Persistent IDs (recommend ORCID iD)

Provide in separate entries the full name of each contributor, each contributor’s professional affiliation, and each contributor’s persistent ID. See ORCID iD for an example of persistent ID (hyperlink: https://orcid.org/). Optional: include the intended contribution of each person listed (e.g. statistical analysis, data collection; see CRediT, hyperlink: https://credit.niso.org/).

Date of Preregistration

This is assigned by the system upon preregistration submission.

Versioning information

This is assigned by the system upon submission of original and subsequent revisions. Should be a persistent identifier, if not a DOI.

Identifier

This unique identifier is assigned by the system upon submission.

Estimated duration of project

Include best estimate for how long the project will take from preregistration submission to project completion.

IRB Status (Institutional Review Board/Independent Ethics Committee/Ethical Review Board/Research Ethics Board)

If the study will include human or animal subjects, provide a brief overview of plans for the treatment of those subjects in accordance with established ethical guidelines. If appropriate institutional approval has been obtained for the study, provide the relevant identifier here. If the study will be exempt from ethical board review, provide reasoning here.

Conflict of Interest Statement

Identify any real or perceived conflicts of interest with this study execution. For example, any interests or activities that might be seen as influencing the research (e.g., financial interests in a test or procedure, funding by pharmaceutical companies for research).

Keywords

Include terms specific to your topic, methodology, and population. Use natural language and avoid words used in the title or overly general terms. If you need help with keywords, try a keyword search using your proposed keywords in a search engine to check results.

Data accessibility statement and planned repository

T10

We plan to make the data available (yes / no) If “yes”, please specify the planned data availability level by selecting one of the options:

Data access via download; usage of data for all purposes (public use file)
Data access via download; usage of data restricted to scientific purposes (scientific use file)
Data access via download; usage of data has to be agreed and defined on an individual case basis
Data access via secure data center (no download, usage/analysis only in a secure data center)
Data available upon email request by member of scientific community -Other (please specify)

Optional: Code availability

T11

We plan to make the code available (yes / no) If “yes”, please specify the planned code availability (use same descriptors of data in T10)

Optional: Standard lab practices

T12

Standard lab practices refer to a (timestamped) document, software package, or similar, which specifies standard pipelines, analytical decisions, etc. which always apply to certain types of research in a lab. Specify here and refer to at the appropriate positions in the remainder of the template: We plan to make the standard lab practices available (yes / no). If “yes”, please specify the planned standard lab practices availability level (use same descriptors of data in T10).

Section: Abstract (150 words)

Background

(See introduction I1)

Objectives and Research questions

(See introduction I2)

Participants

(See methods M4)

Study method

(See methods M10-14)

Section: Introduction (no word limit)

Theoretical background

Provide a brief overview that justifies the research hypotheses.

Objectives and Research question(s)

Outline objectives and research questions that inform the methodology and analyses (below).

Hypothesis (H1, H2, …)

Provide hypothesis for predicted results. If multiple hypotheses, uniquely number them (e.g. H1, H2a, H2b) and refer to them the same way at other points in the registration document and in the manuscript.

Exploratory research questions (if applicable; E1, E2, …)

If planning exploratory analyses, provide rationale for them here. If multiple exploratory analyses, uniquely number them (E1, E2, …) and refer to them in the same way in the registration document and in future publications.

Section: Method

Time point of registration

Select one of the options:

Registration prior to creation of data
Registration prior to any human observation of the data
Registration prior to accessing the data
Registration prior to analysis of the data
Other (please specify; might include if T1 longitudinal data has been analyzed, but T2 has not yet been analyzed)

Proposal: Use of pre-existing data (re-analysis or secondary data analysis)

Will pre-existing data be used in the planned study? If yes, indicate if the data were previously published and specify the source of the data (e.g., DOI or APA style reference of original publication). Specify your level of knowledge of the data (e.g., descriptive statistics from previous publications), whether or not this is relevant for the hypotheses of the present study, and how it is assured that you are unaware of results or statistical patterns in the data of relevance to the present hypotheses.

Sample size, power and precision

Relevant sample sizes: e.g., single groups, multiple groups, and sample sizes (or sample ranges) found at each level of multilevel data. (2) Provide power analysis (e.g. power curves) for fixed-N designs. For sequential designs, indicate your ‘stopping rule’ such as the points at which you intend to be viewing your data and in any way analyzing them (e.g., t-tests and correlations, but even descriptively such as with histograms).

Participant recruitment, selection, and compensation

Indicate (a) methods of recruitment (e.g., subject pool advertisement, community events, crowdsourcing platforms, snowball sampling); (b) selection and inclusion/exclusion criteria (e.g., age, visual acuity, language facility); (c) details of any stratification sampling used; (d) planned participant characteristics (gender, race/ethnicity, sexual orientation and gender identity, SES, education level, age, disability or health status, geographic location); (e) compensation amount and method (e.g., same payment to all, pay based on performance, lottery).

How will participant drop-out be handled?

Indicate any special treatment for participants who drop out (e.g., there is follow-up in a manner different from the main sample, last value carried forward) or whether participants are replaced.

Masking of participants and researchers

Indicate all forms of masking and/or allocation concealment (e.g., administrators, data collectors, raters, confederates are unaware of condition to which participants were assigned).

Data cleaning and screening

Indicate all steps related to data quality control, e.g., outlier treatment, identification of missing data, checks for normality, etc.

How will missing data be handled?

Indicate any procedures that will be applied during the analysis to deal with missing data, such as (a) case deletions; (b) averaging across scale items (to handle missing items for some); (c) test of missingness (MAR, MCAR, MNAR assumptions; (d) imputation procedures (FIML vs. MI); (e) Intention to treat analysis and per protocol analysis (as appropriate).

Other information (optional)

For example, training of raters/participants or anything else not yet specified.

Type of study and study design

M10

Indicate the type of study (e.g., experimental, observational, crosssectional vs. longitudinal, single case, clinical trial) and planned study design (e.g., between vs. within subjects, factorial, repeated measures, etc.), number of factors and factor levels, etc..

Randomization of participants and/or experimental materials

M11

If applicable, describe how participants are assigned to conditions or treatments, how stimuli are assigned to conditions, and how presentation of tests, trials, etc. is randomized. Indicate the randomization technique and whether constraints were applied (pseudo-randomization). Indicate any type of balancing across participants (e.g., assignments of responses to hands, etc.).

Measured variables, manipulated variables, covariates

M12

This section shall be used to unambiguously clarify which variables are used to operationalize the hypotheses specified above (item I3). Please (a) list all measured variables, and (b) explicitly state the functional role of each variable (i.e., independent variable, dependent variable, covariate, mediator, moderator). It is important to (c) specify for each hypothesis how it is operationalized, i.e., which variables will be used to test the respective hypothesis and how the hyothesis will be operationally defined in terms of these variables. The description here shall be consistent with the statistical analysis plans specified under AP6 (below).

Study Materials

M13

Please describe any relevant study materials. This could include, for example, stimulus materials used for experiments, questionnaires used for rating studies, training protocols for intervention studies, etc.

Study Procedures

M14

Please describe here any relevant information about how the study will be conducted, e.g., the number and timing of measurement time points for longitudinal research, the number of blocks or runs per session of an experiment, laboratory setting, the group size in group testing, the number of training sessions in interventional studies, questionnaire administration for online assessments, etc.

Other information (optional)

M15

Section: Analysis plan

Criteria for post-data collection exclusion of participants, if any

AP1

Describe all criteria that will lead to the exclusion of a participant’s data (e.g. performance criteria, non-responding in physiological measures, incomplete data). Be as specific as possible.

Criteria for post-data collection exclusions on trial level (if applicable)

AP2

Describe all criteria that will lead to the exclusion of a trial or item (e.g. statistical outliers, response time criteria). Be as specific as possible.

Data preprocessing

AP3

Describe all data manipulations that are performed in preparation of the main analyses, e.g. calculation of variables or scales, recoding, any data transformations, preprocessing steps for imaging or physiological data (or refer to publicly accessible standard lab procedure, cf. T12).

Reliability analysis (if applicable)

AP4

Specify the type of scale reliability that will be estimated, whether it is internal consistency (e.g. Cronbach’s alpha, omega), test-retest reliability, or some other form (e.g., a confirmatory factor analysis incorporating multiple factors as sources of variance). In a study involving measure development, researchers should specify criteria for removing items from measures a priori (e.g., largest factor loading magnitude, smallest drop in alpha-if-item removed).

Descriptive statistics

AP5

Specify which descriptive statistics will be calculated for which variables. If appropriate, specify which indices of effect size will be used. If descriptive statistics are linked to specific hypotheses, explicitly link the information given here to the respective hypothesis.

Statistical models (provide for each hypothesis if varies)

AP6

Specify the statistical model (e.g. t test, ANOVA, LMM) that will be used to test each of your hypotheses. Give all necessary information about model specification (e.g., variables, interactions, planned contrasts) and follow-up analyses. Include model selection criteria (e.g., fit indices), corrections for multiple testing, and tests for statistical violations, if applicable. Wherever unclear, describe how effect sizes will be calculated (e.g., for d-values, use the control SD or the pooled SD).

Inference criteria

AP7

Specify the criteria used for inferences (e.g., p values, Bayes factors, effect size measures) and the thresholds for accepting or rejecting your hypotheses. If possible, define a smallest effect size of interest. If inference criteria differ between hypotheses, specify separately for each hypothesis and respective statistical model by explicitly referring to the numbers of the hypotheses. Describe which effect size measures will be reported and how they are calculated.

Exploratory analysis (optional)

AP8

Describe any exploratory analyses to be conducted with your data. Include here any planned analyses that are not confirmatory in the sense of being a direct test of one of the specified hypotheses.

Other information (optional)

AP9

Section: Other information, optional

Other information (optional)