Prior to analyzing the complete data set, a time-stamped preregistration was posted in an independent, third-party registry for the data analysis plan.
The manuscript includes a URL to all preregistrations that concern the present study.
The study was preregistered...
Explain
The preregistration fully describes...
all inclusion and exclusion criteria for participation (e.g., English speakers who achieved a certain cutoff score in a language test).
all procedures for assigning participants to conditions.
all procedures for randomizing stimulus materials.
any procedures for ensuring that participants, experimenters, and data-analysts were kept naive (blinded) to potentially biasing information.
a rationale for the sample size used (e.g., an a priori power analysis).
the measures of interest (e.g., friendliness).
all operationalizations for the measures of interest (e.g., a questionnaire measuring friendliness).
the data preprocessing plans (e.g., transformed, cleaned, normalized, smoothed).
how missing data (e.g., dropouts) were planned to be handled.
the intended statistical analysis for each research question (this may require, for example, information about the sidedness of the tests, inference criteria, corrections for multiple testing, model selection criteria, prior distributions etc.).
Comments about your Preregistration
The manuscript fully describes...
the rationale for the sample size used (e.g., an a priori power analysis).
how participants were recruited.
how participants were selected (e.g., eligibility criteria).
what compensation was offered for participation.
how participant dropout was handled (e.g., replaced, omitted, etc).
how participants were assigned to conditions.
how stimulus materials were randomized.
whether (and, if so, how) participants, experimenters, and data-analysts were kept naive to potentially biasing information.
the study design, procedures, and materials to allow independent replication.
the measures of interest (e.g., friendliness).
all operationalizations for the measures of interest (e.g., a questionnaire measuring friendliness).
any changes to the preregistration (such as changes in eligibility criteria, group membership cutoffs, or experimental procedures).
Comments about your Methods section
The manuscript...
distinguishes explicitly between "confirmatory" (i.e., prespecified) and "exploratory" (i.e., not prespecified) analyses.
describes how violations of statistical assumptions were handled.
justifies all statistical choices (e.g., including or excluding covariates; applying or not applying transformations; use of multi-level models vs. ANOVA).
reports the sample size for each cell of the design.
reports how incomplete or missing data were handled.
presents protocols for data preprocessing (e.g., cleaning, discarding of cases and items, normalizing, smoothing, artifact correction).
Comments about your Results and Discussion
The following have been made publicly available...
the (processed) data, on which the analyses of the manuscript were based.
all code and software (that is not copyright protected).
all instructions, stimuli, and test materials (that are not copyright protected).
Are the data properly archived (i.e., would a graduate student with relevant background knowledge be able to identify each variable and reproduce the analysis)?
The manuscript includes a statement concerning the availability and location of all research items, including data, materials, and code relevant to the study.