Resources for participants

resources for repliCATS participants

Version: last updated on 19 March 2021

Quick links to:

Logging on to the platform in phase 2

You can access the repliCATS single trace platform via the links provided. If you are a new user, you’ll need to create an account and consent to participating in our project. NB. If you are having trouble with the platform, contact us via:

Using the platform

Here’s a quick video guide introducing the platform, and how to go about assessing a claim!

assessing single trace claims in phase 2

Single trace claims in phase 2 largely follow the phase 1 format – you will be asked to assess a research claim from a published paper that is supported by a single inferential test result that supports that claim. In the document below, you will find an updated guide to evaluating single trace claims in phase 2:

The recommended time you spend evaluating a single trace claim remains the same as in phase 1. if you are working solo or completely virtually (i.e. with no real time discussion), we suggest that you spend around 10-15 minutes to complete round one, which includes perusing the paper, and spending a bit of extra time to write down your reasoning. This will help you and the other participants for round two and when the claim closes.

assessing bushel papers in phase 2 (workshops)

The first virtual workshop to assess bushel papers will be run from 15-22 June 2021. We are busy working on updating our participant resources and will upload them as soon as they are available.

training materials

The following document contains information about statistical concepts commonly used in scientific papers (e.g. p values, Cohens d, effect sizes) and information from scientific meta-research about the practice and publication of scientific findings, as well as previous replication studies:

additional Videos & resources

Glossary of terms

Type 1 and Type 2 errors

Effect sizes (video – 10 mins)

This video by Daniël Lakens provides a brief introduction to the importance of effect sizes.


Confidence intervals (video – 10 mins)

This video by Daniël Lakens explains how to interpret confidence intervals.




P curve analysis