resources for repliCATS participants
Version: last updated on 19 March 2021
Quick links to:
- Assessing single trace claims in phase 2
- Assessing bushel papers in phase 2 (we’re working on these in preparation for SIPS2021)
Logging on to the platform in phase 2
You can access the repliCATS single trace platform via the links provided. If you are a new user, you’ll need to create an account and consent to participating in our project. NB. If you are having trouble with the platform, contact us via: repliCATSemail@example.com
Using the platform
Single trace claims in phase 2 largely follow the phase 1 format – you will be asked to assess a research claim from a published paper that is supported by a single inferential test result that supports that claim. In the document below, you will find an updated guide to evaluating single trace claims in phase 2:
The recommended time you spend evaluating a single trace claim remains the same as in phase 1. if you are working solo or completely virtually (i.e. with no real time discussion), we suggest that you spend around 10-15 minutes to complete round one, which includes perusing the paper, and spending a bit of extra time to write down your reasoning. This will help you and the other participants for round two and when the claim closes.
The first virtual workshop to assess bushel papers will be run from 15-22 June 2021. We are busy working on updating our participant resources and will upload them as soon as they are available.
The following document contains information about statistical concepts commonly used in scientific papers (e.g. p values, Cohens d, effect sizes) and information from scientific meta-research about the practice and publication of scientific findings, as well as previous replication studies:
additional Videos & resources
Glossary of terms
Type 1 and Type 2 errors
- Exploring Type 1 and Type 2 errors (spreadsheet)
Effect sizes (video – 10 mins)
This video by Daniël Lakens provides a brief introduction to the importance of effect sizes.
Confidence intervals (video – 10 mins)
This video by Daniël Lakens explains how to interpret confidence intervals.
P curve analysis