Reliability* of application rating in the CIHR open operating grant competition, 2012–2014†
Scientific domain | No. of applications n = 11 624 (%) | Intraclass correlation | Variance components | |
---|---|---|---|---|
Between applications | Within raters | |||
All domains | 11 624 (100.0) | 0.41 (0.39–0.43) | 0.43 | 0.18 |
Basic science | 7450 (64.1) | 0.41 (0.39–0.44) | 0.35 | 0.15 |
Applied science | 4174 (35.9) | 0.33 (0.30–0.36) | 0.48 | 0.25 |
Clinical | 1924 (16.6) | 0.33 (0.29–0.38) | 0.41 | 0.21 |
Health services and policy | 941 (8.1) | 0.32 (0.26–0.38) | 0.54 | 0.28 |
Population health | 1309 (11.3) | 0.32 (0.26–0.37) | 0.53 | 0.27 |