Table 2:

Reliability* of application rating in the CIHR open operating grant competition, 2012–2014

Scientific domainNo. of applications
n = 11 624 (%)
Intraclass correlationVariance components
Between applicationsWithin raters
All domains11 624 (100.0)0.41 (0.39–0.43)0.430.18
Basic science7450 (64.1)0.41 (0.39–0.44)0.350.15
Applied science4174 (35.9)0.33 (0.30–0.36)0.480.25
 Clinical1924 (16.6)0.33 (0.29–0.38)0.410.21
 Health services and policy941 (8.1)0.32 (0.26–0.38)0.540.28
 Population health1309 (11.3)0.32 (0.26–0.37)0.530.27
  • Note: CIHR = Canadian Institutes of Health Research.

  • * Intraclass correlation coefficient.

  • Based on the first and second reviewer scores: overall, and by pillar.