Figure 1a. Inter-rater agreement (IRA) for all raters.
In calculating IRA, a portion of the observed percent agreement (PA), is assumed to be attributable to chance (PC), and inter-rater agreement statistical methods are used to determine the percent agreement beyond chance or kappa (κ).
κ 10-20% = slight agreement; κ 20-40% =fair agreement; κ 40-60%=moderate agreement; κ 60-80%=substantial agreement; κ 80-100%= near perfect agreement. Overall PA, PC, κ and 95% confidence interval (CI) is shown, along with PA, PC, κ values and CI for each event subtype (DIND1, DIND2 and DCIN). DIND; Delayed ischemic neurological decline DCIN; Delayed cerebral infarction