Table 6

Results, kappa agreement among the evaluators for each of the 12 examples in the pilot study

Example
No of outcomes
P
Kappa
(SE)

1
3
0.436
0.149
0.031
2
3
0.769
0.075
0.053
3
6
0.643
0.441
0.024
4
3
0.926
0.823
0.050
5
2
0.608
-0.044
0.065
6
3
0.618
0.163
0.050
7
3
0.520
-0.028
0.044
8
3
0.451
0.146
0.036
9
4
0.441
-0.022
0.037
10
5
0.579
0.005
0.034
11
4
0.377
0.112
0.027
12
7
0.718
-0.083
0.043

Atkins et al. BMC Health Services Research 2005 5:25   doi:10.1186/1472-6963-5-25