Table 4

Inter-annotator agreement



P(A)
P(E)
Kappa score

Including ArgM
role identification
.97
.52
.94

role classification
.96
.18
.95

combined decision
.96
.18
.95
Excluding ArgM
role identification
.97
.26
.94

role classification
.99
.28
.98

combined decision
.99
.28
.98

Tsai et al. BMC Bioinformatics 2007 8:325   doi:10.1186/1471-2105-8-325