Table 4

Inter-annotator agreement

P(A)

P(E)

Kappa score


Including ArgM

role identification

.97

.52

.94

role classification

.96

.18

.95

combined decision

.96

.18

.95

Excluding ArgM

role identification

.97

.26

.94

role classification

.99

.28

.98

combined decision

.99

.28

.98


Tsai et al. BMC Bioinformatics 2007 8:325   doi:10.1186/1471-2105-8-325

Open Data