Table 6

Interannotator agreement (A-B) in the main annotation phase, calculated as F-measure among the pair of annotators

Equivalence Criteria

strict (relaxed)

strictCK

strictRK

strictCRK


base

0.500 (0.535)

0.624

0.536

0.655


base + PE

0.530 (0.567)

0.654

0.566

0.684


base + GP

0.505 (0.539)

0.628

0.542

0.659


base + PE + GP

0.536 (0.571)

0.659

0.573

0.688


PE: predication equivalence, GP: gene/gene product correspondence, CK: conceptual knowledge, RK: relational knowledge, CRK: conceptual and relational knowledge

Kilicoglu et al. BMC Bioinformatics 2011 12:486   doi:10.1186/1471-2105-12-486

Open Data