Table 6 |
|||||
|
Evaluation results of Task 1 on the (W)hole, (A)bstract, and (F)ull paper collections |
|||||
|
Team |
Part |
Simple Event |
Binding |
Regulation |
All |
|
|
|||||
|
UTurku09 |
A |
64.21/77.45/70.21 |
40.06/49.82/44.41 |
35.63/45.87/40.11 |
46.73/58.48/51.95 |
|
|
|||||
|
Miwa10 |
A |
70.44 |
52.62 |
40.60 |
48.62/58.96/53.29 |
|
|
|||||
|
W |
68.47/80.25/73.90 |
44.20/53.71/48.49 |
38.02/54.94/44.94 |
49.41/64.75/56.04 |
|
|
FAUST |
A |
66.16/81.04/72.85 |
45.53/58.09/51.05 |
39.38/58.18/46.97 |
50.00/67.53/57.46 |
|
F |
75.58/78.23/76.88 |
40.97/44.70/42.75 |
34.99/48.24/40.56 |
47.92/58.47/52.67 |
|
|
FA |
66.16/81.04/72.85 |
45.53/58.09/51.05 |
39.38/58.18/46.97 |
50.00/67.53/57.46 |
|
|
FI |
77.36/71.93/74.55 |
29.63/36.36/32.65 |
41.77/50.77/45.83 |
51.57/56.94/54.13 |
|
|
FR |
76.34/80.00/78.13 |
39.00/43.82/41.27 |
32.66/45.64/38.07 |
45.98/57.20/50.98 |
|
|
FM |
48.00/75.00/58.54 |
100.0/50.00/66.67 |
20.00/50.00/28.57 |
46.88/68.18/55.56 |
|
|
|
|||||
|
W |
67.01/81.40/73.50 |
42.97/56.42/48.79 |
37.52/52.67/43.82 |
48.49/64.08/55.20 |
|
|
UMass |
A |
64.21/80.74/71.54 |
43.52/60.89/50.76 |
38.78/55.07/45.51 |
48.74/65.94/56.05 |
|
F |
75.58/83.14/79.18 |
41.67/47.62/44.44 |
34.72/47.51/40.12 |
47.84/59.76/53.14 |
|
|
FA |
64.21/80.74/71.54 |
43.52/60.89/50.76 |
38.78/55.07/45.51 |
48.74/65.94/56.05 |
|
|
FI |
79.25/82.35/80.77 |
44.44/48.00/46.15 |
35.44/56.00/43.41 |
51.57/65.08/57.54 |
|
|
FR |
75.95/83.97/79.76 |
34.00/40.96/37.16 |
32.29/42.89/36.85 |
45.09/56.04/49.98 |
|
|
FM |
48.00/85.71/61.54 |
100.0/100.0/100.0 |
20.00/33.33/25.00 |
46.88/78.95/58.82 |
|
|
|
|||||
|
W |
68.22/76.47/72.11 |
42.97/43.60/43.28 |
38.72/47.64/42.72 |
49.56/57.65/53.30 |
|
|
UTurku |
A |
64.97/76.72/70.36 |
45.24/50.00/47.50 |
40.41/49.01/44.30 |
50.06/59.48/54.37 |
|
F |
78.18/75.82/76.98 |
37.50/31.76/34.39 |
34.99/44.46/39.16 |
48.31/53.38/50.72 |
|
|
FA |
64.97/76.72/70.36 |
45.24/50.00/47.50 |
40.41/49.01/44.30 |
50.06/59.48/54.37 |
|
|
FI |
84.91/67.16/75.00 |
25.93/30.43/28.00 |
30.38/30.77/30.57 |
47.80/45.24/46.48 |
|
|
FR |
77.48/78.99/78.23 |
36.00/30.51/33.03 |
34.68/45.54/39.38 |
47.19/54.18/50.44 |
|
|
FM |
60.00/75.00/66.67 |
100.0/20.00/33.33 |
40.00/25.00/30.77 |
59.38/50.00/54.29 |
|
|
|
|||||
|
W |
68.99/74.30/71.54 |
42.36/40.47/41.39 |
36.64/44.08/40.02 |
48.64/54.71/51.50 |
|
|
MSR-NLP |
A |
65.99/74.71/70.08 |
43.23/44.51/43.86 |
37.14/45.38/40.85 |
48.52/56.47/52.20 |
|
F |
78.18/73.24/75.63 |
40.28/32.77/36.14 |
35.52/41.34/38.21 |
48.94/50.77/49.84 |
|
|
FA |
65.99/74.71/70.08 |
43.23/44.51/43.86 |
37.14/45.38/40.85 |
48.52/56.47/52.20 |
|
|
FI |
83.02/57.89/68.22 |
40.74/25.00/30.99 |
35.44/53.85/42.75 |
52.20/48.26/50.15 |
|
|
FR |
78.24/76.49/77.36 |
37.00/35.24/36.10 |
35.78/40.21/37.86 |
48.18/50.93/49.52 |
|
|
FM |
60.00/75.00/66.67 |
100.0/50.00/66.67 |
60.00/50.00/54.55 |
62.50/66.67/64.52 |
|
|
|
|||||
|
W |
59.99/85.53 /70.52 |
29.33/49.66/36.88 |
35.72/45.85/40.16 |
43.55/59.58/50.32 |
|
|
ConcordU |
A |
56.51/84.56 /67.75 |
29.97/49.76/37.41 |
36.24/47.09/40.96 |
43.09/60.37/50.28 |
|
F |
70.65/88.03 /78.39 |
27.78/49.38/35.56 |
34.58/43.22/38.42 |
44.71/57.75/50.40 |
|
|
FA |
56.51/84.56 /67.75 |
29.97/49.76/37.41 |
36.24/47.09/40.96 |
43.09/60.37/50.28 |
|
|
FI |
58.49/86.11 /69.66 |
22.22/50.00/30.77 |
31.65/40.98/35.71 |
38.99/56.88/46.27 |
|
|
FR |
71.37/89.05 /79.24 |
28.00/53.85/36.84 |
33.76/44.12/38.25 |
43.99/58.76/50.32 |
|
|
FM |
72.00/94.74/81.82 |
50.00/20.00/28.57 |
40.00/11.76/18.18 |
65.62/51.22/57.53 |
|
|
|
|||||
|
W |
57.33/71.34/63.57 |
34.01/44.77/38.66 |
16.39/25.37/19.91 |
32.73/45.84/38.19 |
|
|
TM-SCS |
A |
53.65/71.66/61.36 |
36.02/49.41/41.67 |
18.29/27.07/21.83 |
33.36/47.09/39.06 |
|
F |
68.57/70.59/69.57 |
29.17/35.00/31.82 |
12.20/21.02/15.44 |
31.14/42.83/36.06 |
|
|
FA |
53.65/71.66/61.36 |
36.02/49.41/41.67 |
18.29/27.07/21.83 |
33.36/47.09/39.06 |
|
|
FI |
71.70/67.86/69.72 |
18.52/31.25/23.26 |
12.66/27.78/17.39 |
33.33/49.07/39.70 |
|
|
FR |
66.03/69.76/67.84 |
32.00/37.65/34.59 |
11.38/19.68/14.42 |
29.44/41.20/34.34 |
|
|
FM |
72.00/72.00/72.00 |
50.00/50.00/50.00 |
20.00/12.50/15.38 |
62.50/57.14/59.70 |
|
|
|
|||||
|
The full paper collection is further classified to titles/abstracts (FA), introductions (FI), results/dicussions/conclusions (FR), and methods (FM). Evaluated performance is reported in recall/precision/f-score. Some notable figures are underlined. |
|||||
|
Kim et al. BMC Bioinformatics 2012 13(Suppl 11):S1 doi:10.1186/1471-2105-13-S11-S1 |
|||||
