Table 6

Evaluation results of Task 1 on the (W)hole, (A)bstract, and (F)ull paper collections

Team

Part

Simple Event

Binding

Regulation

All


UTurku09

A

64.21/77.45/70.21

40.06/49.82/44.41

35.63/45.87/40.11

46.73/58.48/51.95


Miwa10

A

70.44

52.62

40.60

48.62/58.96/53.29


W

    68.47/80.25/73.90

44.20/53.71/48.49

    38.02/54.94/44.94

    49.41/64.75/56.04

FAUST

A

    66.16/81.04/72.85

    45.53/58.09/51.05

    39.38/58.18/46.97

    50.00/67.53/57.46

F

75.58/78.23/76.88

40.97/44.70/42.75

    34.99/48.24/40.56

47.92/58.47/52.67

FA

66.16/81.04/72.85

45.53/58.09/51.05

39.38/58.18/46.97

50.00/67.53/57.46

FI

77.36/71.93/74.55

29.63/36.36/32.65

41.77/50.77/45.83

51.57/56.94/54.13

FR

76.34/80.00/78.13

39.00/43.82/41.27

32.66/45.64/38.07

45.98/57.20/50.98

FM

48.00/75.00/58.54

100.0/50.00/66.67

20.00/50.00/28.57

46.88/68.18/55.56


W

67.01/81.40/73.50

    42.97/56.42/48.79

37.52/52.67/43.82

48.49/64.08/55.20

UMass

A

64.21/80.74/71.54

43.52/60.89/50.76

38.78/55.07/45.51

48.74/65.94/56.05

F

    75.58/83.14/79.18

    41.67/47.62/44.44

34.72/47.51/40.12

    47.84/59.76/53.14

FA

64.21/80.74/71.54

43.52/60.89/50.76

38.78/55.07/45.51

48.74/65.94/56.05

FI

79.25/82.35/80.77

44.44/48.00/46.15

35.44/56.00/43.41

51.57/65.08/57.54

FR

75.95/83.97/79.76

34.00/40.96/37.16

32.29/42.89/36.85

45.09/56.04/49.98

FM

48.00/85.71/61.54

100.0/100.0/100.0

20.00/33.33/25.00

46.88/78.95/58.82


W

68.22/76.47/72.11

42.97/43.60/43.28

38.72/47.64/42.72

49.56/57.65/53.30

UTurku

A

64.97/76.72/70.36

45.24/50.00/47.50

40.41/49.01/44.30

50.06/59.48/54.37

F

78.18/75.82/76.98

37.50/31.76/34.39

34.99/44.46/39.16

48.31/53.38/50.72

FA

64.97/76.72/70.36

45.24/50.00/47.50

40.41/49.01/44.30

50.06/59.48/54.37

FI

84.91/67.16/75.00

25.93/30.43/28.00

30.38/30.77/30.57

47.80/45.24/46.48

FR

77.48/78.99/78.23

36.00/30.51/33.03

34.68/45.54/39.38

47.19/54.18/50.44

FM

60.00/75.00/66.67

100.0/20.00/33.33

40.00/25.00/30.77

59.38/50.00/54.29


W

68.99/74.30/71.54

42.36/40.47/41.39

36.64/44.08/40.02

48.64/54.71/51.50

MSR-NLP

A

65.99/74.71/70.08

43.23/44.51/43.86

37.14/45.38/40.85

48.52/56.47/52.20

F

78.18/73.24/75.63

40.28/32.77/36.14

35.52/41.34/38.21

48.94/50.77/49.84

FA

65.99/74.71/70.08

43.23/44.51/43.86

37.14/45.38/40.85

48.52/56.47/52.20

FI

83.02/57.89/68.22

40.74/25.00/30.99

35.44/53.85/42.75

52.20/48.26/50.15

FR

78.24/76.49/77.36

37.00/35.24/36.10

35.78/40.21/37.86

48.18/50.93/49.52

FM

60.00/75.00/66.67

100.0/50.00/66.67

60.00/50.00/54.55

62.50/66.67/64.52


W

59.99/

    85.53
/70.52

29.33/49.66/36.88

35.72/45.85/40.16

43.55/59.58/50.32

ConcordU

A

56.51/

    84.56
/67.75

29.97/49.76/37.41

36.24/47.09/40.96

43.09/60.37/50.28

F

70.65/

    88.03
/78.39

27.78/49.38/35.56

34.58/43.22/38.42

44.71/57.75/50.40

FA

56.51/

    84.56
/67.75

29.97/49.76/37.41

36.24/47.09/40.96

43.09/60.37/50.28

FI

58.49/

    86.11
/69.66

22.22/50.00/30.77

31.65/40.98/35.71

38.99/56.88/46.27

FR

71.37/

    89.05
/79.24

28.00/53.85/36.84

33.76/44.12/38.25

43.99/58.76/50.32

FM

72.00/94.74/81.82

50.00/20.00/28.57

40.00/11.76/18.18

65.62/51.22/57.53


W

57.33/71.34/63.57

34.01/44.77/38.66

16.39/25.37/19.91

32.73/45.84/38.19

TM-SCS

A

53.65/71.66/61.36

36.02/49.41/41.67

18.29/27.07/21.83

33.36/47.09/39.06

F

68.57/70.59/69.57

29.17/35.00/31.82

12.20/21.02/15.44

31.14/42.83/36.06

FA

53.65/71.66/61.36

36.02/49.41/41.67

18.29/27.07/21.83

33.36/47.09/39.06

FI

71.70/67.86/69.72

18.52/31.25/23.26

12.66/27.78/17.39

33.33/49.07/39.70

FR

66.03/69.76/67.84

32.00/37.65/34.59

11.38/19.68/14.42

29.44/41.20/34.34

FM

    72.00/72.00/72.00

50.00/50.00/50.00

20.00/12.50/15.38

62.50/57.14/59.70


The full paper collection is further classified to titles/abstracts (FA), introductions (FI), results/dicussions/conclusions (FR), and methods (FM). Evaluated performance is reported in recall/precision/f-score. Some notable figures are underlined.

Kim et al. BMC Bioinformatics 2012 13(Suppl 11):S1   doi:10.1186/1471-2105-13-S11-S1

Open Data