Table 9 |
|||||||||
|
Five Way Classification Including 'Outcome Measure' on Manually Annotated Abstracts |
|||||||||
|
All Abstracts |
Structured Subset |
Unstructured Subset |
|||||||
|
|
|||||||||
|
P |
R |
F |
P |
R |
F |
P |
R |
F |
|
|
|
|||||||||
|
System 1 |
Accuracy = 90.29% |
Accuracy = 90.95% |
Accuracy = 00.00% |
||||||
|
|
|||||||||
|
Aim |
0.98 |
0.97 |
0.97 |
0.98 |
0.98 |
0.98 |
0.97 |
0.94 |
0.96 |
|
Method |
0.87 |
0.83 |
0.85 |
0.88 |
0.83 |
0.85 |
0.85 |
0.82 |
0.84 |
|
Outcome Measure |
0.79 |
0.69 |
0.74 |
0.80 |
0.69 |
0.74 |
0.76 |
0.69 |
0.72 |
|
Results |
0.89 |
0.96 |
0.92 |
0.90 |
0.97 |
0.93 |
0.88 |
0.93 |
0.90 |
|
Conclusion |
0.96 |
0.93 |
0.95 |
0.98 |
0.94 |
0.96 |
0.93 |
0.93 |
0.93 |
|
|
|||||||||
|
System 2 |
Accuracy = 94.22% |
Accuracy = 94.89% |
Accuracy = 92.70% |
||||||
|
|
|||||||||
|
Aim |
0.98 |
0.98 |
0.98 |
0.98 |
0.99 |
0.99 |
0.96 |
0.95 |
0.96 |
|
Method |
0.88 |
0.88 |
0.88 |
0.89 |
0.88 |
0.89 |
0.87 |
0.88 |
0.88 |
|
Outcome Measure |
0.81 |
0.77 |
0.79 |
0.82 |
0.77 |
0.79 |
0.80 |
0.75 |
0.77 |
|
Results |
0.97 |
0.98 |
0.98 |
0.98 |
0.99 |
0.99 |
0.95 |
0.97 |
0.96 |
|
Conclusion |
0.99 |
0.99 |
0.99 |
1.00 |
1.00 |
1.00 |
0.97 |
0.97 |
0.97 |
|
|
|||||||||
|
System 3 |
Accuracy = 94.77% |
Accuracy = 94.89% |
Accuracy = 94.07% |
||||||
|
|
|||||||||
|
Aim |
0.98 |
0.99 |
0.99 |
0.98 |
0.99 |
0.99 |
0.98 |
0.98 |
0.98 |
|
Method |
0.89 |
0.89 |
0.89 |
0.89 |
0.88 |
0.89 |
0.90 |
0.88 |
0.89 |
|
Outcome Measure |
0.81 |
0.77 |
0.79 |
0.82 |
0.77 |
0.79 |
0.78 |
0.77 |
0.78 |
|
Results |
0.98 |
0.99 |
0.98 |
0.98 |
0.99 |
0.99 |
0.96 |
0.98 |
0.97 |
|
Conclusion |
0.99 |
0.99 |
0.99 |
1.00 |
1.00 |
1.00 |
0.99 |
0.98 |
0.98 |
|
|
|||||||||
|
System 4 |
Accuracy = 95.60% |
Accuracy = 96.71% |
Accuracy = 93.09% |
||||||
|
|
|||||||||
|
Aim |
0.99 |
0.98 |
0.98 |
1.00 |
1.00 |
1.00 |
0.96 |
0.95 |
0.96 |
|
Method |
0.91 |
0.89 |
0.90 |
0.92 |
0.91 |
0.92 |
0.91 |
0.85 |
0.88 |
|
Outcome Measure |
0.82 |
0.85 |
0.84 |
0.85 |
0.86 |
0.85 |
0.76 |
0.83 |
0.79 |
|
Results |
0.99 |
0.99 |
0.99 |
1.00 |
1.00 |
1.00 |
0.96 |
0.97 |
0.96 |
|
Conclusion |
0.99 |
0.99 |
0.99 |
1.00 |
1.00 |
1.00 |
0.97 |
0.98 |
0.97 |
|
|
|||||||||
|
Sentence classification using CRFs into five classes including Outcome Measure. Results report on four systems as described in Table 8. System 4 describes a system identical to System 2 except the training data is augmented with those from Set O. |
|||||||||
|
Chung BMC Medical Informatics and Decision Making 2009 9:10 doi:10.1186/1472-6947-9-10 |
|||||||||
