|
Summary results for performance comparisons between SCOPE and its component algorithms, on all regulons. A "Win" is a regulon for which a program had the highest accuracy and that accuracy was at least 0.10. Programs in a two-way tie are credited with 0.5 wins each, so by construction, SCOPE can at best share a win with one of the other programs. A perfect winner-take-all ensemble method would have the same number of wins as all the component algorithms combined. A "clear win (loss)" is a regulon for which SCOPE's accuracy was at least 0.10 higher (lower) than the other program. The p-value reported for the paired t-test was Bonferroni-corrected to account for multiple (three) comparisons. |
||||
| SCOPE |
BEAM |
PRISM |
SPACER |
|
|
|
||||
| Average |
0.24 |
0.17 |
0.18 |
0.17 |
| Stderr |
0.02 |
0.02 |
0.02 |
0.02 |
| Wins |
20 |
13 |
11 |
17 |
| scores ≥ 0.50 |
8 |
8 |
6 |
5 |
| scores ≥ 0.33 |
21 |
15 |
14 |
14 |
| scores ≥ 0.20 |
39 |
23 |
23 |
26 |
| Regulons returned |
78 |
78 |
78 |
78 |
| clear win for SCOPE vs |
- |
28 |
18 |
19 |
| clear loss for SCOPE vs |
- |
6 |
2 |
3 |
| t-test p-value |
- |
0.002 |
0.002 |
0.004 |
Chakravarty et al. BMC Bioinformatics 2007 8:249 doi:10.1186/1471-2105-8-249 |
||||