Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SAM-T99sec
3. PROFsec
4. APSSP2
5. SCRATCH (SSpro3)
6. SSpro1
7. SSpro2
8. PROF_king
9. PHDpsi
10. JPred
11. Prospect
12. PHD
13. JUFO
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SAM-T99sec | PROFsec | APSSP2 | SCRATCH (SSpro3) | SSpro1 | SSpro2 | PROF_king | PHDpsi | JPred | Prospect | PHD | JUFO | PSSP | APSSP |
1. PSIpred | | 0.01 ± 7.93 [ 195] | 0.64 ± 8.40 [ 245] | 1.01 ± 4.59 [ 247] | 0.05 ± 6.21 [ 50] | ? | 1.30 ± 7.93 [ 232] | 2.67 ± 7.54 [ 240] | 3.14 ± 9.10 [ 243] | 2.95 ± 7.68 [ 151] | 2.97 ± 9.30 [ 178] | 4.99 ± 10.26 [ 245] | 4.15 ± 8.20 [ 34] | ? | 7.45 ± 10.44 [ 210] | 2. SAM-T99sec | -0.01 ± 7.93 [ 195] | | -0.12 ± 8.09 [ 180] | 0.80 ± 7.67 [ 175] | 1.00 ± 6.97 [ 61] | ? | 0.89 ± 8.04 [ 161] | 2.13 ± 7.61 [ 186] | 2.02 ± 8.10 [ 179] | 2.04 ± 7.87 [ 108] | 3.59 ± 9.69 [ 136] | 3.82 ± 9.75 [ 180] | 5.40 ± 7.45 [ 43] | ? | 6.72 ± 10.70 [ 146] | 3. PROFsec | -0.64 ± 8.40 [ 245] | 0.12 ± 8.09 [ 180] | | 0.48 ± 8.53 [ 221] | -1.01 ± 7.97 [ 75] | ? | 1.05 ± 7.26 [ 194] | 1.84 ± 7.12 [ 230] | 2.26 ± 5.96 [ 276] | 3.10 ± 7.79 [ 129] | 2.62 ± 9.68 [ 170] | 3.90 ± 7.46 [ 278] | 2.73 ± 9.25 [ 53] | ? | 6.90 ± 10.02 [ 176] | 4. APSSP2 | -1.01 ± 4.59 [ 247] | -0.80 ± 7.67 [ 175] | -0.48 ± 8.53 [ 221] | | 0.17 ± 6.04 [ 42] | ? | 0.02 ± 7.22 [ 231] | 1.71 ± 8.34 [ 238] | 2.03 ± 9.59 [ 219] | 1.85 ± 6.86 [ 144] | 3.02 ± 10.69 [ 186] | 3.42 ± 10.49 [ 221] | 4.82 ± 6.82 [ 29] | ? | 6.21 ± 8.97 [ 210] | 5. SCRATCH (SSpro3) | -0.05 ± 6.21 [ 50] | -1.00 ± 6.97 [ 61] | 1.01 ± 7.97 [ 75] | -0.17 ± 6.04 [ 42] | | ? | ? | 2.17 ± 7.42 [ 72] | 2.80 ± 8.41 [ 75] | ? | 3.40 ± 12.07 [ 58] | 2.92 ± 8.64 [ 75] | 4.05 ± 8.30 [ 53] | ? | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. SSpro2 | -1.30 ± 7.93 [ 232] | -0.89 ± 8.04 [ 161] | -1.05 ± 7.26 [ 194] | -0.02 ± 7.22 [ 231] | ? | ? | | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.74 ± 7.35 [ 166] | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | ? | ? | 5.95 ± 9.61 [ 233] | 8. PROF_king | -2.67 ± 7.54 [ 240] | -2.13 ± 7.61 [ 186] | -1.84 ± 7.12 [ 230] | -1.71 ± 8.34 [ 238] | -2.17 ± 7.42 [ 72] | ? | -1.11 ± 7.19 [ 204] | | 0.36 ± 7.60 [ 228] | 0.56 ± 7.08 [ 123] | 0.88 ± 9.90 [ 195] | 1.70 ± 8.30 [ 230] | 2.05 ± 8.11 [ 52] | ? | 5.61 ± 9.21 [ 181] | 9. PHDpsi | -3.14 ± 9.10 [ 243] | -2.02 ± 8.10 [ 179] | -2.26 ± 5.96 [ 276] | -2.03 ± 9.59 [ 219] | -2.80 ± 8.41 [ 75] | ? | -1.40 ± 7.75 [ 192] | -0.36 ± 7.60 [ 228] | | 0.81 ± 8.05 [ 128] | 0.45 ± 10.18 [ 168] | 1.65 ± 5.77 [ 276] | 1.52 ± 6.62 [ 53] | ? | 4.33 ± 9.89 [ 174] | 10. JPred | -2.95 ± 7.68 [ 151] | -2.04 ± 7.87 [ 108] | -3.10 ± 7.79 [ 129] | -1.85 ± 6.86 [ 144] | ? | ? | -1.74 ± 7.35 [ 166] | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | ? | ? | 4.29 ± 8.18 [ 165] | 11. Prospect | -2.97 ± 9.30 [ 178] | -3.59 ± 9.69 [ 136] | -2.62 ± 9.68 [ 170] | -3.02 ± 10.69 [ 186] | -3.40 ± 12.07 [ 58] | ? | -1.94 ± 8.98 [ 150] | -0.88 ± 9.90 [ 195] | -0.45 ± 10.18 [ 168] | -1.77 ± 9.86 [ 88] | | 0.71 ± 11.05 [ 170] | 0.38 ± 11.93 [ 48] | ? | 3.98 ± 12.03 [ 132] | 12. PHD | -4.99 ± 10.26 [ 245] | -3.82 ± 9.75 [ 180] | -3.90 ± 7.46 [ 278] | -3.42 ± 10.49 [ 221] | -2.92 ± 8.64 [ 75] | ? | -3.61 ± 9.30 [ 194] | -1.70 ± 8.30 [ 230] | -1.65 ± 5.77 [ 276] | -2.68 ± 9.89 [ 129] | -0.71 ± 11.05 [ 170] | | 1.34 ± 7.23 [ 53] | ? | 1.94 ± 9.91 [ 176] | 13. JUFO | -4.15 ± 8.20 [ 34] | -5.40 ± 7.45 [ 43] | -2.73 ± 9.25 [ 53] | -4.82 ± 6.82 [ 29] | -4.05 ± 8.30 [ 53] | ? | ? | -2.05 ± 8.11 [ 52] | -1.52 ± 6.62 [ 53] | ? | -0.38 ± 11.93 [ 48] | -1.34 ± 7.23 [ 53] | | ? | ? | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -7.45 ± 10.44 [ 210] | -6.72 ± 10.70 [ 146] | -6.90 ± 10.02 [ 176] | -6.21 ± 8.97 [ 210] | ? | ? | -5.95 ± 9.61 [ 233] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -4.29 ± 8.18 [ 165] | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PROFsec
2. PSIpred
3. SSpro1
4. SAM-T99sec
5. APSSP2
6. PROF_king
7. SCRATCH (SSpro3)
8. SSpro2
9. JPred
10. Prospect
11. PHDpsi
12. JUFO
13. PHD
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PROFsec | PSIpred | SSpro1 | SAM-T99sec | APSSP2 | PROF_king | SCRATCH (SSpro3) | SSpro2 | JPred | Prospect | PHDpsi | JUFO | PHD | PSSP | APSSP |
1. PROFsec | | -0.77 ± 13.34 [ 245] | ? | 0.74 ± 11.65 [ 180] | 1.57 ± 13.72 [ 221] | 2.38 ± 10.46 [ 230] | 0.29 ± 11.09 [ 75] | 2.69 ± 11.65 [ 194] | 3.43 ± 10.66 [ 129] | 3.07 ± 14.91 [ 170] | 3.31 ± 9.15 [ 276] | 2.96 ± 13.79 [ 53] | 4.81 ± 11.04 [ 278] | ? | 8.83 ± 14.59 [ 176] | 2. PSIpred | 0.77 ± 13.34 [ 245] | | ? | 1.31 ± 12.01 [ 195] | 1.79 ± 8.92 [ 247] | 3.65 ± 11.65 [ 240] | 2.37 ± 11.07 [ 50] | 3.28 ± 12.70 [ 232] | 3.58 ± 11.04 [ 151] | 3.45 ± 13.24 [ 178] | 4.56 ± 14.26 [ 243] | 3.78 ± 11.46 [ 34] | 6.20 ± 15.33 [ 245] | ? | 9.72 ± 14.02 [ 210] | 3. SSpro1 | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 4. SAM-T99sec | -0.74 ± 11.65 [ 180] | -1.31 ± 12.01 [ 195] | ? | | 0.76 ± 12.99 [ 175] | 1.56 ± 11.80 [ 186] | 1.89 ± 11.43 [ 61] | 1.68 ± 11.97 [ 161] | 1.55 ± 10.64 [ 108] | 3.11 ± 15.28 [ 136] | 2.45 ± 11.50 [ 179] | 4.87 ± 12.50 [ 43] | 4.03 ± 12.56 [ 180] | ? | 6.99 ± 14.40 [ 146] | 5. APSSP2 | -1.57 ± 13.72 [ 221] | -1.79 ± 8.92 [ 247] | ? | -0.76 ± 12.99 [ 175] | | 1.82 ± 12.40 [ 238] | 1.51 ± 10.87 [ 42] | 0.65 ± 13.37 [ 231] | 1.22 ± 10.63 [ 144] | 2.75 ± 14.65 [ 186] | 2.02 ± 15.86 [ 219] | 4.63 ± 9.73 [ 29] | 3.58 ± 16.92 [ 221] | ? | 7.03 ± 13.51 [ 210] | 6. PROF_king | -2.38 ± 10.46 [ 230] | -3.65 ± 11.65 [ 240] | ? | -1.56 ± 11.80 [ 186] | -1.82 ± 12.40 [ 238] | | -1.75 ± 11.49 [ 72] | 0.06 ± 11.38 [ 204] | 0.66 ± 11.46 [ 123] | -0.00 ± 13.56 [ 195] | 0.79 ± 11.48 [ 228] | 1.12 ± 13.51 [ 52] | 2.32 ± 12.11 [ 230] | ? | 7.39 ± 13.01 [ 181] | 7. SCRATCH (SSpro3) | -0.29 ± 11.09 [ 75] | -2.37 ± 11.07 [ 50] | ? | -1.89 ± 11.43 [ 61] | -1.51 ± 10.87 [ 42] | 1.75 ± 11.49 [ 72] | | ? | ? | 1.89 ± 17.58 [ 58] | 2.82 ± 11.58 [ 75] | 2.69 ± 12.44 [ 53] | 2.99 ± 11.73 [ 75] | ? | ? | 8. SSpro2 | -2.69 ± 11.65 [ 194] | -3.28 ± 12.70 [ 232] | ? | -1.68 ± 11.97 [ 161] | -0.65 ± 13.37 [ 231] | -0.06 ± 11.38 [ 204] | ? | | 0.30 ± 11.91 [ 166] | 0.31 ± 14.53 [ 150] | 0.71 ± 13.51 [ 192] | ? | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. JPred | -3.43 ± 10.66 [ 129] | -3.58 ± 11.04 [ 151] | ? | -1.55 ± 10.64 [ 108] | -1.22 ± 10.63 [ 144] | -0.66 ± 11.46 [ 123] | ? | -0.30 ± 11.91 [ 166] | | 1.87 ± 14.44 [ 88] | -0.05 ± 11.37 [ 128] | ? | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 10. Prospect | -3.07 ± 14.91 [ 170] | -3.45 ± 13.24 [ 178] | ? | -3.11 ± 15.28 [ 136] | -2.75 ± 14.65 [ 186] | 0.00 ± 13.56 [ 195] | -1.89 ± 17.58 [ 58] | -0.31 ± 14.53 [ 150] | -1.87 ± 14.44 [ 88] | | 0.71 ± 15.72 [ 168] | 0.11 ± 18.62 [ 48] | 1.98 ± 16.59 [ 170] | ? | 5.76 ± 16.07 [ 132] | 11. PHDpsi | -3.31 ± 9.15 [ 276] | -4.56 ± 14.26 [ 243] | ? | -2.45 ± 11.50 [ 179] | -2.02 ± 15.86 [ 219] | -0.79 ± 11.48 [ 228] | -2.82 ± 11.58 [ 75] | -0.71 ± 13.51 [ 192] | 0.05 ± 11.37 [ 128] | -0.71 ± 15.72 [ 168] | | 0.36 ± 10.12 [ 53] | 1.45 ± 7.39 [ 276] | ? | 5.48 ± 13.88 [ 174] | 12. JUFO | -2.96 ± 13.79 [ 53] | -3.78 ± 11.46 [ 34] | ? | -4.87 ± 12.50 [ 43] | -4.63 ± 9.73 [ 29] | -1.12 ± 13.51 [ 52] | -2.69 ± 12.44 [ 53] | ? | ? | -0.11 ± 18.62 [ 48] | -0.36 ± 10.12 [ 53] | | -0.12 ± 10.40 [ 53] | ? | ? | 13. PHD | -4.81 ± 11.04 [ 278] | -6.20 ± 15.33 [ 245] | ? | -4.03 ± 12.56 [ 180] | -3.58 ± 16.92 [ 221] | -2.32 ± 12.11 [ 230] | -2.99 ± 11.73 [ 75] | -2.62 ± 14.58 [ 194] | -2.98 ± 13.90 [ 129] | -1.98 ± 16.59 [ 170] | -1.45 ± 7.39 [ 276] | 0.12 ± 10.40 [ 53] | | ? | 3.37 ± 12.86 [ 176] | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -8.83 ± 14.59 [ 176] | -9.72 ± 14.02 [ 210] | ? | -6.99 ± 14.40 [ 146] | -7.03 ± 13.51 [ 210] | -7.39 ± 13.01 [ 181] | ? | -6.27 ± 14.06 [ 233] | -5.51 ± 12.88 [ 165] | -5.76 ± 16.07 [ 132] | -5.48 ± 13.88 [ 174] | ? | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top