Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SAM-T99sec
3. PROFsec
4. APSSP2
5. SCRATCH (SSpro3)
6. SSpro1
7. SSpro2
8. PROF_king
9. PHDpsi
10. JPred
11. Prospect
12. PHD
13. JUFO
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SAM-T99sec | PROFsec | APSSP2 | SCRATCH (SSpro3) | SSpro1 | SSpro2 | PROF_king | PHDpsi | JPred | Prospect | PHD | JUFO | PSSP | APSSP |
1. PSIpred | | -0.00 ± 8.00 [ 191] | 0.62 ± 8.42 [ 241] | 1.01 ± 4.59 [ 247] | 0.52 ± 6.18 [ 46] | ? | 1.30 ± 7.93 [ 232] | 2.72 ± 7.55 [ 236] | 3.09 ± 9.10 [ 239] | 2.95 ± 7.68 [ 151] | 2.98 ± 9.19 [ 174] | 4.97 ± 10.28 [ 241] | 4.01 ± 6.76 [ 30] | ? | 7.45 ± 10.44 [ 210] | 2. SAM-T99sec | 0.00 ± 8.00 [ 191] | | -0.16 ± 8.19 [ 175] | 0.80 ± 7.67 [ 175] | 1.57 ± 6.83 [ 56] | ? | 0.89 ± 8.04 [ 161] | 2.21 ± 7.68 [ 181] | 1.96 ± 8.14 [ 174] | 2.04 ± 7.87 [ 108] | 3.62 ± 9.71 [ 131] | 3.82 ± 9.83 [ 175] | 5.56 ± 7.00 [ 38] | ? | 6.72 ± 10.70 [ 146] | 3. PROFsec | -0.62 ± 8.42 [ 241] | 0.16 ± 8.19 [ 175] | | 0.48 ± 8.53 [ 221] | -0.59 ± 7.85 [ 70] | ? | 1.05 ± 7.26 [ 194] | 1.92 ± 7.17 [ 225] | 2.25 ± 5.97 [ 271] | 3.10 ± 7.79 [ 129] | 2.65 ± 9.73 [ 165] | 3.92 ± 7.49 [ 273] | 2.72 ± 9.40 [ 48] | ? | 6.90 ± 10.02 [ 176] | 4. APSSP2 | -1.01 ± 4.59 [ 247] | -0.80 ± 7.67 [ 175] | -0.48 ± 8.53 [ 221] | | 0.17 ± 6.04 [ 42] | ? | 0.02 ± 7.22 [ 231] | 1.71 ± 8.34 [ 238] | 2.03 ± 9.59 [ 219] | 1.85 ± 6.86 [ 144] | 3.02 ± 10.69 [ 186] | 3.42 ± 10.49 [ 221] | 4.82 ± 6.82 [ 29] | ? | 6.21 ± 8.97 [ 210] | 5. SCRATCH (SSpro3) | -0.52 ± 6.18 [ 46] | -1.57 ± 6.83 [ 56] | 0.59 ± 7.85 [ 70] | -0.17 ± 6.04 [ 42] | | ? | ? | 1.98 ± 7.39 [ 67] | 2.32 ± 8.05 [ 70] | ? | 2.92 ± 11.81 [ 53] | 2.45 ± 8.31 [ 70] | 3.46 ± 7.03 [ 48] | ? | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. SSpro2 | -1.30 ± 7.93 [ 232] | -0.89 ± 8.04 [ 161] | -1.05 ± 7.26 [ 194] | -0.02 ± 7.22 [ 231] | ? | ? | | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.74 ± 7.35 [ 166] | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | ? | ? | 5.95 ± 9.61 [ 233] | 8. PROF_king | -2.72 ± 7.55 [ 236] | -2.21 ± 7.68 [ 181] | -1.92 ± 7.17 [ 225] | -1.71 ± 8.34 [ 238] | -1.98 ± 7.39 [ 67] | ? | -1.11 ± 7.19 [ 204] | | 0.26 ± 7.62 [ 223] | 0.56 ± 7.08 [ 123] | 0.81 ± 9.94 [ 190] | 1.63 ± 8.35 [ 225] | 1.73 ± 8.05 [ 47] | ? | 5.61 ± 9.21 [ 181] | 9. PHDpsi | -3.09 ± 9.10 [ 239] | -1.96 ± 8.14 [ 174] | -2.25 ± 5.97 [ 271] | -2.03 ± 9.59 [ 219] | -2.32 ± 8.05 [ 70] | ? | -1.40 ± 7.75 [ 192] | -0.26 ± 7.62 [ 223] | | 0.81 ± 8.05 [ 128] | 0.50 ± 10.18 [ 163] | 1.68 ± 5.82 [ 271] | 1.66 ± 6.58 [ 48] | ? | 4.33 ± 9.89 [ 174] | 10. JPred | -2.95 ± 7.68 [ 151] | -2.04 ± 7.87 [ 108] | -3.10 ± 7.79 [ 129] | -1.85 ± 6.86 [ 144] | ? | ? | -1.74 ± 7.35 [ 166] | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | ? | ? | 4.29 ± 8.18 [ 165] | 11. Prospect | -2.98 ± 9.19 [ 174] | -3.62 ± 9.71 [ 131] | -2.65 ± 9.73 [ 165] | -3.02 ± 10.69 [ 186] | -2.92 ± 11.81 [ 53] | ? | -1.94 ± 8.98 [ 150] | -0.81 ± 9.94 [ 190] | -0.50 ± 10.18 [ 163] | -1.77 ± 9.86 [ 88] | | 0.70 ± 11.07 [ 165] | 0.28 ± 12.29 [ 43] | ? | 3.98 ± 12.03 [ 132] | 12. PHD | -4.97 ± 10.28 [ 241] | -3.82 ± 9.83 [ 175] | -3.92 ± 7.49 [ 273] | -3.42 ± 10.49 [ 221] | -2.45 ± 8.31 [ 70] | ? | -3.61 ± 9.30 [ 194] | -1.63 ± 8.35 [ 225] | -1.68 ± 5.82 [ 271] | -2.68 ± 9.89 [ 129] | -0.70 ± 11.07 [ 165] | | 1.46 ± 7.26 [ 48] | ? | 1.94 ± 9.91 [ 176] | 13. JUFO | -4.01 ± 6.76 [ 30] | -5.56 ± 7.00 [ 38] | -2.72 ± 9.40 [ 48] | -4.82 ± 6.82 [ 29] | -3.46 ± 7.03 [ 48] | ? | ? | -1.73 ± 8.05 [ 47] | -1.66 ± 6.58 [ 48] | ? | -0.28 ± 12.29 [ 43] | -1.46 ± 7.26 [ 48] | | ? | ? | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -7.45 ± 10.44 [ 210] | -6.72 ± 10.70 [ 146] | -6.90 ± 10.02 [ 176] | -6.21 ± 8.97 [ 210] | ? | ? | -5.95 ± 9.61 [ 233] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -4.29 ± 8.18 [ 165] | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PROFsec
2. PSIpred
3. SSpro1
4. SAM-T99sec
5. APSSP2
6. SCRATCH (SSpro3)
7. PROF_king
8. SSpro2
9. JPred
10. Prospect
11. JUFO
12. PHDpsi
13. PHD
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PROFsec | PSIpred | SSpro1 | SAM-T99sec | APSSP2 | SCRATCH (SSpro3) | PROF_king | SSpro2 | JPred | Prospect | JUFO | PHDpsi | PHD | PSSP | APSSP |
1. PROFsec | | -0.81 ± 13.35 [ 241] | ? | 0.90 ± 11.75 [ 175] | 1.57 ± 13.72 [ 221] | 0.33 ± 11.19 [ 70] | 2.47 ± 10.51 [ 225] | 2.69 ± 11.65 [ 194] | 3.43 ± 10.66 [ 129] | 3.07 ± 14.91 [ 165] | 2.72 ± 13.16 [ 48] | 3.34 ± 9.20 [ 271] | 4.87 ± 11.11 [ 273] | ? | 8.83 ± 14.59 [ 176] | 2. PSIpred | 0.81 ± 13.35 [ 241] | | ? | 1.48 ± 12.00 [ 191] | 1.79 ± 8.92 [ 247] | 2.47 ± 11.17 [ 46] | 3.72 ± 11.64 [ 236] | 3.28 ± 12.70 [ 232] | 3.58 ± 11.04 [ 151] | 3.52 ± 13.36 [ 174] | 3.45 ± 9.76 [ 30] | 4.60 ± 14.31 [ 239] | 6.27 ± 15.39 [ 241] | ? | 9.72 ± 14.02 [ 210] | 3. SSpro1 | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 4. SAM-T99sec | -0.90 ± 11.75 [ 175] | -1.48 ± 12.00 [ 191] | ? | | 0.76 ± 12.99 [ 175] | 1.63 ± 11.63 [ 56] | 1.51 ± 11.91 [ 181] | 1.68 ± 11.97 [ 161] | 1.55 ± 10.64 [ 108] | 2.93 ± 15.35 [ 131] | 4.16 ± 10.98 [ 38] | 2.33 ± 11.58 [ 174] | 3.96 ± 12.67 [ 175] | ? | 6.99 ± 14.40 [ 146] | 5. APSSP2 | -1.57 ± 13.72 [ 221] | -1.79 ± 8.92 [ 247] | ? | -0.76 ± 12.99 [ 175] | | 1.51 ± 10.87 [ 42] | 1.82 ± 12.40 [ 238] | 0.65 ± 13.37 [ 231] | 1.22 ± 10.63 [ 144] | 2.75 ± 14.65 [ 186] | 4.63 ± 9.73 [ 29] | 2.02 ± 15.86 [ 219] | 3.58 ± 16.92 [ 221] | ? | 7.03 ± 13.51 [ 210] | 6. SCRATCH (SSpro3) | -0.33 ± 11.19 [ 70] | -2.47 ± 11.17 [ 46] | ? | -1.63 ± 11.63 [ 56] | -1.51 ± 10.87 [ 42] | | 2.00 ± 11.82 [ 67] | ? | ? | 1.77 ± 17.85 [ 53] | 2.40 ± 12.03 [ 48] | 2.91 ± 11.85 [ 70] | 3.09 ± 12.02 [ 70] | ? | ? | 7. PROF_king | -2.47 ± 10.51 [ 225] | -3.72 ± 11.64 [ 236] | ? | -1.51 ± 11.91 [ 181] | -1.82 ± 12.40 [ 238] | -2.00 ± 11.82 [ 67] | | 0.06 ± 11.38 [ 204] | 0.66 ± 11.46 [ 123] | -0.13 ± 13.48 [ 190] | 0.48 ± 12.66 [ 47] | 0.74 ± 11.57 [ 223] | 2.30 ± 12.21 [ 225] | ? | 7.39 ± 13.01 [ 181] | 8. SSpro2 | -2.69 ± 11.65 [ 194] | -3.28 ± 12.70 [ 232] | ? | -1.68 ± 11.97 [ 161] | -0.65 ± 13.37 [ 231] | ? | -0.06 ± 11.38 [ 204] | | 0.30 ± 11.91 [ 166] | 0.31 ± 14.53 [ 150] | ? | 0.71 ± 13.51 [ 192] | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. JPred | -3.43 ± 10.66 [ 129] | -3.58 ± 11.04 [ 151] | ? | -1.55 ± 10.64 [ 108] | -1.22 ± 10.63 [ 144] | ? | -0.66 ± 11.46 [ 123] | -0.30 ± 11.91 [ 166] | | 1.87 ± 14.44 [ 88] | ? | -0.05 ± 11.37 [ 128] | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 10. Prospect | -3.07 ± 14.91 [ 165] | -3.52 ± 13.36 [ 174] | ? | -2.93 ± 15.35 [ 131] | -2.75 ± 14.65 [ 186] | -1.77 ± 17.85 [ 53] | 0.13 ± 13.48 [ 190] | -0.31 ± 14.53 [ 150] | -1.87 ± 14.44 [ 88] | | -0.15 ± 18.44 [ 43] | 0.78 ± 15.77 [ 163] | 2.09 ± 16.65 [ 165] | ? | 5.76 ± 16.07 [ 132] | 11. JUFO | -2.72 ± 13.16 [ 48] | -3.45 ± 9.76 [ 30] | ? | -4.16 ± 10.98 [ 38] | -4.63 ± 9.73 [ 29] | -2.40 ± 12.03 [ 48] | -0.48 ± 12.66 [ 47] | ? | ? | 0.15 ± 18.44 [ 43] | | 0.01 ± 9.52 [ 48] | 0.28 ± 9.84 [ 48] | ? | ? | 12. PHDpsi | -3.34 ± 9.20 [ 271] | -4.60 ± 14.31 [ 239] | ? | -2.33 ± 11.58 [ 174] | -2.02 ± 15.86 [ 219] | -2.91 ± 11.85 [ 70] | -0.74 ± 11.57 [ 223] | -0.71 ± 13.51 [ 192] | 0.05 ± 11.37 [ 128] | -0.78 ± 15.77 [ 163] | -0.01 ± 9.52 [ 48] | | 1.48 ± 7.46 [ 271] | ? | 5.48 ± 13.88 [ 174] | 13. PHD | -4.87 ± 11.11 [ 273] | -6.27 ± 15.39 [ 241] | ? | -3.96 ± 12.67 [ 175] | -3.58 ± 16.92 [ 221] | -3.09 ± 12.02 [ 70] | -2.30 ± 12.21 [ 225] | -2.62 ± 14.58 [ 194] | -2.98 ± 13.90 [ 129] | -2.09 ± 16.65 [ 165] | -0.28 ± 9.84 [ 48] | -1.48 ± 7.46 [ 271] | | ? | 3.37 ± 12.86 [ 176] | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -8.83 ± 14.59 [ 176] | -9.72 ± 14.02 [ 210] | ? | -6.99 ± 14.40 [ 146] | -7.03 ± 13.51 [ 210] | ? | -7.39 ± 13.01 [ 181] | -6.27 ± 14.06 [ 233] | -5.51 ± 12.88 [ 165] | -5.76 ± 16.07 [ 132] | ? | -5.48 ± 13.88 [ 174] | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top