Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. SAM-T99sec
2. PSIpred
3. PROFsec
4. SCRATCH (SSpro3)
5. APSSP2
6. SSpro1
7. SSpro2
8. PROF_king
9. PHDpsi
10. JPred
11. JUFO
12. Prospect
13. PHD
14. APSSP
15. PSSP
t-Student statistical analysis of the comparisons:
| SAM-T99sec | PSIpred | PROFsec | SCRATCH (SSpro3) | APSSP2 | SSpro1 | SSpro2 | PROF_king | PHDpsi | JPred | JUFO | Prospect | PHD | APSSP | PSSP |
1. SAM-T99sec | | 0.13 ± 8.08 [ 171] | -0.24 ± 8.18 [ 138] | 2.88 ± 6.00 [ 19] | 0.69 ± 7.78 [ 159] | ? | 0.89 ± 8.04 [ 161] | 2.12 ± 7.65 [ 146] | 1.88 ± 7.92 [ 137] | 2.04 ± 7.87 [ 108] | 6.65 ± 6.24 [ 13] | 4.14 ± 10.22 [ 103] | 4.19 ± 10.02 [ 138] | 6.72 ± 10.70 [ 146] | ? | 2. PSIpred | -0.13 ± 8.08 [ 171] | | 0.51 ± 8.34 [ 221] | 0.16 ± 5.66 [ 26] | 0.93 ± 4.59 [ 236] | ? | 1.30 ± 7.93 [ 232] | 2.62 ± 7.41 [ 218] | 2.88 ± 8.74 [ 219] | 2.95 ± 7.68 [ 151] | 3.33 ± 6.69 [ 16] | 3.24 ± 9.16 [ 158] | 4.90 ± 10.05 [ 221] | 7.45 ± 10.44 [ 210] | ? | 3. PROFsec | 0.24 ± 8.18 [ 138] | -0.51 ± 8.34 [ 221] | | -2.66 ± 7.58 [ 32] | 0.51 ± 8.59 [ 205] | ? | 1.05 ± 7.26 [ 194] | 1.80 ± 7.03 [ 189] | 2.23 ± 5.84 [ 233] | 3.10 ± 7.79 [ 129] | 1.20 ± 9.17 [ 22] | 2.87 ± 9.80 [ 136] | 4.15 ± 7.60 [ 235] | 6.90 ± 10.02 [ 176] | ? | 4. SCRATCH (SSpro3) | -2.88 ± 6.00 [ 19] | -0.16 ± 5.66 [ 26] | 2.66 ± 7.58 [ 32] | | 0.44 ± 4.97 [ 26] | ? | ? | 2.17 ± 6.67 [ 31] | 3.63 ± 6.83 [ 32] | ? | 4.67 ± 5.85 [ 22] | 6.27 ± 14.10 [ 24] | 3.70 ± 6.85 [ 32] | ? | ? | 5. APSSP2 | -0.69 ± 7.78 [ 159] | -0.93 ± 4.59 [ 236] | -0.51 ± 8.59 [ 205] | -0.44 ± 4.97 [ 26] | | ? | 0.02 ± 7.22 [ 231] | 1.54 ± 8.38 [ 222] | 1.88 ± 9.50 [ 203] | 1.85 ± 6.86 [ 144] | 4.69 ± 7.90 [ 17] | 3.25 ± 10.80 [ 175] | 3.40 ± 10.49 [ 205] | 6.21 ± 8.97 [ 210] | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. SSpro2 | -0.89 ± 8.04 [ 161] | -1.30 ± 7.93 [ 232] | -1.05 ± 7.26 [ 194] | ? | -0.02 ± 7.22 [ 231] | ? | | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.74 ± 7.35 [ 166] | ? | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | 5.95 ± 9.61 [ 233] | ? | 8. PROF_king | -2.12 ± 7.65 [ 146] | -2.62 ± 7.41 [ 218] | -1.80 ± 7.03 [ 189] | -2.17 ± 6.67 [ 31] | -1.54 ± 8.38 [ 222] | ? | -1.11 ± 7.19 [ 204] | | 0.47 ± 7.68 [ 187] | 0.56 ± 7.08 [ 123] | 3.30 ± 8.98 [ 22] | 1.06 ± 10.28 [ 163] | 2.06 ± 8.37 [ 189] | 5.61 ± 9.21 [ 181] | ? | 9. PHDpsi | -1.88 ± 7.92 [ 137] | -2.88 ± 8.74 [ 219] | -2.23 ± 5.84 [ 233] | -3.63 ± 6.83 [ 32] | -1.88 ± 9.50 [ 203] | ? | -1.40 ± 7.75 [ 192] | -0.47 ± 7.68 [ 187] | | 0.81 ± 8.05 [ 128] | 0.45 ± 6.23 [ 22] | 0.60 ± 10.35 [ 134] | 1.92 ± 6.20 [ 233] | 4.33 ± 9.89 [ 174] | ? | 10. JPred | -2.04 ± 7.87 [ 108] | -2.95 ± 7.68 [ 151] | -3.10 ± 7.79 [ 129] | ? | -1.85 ± 6.86 [ 144] | ? | -1.74 ± 7.35 [ 166] | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | | ? | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | 4.29 ± 8.18 [ 165] | ? | 11. JUFO | -6.65 ± 6.24 [ 13] | -3.33 ± 6.69 [ 16] | -1.20 ± 9.17 [ 22] | -4.67 ± 5.85 [ 22] | -4.69 ± 7.90 [ 17] | ? | ? | -3.30 ± 8.98 [ 22] | -0.45 ± 6.23 [ 22] | ? | | 1.55 ± 15.11 [ 19] | -0.35 ± 6.21 [ 22] | ? | ? | 12. Prospect | -4.14 ± 10.22 [ 103] | -3.24 ± 9.16 [ 158] | -2.87 ± 9.80 [ 136] | -6.27 ± 14.10 [ 24] | -3.25 ± 10.80 [ 175] | ? | -1.94 ± 8.98 [ 150] | -1.06 ± 10.28 [ 163] | -0.60 ± 10.35 [ 134] | -1.77 ± 9.86 [ 88] | -1.55 ± 15.11 [ 19] | | 0.78 ± 11.37 [ 136] | 3.98 ± 12.03 [ 132] | ? | 13. PHD | -4.19 ± 10.02 [ 138] | -4.90 ± 10.05 [ 221] | -4.15 ± 7.60 [ 235] | -3.70 ± 6.85 [ 32] | -3.40 ± 10.49 [ 205] | ? | -3.61 ± 9.30 [ 194] | -2.06 ± 8.37 [ 189] | -1.92 ± 6.20 [ 233] | -2.68 ± 9.89 [ 129] | 0.35 ± 6.21 [ 22] | -0.78 ± 11.37 [ 136] | | 1.94 ± 9.91 [ 176] | ? | 14. APSSP | -6.72 ± 10.70 [ 146] | -7.45 ± 10.44 [ 210] | -6.90 ± 10.02 [ 176] | ? | -6.21 ± 8.97 [ 210] | ? | -5.95 ± 9.61 [ 233] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -4.29 ± 8.18 [ 165] | ? | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | | ? | 15. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PROFsec
2. PSIpred
3. SSpro1
4. SAM-T99sec
5. SCRATCH (SSpro3)
6. APSSP2
7. PROF_king
8. SSpro2
9. JUFO
10. JPred
11. PHDpsi
12. Prospect
13. PHD
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PROFsec | PSIpred | SSpro1 | SAM-T99sec | SCRATCH (SSpro3) | APSSP2 | PROF_king | SSpro2 | JUFO | JPred | PHDpsi | Prospect | PHD | PSSP | APSSP |
1. PROFsec | | -0.52 ± 13.23 [ 221] | ? | 1.38 ± 11.53 [ 138] | -0.93 ± 8.60 [ 32] | 1.77 ± 13.68 [ 205] | 2.60 ± 10.18 [ 189] | 2.69 ± 11.65 [ 194] | 0.76 ± 11.80 [ 22] | 3.43 ± 10.66 [ 129] | 3.25 ± 9.13 [ 233] | 3.56 ± 14.90 [ 136] | 4.99 ± 11.35 [ 235] | ? | 8.83 ± 14.59 [ 176] | 2. PSIpred | 0.52 ± 13.23 [ 221] | | ? | 1.41 ± 12.26 [ 171] | 2.40 ± 12.18 [ 26] | 1.65 ± 9.04 [ 236] | 3.52 ± 11.59 [ 218] | 3.28 ± 12.70 [ 232] | -0.72 ± 9.12 [ 16] | 3.58 ± 11.04 [ 151] | 4.12 ± 14.07 [ 219] | 3.66 ± 13.39 [ 158] | 5.91 ± 15.31 [ 221] | ? | 9.72 ± 14.02 [ 210] | 3. SSpro1 | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 4. SAM-T99sec | -1.38 ± 11.53 [ 138] | -1.41 ± 12.26 [ 171] | ? | | 1.07 ± 10.71 [ 19] | 0.63 ± 13.26 [ 159] | 1.19 ± 11.96 [ 146] | 1.68 ± 11.97 [ 161] | 0.59 ± 10.78 [ 13] | 1.55 ± 10.64 [ 108] | 1.76 ± 11.33 [ 137] | 3.13 ± 16.07 [ 103] | 3.77 ± 12.82 [ 138] | ? | 6.99 ± 14.40 [ 146] | 5. SCRATCH (SSpro3) | 0.93 ± 8.60 [ 32] | -2.40 ± 12.18 [ 26] | ? | -1.07 ± 10.71 [ 19] | | -1.47 ± 9.93 [ 26] | 3.05 ± 9.92 [ 31] | ? | 3.10 ± 11.36 [ 22] | ? | 3.37 ± 8.47 [ 32] | 5.10 ± 20.59 [ 24] | 3.54 ± 8.86 [ 32] | ? | ? | 6. APSSP2 | -1.77 ± 13.68 [ 205] | -1.65 ± 9.04 [ 236] | ? | -0.63 ± 13.26 [ 159] | 1.47 ± 9.93 [ 26] | | 1.63 ± 12.37 [ 222] | 0.65 ± 13.37 [ 231] | 4.97 ± 10.15 [ 17] | 1.22 ± 10.63 [ 144] | 1.75 ± 15.66 [ 203] | 2.91 ± 14.91 [ 175] | 3.42 ± 16.85 [ 205] | ? | 7.03 ± 13.51 [ 210] | 7. PROF_king | -2.60 ± 10.18 [ 189] | -3.52 ± 11.59 [ 218] | ? | -1.19 ± 11.96 [ 146] | -3.05 ± 9.92 [ 31] | -1.63 ± 12.37 [ 222] | | 0.06 ± 11.38 [ 204] | 0.23 ± 14.06 [ 22] | 0.66 ± 11.46 [ 123] | 0.64 ± 11.63 [ 187] | 0.07 ± 13.94 [ 163] | 2.46 ± 12.37 [ 189] | ? | 7.39 ± 13.01 [ 181] | 8. SSpro2 | -2.69 ± 11.65 [ 194] | -3.28 ± 12.70 [ 232] | ? | -1.68 ± 11.97 [ 161] | ? | -0.65 ± 13.37 [ 231] | -0.06 ± 11.38 [ 204] | | ? | 0.30 ± 11.91 [ 166] | 0.71 ± 13.51 [ 192] | 0.31 ± 14.53 [ 150] | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. JUFO | -0.76 ± 11.80 [ 22] | 0.72 ± 9.12 [ 16] | ? | -0.59 ± 10.78 [ 13] | -3.10 ± 11.36 [ 22] | -4.97 ± 10.15 [ 17] | -0.23 ± 14.06 [ 22] | ? | | ? | 1.33 ± 10.29 [ 22] | 2.36 ± 23.04 [ 19] | 1.58 ± 10.73 [ 22] | ? | ? | 10. JPred | -3.43 ± 10.66 [ 129] | -3.58 ± 11.04 [ 151] | ? | -1.55 ± 10.64 [ 108] | ? | -1.22 ± 10.63 [ 144] | -0.66 ± 11.46 [ 123] | -0.30 ± 11.91 [ 166] | ? | | -0.05 ± 11.37 [ 128] | 1.87 ± 14.44 [ 88] | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 11. PHDpsi | -3.25 ± 9.13 [ 233] | -4.12 ± 14.07 [ 219] | ? | -1.76 ± 11.33 [ 137] | -3.37 ± 8.47 [ 32] | -1.75 ± 15.66 [ 203] | -0.64 ± 11.63 [ 187] | -0.71 ± 13.51 [ 192] | -1.33 ± 10.29 [ 22] | 0.05 ± 11.37 [ 128] | | -0.35 ± 16.30 [ 134] | 1.68 ± 8.02 [ 233] | ? | 5.48 ± 13.88 [ 174] | 12. Prospect | -3.56 ± 14.90 [ 136] | -3.66 ± 13.39 [ 158] | ? | -3.13 ± 16.07 [ 103] | -5.10 ± 20.59 [ 24] | -2.91 ± 14.91 [ 175] | -0.07 ± 13.94 [ 163] | -0.31 ± 14.53 [ 150] | -2.36 ± 23.04 [ 19] | -1.87 ± 14.44 [ 88] | 0.35 ± 16.30 [ 134] | | 1.91 ± 17.34 [ 136] | ? | 5.76 ± 16.07 [ 132] | 13. PHD | -4.99 ± 11.35 [ 235] | -5.91 ± 15.31 [ 221] | ? | -3.77 ± 12.82 [ 138] | -3.54 ± 8.86 [ 32] | -3.42 ± 16.85 [ 205] | -2.46 ± 12.37 [ 189] | -2.62 ± 14.58 [ 194] | -1.58 ± 10.73 [ 22] | -2.98 ± 13.90 [ 129] | -1.68 ± 8.02 [ 233] | -1.91 ± 17.34 [ 136] | | ? | 3.37 ± 12.86 [ 176] | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -8.83 ± 14.59 [ 176] | -9.72 ± 14.02 [ 210] | ? | -6.99 ± 14.40 [ 146] | ? | -7.03 ± 13.51 [ 210] | -7.39 ± 13.01 [ 181] | -6.27 ± 14.06 [ 233] | ? | -5.51 ± 12.88 [ 165] | -5.48 ± 13.88 [ 174] | -5.76 ± 16.07 [ 132] | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top