Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. SAM-T99sec
2. PSIpred
3. SABLE
4. PROFsec
5. SCRATCH (SSpro3)
6. SSpro1
7. SSpro2
8. APSSP2
9. JPred
10. PROF_king
11. PHDpsi
12. Prospect
13. PHD
14. JUFO
15. PSSP
16. APSSP
t-Student statistical analysis of the comparisons:
| SAM-T99sec | PSIpred | SABLE | PROFsec | SCRATCH (SSpro3) | SSpro1 | SSpro2 | APSSP2 | JPred | PROF_king | PHDpsi | Prospect | PHD | JUFO | PSSP | APSSP |
1. SAM-T99sec | | 0.22 ± 7.76 [ 232] | 0.52 ± 5.29 [ 39] | 0.60 ± 8.16 [ 234] | 0.89 ± 7.21 [ 109] | ? | 0.89 ± 8.04 [ 161] | 1.17 ± 8.28 [ 213] | 2.04 ± 7.87 [ 108] | 2.94 ± 8.25 [ 234] | 2.56 ± 8.25 [ 232] | 3.99 ± 9.99 [ 170] | 4.14 ± 9.63 [ 234] | 6.42 ± 9.40 [ 88] | ? | 6.72 ± 10.70 [ 146] | 2. PSIpred | -0.22 ± 7.76 [ 232] | | -0.43 ± 5.85 [ 26] | 0.83 ± 8.46 [ 282] | 0.22 ± 6.83 [ 81] | ? | 1.30 ± 7.93 [ 232] | 1.08 ± 5.00 [ 271] | 2.95 ± 7.68 [ 151] | 2.90 ± 7.90 [ 277] | 3.19 ± 9.15 [ 279] | 3.14 ± 9.68 [ 204] | 4.95 ± 10.27 [ 282] | 5.25 ± 9.31 [ 63] | ? | 7.45 ± 10.44 [ 210] | 3. SABLE | -0.52 ± 5.29 [ 39] | 0.43 ± 5.85 [ 26] | | 3.31 ± 8.26 [ 39] | -0.26 ± 9.13 [ 33] | ? | ? | 1.39 ± 10.90 [ 31] | ? | 6.33 ± 11.53 [ 33] | 4.37 ± 8.06 [ 38] | 5.32 ± 8.40 [ 23] | 5.54 ± 9.46 [ 39] | 7.76 ± 12.75 [ 34] | ? | ? | 4. PROFsec | -0.60 ± 8.16 [ 234] | -0.83 ± 8.46 [ 282] | -3.31 ± 8.26 [ 39] | | -1.29 ± 8.62 [ 123] | ? | 1.05 ± 7.26 [ 194] | 0.41 ± 9.07 [ 259] | 3.10 ± 7.79 [ 129] | 2.05 ± 8.08 [ 278] | 2.15 ± 6.10 [ 329] | 2.45 ± 10.37 [ 204] | 3.62 ± 7.47 [ 332] | 3.50 ± 10.19 [ 98] | ? | 6.90 ± 10.02 [ 176] | 5. SCRATCH (SSpro3) | -0.89 ± 7.21 [ 109] | -0.22 ± 6.83 [ 81] | 0.26 ± 9.13 [ 33] | 1.29 ± 8.62 [ 123] | | ? | ? | 0.83 ± 7.15 [ 74] | ? | 3.01 ± 8.52 [ 114] | 2.97 ± 8.88 [ 122] | 3.76 ± 12.61 [ 87] | 3.45 ± 9.52 [ 123] | 5.41 ± 10.36 [ 92] | ? | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. SSpro2 | -0.89 ± 8.04 [ 161] | -1.30 ± 7.93 [ 232] | ? | -1.05 ± 7.26 [ 194] | ? | ? | | -0.02 ± 7.22 [ 231] | 1.74 ± 7.35 [ 166] | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | ? | ? | 5.95 ± 9.61 [ 233] | 8. APSSP2 | -1.17 ± 8.28 [ 213] | -1.08 ± 5.00 [ 271] | -1.39 ± 10.90 [ 31] | -0.41 ± 9.07 [ 259] | -0.83 ± 7.15 [ 74] | ? | 0.02 ± 7.22 [ 231] | | 1.85 ± 6.86 [ 144] | 1.77 ± 8.36 [ 270] | 1.80 ± 10.09 [ 256] | 3.18 ± 11.10 [ 208] | 3.12 ± 11.03 [ 259] | 4.93 ± 10.07 [ 60] | ? | 6.21 ± 8.97 [ 210] | 9. JPred | -2.04 ± 7.87 [ 108] | -2.95 ± 7.68 [ 151] | ? | -3.10 ± 7.79 [ 129] | ? | ? | -1.74 ± 7.35 [ 166] | -1.85 ± 6.86 [ 144] | | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | ? | ? | 4.29 ± 8.18 [ 165] | 10. PROF_king | -2.94 ± 8.25 [ 234] | -2.90 ± 7.90 [ 277] | -6.33 ± 11.53 [ 33] | -2.05 ± 8.08 [ 278] | -3.01 ± 8.52 [ 114] | ? | -1.11 ± 7.19 [ 204] | -1.77 ± 8.36 [ 270] | 0.56 ± 7.08 [ 123] | | 0.12 ± 8.59 [ 275] | 0.63 ± 10.43 [ 227] | 1.33 ± 9.17 [ 278] | 1.68 ± 9.51 [ 92] | ? | 5.61 ± 9.21 [ 181] | 11. PHDpsi | -2.56 ± 8.25 [ 232] | -3.19 ± 9.15 [ 279] | -4.37 ± 8.06 [ 38] | -2.15 ± 6.10 [ 329] | -2.97 ± 8.88 [ 122] | ? | -1.40 ± 7.75 [ 192] | -1.80 ± 10.09 [ 256] | 0.81 ± 8.05 [ 128] | -0.12 ± 8.59 [ 275] | | 0.40 ± 10.57 [ 201] | 1.43 ± 5.38 [ 329] | 1.87 ± 8.46 [ 97] | ? | 4.33 ± 9.89 [ 174] | 12. Prospect | -3.99 ± 9.99 [ 170] | -3.14 ± 9.68 [ 204] | -5.32 ± 8.40 [ 23] | -2.45 ± 10.37 [ 204] | -3.76 ± 12.61 [ 87] | ? | -1.94 ± 8.98 [ 150] | -3.18 ± 11.10 [ 208] | -1.77 ± 9.86 [ 88] | -0.63 ± 10.43 [ 227] | -0.40 ± 10.57 [ 201] | | 0.81 ± 11.47 [ 204] | 0.53 ± 12.27 [ 82] | ? | 3.98 ± 12.03 [ 132] | 13. PHD | -4.14 ± 9.63 [ 234] | -4.95 ± 10.27 [ 282] | -5.54 ± 9.46 [ 39] | -3.62 ± 7.47 [ 332] | -3.45 ± 9.52 [ 123] | ? | -3.61 ± 9.30 [ 194] | -3.12 ± 11.03 [ 259] | -2.68 ± 9.89 [ 129] | -1.33 ± 9.17 [ 278] | -1.43 ± 5.38 [ 329] | -0.81 ± 11.47 [ 204] | | 1.57 ± 8.82 [ 98] | ? | 1.94 ± 9.91 [ 176] | 14. JUFO | -6.42 ± 9.40 [ 88] | -5.25 ± 9.31 [ 63] | -7.76 ± 12.75 [ 34] | -3.50 ± 10.19 [ 98] | -5.41 ± 10.36 [ 92] | ? | ? | -4.93 ± 10.07 [ 60] | ? | -1.68 ± 9.51 [ 92] | -1.87 ± 8.46 [ 97] | -0.53 ± 12.27 [ 82] | -1.57 ± 8.82 [ 98] | | ? | ? | 15. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 16. APSSP | -6.72 ± 10.70 [ 146] | -7.45 ± 10.44 [ 210] | ? | -6.90 ± 10.02 [ 176] | ? | ? | -5.95 ± 9.61 [ 233] | -6.21 ± 8.97 [ 210] | -4.29 ± 8.18 [ 165] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SABLE
3. PROFsec
4. SAM-T99sec
5. SSpro1
6. APSSP2
7. SCRATCH (SSpro3)
8. SSpro2
9. PROF_king
10. JPred
11. PHDpsi
12. Prospect
13. JUFO
14. PHD
15. PSSP
16. APSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SABLE | PROFsec | SAM-T99sec | SSpro1 | APSSP2 | SCRATCH (SSpro3) | SSpro2 | PROF_king | JPred | PHDpsi | Prospect | JUFO | PHD | PSSP | APSSP |
1. PSIpred | | -2.76 ± 8.93 [ 26] | 0.73 ± 13.31 [ 282] | 0.81 ± 11.93 [ 232] | ? | 1.79 ± 9.36 [ 271] | 1.65 ± 11.67 [ 81] | 3.28 ± 12.70 [ 232] | 3.88 ± 11.66 [ 277] | 3.58 ± 11.04 [ 151] | 4.42 ± 14.33 [ 279] | 3.67 ± 13.63 [ 204] | 4.66 ± 12.40 [ 63] | 5.92 ± 15.27 [ 282] | ? | 9.72 ± 14.02 [ 210] | 2. SABLE | 2.76 ± 8.93 [ 26] | | 5.85 ± 14.08 [ 39] | 0.85 ± 9.39 [ 39] | ? | 2.57 ± 14.85 [ 31] | 2.02 ± 13.93 [ 33] | ? | 9.71 ± 16.46 [ 33] | ? | 7.38 ± 16.91 [ 38] | 10.59 ± 15.95 [ 23] | 10.21 ± 15.98 [ 34] | 8.11 ± 17.24 [ 39] | ? | ? | 3. PROFsec | -0.73 ± 13.31 [ 282] | -5.85 ± 14.08 [ 39] | | -0.27 ± 12.39 [ 234] | ? | 1.19 ± 14.38 [ 259] | -0.54 ± 13.73 [ 123] | 2.69 ± 11.65 [ 194] | 2.84 ± 11.49 [ 278] | 3.43 ± 10.66 [ 129] | 3.00 ± 9.80 [ 329] | 3.09 ± 16.16 [ 204] | 3.58 ± 15.57 [ 98] | 4.33 ± 11.40 [ 332] | ? | 8.83 ± 14.59 [ 176] | 4. SAM-T99sec | -0.81 ± 11.93 [ 232] | -0.85 ± 9.39 [ 39] | 0.27 ± 12.39 [ 234] | | ? | 1.08 ± 13.29 [ 213] | 1.41 ± 12.20 [ 109] | 1.68 ± 11.97 [ 161] | 2.77 ± 12.86 [ 234] | 1.55 ± 10.64 [ 108] | 3.08 ± 11.93 [ 232] | 3.67 ± 15.20 [ 170] | 6.45 ± 13.87 [ 88] | 4.36 ± 12.70 [ 234] | ? | 6.99 ± 14.40 [ 146] | 5. SSpro1 | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 6. APSSP2 | -1.79 ± 9.36 [ 271] | -2.57 ± 14.85 [ 31] | -1.19 ± 14.38 [ 259] | -1.08 ± 13.29 [ 213] | ? | | 0.38 ± 10.74 [ 74] | 0.65 ± 13.37 [ 231] | 2.19 ± 12.82 [ 270] | 1.22 ± 10.63 [ 144] | 1.92 ± 16.67 [ 256] | 3.25 ± 15.57 [ 208] | 6.21 ± 14.26 [ 60] | 3.36 ± 17.58 [ 259] | ? | 7.03 ± 13.51 [ 210] | 7. SCRATCH (SSpro3) | -1.65 ± 11.67 [ 81] | -2.02 ± 13.93 [ 33] | 0.54 ± 13.73 [ 123] | -1.41 ± 12.20 [ 109] | ? | -0.38 ± 10.74 [ 74] | | ? | 3.13 ± 12.24 [ 114] | ? | 2.90 ± 14.19 [ 122] | 2.97 ± 18.05 [ 87] | 4.72 ± 13.87 [ 92] | 3.28 ± 14.46 [ 123] | ? | ? | 8. SSpro2 | -3.28 ± 12.70 [ 232] | ? | -2.69 ± 11.65 [ 194] | -1.68 ± 11.97 [ 161] | ? | -0.65 ± 13.37 [ 231] | ? | | -0.06 ± 11.38 [ 204] | 0.30 ± 11.91 [ 166] | 0.71 ± 13.51 [ 192] | 0.31 ± 14.53 [ 150] | ? | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. PROF_king | -3.88 ± 11.66 [ 277] | -9.71 ± 16.46 [ 33] | -2.84 ± 11.49 [ 278] | -2.77 ± 12.86 [ 234] | ? | -2.19 ± 12.82 [ 270] | -3.13 ± 12.24 [ 114] | 0.06 ± 11.38 [ 204] | | 0.66 ± 11.46 [ 123] | 0.22 ± 12.83 [ 275] | -0.31 ± 14.31 [ 227] | 0.44 ± 13.27 [ 92] | 1.53 ± 13.35 [ 278] | ? | 7.39 ± 13.01 [ 181] | 10. JPred | -3.58 ± 11.04 [ 151] | ? | -3.43 ± 10.66 [ 129] | -1.55 ± 10.64 [ 108] | ? | -1.22 ± 10.63 [ 144] | ? | -0.30 ± 11.91 [ 166] | -0.66 ± 11.46 [ 123] | | -0.05 ± 11.37 [ 128] | 1.87 ± 14.44 [ 88] | ? | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 11. PHDpsi | -4.42 ± 14.33 [ 279] | -7.38 ± 16.91 [ 38] | -3.00 ± 9.80 [ 329] | -3.08 ± 11.93 [ 232] | ? | -1.92 ± 16.67 [ 256] | -2.90 ± 14.19 [ 122] | -0.71 ± 13.51 [ 192] | -0.22 ± 12.83 [ 275] | 0.05 ± 11.37 [ 128] | | -0.43 ± 15.96 [ 201] | 1.06 ± 14.72 [ 97] | 1.23 ± 6.80 [ 329] | ? | 5.48 ± 13.88 [ 174] | 12. Prospect | -3.67 ± 13.63 [ 204] | -10.59 ± 15.95 [ 23] | -3.09 ± 16.16 [ 204] | -3.67 ± 15.20 [ 170] | ? | -3.25 ± 15.57 [ 208] | -2.97 ± 18.05 [ 87] | -0.31 ± 14.53 [ 150] | 0.31 ± 14.31 [ 227] | -1.87 ± 14.44 [ 88] | 0.43 ± 15.96 [ 201] | | 0.19 ± 18.39 [ 82] | 1.60 ± 16.74 [ 204] | ? | 5.76 ± 16.07 [ 132] | 13. JUFO | -4.66 ± 12.40 [ 63] | -10.21 ± 15.98 [ 34] | -3.58 ± 15.57 [ 98] | -6.45 ± 13.87 [ 88] | ? | -6.21 ± 14.26 [ 60] | -4.72 ± 13.87 [ 92] | ? | -0.44 ± 13.27 [ 92] | ? | -1.06 ± 14.72 [ 97] | -0.19 ± 18.39 [ 82] | | -1.02 ± 14.74 [ 98] | ? | ? | 14. PHD | -5.92 ± 15.27 [ 282] | -8.11 ± 17.24 [ 39] | -4.33 ± 11.40 [ 332] | -4.36 ± 12.70 [ 234] | ? | -3.36 ± 17.58 [ 259] | -3.28 ± 14.46 [ 123] | -2.62 ± 14.58 [ 194] | -1.53 ± 13.35 [ 278] | -2.98 ± 13.90 [ 129] | -1.23 ± 6.80 [ 329] | -1.60 ± 16.74 [ 204] | 1.02 ± 14.74 [ 98] | | ? | 3.37 ± 12.86 [ 176] | 15. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 16. APSSP | -9.72 ± 14.02 [ 210] | ? | -8.83 ± 14.59 [ 176] | -6.99 ± 14.40 [ 146] | ? | -7.03 ± 13.51 [ 210] | ? | -6.27 ± 14.06 [ 233] | -7.39 ± 13.01 [ 181] | -5.51 ± 12.88 [ 165] | -5.48 ± 13.88 [ 174] | -5.76 ± 16.07 [ 132] | ? | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top