Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. SAM-T99sec
2. SABLE
3. PSIpred
4. PROFsec
5. SCRATCH (SSpro3)
6. SSpro1
7. APSSP2
8. SSpro2
9. JPred
10. PROF_king
11. PHDpsi
12. Prospect
13. PHD
14. JUFO
15. PSSP
16. APSSP
t-Student statistical analysis of the comparisons:
| SAM-T99sec | SABLE | PSIpred | PROFsec | SCRATCH (SSpro3) | SSpro1 | APSSP2 | SSpro2 | JPred | PROF_king | PHDpsi | Prospect | PHD | JUFO | PSSP | APSSP |
1. SAM-T99sec | | -0.42 ± 5.43 [ 22] | 0.18 ± 7.92 [ 215] | 0.27 ± 8.04 [ 217] | 0.50 ± 6.91 [ 98] | ? | 0.91 ± 8.01 [ 196] | 0.89 ± 8.04 [ 161] | 2.04 ± 7.87 [ 108] | 2.57 ± 8.04 [ 217] | 2.29 ± 8.22 [ 216] | 3.65 ± 9.64 [ 157] | 3.87 ± 9.58 [ 217] | 5.81 ± 9.40 [ 74] | ? | 6.72 ± 10.70 [ 146] | 2. SABLE | 0.42 ± 5.43 [ 22] | | 2.99 ± 4.38 [ 9] | 3.52 ± 8.80 [ 22] | -1.65 ± 7.64 [ 22] | ? | 0.02 ± 12.26 [ 14] | ? | ? | 6.71 ± 12.81 [ 16] | 4.53 ± 9.23 [ 22] | 5.03 ± 6.66 [ 10] | 5.29 ± 9.66 [ 22] | 8.12 ± 14.89 [ 20] | ? | ? | 3. PSIpred | -0.18 ± 7.92 [ 215] | -2.99 ± 4.38 [ 9] | | 0.62 ± 8.56 [ 265] | -0.28 ± 6.51 [ 70] | ? | 0.92 ± 4.61 [ 254] | 1.30 ± 7.93 [ 232] | 2.95 ± 7.68 [ 151] | 2.64 ± 7.72 [ 260] | 3.06 ± 9.18 [ 263] | 2.87 ± 9.23 [ 191] | 4.83 ± 10.29 [ 265] | 4.25 ± 8.85 [ 49] | ? | 7.45 ± 10.44 [ 210] | 4. PROFsec | -0.27 ± 8.04 [ 217] | -3.52 ± 8.80 [ 22] | -0.62 ± 8.56 [ 265] | | -1.50 ± 8.18 [ 112] | ? | 0.48 ± 8.78 [ 242] | 1.05 ± 7.26 [ 194] | 3.10 ± 7.79 [ 129] | 1.99 ± 7.78 [ 261] | 2.16 ± 6.07 [ 313] | 2.47 ± 9.99 [ 191] | 3.67 ± 7.46 [ 315] | 3.41 ± 10.03 [ 84] | ? | 6.90 ± 10.02 [ 176] | 5. SCRATCH (SSpro3) | -0.50 ± 6.91 [ 98] | 1.65 ± 7.64 [ 22] | 0.28 ± 6.51 [ 70] | 1.50 ± 8.18 [ 112] | | ? | 0.73 ± 7.09 [ 63] | ? | ? | 2.79 ± 8.40 [ 103] | 3.18 ± 8.27 [ 112] | 3.55 ± 11.27 [ 79] | 3.41 ± 8.51 [ 112] | 5.25 ± 9.53 [ 84] | ? | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. APSSP2 | -0.91 ± 8.01 [ 196] | -0.02 ± 12.26 [ 14] | -0.92 ± 4.61 [ 254] | -0.48 ± 8.78 [ 242] | -0.73 ± 7.09 [ 63] | ? | | 0.02 ± 7.22 [ 231] | 1.85 ± 6.86 [ 144] | 1.65 ± 8.35 [ 253] | 1.83 ± 9.82 [ 240] | 3.18 ± 10.76 [ 195] | 3.11 ± 10.65 [ 242] | 4.95 ± 8.29 [ 46] | ? | 6.21 ± 8.97 [ 210] | 8. SSpro2 | -0.89 ± 8.04 [ 161] | ? | -1.30 ± 7.93 [ 232] | -1.05 ± 7.26 [ 194] | ? | ? | -0.02 ± 7.22 [ 231] | | 1.74 ± 7.35 [ 166] | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | ? | ? | 5.95 ± 9.61 [ 233] | 9. JPred | -2.04 ± 7.87 [ 108] | ? | -2.95 ± 7.68 [ 151] | -3.10 ± 7.79 [ 129] | ? | ? | -1.85 ± 6.86 [ 144] | -1.74 ± 7.35 [ 166] | | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | ? | ? | 4.29 ± 8.18 [ 165] | 10. PROF_king | -2.57 ± 8.04 [ 217] | -6.71 ± 12.81 [ 16] | -2.64 ± 7.72 [ 260] | -1.99 ± 7.78 [ 261] | -2.79 ± 8.40 [ 103] | ? | -1.65 ± 8.35 [ 253] | -1.11 ± 7.19 [ 204] | 0.56 ± 7.08 [ 123] | | 0.19 ± 8.33 [ 259] | 0.71 ± 9.88 [ 214] | 1.43 ± 8.94 [ 261] | 1.76 ± 9.04 [ 78] | ? | 5.61 ± 9.21 [ 181] | 11. PHDpsi | -2.29 ± 8.22 [ 216] | -4.53 ± 9.23 [ 22] | -3.06 ± 9.18 [ 263] | -2.16 ± 6.07 [ 313] | -3.18 ± 8.27 [ 112] | ? | -1.83 ± 9.82 [ 240] | -1.40 ± 7.75 [ 192] | 0.81 ± 8.05 [ 128] | -0.19 ± 8.33 [ 259] | | 0.32 ± 10.30 [ 189] | 1.50 ± 5.51 [ 313] | 1.98 ± 8.36 [ 84] | ? | 4.33 ± 9.89 [ 174] | 12. Prospect | -3.65 ± 9.64 [ 157] | -5.03 ± 6.66 [ 10] | -2.87 ± 9.23 [ 191] | -2.47 ± 9.99 [ 191] | -3.55 ± 11.27 [ 79] | ? | -3.18 ± 10.76 [ 195] | -1.94 ± 8.98 [ 150] | -1.77 ± 9.86 [ 88] | -0.71 ± 9.88 [ 214] | -0.32 ± 10.30 [ 189] | | 0.80 ± 11.07 [ 191] | 0.50 ± 12.22 [ 69] | ? | 3.98 ± 12.03 [ 132] | 13. PHD | -3.87 ± 9.58 [ 217] | -5.29 ± 9.66 [ 22] | -4.83 ± 10.29 [ 265] | -3.67 ± 7.46 [ 315] | -3.41 ± 8.51 [ 112] | ? | -3.11 ± 10.65 [ 242] | -3.61 ± 9.30 [ 194] | -2.68 ± 9.89 [ 129] | -1.43 ± 8.94 [ 261] | -1.50 ± 5.51 [ 313] | -0.80 ± 11.07 [ 191] | | 1.67 ± 8.83 [ 84] | ? | 1.94 ± 9.91 [ 176] | 14. JUFO | -5.81 ± 9.40 [ 74] | -8.12 ± 14.89 [ 20] | -4.25 ± 8.85 [ 49] | -3.41 ± 10.03 [ 84] | -5.25 ± 9.53 [ 84] | ? | -4.95 ± 8.29 [ 46] | ? | ? | -1.76 ± 9.04 [ 78] | -1.98 ± 8.36 [ 84] | -0.50 ± 12.22 [ 69] | -1.67 ± 8.83 [ 84] | | ? | ? | 15. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 16. APSSP | -6.72 ± 10.70 [ 146] | ? | -7.45 ± 10.44 [ 210] | -6.90 ± 10.02 [ 176] | ? | ? | -6.21 ± 8.97 [ 210] | -5.95 ± 9.61 [ 233] | -4.29 ± 8.18 [ 165] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SAM-T99sec
3. PROFsec
4. SSpro1
5. SABLE
6. SCRATCH (SSpro3)
7. APSSP2
8. SSpro2
9. PROF_king
10. JPred
11. PHDpsi
12. Prospect
13. JUFO
14. PHD
15. PSSP
16. APSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SAM-T99sec | PROFsec | SSpro1 | SABLE | SCRATCH (SSpro3) | APSSP2 | SSpro2 | PROF_king | JPred | PHDpsi | Prospect | JUFO | PHD | PSSP | APSSP |
1. PSIpred | | 0.89 ± 11.75 [ 215] | 0.71 ± 13.33 [ 265] | ? | -3.46 ± 8.31 [ 9] | 1.25 ± 10.73 [ 70] | 1.77 ± 8.87 [ 254] | 3.28 ± 12.70 [ 232] | 3.57 ± 11.54 [ 260] | 3.58 ± 11.04 [ 151] | 4.33 ± 14.25 [ 263] | 3.24 ± 13.31 [ 191] | 3.25 ± 11.69 [ 49] | 5.87 ± 15.26 [ 265] | ? | 9.72 ± 14.02 [ 210] | 2. SAM-T99sec | -0.89 ± 11.75 [ 215] | | 0.20 ± 12.02 [ 217] | ? | 0.20 ± 7.06 [ 22] | 1.19 ± 10.43 [ 98] | 0.98 ± 12.68 [ 196] | 1.68 ± 11.97 [ 161] | 2.30 ± 12.16 [ 217] | 1.55 ± 10.64 [ 108] | 2.83 ± 11.94 [ 216] | 3.18 ± 15.10 [ 157] | 5.73 ± 13.55 [ 74] | 4.16 ± 12.80 [ 217] | ? | 6.99 ± 14.40 [ 146] | 3. PROFsec | -0.71 ± 13.33 [ 265] | -0.20 ± 12.02 [ 217] | | ? | -7.82 ± 15.75 [ 22] | -1.37 ± 12.47 [ 112] | 1.19 ± 13.88 [ 242] | 2.69 ± 11.65 [ 194] | 2.52 ± 10.62 [ 261] | 3.43 ± 10.66 [ 129] | 2.90 ± 9.38 [ 313] | 2.72 ± 15.39 [ 191] | 2.74 ± 15.06 [ 84] | 4.24 ± 11.11 [ 315] | ? | 8.83 ± 14.59 [ 176] | 4. SSpro1 | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 5. SABLE | 3.46 ± 8.31 [ 9] | -0.20 ± 7.06 [ 22] | 7.82 ± 15.75 [ 22] | ? | | -0.93 ± 10.85 [ 22] | 0.25 ± 14.00 [ 14] | ? | 8.31 ± 16.97 [ 16] | ? | 7.14 ± 17.47 [ 22] | 8.42 ± 11.02 [ 10] | 8.92 ± 17.52 [ 20] | 7.29 ± 17.63 [ 22] | ? | ? | 6. SCRATCH (SSpro3) | -1.25 ± 10.73 [ 70] | -1.19 ± 10.43 [ 98] | 1.37 ± 12.47 [ 112] | ? | 0.93 ± 10.85 [ 22] | | -0.01 ± 11.15 [ 63] | ? | 2.97 ± 12.48 [ 103] | ? | 3.42 ± 12.66 [ 112] | 2.51 ± 16.80 [ 79] | 4.69 ± 13.24 [ 84] | 3.58 ± 12.78 [ 112] | ? | ? | 7. APSSP2 | -1.77 ± 8.87 [ 254] | -0.98 ± 12.68 [ 196] | -1.19 ± 13.88 [ 242] | ? | -0.25 ± 14.00 [ 14] | 0.01 ± 11.15 [ 63] | | 0.65 ± 13.37 [ 231] | 1.90 ± 12.75 [ 253] | 1.22 ± 10.63 [ 144] | 1.83 ± 16.04 [ 240] | 2.87 ± 14.97 [ 195] | 5.81 ± 13.73 [ 46] | 3.27 ± 17.01 [ 242] | ? | 7.03 ± 13.51 [ 210] | 8. SSpro2 | -3.28 ± 12.70 [ 232] | -1.68 ± 11.97 [ 161] | -2.69 ± 11.65 [ 194] | ? | ? | ? | -0.65 ± 13.37 [ 231] | | -0.06 ± 11.38 [ 204] | 0.30 ± 11.91 [ 166] | 0.71 ± 13.51 [ 192] | 0.31 ± 14.53 [ 150] | ? | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. PROF_king | -3.57 ± 11.54 [ 260] | -2.30 ± 12.16 [ 217] | -2.52 ± 10.62 [ 261] | ? | -8.31 ± 16.97 [ 16] | -2.97 ± 12.48 [ 103] | -1.90 ± 12.75 [ 253] | 0.06 ± 11.38 [ 204] | | 0.66 ± 11.46 [ 123] | 0.39 ± 12.13 [ 259] | -0.27 ± 13.64 [ 214] | 0.62 ± 13.03 [ 78] | 1.75 ± 12.72 [ 261] | ? | 7.39 ± 13.01 [ 181] | 10. JPred | -3.58 ± 11.04 [ 151] | -1.55 ± 10.64 [ 108] | -3.43 ± 10.66 [ 129] | ? | ? | ? | -1.22 ± 10.63 [ 144] | -0.30 ± 11.91 [ 166] | -0.66 ± 11.46 [ 123] | | -0.05 ± 11.37 [ 128] | 1.87 ± 14.44 [ 88] | ? | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 11. PHDpsi | -4.33 ± 14.25 [ 263] | -2.83 ± 11.94 [ 216] | -2.90 ± 9.38 [ 313] | ? | -7.14 ± 17.47 [ 22] | -3.42 ± 12.66 [ 112] | -1.83 ± 16.04 [ 240] | -0.71 ± 13.51 [ 192] | -0.39 ± 12.13 [ 259] | 0.05 ± 11.37 [ 128] | | -0.63 ± 15.78 [ 189] | 1.06 ± 13.67 [ 84] | 1.29 ± 6.96 [ 313] | ? | 5.48 ± 13.88 [ 174] | 12. Prospect | -3.24 ± 13.31 [ 191] | -3.18 ± 15.10 [ 157] | -2.72 ± 15.39 [ 191] | ? | -8.42 ± 11.02 [ 10] | -2.51 ± 16.80 [ 79] | -2.87 ± 14.97 [ 195] | -0.31 ± 14.53 [ 150] | 0.27 ± 13.64 [ 214] | -1.87 ± 14.44 [ 88] | 0.63 ± 15.78 [ 189] | | 0.16 ± 17.56 [ 69] | 1.76 ± 16.56 [ 191] | ? | 5.76 ± 16.07 [ 132] | 13. JUFO | -3.25 ± 11.69 [ 49] | -5.73 ± 13.55 [ 74] | -2.74 ± 15.06 [ 84] | ? | -8.92 ± 17.52 [ 20] | -4.69 ± 13.24 [ 84] | -5.81 ± 13.73 [ 46] | ? | -0.62 ± 13.03 [ 78] | ? | -1.06 ± 13.67 [ 84] | -0.16 ± 17.56 [ 69] | | -0.94 ± 13.78 [ 84] | ? | ? | 14. PHD | -5.87 ± 15.26 [ 265] | -4.16 ± 12.80 [ 217] | -4.24 ± 11.11 [ 315] | ? | -7.29 ± 17.63 [ 22] | -3.58 ± 12.78 [ 112] | -3.27 ± 17.01 [ 242] | -2.62 ± 14.58 [ 194] | -1.75 ± 12.72 [ 261] | -2.98 ± 13.90 [ 129] | -1.29 ± 6.96 [ 313] | -1.76 ± 16.56 [ 191] | 0.94 ± 13.78 [ 84] | | ? | 3.37 ± 12.86 [ 176] | 15. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 16. APSSP | -9.72 ± 14.02 [ 210] | -6.99 ± 14.40 [ 146] | -8.83 ± 14.59 [ 176] | ? | ? | ? | -7.03 ± 13.51 [ 210] | -6.27 ± 14.06 [ 233] | -7.39 ± 13.01 [ 181] | -5.51 ± 12.88 [ 165] | -5.48 ± 13.88 [ 174] | -5.76 ± 16.07 [ 132] | ? | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top