Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SAM-T99sec
3. PROFsec
4. SSpro1
5. SCRATCH (SSpro3)
6. APSSP2
7. SSpro2
8. JPred
9. PROF_king
10. PHDpsi
11. Prospect
12. PHD
13. APSSP
14. PSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SAM-T99sec | PROFsec | SSpro1 | SCRATCH (SSpro3) | APSSP2 | SSpro2 | JPred | PROF_king | PHDpsi | Prospect | PHD | APSSP | PSSP |
1. PSIpred | | -0.05 ± 8.18 [ 164] | 0.46 ± 8.45 [ 212] | ? | 0.62 ± 5.60 [ 17] | 0.92 ± 4.54 [ 233] | 1.30 ± 7.93 [ 232] | 2.95 ± 7.68 [ 151] | 2.69 ± 7.39 [ 209] | 2.84 ± 8.90 [ 210] | 3.20 ± 9.07 [ 152] | 4.94 ± 10.24 [ 212] | 7.45 ± 10.44 [ 210] | ? | 2. SAM-T99sec | 0.05 ± 8.18 [ 164] | | -0.47 ± 8.26 [ 130] | ? | 3.42 ± 6.86 [ 11] | 0.62 ± 7.79 [ 157] | 0.89 ± 8.04 [ 161] | 2.04 ± 7.87 [ 108] | 2.07 ± 7.74 [ 138] | 1.73 ± 8.03 [ 129] | 3.30 ± 8.41 [ 98] | 4.18 ± 10.24 [ 130] | 6.72 ± 10.70 [ 146] | ? | 3. PROFsec | -0.46 ± 8.45 [ 212] | 0.47 ± 8.26 [ 130] | | ? | -3.27 ± 9.24 [ 19] | 0.51 ± 8.71 [ 198] | 1.05 ± 7.26 [ 194] | 3.10 ± 7.79 [ 129] | 2.02 ± 7.07 [ 176] | 2.26 ± 5.93 [ 220] | 2.32 ± 8.36 [ 126] | 4.29 ± 7.74 [ 222] | 6.90 ± 10.02 [ 176] | ? | 4. SSpro1 | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 5. SCRATCH (SSpro3) | -0.62 ± 5.60 [ 17] | -3.42 ± 6.86 [ 11] | 3.27 ± 9.24 [ 19] | ? | | 0.42 ± 5.77 [ 19] | ? | ? | 3.36 ± 6.69 [ 18] | 3.72 ± 7.81 [ 19] | 2.57 ± 8.43 [ 14] | 3.79 ± 7.84 [ 19] | ? | ? | 6. APSSP2 | -0.92 ± 4.54 [ 233] | -0.62 ± 7.79 [ 157] | -0.51 ± 8.71 [ 198] | ? | -0.42 ± 5.77 [ 19] | | 0.02 ± 7.22 [ 231] | 1.85 ± 6.86 [ 144] | 1.63 ± 8.43 [ 215] | 1.88 ± 9.57 [ 196] | 2.96 ± 10.23 [ 169] | 3.45 ± 10.58 [ 198] | 6.21 ± 8.97 [ 210] | ? | 7. SSpro2 | -1.30 ± 7.93 [ 232] | -0.89 ± 8.04 [ 161] | -1.05 ± 7.26 [ 194] | ? | ? | -0.02 ± 7.22 [ 231] | | 1.74 ± 7.35 [ 166] | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.94 ± 8.98 [ 150] | 3.61 ± 9.30 [ 194] | 5.95 ± 9.61 [ 233] | ? | 8. JPred | -2.95 ± 7.68 [ 151] | -2.04 ± 7.87 [ 108] | -3.10 ± 7.79 [ 129] | ? | ? | -1.85 ± 6.86 [ 144] | -1.74 ± 7.35 [ 166] | | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | 1.77 ± 9.86 [ 88] | 2.68 ± 9.89 [ 129] | 4.29 ± 8.18 [ 165] | ? | 9. PROF_king | -2.69 ± 7.39 [ 209] | -2.07 ± 7.74 [ 138] | -2.02 ± 7.07 [ 176] | ? | -3.36 ± 6.69 [ 18] | -1.63 ± 8.43 [ 215] | -1.11 ± 7.19 [ 204] | 0.56 ± 7.08 [ 123] | | 0.29 ± 7.69 [ 174] | 0.33 ± 9.00 [ 153] | 1.99 ± 8.45 [ 176] | 5.61 ± 9.21 [ 181] | ? | 10. PHDpsi | -2.84 ± 8.90 [ 210] | -1.73 ± 8.03 [ 129] | -2.26 ± 5.93 [ 220] | ? | -3.72 ± 7.81 [ 19] | -1.88 ± 9.57 [ 196] | -1.40 ± 7.75 [ 192] | 0.81 ± 8.05 [ 128] | -0.29 ± 7.69 [ 174] | | 0.06 ± 8.72 [ 124] | 2.03 ± 6.36 [ 220] | 4.33 ± 9.89 [ 174] | ? | 11. Prospect | -3.20 ± 9.07 [ 152] | -3.30 ± 8.41 [ 98] | -2.32 ± 8.36 [ 126] | ? | -2.57 ± 8.43 [ 14] | -2.96 ± 10.23 [ 169] | -1.94 ± 8.98 [ 150] | -1.77 ± 9.86 [ 88] | -0.33 ± 9.00 [ 153] | -0.06 ± 8.72 [ 124] | | 1.41 ± 9.94 [ 126] | 3.98 ± 12.03 [ 132] | ? | 12. PHD | -4.94 ± 10.24 [ 212] | -4.18 ± 10.24 [ 130] | -4.29 ± 7.74 [ 222] | ? | -3.79 ± 7.84 [ 19] | -3.45 ± 10.58 [ 198] | -3.61 ± 9.30 [ 194] | -2.68 ± 9.89 [ 129] | -1.99 ± 8.45 [ 176] | -2.03 ± 6.36 [ 220] | -1.41 ± 9.94 [ 126] | | 1.94 ± 9.91 [ 176] | ? | 13. APSSP | -7.45 ± 10.44 [ 210] | -6.72 ± 10.70 [ 146] | -6.90 ± 10.02 [ 176] | ? | ? | -6.21 ± 8.97 [ 210] | -5.95 ± 9.61 [ 233] | -4.29 ± 8.18 [ 165] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -3.98 ± 12.03 [ 132] | -1.94 ± 9.91 [ 176] | | ? | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PROFsec
2. PSIpred
3. SSpro1
4. SAM-T99sec
5. APSSP2
6. SCRATCH (SSpro3)
7. SSpro2
8. PROF_king
9. JPred
10. Prospect
11. PHDpsi
12. PHD
13. APSSP
14. PSSP
t-Student statistical analysis of the comparisons:
| PROFsec | PSIpred | SSpro1 | SAM-T99sec | APSSP2 | SCRATCH (SSpro3) | SSpro2 | PROF_king | JPred | Prospect | PHDpsi | PHD | APSSP | PSSP |
1. PROFsec | | -0.41 ± 13.40 [ 212] | ? | 1.67 ± 11.67 [ 130] | 1.84 ± 13.84 [ 198] | -0.00 ± 8.53 [ 19] | 2.69 ± 11.65 [ 194] | 2.96 ± 10.38 [ 176] | 3.43 ± 10.66 [ 129] | 3.00 ± 13.64 [ 126] | 3.40 ± 9.32 [ 220] | 5.25 ± 11.59 [ 222] | 8.83 ± 14.59 [ 176] | ? | 2. PSIpred | 0.41 ± 13.40 [ 212] | | ? | 1.42 ± 12.37 [ 164] | 1.70 ± 9.00 [ 233] | 3.72 ± 12.71 [ 17] | 3.28 ± 12.70 [ 232] | 3.62 ± 11.71 [ 209] | 3.58 ± 11.04 [ 151] | 3.70 ± 13.40 [ 152] | 4.16 ± 14.26 [ 210] | 6.02 ± 15.53 [ 212] | 9.72 ± 14.02 [ 210] | ? | 3. SSpro1 | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 4. SAM-T99sec | -1.67 ± 11.67 [ 130] | -1.42 ± 12.37 [ 164] | ? | | 0.58 ± 13.33 [ 157] | 2.73 ± 11.89 [ 11] | 1.68 ± 11.97 [ 161] | 1.18 ± 12.25 [ 138] | 1.55 ± 10.64 [ 108] | 2.04 ± 14.15 [ 98] | 1.76 ± 11.54 [ 129] | 3.90 ± 13.08 [ 130] | 6.99 ± 14.40 [ 146] | ? | 5. APSSP2 | -1.84 ± 13.84 [ 198] | -1.70 ± 9.00 [ 233] | ? | -0.58 ± 13.33 [ 157] | | 1.65 ± 10.51 [ 19] | 0.65 ± 13.37 [ 231] | 1.76 ± 12.39 [ 215] | 1.22 ± 10.63 [ 144] | 2.58 ± 13.88 [ 169] | 1.72 ± 15.89 [ 196] | 3.46 ± 17.09 [ 198] | 7.03 ± 13.51 [ 210] | ? | 6. SCRATCH (SSpro3) | 0.00 ± 8.53 [ 19] | -3.72 ± 12.71 [ 17] | ? | -2.73 ± 11.89 [ 11] | -1.65 ± 10.51 [ 19] | | ? | 5.25 ± 8.73 [ 18] | ? | 0.63 ± 12.90 [ 14] | 3.67 ± 9.42 [ 19] | 3.96 ± 10.02 [ 19] | ? | ? | 7. SSpro2 | -2.69 ± 11.65 [ 194] | -3.28 ± 12.70 [ 232] | ? | -1.68 ± 11.97 [ 161] | -0.65 ± 13.37 [ 231] | ? | | -0.06 ± 11.38 [ 204] | 0.30 ± 11.91 [ 166] | 0.31 ± 14.53 [ 150] | 0.71 ± 13.51 [ 192] | 2.62 ± 14.58 [ 194] | 6.27 ± 14.06 [ 233] | ? | 8. PROF_king | -2.96 ± 10.38 [ 176] | -3.62 ± 11.71 [ 209] | ? | -1.18 ± 12.25 [ 138] | -1.76 ± 12.39 [ 215] | -5.25 ± 8.73 [ 18] | 0.06 ± 11.38 [ 204] | | 0.66 ± 11.46 [ 123] | -0.80 ± 12.49 [ 153] | 0.46 ± 11.91 [ 174] | 2.42 ± 12.70 [ 176] | 7.39 ± 13.01 [ 181] | ? | 9. JPred | -3.43 ± 10.66 [ 129] | -3.58 ± 11.04 [ 151] | ? | -1.55 ± 10.64 [ 108] | -1.22 ± 10.63 [ 144] | ? | -0.30 ± 11.91 [ 166] | -0.66 ± 11.46 [ 123] | | 1.87 ± 14.44 [ 88] | -0.05 ± 11.37 [ 128] | 2.98 ± 13.90 [ 129] | 5.51 ± 12.88 [ 165] | ? | 10. Prospect | -3.00 ± 13.64 [ 126] | -3.70 ± 13.40 [ 152] | ? | -2.04 ± 14.15 [ 98] | -2.58 ± 13.88 [ 169] | -0.63 ± 12.90 [ 14] | -0.31 ± 14.53 [ 150] | 0.80 ± 12.49 [ 153] | -1.87 ± 14.44 [ 88] | | 1.14 ± 14.78 [ 124] | 2.82 ± 15.94 [ 126] | 5.76 ± 16.07 [ 132] | ? | 11. PHDpsi | -3.40 ± 9.32 [ 220] | -4.16 ± 14.26 [ 210] | ? | -1.76 ± 11.54 [ 129] | -1.72 ± 15.89 [ 196] | -3.67 ± 9.42 [ 19] | -0.71 ± 13.51 [ 192] | -0.46 ± 11.91 [ 174] | 0.05 ± 11.37 [ 128] | -1.14 ± 14.78 [ 124] | | 1.78 ± 8.24 [ 220] | 5.48 ± 13.88 [ 174] | ? | 12. PHD | -5.25 ± 11.59 [ 222] | -6.02 ± 15.53 [ 212] | ? | -3.90 ± 13.08 [ 130] | -3.46 ± 17.09 [ 198] | -3.96 ± 10.02 [ 19] | -2.62 ± 14.58 [ 194] | -2.42 ± 12.70 [ 176] | -2.98 ± 13.90 [ 129] | -2.82 ± 15.94 [ 126] | -1.78 ± 8.24 [ 220] | | 3.37 ± 12.86 [ 176] | ? | 13. APSSP | -8.83 ± 14.59 [ 176] | -9.72 ± 14.02 [ 210] | ? | -6.99 ± 14.40 [ 146] | -7.03 ± 13.51 [ 210] | ? | -6.27 ± 14.06 [ 233] | -7.39 ± 13.01 [ 181] | -5.51 ± 12.88 [ 165] | -5.76 ± 16.07 [ 132] | -5.48 ± 13.88 [ 174] | -3.37 ± 12.86 [ 176] | | ? | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top