Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. SAM-T99sec
3. PROFsec
4. APSSP2
5. SCRATCH (SSpro3)
6. SSpro1
7. SSpro2
8. PROF_king
9. PHDpsi
10. JPred
11. Prospect
12. JUFO
13. PHD
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PSIpred | SAM-T99sec | PROFsec | APSSP2 | SCRATCH (SSpro3) | SSpro1 | SSpro2 | PROF_king | PHDpsi | JPred | Prospect | JUFO | PHD | PSSP | APSSP |
1. PSIpred | | 0.09 ± 7.91 [ 200] | 0.70 ± 8.34 [ 250] | 1.01 ± 4.59 [ 247] | 0.42 ± 6.15 [ 55] | ? | 1.30 ± 7.93 [ 232] | 2.85 ± 7.57 [ 245] | 3.20 ± 9.02 [ 248] | 2.95 ± 7.68 [ 151] | 3.01 ± 9.21 [ 182] | 4.36 ± 7.86 [ 38] | 5.01 ± 10.16 [ 250] | ? | 7.45 ± 10.44 [ 210] | 2. SAM-T99sec | -0.09 ± 7.91 [ 200] | | -0.10 ± 7.94 [ 188] | 0.80 ± 7.67 [ 175] | 0.94 ± 6.59 [ 69] | ? | 0.89 ± 8.04 [ 161] | 2.29 ± 7.66 [ 194] | 2.06 ± 7.98 [ 187] | 2.04 ± 7.87 [ 108] | 3.44 ± 9.58 [ 143] | 5.09 ± 7.38 [ 50] | 3.80 ± 9.59 [ 188] | ? | 6.72 ± 10.70 [ 146] | 3. PROFsec | -0.70 ± 8.34 [ 250] | 0.10 ± 7.94 [ 188] | | 0.48 ± 8.53 [ 221] | -0.90 ± 7.60 [ 83] | ? | 1.05 ± 7.26 [ 194] | 1.96 ± 7.12 [ 238] | 2.27 ± 5.90 [ 284] | 3.10 ± 7.79 [ 129] | 2.53 ± 9.55 [ 177] | 2.76 ± 8.85 [ 60] | 3.87 ± 7.38 [ 286] | ? | 6.90 ± 10.02 [ 176] | 4. APSSP2 | -1.01 ± 4.59 [ 247] | -0.80 ± 7.67 [ 175] | -0.48 ± 8.53 [ 221] | | 0.17 ± 6.04 [ 42] | ? | 0.02 ± 7.22 [ 231] | 1.71 ± 8.34 [ 238] | 2.03 ± 9.59 [ 219] | 1.85 ± 6.86 [ 144] | 3.02 ± 10.69 [ 186] | 4.82 ± 6.82 [ 29] | 3.42 ± 10.49 [ 221] | ? | 6.21 ± 8.97 [ 210] | 5. SCRATCH (SSpro3) | -0.42 ± 6.15 [ 55] | -0.94 ± 6.59 [ 69] | 0.90 ± 7.60 [ 83] | -0.17 ± 6.04 [ 42] | | ? | ? | 2.50 ± 7.40 [ 80] | 2.78 ± 8.08 [ 83] | ? | 3.04 ± 11.57 [ 65] | 3.90 ± 8.04 [ 60] | 2.90 ± 8.29 [ 83] | ? | ? | 6. SSpro1 | ? | ? | ? | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | 7. SSpro2 | -1.30 ± 7.93 [ 232] | -0.89 ± 8.04 [ 161] | -1.05 ± 7.26 [ 194] | -0.02 ± 7.22 [ 231] | ? | ? | | 1.11 ± 7.19 [ 204] | 1.40 ± 7.75 [ 192] | 1.74 ± 7.35 [ 166] | 1.94 ± 8.98 [ 150] | ? | 3.61 ± 9.30 [ 194] | ? | 5.95 ± 9.61 [ 233] | 8. PROF_king | -2.85 ± 7.57 [ 245] | -2.29 ± 7.66 [ 194] | -1.96 ± 7.12 [ 238] | -1.71 ± 8.34 [ 238] | -2.50 ± 7.40 [ 80] | ? | -1.11 ± 7.19 [ 204] | | 0.25 ± 7.56 [ 236] | 0.56 ± 7.08 [ 123] | 0.66 ± 9.81 [ 202] | 1.48 ± 8.02 [ 59] | 1.55 ± 8.26 [ 238] | ? | 5.61 ± 9.21 [ 181] | 9. PHDpsi | -3.20 ± 9.02 [ 248] | -2.06 ± 7.98 [ 187] | -2.27 ± 5.90 [ 284] | -2.03 ± 9.59 [ 219] | -2.78 ± 8.08 [ 83] | ? | -1.40 ± 7.75 [ 192] | -0.25 ± 7.56 [ 236] | | 0.81 ± 8.05 [ 128] | 0.32 ± 10.04 [ 175] | 1.33 ± 6.28 [ 60] | 1.60 ± 5.69 [ 284] | ? | 4.33 ± 9.89 [ 174] | 10. JPred | -2.95 ± 7.68 [ 151] | -2.04 ± 7.87 [ 108] | -3.10 ± 7.79 [ 129] | -1.85 ± 6.86 [ 144] | ? | ? | -1.74 ± 7.35 [ 166] | -0.56 ± 7.08 [ 123] | -0.81 ± 8.05 [ 128] | | 1.77 ± 9.86 [ 88] | ? | 2.68 ± 9.89 [ 129] | ? | 4.29 ± 8.18 [ 165] | 11. Prospect | -3.01 ± 9.21 [ 182] | -3.44 ± 9.58 [ 143] | -2.53 ± 9.55 [ 177] | -3.02 ± 10.69 [ 186] | -3.04 ± 11.57 [ 65] | ? | -1.94 ± 8.98 [ 150] | -0.66 ± 9.81 [ 202] | -0.32 ± 10.04 [ 175] | -1.77 ± 9.86 [ 88] | | 0.67 ± 11.33 [ 55] | 0.79 ± 10.87 [ 177] | ? | 3.98 ± 12.03 [ 132] | 12. JUFO | -4.36 ± 7.86 [ 38] | -5.09 ± 7.38 [ 50] | -2.76 ± 8.85 [ 60] | -4.82 ± 6.82 [ 29] | -3.90 ± 8.04 [ 60] | ? | ? | -1.48 ± 8.02 [ 59] | -1.33 ± 6.28 [ 60] | ? | -0.67 ± 11.33 [ 55] | | -1.18 ± 6.85 [ 60] | ? | ? | 13. PHD | -5.01 ± 10.16 [ 250] | -3.80 ± 9.59 [ 188] | -3.87 ± 7.38 [ 286] | -3.42 ± 10.49 [ 221] | -2.90 ± 8.29 [ 83] | ? | -3.61 ± 9.30 [ 194] | -1.55 ± 8.26 [ 238] | -1.60 ± 5.69 [ 284] | -2.68 ± 9.89 [ 129] | -0.79 ± 10.87 [ 177] | 1.18 ± 6.85 [ 60] | | ? | 1.94 ± 9.91 [ 176] | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -7.45 ± 10.44 [ 210] | -6.72 ± 10.70 [ 146] | -6.90 ± 10.02 [ 176] | -6.21 ± 8.97 [ 210] | ? | ? | -5.95 ± 9.61 [ 233] | -5.61 ± 9.21 [ 181] | -4.33 ± 9.89 [ 174] | -4.29 ± 8.18 [ 165] | -3.98 ± 12.03 [ 132] | ? | -1.94 ± 9.91 [ 176] | ? | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PROFsec
2. PSIpred
3. SSpro1
4. SAM-T99sec
5. APSSP2
6. SCRATCH (SSpro3)
7. PROF_king
8. SSpro2
9. JPred
10. Prospect
11. PHDpsi
12. JUFO
13. PHD
14. PSSP
15. APSSP
t-Student statistical analysis of the comparisons:
| PROFsec | PSIpred | SSpro1 | SAM-T99sec | APSSP2 | SCRATCH (SSpro3) | PROF_king | SSpro2 | JPred | Prospect | PHDpsi | JUFO | PHD | PSSP | APSSP |
1. PROFsec | | -0.80 ± 13.24 [ 250] | ? | 0.78 ± 11.47 [ 188] | 1.57 ± 13.72 [ 221] | 0.33 ± 10.63 [ 83] | 2.56 ± 10.46 [ 238] | 2.69 ± 11.65 [ 194] | 3.43 ± 10.66 [ 129] | 2.92 ± 14.71 [ 177] | 3.30 ± 9.03 [ 284] | 3.20 ± 13.12 [ 60] | 4.76 ± 10.90 [ 286] | ? | 8.83 ± 14.59 [ 176] | 2. PSIpred | 0.80 ± 13.24 [ 250] | | ? | 1.31 ± 11.91 [ 200] | 1.79 ± 8.92 [ 247] | 2.55 ± 10.59 [ 55] | 3.82 ± 11.61 [ 245] | 3.28 ± 12.70 [ 232] | 3.58 ± 11.04 [ 151] | 3.42 ± 13.10 [ 182] | 4.57 ± 14.13 [ 248] | 3.88 ± 10.95 [ 38] | 6.18 ± 15.19 [ 250] | ? | 9.72 ± 14.02 [ 210] | 3. SSpro1 | ? | ? | | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | 4. SAM-T99sec | -0.78 ± 11.47 [ 188] | -1.31 ± 11.91 [ 200] | ? | | 0.76 ± 12.99 [ 175] | 1.54 ± 11.12 [ 69] | 1.74 ± 11.77 [ 194] | 1.68 ± 11.97 [ 161] | 1.55 ± 10.64 [ 108] | 2.81 ± 15.09 [ 143] | 2.41 ± 11.33 [ 187] | 4.53 ± 12.07 [ 50] | 3.92 ± 12.37 [ 188] | ? | 6.99 ± 14.40 [ 146] | 5. APSSP2 | -1.57 ± 13.72 [ 221] | -1.79 ± 8.92 [ 247] | ? | -0.76 ± 12.99 [ 175] | | 1.51 ± 10.87 [ 42] | 1.82 ± 12.40 [ 238] | 0.65 ± 13.37 [ 231] | 1.22 ± 10.63 [ 144] | 2.75 ± 14.65 [ 186] | 2.02 ± 15.86 [ 219] | 4.63 ± 9.73 [ 29] | 3.58 ± 16.92 [ 221] | ? | 7.03 ± 13.51 [ 210] | 6. SCRATCH (SSpro3) | -0.33 ± 10.63 [ 83] | -2.55 ± 10.59 [ 55] | ? | -1.54 ± 11.12 [ 69] | -1.51 ± 10.87 [ 42] | | 2.30 ± 11.23 [ 80] | ? | ? | 1.52 ± 16.78 [ 65] | 2.80 ± 11.07 [ 83] | 2.84 ± 11.91 [ 60] | 2.95 ± 11.22 [ 83] | ? | ? | 7. PROF_king | -2.56 ± 10.46 [ 238] | -3.82 ± 11.61 [ 245] | ? | -1.74 ± 11.77 [ 194] | -1.82 ± 12.40 [ 238] | -2.30 ± 11.23 [ 80] | | 0.06 ± 11.38 [ 204] | 0.66 ± 11.46 [ 123] | -0.32 ± 13.45 [ 202] | 0.61 ± 11.39 [ 236] | 0.57 ± 12.95 [ 59] | 2.08 ± 12.03 [ 238] | ? | 7.39 ± 13.01 [ 181] | 8. SSpro2 | -2.69 ± 11.65 [ 194] | -3.28 ± 12.70 [ 232] | ? | -1.68 ± 11.97 [ 161] | -0.65 ± 13.37 [ 231] | ? | -0.06 ± 11.38 [ 204] | | 0.30 ± 11.91 [ 166] | 0.31 ± 14.53 [ 150] | 0.71 ± 13.51 [ 192] | ? | 2.62 ± 14.58 [ 194] | ? | 6.27 ± 14.06 [ 233] | 9. JPred | -3.43 ± 10.66 [ 129] | -3.58 ± 11.04 [ 151] | ? | -1.55 ± 10.64 [ 108] | -1.22 ± 10.63 [ 144] | ? | -0.66 ± 11.46 [ 123] | -0.30 ± 11.91 [ 166] | | 1.87 ± 14.44 [ 88] | -0.05 ± 11.37 [ 128] | ? | 2.98 ± 13.90 [ 129] | ? | 5.51 ± 12.88 [ 165] | 10. Prospect | -2.92 ± 14.71 [ 177] | -3.42 ± 13.10 [ 182] | ? | -2.81 ± 15.09 [ 143] | -2.75 ± 14.65 [ 186] | -1.52 ± 16.78 [ 65] | 0.32 ± 13.45 [ 202] | -0.31 ± 14.53 [ 150] | -1.87 ± 14.44 [ 88] | | 0.86 ± 15.46 [ 175] | 0.80 ± 17.60 [ 55] | 2.08 ± 16.30 [ 177] | ? | 5.76 ± 16.07 [ 132] | 11. PHDpsi | -3.30 ± 9.03 [ 284] | -4.57 ± 14.13 [ 248] | ? | -2.41 ± 11.33 [ 187] | -2.02 ± 15.86 [ 219] | -2.80 ± 11.07 [ 83] | -0.61 ± 11.39 [ 236] | -0.71 ± 13.51 [ 192] | 0.05 ± 11.37 [ 128] | -0.86 ± 15.46 [ 175] | | 0.43 ± 9.58 [ 60] | 1.41 ± 7.29 [ 284] | ? | 5.48 ± 13.88 [ 174] | 12. JUFO | -3.20 ± 13.12 [ 60] | -3.88 ± 10.95 [ 38] | ? | -4.53 ± 12.07 [ 50] | -4.63 ± 9.73 [ 29] | -2.84 ± 11.91 [ 60] | -0.57 ± 12.95 [ 59] | ? | ? | -0.80 ± 17.60 [ 55] | -0.43 ± 9.58 [ 60] | | -0.22 ± 9.84 [ 60] | ? | ? | 13. PHD | -4.76 ± 10.90 [ 286] | -6.18 ± 15.19 [ 250] | ? | -3.92 ± 12.37 [ 188] | -3.58 ± 16.92 [ 221] | -2.95 ± 11.22 [ 83] | -2.08 ± 12.03 [ 238] | -2.62 ± 14.58 [ 194] | -2.98 ± 13.90 [ 129] | -2.08 ± 16.30 [ 177] | -1.41 ± 7.29 [ 284] | 0.22 ± 9.84 [ 60] | | ? | 3.37 ± 12.86 [ 176] | 14. PSSP | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | | ? | 15. APSSP | -8.83 ± 14.59 [ 176] | -9.72 ± 14.02 [ 210] | ? | -6.99 ± 14.40 [ 146] | -7.03 ± 13.51 [ 210] | ? | -7.39 ± 13.01 [ 181] | -6.27 ± 14.06 [ 233] | -5.51 ± 12.88 [ 165] | -5.76 ± 16.07 [ 132] | -5.48 ± 13.88 [ 174] | ? | -3.37 ± 12.86 [ 176] | ? | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top