Evaluation of 3D-Jury on CASP7 models.
BACKGROUND
3D-Jury, the structure prediction consensus method publicly available in the Meta Server http://meta.bioinfo.pl/, was evaluated using models gathered in the 7th round of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7). 3D-Jury is an automated expert process that generates protein structure meta-predictions from sets of models obtained from partner servers.


RESULTS
The performance of 3D-Jury was analysed for three aspects. First, we examined the correlation between the 3D-Jury score and a model quality measure: the number of correctly predicted residues. The 3D-Jury score was shown to correlate significantly with the number of correctly predicted residues, the correlation is good enough to be used for prediction. 3D-Jury was also found to improve upon the competing servers' choice of the best structure model in most cases. The value of the 3D-Jury score as a generic reliability measure was also examined. We found that the 3D-Jury score separates bad models from good models better than the reliability score of the original server in 27 cases and falls short of it in only 5 cases out of a total of 38. We report the release of a new Meta Server feature: instant 3D-Jury scoring of uploaded user models.


CONCLUSIONS
The 3D-Jury score continues to be a good indicator of structural model quality. It also provides a generic reliability score, especially important for models that were not assigned such by the original server. Individual structure modellers can also benefit from the 3D-Jury scoring system by testing their models in the new instant scoring feature http://meta.bioinfo.pl/compare_your_model_example.pl available in the Meta Server.
Kaján
László
L
BioInfoBank Institute, ul, Limanowskiego 24 A, 60-744 Poznań, Poland. kajla@bioinfo.pl
Rychlewski
Leszek
L
D000595:Amino Acid Sequence; D003198:Computer Simulation; D008956:Models, Chemical; D008958:Models, Molecular; D008969:Molecular Sequence Data; D011487:Protein Conformation; D011506:Proteins / Q000737:chemistry* / Q000648:ultrastructure*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D020539:Sequence Analysis, Protein / Q000379:methods*; D012984:Software; D012986:Software Validation
D011506:Proteins
Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W77-80
15980581
Protein Sci. 2001 Feb;10(2):352-61
11266621
Bioinformatics. 2003 May 1;19(7):874-81
12724298
J Mol Biol. 2001 Jun 29;310(1):243-57
11419950
Proteins. 2001;Suppl 5:86-91
11835485
Bioinformatics. 2000 Sep;16(9):776-85
11108700
Proteins. 2002 Dec 1;49(4):493-509
12402359
Curr Opin Struct Biol. 2006 Apr;16(2):178-82
16546376
Protein Sci. 1996 Nov;5(11):2217-25
8931140
J Struct Funct Genomics. 2003;4(2-3):57-66
14649289
Bioinformatics. 2004 Mar 1;20(4):594-5
14764565
Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W532-5
15215443
Proteins. 2003;53 Suppl 6:534-41
14579343
Nucleic Acids Res. 2003 Jul 1;31(13):3305-7
12824313
Bioinformatics. 2005 Dec 1;21(23):4248-54
16204344
Proteins. 2003 May 15;51(3):434-41
12696054
Nucleic Acids Res. 2003 Jan 1;31(1):463-8
12520053
Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W526-31
15215442
Proteins. 2004 Jan 1;54(1):41-8
14705022
BMC Bioinformatics. 2006 Mar 30;7:180
16573808
Proteins. 2007 Aug 15;68(3):636-45
17510969
Proteins. 2001;Suppl 5:39-46
11835480
J Mol Biol. 2000 Jun 2;299(2):499-520
10860755
Bioinformatics. 2003 May 22;19(8):1015-8
12761065
Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W244-8
15980461
Bioinformatics. 2006 Jun 15;22(12):1456-63
16547073
Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W36-8
15980489
Protein Sci. 2003 Sep;12(9):2001-14
12930999
Comput Syst Bioinformatics Conf. 2006;:19-29
17369622
Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W576-81
15215454
Proteins. 2003;53 Suppl 6:491-6
14579338
Nucleic Acids Res. 2003 Jul 1;31(13):3804-7
12824423
Bioinformatics. 1998;14(10):846-56
9927713
Pac Symp Biocomput. 2000;:119-30
10902162
J Bioinform Comput Biol. 2003 Apr;1(1):95-117
15290783
Proteins. 2005;61 Suppl 7:91-98
16187349
Bioinformatics. 2001 Aug;17(8):750-1
11524381
Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W284-8
15980471
BMC Biol. 2007 May 08;5:17
17488521
Protein Sci. 2005 Jan;14(1):240-5
15608124