title: Evaluation of 3D-Jury on CASP7 models.
abstract: BACKGROUND
  3D-Jury, the structure prediction consensus method publicly available in the Meta Server http://meta.bioinfo.pl/, was evaluated using models gathered in the 7th round of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7). 3D-Jury is an automated expert process that generates protein structure meta-predictions from sets of models obtained from partner servers.
  
  
  RESULTS
  The performance of 3D-Jury was analysed for three aspects. First, we examined the correlation between the 3D-Jury score and a model quality measure: the number of correctly predicted residues. The 3D-Jury score was shown to correlate significantly with the number of correctly predicted residues, the correlation is good enough to be used for prediction. 3D-Jury was also found to improve upon the competing servers' choice of the best structure model in most cases. The value of the 3D-Jury score as a generic reliability measure was also examined. We found that the 3D-Jury score separates bad models from good models better than the reliability score of the original server in 27 cases and falls short of it in only 5 cases out of a total of 38. We report the release of a new Meta Server feature: instant 3D-Jury scoring of uploaded user models.
  
  
  CONCLUSIONS
  The 3D-Jury score continues to be a good indicator of structural model quality. It also provides a generic reliability score, especially important for models that were not assigned such by the original server. Individual structure modellers can also benefit from the 3D-Jury scoring system by testing their models in the new instant scoring feature http://meta.bioinfo.pl/compare_your_model_example.pl available in the Meta Server.
authors: BioInfoBank Institute, ul, Limanowskiego 24 A, 60-744 Poznań, Poland. kajla@bioinfo.pl
authors: László
authors: L
authors: Kaján
authors: Leszek
authors: L
authors: Rychlewski
mesh_terms: D000595:Amino Acid Sequence; D003198:Computer Simulation; D008956:Models, Chemical; D008958:Models, Molecular; D008969:Molecular Sequence Data; D011487:Protein Conformation; D011506:Proteins / Q000737:chemistry* / Q000648:ultrastructure*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D020539:Sequence Analysis, Protein / Q000379:methods*; D012984:Software; D012986:Software Validation
chemical_list: D011506:Proteins
references: Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W77-80
references: 15980581
references: Protein Sci. 2001 Feb;10(2):352-61
references: 11266621
references: Bioinformatics. 2003 May 1;19(7):874-81
references: 12724298
references: J Mol Biol. 2001 Jun 29;310(1):243-57
references: 11419950
references: Proteins. 2001;Suppl 5:86-91
references: 11835485
references: Bioinformatics. 2000 Sep;16(9):776-85
references: 11108700
references: Proteins. 2002 Dec 1;49(4):493-509
references: 12402359
references: Curr Opin Struct Biol. 2006 Apr;16(2):178-82
references: 16546376
references: Protein Sci. 1996 Nov;5(11):2217-25
references: 8931140
references: J Struct Funct Genomics. 2003;4(2-3):57-66
references: 14649289
references: Bioinformatics. 2004 Mar 1;20(4):594-5
references: 14764565
references: Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W532-5
references: 15215443
references: Proteins. 2003;53 Suppl 6:534-41
references: 14579343
references: Nucleic Acids Res. 2003 Jul 1;31(13):3305-7
references: 12824313
references: Bioinformatics. 2005 Dec 1;21(23):4248-54
references: 16204344
references: Proteins. 2003 May 15;51(3):434-41
references: 12696054
references: Nucleic Acids Res. 2003 Jan 1;31(1):463-8
references: 12520053
references: Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W526-31
references: 15215442
references: Proteins. 2004 Jan 1;54(1):41-8
references: 14705022
references: BMC Bioinformatics. 2006 Mar 30;7:180
references: 16573808
references: Proteins. 2007 Aug 15;68(3):636-45
references: 17510969
references: Proteins. 2001;Suppl 5:39-46
references: 11835480
references: J Mol Biol. 2000 Jun 2;299(2):499-520
references: 10860755
references: Bioinformatics. 2003 May 22;19(8):1015-8
references: 12761065
references: Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W244-8
references: 15980461
references: Bioinformatics. 2006 Jun 15;22(12):1456-63
references: 16547073
references: Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W36-8
references: 15980489
references: Protein Sci. 2003 Sep;12(9):2001-14
references: 12930999
references: Comput Syst Bioinformatics Conf. 2006;:19-29
references: 17369622
references: Nucleic Acids Res. 2004 Jul 1;32(Web Server issue):W576-81
references: 15215454
references: Proteins. 2003;53 Suppl 6:491-6
references: 14579338
references: Nucleic Acids Res. 2003 Jul 1;31(13):3804-7
references: 12824423
references: Bioinformatics. 1998;14(10):846-56
references: 9927713
references: Pac Symp Biocomput. 2000;:119-30
references: 10902162
references: J Bioinform Comput Biol. 2003 Apr;1(1):95-117
references: 15290783
references: Proteins. 2005;61 Suppl 7:91-98
references: 16187349
references: Bioinformatics. 2001 Aug;17(8):750-1
references: 11524381
references: Nucleic Acids Res. 2005 Jul 1;33(Web Server issue):W284-8
references: 15980471
references: BMC Biol. 2007 May 08;5:17
references: 17488521
references: Protein Sci. 2005 Jan;14(1):240-5
references: 15608124