Benchmarking PSI-BLAST in genome annotation.
The recognition of remote protein homologies is a major aspect of the structural and functional annotation of newly determined genomes. Here we benchmark the coverage and error rate of genome annotation using the widely used homology-searching program PSI-BLAST (position-specific iterated basic local alignment search tool). This study evaluates the one-to-many success rate for recognition, as often there are several homologues in the database and only one needs to be identified for annotating the sequence. In contrast, previous benchmarks considered one-to-one recognition in which a single query was required to find a particular target. The benchmark constructs a model genome from the full sequences of the structural classification of protein (SCOP) database and searches against a target library of remote homologous domains (<20 % identity). The structural benchmark provides a reliable list of correct and false homology assignments. PSI-BLAST successfully annotated 40 % of the domains in the model genome that had at least one homologue in the target library. This coverage is more than three times that if one-to-one recognition is evaluated (11 % coverage of domains). Although a structural benchmark was used, the results equally apply to just sequence homology searches. Accordingly, structural and sequence assignments were made to the sequences of Mycoplasma genitalium and Mycobacterium tuberculosis (see http://www.bmm.icnet. uk). The extent of missed assignments and of new superfamilies can be estimated for these genomes for both structural and functional annotations.
Müller
A
A
Biomolecular Modelling Laboratory, Imperial Cancer Research Fund, 44 Lincoln's Inn Fields, London, WC2A 3PX, England.
MacCallum
R M
RM
Sternberg
M J
MJ
D000465:Algorithms; D001426:Bacterial Proteins / Q000737:chemistry* / Q000145:classification / Q000235:genetics / Q000378:metabolism*; D019985:Benchmarking; D019295:Computational Biology; D017124:Conserved Sequence; D016208:Databases, Factual; D005189:False Positive Reactions; D016680:Genome, Bacterial; D020407:Internet; D005810:Multigene Family; D009169:Mycobacterium tuberculosis / Q000737:chemistry / Q000201:enzymology / Q000235:genetics; D009174:Mycoplasma / Q000737:chemistry / Q000201:enzymology / Q000235:genetics; D016366:Open Reading Frames / Q000235:genetics; D012680:Sensitivity and Specificity; D016415:Sequence Alignment; D017386:Sequence Homology, Amino Acid; D012984:Software; D013329:Structure-Activity Relationship
D001426:Bacterial Proteins