title: On the significance of sequence alignments when using multiple scoring matrices.
abstract: BACKGROUND
  Pairwise local sequence alignment is commonly used to search data bases for sequences related to some query sequence. Alignments are obtained using a scoring matrix that takes into account the different frequencies of occurrence of the various types of amino acid substitutions. Software like BLAST provides the user with a set of scoring matrices available to choose from, and in the literature it is sometimes recommended to try several scoring matrices on the sequences of interest. The significance of an alignment is usually assessed by looking at E-values and p-values. While sequence lengths and data base sizes enter the standard calculations of significance, it is much less common to take the use of several scoring matrices on the same sequences into account. Altschul proposed corrections of the p-value that account for the simultaneous use of an infinite number of PAM matrices. Here we consider the more realistic situation where the user may choose from a finite set of popular PAM and BLOSUM matrices, in particular the ones available in BLAST. It turns out that the significance of a result can be considerably overestimated, if a set of substitution matrices is used in an alignment problem and the most significant alignment is then quoted.
  
  
  RESULTS
  Based on extensive simulations, we study the multiple testing problem that occurs when several scoring matrices for local sequence alignment are used. We consider a simple Bonferroni correction of the p-values and investigate its accuracy. Finally, we propose a more accurate correction based on extreme value distributions fitted to the maximum of the normalized scores obtained from different scoring matrices. For various sets of matrices we provide correction factors which can be easily applied to adjust p- and E-values reported by software packages.
authors.affiliation: Department of Medical Statistics, University of Vienna, Vienna, Austria. Florian.Frommlet@univie.ac.at
authors.forename: Florian
authors.initials: F
authors.lastname: Frommlet
authors.forename: Andreas
authors.initials: A
authors.lastname: Futschik
authors.forename: Malgorzata
authors.initials: M
authors.lastname: Bogdan
mesh_terms: D003627:Data Interpretation, Statistical; D030562:Databases, Protein; D008957:Models, Genetic; D015233:Models, Statistical; D011506:Proteins / Q000737:chemistry* / Q000235:genetics*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D016415:Sequence Alignment / Q000379:methods*; D020539:Sequence Analysis, Protein / Q000379:methods*
chemical_list: D011506:Proteins