Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Research article

A mass accuracy sensitive probability based scoring algorithm for database searching of tandem mass spectrometry data

Hua Xu1 and Michael A Freitas2*

Author Affiliations

1 Department of Chemistry, the Ohio State University, Columbus 43210, OH, USA

2 Department of Molecular Immunology Virology and Medical Genetics, the Ohio State University, Columbus 43210, OH, USA

For all author emails, please log on.

BMC Bioinformatics 2007, 8:133  doi:10.1186/1471-2105-8-133

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/8/133


Received:7 December 2006
Accepted:20 April 2007
Published:20 April 2007

© 2007 Xu and Freitas; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) has become one of the most used tools in mass spectrometry based proteomics. Various algorithms have since been developed to automate the process for modern high-throughput LC-MS/MS experiments.

Results

A probability based statistical scoring model for assessing peptide and protein matches in tandem MS database search was derived. The statistical scores in the model represent the probability that a peptide match is a random occurrence based on the number or the total abundance of matched product ions in the experimental spectrum. The model also calculates probability based scores to assess protein matches. Thus the protein scores in the model reflect the significance of protein matches and can be used to differentiate true from random protein matches.

Conclusion

The model is sensitive to high mass accuracy and implicitly takes mass accuracy into account during scoring. High mass accuracy will not only reduce false positives, but also improves the scores of true positive matches. The algorithm is incorporated in an automated database search program MassMatrix.

Background

Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) has become one of the most used tools in mass spectrometry based proteomics [1]. In shotgun proteomics, peptides are separated using liquid chromatography and introduced into a mass spectrometer via an ionization interface. In tandem mass spectrometry, the peptide precursor ions are isolated and fragmented via collision-induced dissociation (CID) [2] with inert gas, electron capture dissociation (ECD) [3], surface induced dissociation (SID) [4] and/or electron transfer dissociation (ETD) [5]. The resulting tandem MS spectra contain product ion signatures that relate back to the identity of the peptide precursor ions [2,6,7].

Various algorithms have since been developed to automate the process for modern high-throughput LC-MS/MS experiments. These algorithms fall under two categories: de novo sequence inference and database searching [8]. The first approach identifies peptide sequences directly from the tandem MS data [9,10]. This type of algorithm is usually computationally expensive and limited by the mass accuracy of the tandem MS data [8]. The database searching algorithms identify peptides by comparison with a protein sequence database [11]. In this approach, all potential peptides are created from the sequence database via digestion with proteases. Theoretical spectra containing product ion series appropriate for the given fragmentation technique are created for the peptides. All tandem MS spectra in the data set are then compared with the theoretical spectra [1]. Because of their relatively lower computation expense and higher compatibility with low mass accuracy spectra, database searching programs are more commonly used at this time [12].

There are also various probability based post-search methods used to statistically curate search results from database search algorithms [13,14]. These methods estimate the accuracy of protein/peptide identifications and compare search results from different algorithms based on a common standard. However, many models involve empirical parameters such as score from correlative scoring algorithms. Therefore they may possess biases as a result of parameter optimization or model training.

The key comparison between different algorithms lies in how each approach scores a potential match between experimental and theoretical spectra [11,15-25]. We recently developed a database searching program, MassMatrix that uses a mass accuracy sensitive statistical model for scoring. This approach is separate and distinct from algorithms that filter matches based on mass accuracy. In the latter high mass accuracy can be used to filter spectra by only searching tandem mass spectra whose precursor ion falls within the stated mass tolerance, and filtering product ions by high mass accuracy can further reduce the likelihood of a random match [26,27]. However, a score sensitive model implicitly takes mass accuracy into account during scoring. The model is rigorously derived and sensitive to the searching tolerance determined by the accuracy of mass spectrometer. High accuracy improves the sensitivity and selectivity of searches. The statistical scores represent the probability that a match is a random occurrence. In addition, a novel statistically derived algorithm to rigorously calculate protein scores from the statistically based peptide scores has been developed. Thus the protein scores reflect the significance of protein hits and can be used to differentiate true protein hits from random ones. Herein we describe the statistical models.

Results

Multiple scoring algorithms

The peptide matching algorithm contains two independent scoring models, including a descriptive model and a statistical model. These models are used to calculate three distinct scores for a peptide match. Each of the scores may be independently used to ascertain the quality of the match. Because each score is distinct, the combination of scores is useful for validating each peptide match. The two models and the application to calculating peptide match scores are described in detail in the following.

Descriptive peptide scoring model

Descriptive scores do not strictly convey any statistical relevance and may be prone to bias due to the scoring parameters. However, they have proven to be useful and generally augment probability based scores [13]. The descriptive model used herein to calculate peptide match scores (S) is shown in eqn. 1.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M1">View MathML</a>

(1)

Ii is defined as the standardized abundance of the ith product ion in the experimental spectrum (calculated by dividing the abundance of the ith product ion by the maximum abundance in the spectrum), <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M2">View MathML</a> is the total standardized abundance of matched product ions, nmatch is the number of matched product ions, rmatch is the ratio of standardized abundance of matched product ions to total standardized abundance of the experimental spectrum, and Lpep is the length of the peptide in the number of amino acids. Each of these factors contributes to the overall score as follows: <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M2">View MathML</a> evaluates the quality of the match, <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M3">View MathML</a> introduces a penalty for unmatched product ions, <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M4">View MathML</a> is an arbitrary penalty for matches with poor fragmentation, <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M5">View MathML</a> is an additional penalty for peptides with long sequences and the constant 100 is used arbitrarily to scale the scores. By default, scores for a spectrum with less than three matched product ions will be 0 due to the arbitrary penalty. However, the minimum number of matched ions may be changed to any value. Reducing this number is especially valuable for the analysis of singly charged peptides that have characteristic C-terminal aspartic acid fragmentation [28]. The penalty for peptide length is included to normalize the scores. Peptides with longer sequences have more fragment ions and higher empirical scores than shorter sequences. The penalty results in long and short sequences both have similar scores for matches of similar quality. The choices of incorporating squared and square root for the terms nmatch and Lpep were empirically determined from the evaluation of tandem MS data sets collected from LCQ and LTQ-Orbitrap mass spectrometers.

Descriptive protein score

For "true" matches, we assume that the scores are normally distributed with a mean of 20 and a variance of 25. This arbitrary distribution estimates the distributions observed from analysis of several datasets. The expected contribution of each match to the protein score will be <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M6','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M6">View MathML</a>. Thus, the protein score from the descriptively scored matches is calculated from eqn. 2.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M7','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M7">View MathML</a>

(2)

Probability based peptide scoring model

In addition to the empirical score, a mass accuracy sensitive probability based scoring model was derived to evaluate peptide matches. The model determines the likelihood that an experimental spectrum match to a theoretical spectrum is a random occurrence. Consider a pair of spectra: one experimental and one theoretical. We and Wt denote their precursor masses respectively. In addition, the experimental data contains information regarding the abundance of product ions Ii for each precursor, We. The model ultimately tests the following two hypotheses: the null hypothesis, H0, states that a match is random, i.e. the theoretical spectrum is independent of the experimental; and the alternative hypothesis, HA, states that the match is not random, i.e. the theoretical spectrum is related to the experimental one.

Scoring the match is performed in two stages: 1) match We against Wt within the specified precursor ion mass accuracy and 2) match all product ions in the experimental spectrum against the theoretical within the specified mass accuracy. Both stages rely on calculating the probability that the occurrence of an ion within a fixed mass window could be a random occurrence (<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M8','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M8">View MathML</a>).

To match the experimental precursor with that of theoretical peptide we first define the variable q:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M9','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M9">View MathML</a>

(3)

Under H0, the possibility that any precursor ion match (q = 1) could be random is given in eqn. 4.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M10','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M10">View MathML</a>

(4)

In the above equation, τpep is the mass accuracy of the precursor ion and Π is the detection range for the precursor ion. For each precursor ion the mass window is defined as ± τpep (2 × τpep). Thus q has a bernoulli (p1) distribution under H0. If the precursor ion masses of the pair of spectra do not match (q = 0) then the second stage is skipped. If q = 1 we proceed to stage 2 where we test the match of the experimental product ion spectrum against the theoretical spectrum.

The variable bi is defined for each product ion, i, in the experimental spectrum as follows:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M11','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M11">View MathML</a>

(5)

Under H0, all matched product ions are random and independent occurrences. The probability that a product ion randomly matches any of the product ions in the theoretical spectrum is:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M12','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M12">View MathML</a>

(6)

where Πtheo is the total coverage of the detection range for all product ions in the theoretical spectrum and Π is the MS/MS detection range. It is assumed that Π is the same as the precursor ion mass range. However, for instruments that have a dynamic detection range assuming a fixed value Π will result in more conservative scores. For each product ion in the theoretical spectrum, the mass window is ± τmsms (2 × τmsms). If we assume there is no overlap in the product ion mass windows, then Πtheo is calculated using the following equation

Πtheo = 2 m × τmsms.(7)

The probability that any single matched product ion (bi = 1) could be random can be calculated using the eqn. 8

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M13','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M13">View MathML</a>

(8)

where τmsms is the product ion mass accuracy and m is the number of product ions within the detection range in the theoretical spectrum. Because the theoretical spectrum is independent of the experimental under H0, all bi (i = 1, 2 ..., n) are assumed to have an identical and independent bernoulli (p2) distribution under H0. The model is then used to perform two distinct tests. Each uses a different approach to evaluate the quality of a match: number of matched product ions x and total abundance of matched product ions Y.

The pp score

The model is used to evaluate whether the number of matched product ions in an experimental spectrum could be a random occurrence. For all spectra whose precursor ion masses match, i.e. q = 1, the variable x is defined as the number of product ions in the experimental spectrum that match the theoretical spectrum (eqn. 9) where bi (i = 1, 2 ..., n) is defined in eqn. 5 and n is the number of product ions in the experimental spectrum.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M14','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M14">View MathML</a>

(9)

Under H0, all bi have an identical and independent bernoulli (p2) distribution. Therefore, x will have a binomial (n, p2) distribution. Consequently the probability mass function for x is:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M15','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M15">View MathML</a>

(10)

where p2 is calculated from eqn. 6. The p-value, α, is defined as the probability that the quality of a random match between a pair of spectra is greater than or equal to a match observed under H0. The pp value, β, is defined as the negative common logarithm of the p-value:

β = -log(α)(11)

We use x to evaluate the quality of a match, such that the p-value is the probability that x for a random match between the pair of theoretical and experimental spectra is greater than or equal to that of the actual match, x = nmatch, under H0. The p-value is:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M16','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M16">View MathML</a>

(12)

and the pp value is

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M17','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M17">View MathML</a>

(13)

The pp2 score

The second approach evaluates whether the total abundance of matched product ions in the experimental spectrum could be a random occurrence. Y is defined as the total abundance of experimental product ions that match product ions in a given theoretical spectrum:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M18','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M18">View MathML</a>

(14)

where Ii is the standardized abundance of the ith product ion in the experimental spectrum and bi is defined in eqn. 5. For clarity we define yi = Ii bi to give eqn. 15.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M19','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M19">View MathML</a>

(15)

However, to complete the test we must know the inherent distribution of Y. This distribution is unknown and thus pp2 values can not be precisely calculated as were the pp values based on the total number of matched product ions. In order to estimate the pp2 value, three assumptions are needed:

1. Ii is identically and independently distributed across product ions in the experimental spectrum,

2. bi is uncorrelated with Ii in the experimental spectrum,

3. the number of product ions, n, in the experimental spectrum is large (n > 30).

Under assumption 1, the mean μI and variance σI2 for the distribution of Ii are estimated by:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M20">View MathML</a>

(16)

Since yi = Ii bi, assumption 2 yields eqn. 17 under H0,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M21','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M21">View MathML</a>

(17)

Thus, μy and σy2 can be estimated as:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M22','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M22">View MathML</a>

(18)

According to the central limit theorem, Y is approximately a normal distribution with the following parameters under assumption 3, i.e. when n is large (n > 30)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M23','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M23">View MathML</a>

(19)

The resulting probability density function is given in eqn. 20.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M24">View MathML</a>

(20)

And μY and σY2 are estimated by eqn. 21.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M25','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M25">View MathML</a>

(21)

The p-value, α, is the probability that Y for a random match is greater than or equal to that of the actual match, Imatch, under H0. The p-value becomes:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M26','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M26">View MathML</a>

(22)

and is estimated by:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M27','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M27">View MathML</a>

(23)

resulting in the pp2 value, β, as follows:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M28','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M28">View MathML</a>

(24)

The pp2 value can be estimated by equation 17 very efficiently. However, the real distribution of Y is more tailed to larger values than the normal distribution. Therefore, pp2 values are overestimated when they are large.

Distribution of pp value for random matches

When q = 0, the algorithm always assigns pp value, β = 0 because the experimental and theoretical precursor ions do not match. The cumulative distribution function for pp value when q = 0 is shown in eqn. 25.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M29','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M29">View MathML</a>

(25)

In statistical hypothesis testing, a p-value for a null hypothesis H0 is always a uniform distribution on the interval [0, 1]. Therefore, the cumulative distribution function for p-value of a random match is continuously distributed as

Fα|q = 1(α) = α   (0 ≤ α≤ 1)(26)

when q = 1. According to the definition of pp value (eqn. 11), the cumulative distribution function for pp value when q = 1 is

Fβ|q = 1(β) = 1 - 10-β   (β ≥ 0)(27)

and the probability density function is

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M30','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M30">View MathML</a>

(28)

Matches with pp or pp2 values under a critical value βc > 0 are discarded, i.e. their pp values are assigned 0. Thus the distribution of pp value for random matches returned by the algorithm is

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M31','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M31">View MathML</a>

(29)

and for β βc > 0,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M32','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M32">View MathML</a>

(30)

Thus when q = 1

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M33','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M33">View MathML</a>

(31)

Likewise we can specify the unconditional distribution of pp values for random matches as follows. Since q has a bernoulli (p1) distribution, we have

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M34','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M34">View MathML</a>

(32)

For β = 0 the cumulative distribution function becomes,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M35','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M35">View MathML</a>

(33)

and for β βc > 0, it becomes,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M36','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M36">View MathML</a>

(34)

The combined cumulative distribution function is thus,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M37','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M37">View MathML</a>

(35)

When β βc, Fβ(β) is continuous and the probability density function of pp value for random matches is

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M38','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M38">View MathML</a>

(36)

Confidence level for pp and pp2 values

The confidence level can also be determined for both pp and pp2. Suppose there are r theoretical spectra within the protein sequence database. If we assume that all theoretical spectra are uncorrelated, eqn. 37 gives φ, the number of random matches that have a pp value greater than or equal to β under H0 for any given experimental spectrum.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M39','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M39">View MathML</a>

(37)

The confidence level, ψ, is defined as

ψ = -log(φ) = -log(r p1 10-β) = β -log(r)-log(p1)(38)

where β is either the pp or pp2 value, r is the number of theoretical spectra within the protein sequence database, and p1 is given in eqn. 4. Confidence levels calculated from pp value and pp2 value are referred as confidence level and confidence level2 respectively.

The confidence level is the negative common logarithm of the expected number of random matches with a pp value bigger than or equal to the one we observe for the corresponding experimental spectrum. Therefore, if the confidence level is below 0, more than one random match for the spectrum is expected and the corresponding match is highly suspect. From eqn. 38, the pp value is directly related to the confidence value. The confidence level is dependent upon the size of the database and degrades as the number of peptide created from the database increases.

The protein pp score

The pp model is also used to calculate pp values for protein matches. Let rprotein denote the total number of theoretical spectra created from a protein sequence and nspectra denote the total number of experimental spectra in the data set. The cross match of all experimental spectra with theoretical peptides for the protein sequence generates nmatch_protein = rprotein × nspctra potential matches. The sum of reported pp values of all matches for the protein is calculated from eqn. 39.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M40','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M40">View MathML</a>

(39)

The statistical model is used to test the following hypotheses: H0 – All peptide matches for a given protein are random and HA – At least one peptide match for a given protein is not random. We assume that rspectra theoretical spectra created from the protein sequence are uncorrelated to each other and that nspectra experimental spectra from the data set are uncorrelated to each other. Since nmatch_protein is normally very large, B is approximately a normal distribution with a mean of μB = nmatch_protein × μβ and a variance of σB2 = nmatch_protein × σβ2 according to the central limit theorem.

According to the distribution of the pp value for random matches described above, the mean and variances of a random match are given by the following equations:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M41','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M41">View MathML</a>

(40)

and

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M42','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M42">View MathML</a>

(41)

where p1 is given in eqn. 4 and βc is the pp value threshold. Likewise for the sum of pp values for the protein, B, the mean and variance for the distribution under H0 are given in eqn. 42:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M43','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M43">View MathML</a>

(42)

The p-value for a protein, αprotein, is defined to be the probability that the protein hit can have a sum of pp values from all its peptide matches greater than or equal to B under H0. Thus αprotein is given by

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M44','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M44">View MathML</a>

(43)

and the protein pp value becomes

<a onClick="popup('http://www.biomedcentral.com/1471-2105/8/133/mathml/M45','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/133/mathml/M45">View MathML</a>

(44)

Discussion

Effect of various spectral characteristics on scoring

Five example spectra, shown in Figure 1, are used to illustrate the effect of various spectral characteristics on scoring. All spectra were collected on an LTQ-Orbitrap mass spectrometer (ThermoElectron Finnigan, San Jose, CA, USA) [29]. Precursor and product ions were mass analyzed by the Orbitrap to achieve a mass accuracy of < 5.0 ppm. The pp and pp2 values at different mass accuracies (0.01 Da, 0.1 Da and 1.0 Da) were calculated and listed in Table 1. Mass accuracy tolerances were specified as either relative or absolute for precursor ions but only as absolute tolerances for product ions. Absolute mass accuracy tolerances for product ions are computationally cheaper and yield a reasonable compromise between computational expense and accuracy. Good quality spectra (Figure 1a,1b) yielded high empirical and statistical scores as expected. These sequences in Figure 1a &1b illustrate that peptide length has little effect on the scoring. This observation is consistent with the statistical model lack of peptide sequence bias and the peptide length penalty included in the empirical score (eqn. 1). Low quality data (i.e. low signal to noise ratio) can still yield good scores if the most abundant ions are dominated by signal (Figure 1c). The most challenging spectra are those with few dominant signal peaks. Examples are shown in 1d &1e. These figures show the spectra with one single dominant ion due to N-terminal fragmentation of an internal Pro residue and the neutral loss of H2O at an N-terminal Glu residue [30]. The empirical scores were poorer for these cases since only a single ion mainly contributes to score (eqn. 1). However, the pp and pp2 values were not as severely affected and able to accurately discriminate these matches from false positives.

thumbnailFigure 1. Examples of spectral influences on scoring. High quality data for peptides of short (a) and long (b) lengths. Poorer quality data from a low signal-to-noise spectrum (c), a spectrum from a peptide with a single dominant product ion due to fragmentation at the N-terminal side of Pro (d) and a spectrum of a peptide with a single dominant product ion due to a extensive neutral loss of water at the N-terminal Glu (e) [30].

Table 1. Empirical and statistical scores along with associated parameters (p1 and p2) for each spectrum shown in Figure 1. The data were obtained for mass accuracies of 1.0 Da, 0.1 Da and 0.01 Da. Confidence levels were calculated based on a search space of 2726345 theoretical peptides. The confidence levels for the pp and pp2 scores are denotes as confidence level and confidence level2

Comparison between pp and pp2 values

The pp value is the primary discriminator for quality of matches. The pp2 value can provide a complementary assessment of quality when pp values are suspect. Although the pp and pp2 value have the same statistical basis, there are several differences between them: The pp value is based on the number of matched product ions and the pp2 value is based on the total abundance of matched product ions. The pp value can be underestimated when noise is present in the experimental spectrum especially at low mass accuracy. Because noise normally has lower abundance than product ions, the pp2 value, on the other hand, is generally unaffected. As shown in Table 1, pp value for the spectrum with low signal to noise ratio and majority of noise peaks (Figure 1c) were affected negatively by the noise peaks and relative low compared with those for normal spectra at mass accuracy of 1.0 Da. However, pp2 value was not affected by the noise peaks.

While pp value can be precisely calculated, there are three assumptions needed to estimate the pp2 values. Assumption 1 and 3 for the pp2 test are not plausible when the number of product ions in the experimental spectrum, n is small. Therefore, pp2 value estimated by the central limit theorem cannot evaluate the quality of matches with a small number of product ions. Furthermore the normal distribution under the central limit theorem is less tailed than the true distribution of Y, pp2 value is normally overestimated when it is large (> 16) as shown in Table 1.

From the above discussion, the pp value is more reliable and accurate than the pp2 value under most circumstances, but it can be affected by noise. Under these circumstances, the number of product ions in the spectrum is normally large and pp2 value can be well estimated and complementary to pp value. Thus the combination of the two scores provides an excellent means to ascertain the quality of matches under conditions where one might fail.

Effect of mass accuracy on pp values

In the pp model, the two most important parameters (p1, the probability that a theoretical precursor randomly matches the experimental and p2, the probability that a theoretical product ion randomly matches any product ions in the MS/MS spectrum) are set in accordance with the predetermined mass accuracy of mass spectrometer. These parameters' values decrease as mass accuracy increases. This effect is shown in Table 1. A more thorough list of all parameters used in calculating the empirical and statistical scores is provided as supplementary material [see Additional file 1]. The statistical model specifically takes each parameter into account when calculating the statistical scores. Therefore, these two parameters have a substantial effect on the pp values for both random matches and true matches. Consequently, pp and pp2 values are very sensitive to the accuracy of mass spectrometer.

As is shown in the Figure 2, the probability of random matches having high pp values is substantially reduced as we increase mass accuracy. Increasing mass accuracy resulted in a shift of the pp value distribution for random matches to lower values. At the same time the pp value distribution for true matches moves to higher pp values. This effect is evident from the pp values in Table 1. As mass accuracy improved, the pp values improved for all peptide matches in Figure 1. Thus higher mass accuracy improves sensitivity and selectivity for a search and help discriminate true matches from random matches.

thumbnailFigure 2. Effect of mass accuracy on the theoretical probability density function (f(pp)) of pp and pp2 values for random matches (β βc).

Conclusion

A new statistically derived scoring algorithm was developed for characterization of peptides, proteins and their posttranslational modifications from tandem MS data. The probability based algorithm implicitly incorporates mass accuracy into scoring the potential peptide and protein matches. This approach is separate and distinct from algorithms that filter precursor and product ion matches based on mass accuracy. The statistical model involves no empirical parameters and its scores correlate to the probability that a match is a random occurrence. A novel statistically derived algorithm to rigorously calculate protein scores from the probability based peptide scores was also developed. Thus the protein scores reflect the significance of protein matches and can be used to differentiate true protein matches from random matches. The algorithm is incorporated in an automated database search program MassMatrix.

Authors' contributions

HX designed and mathematically proved the statistical model and drafted the manuscript. MAF was the principle investigator and provided overall guidance of the project, and also revised the manuscript critically. Both authors read and approved the final manuscript.

Acknowledgements

The study was funded by the Ohio State University, the National Institutes of Health CA107106, the V Foundation/American Association for Cancer Research Translational Cancer Research Grant and the Leukemia & Lymphoma Society.

References

  1. Sadygov RG, Cociorva DC, Yates JR: Large-scale database searching using tandem mass spectra: Looking up the answer in the back of the book.

    Nature Methods 2004, 1(3):195-202. PubMed Abstract | Publisher Full Text OpenURL

  2. Hunt DF, Yates JR, Shabanowitz J, Winston S, Hauer CR: Protein sequencing by tandem mass-spectrometry.

    Proc Natl Acad Sci U S A 1986, 57:6233-6237. Publisher Full Text OpenURL

  3. Bakhtiar R, Guan ZQ: Electron capture dissociation mass spectrometry in characterization of peptides and proteins.

    Biotechnol Lett 2006, 28(14):1047-1059. PubMed Abstract | Publisher Full Text OpenURL

  4. Nikolaev EN, Somogyi A, Smith DL, Gu CG, Wysocki VH, Martin CD, Samuelson GL: Implementation of low-energy surface-induced dissociation (eV SID) and high-energy collision-induced dissociation (keV CID) in a linear sector-TOF hybrid tandem mass spectrometer.

    Int J Mass Spectrom 2001, 212:535-551. Publisher Full Text OpenURL

  5. Syka JEP, Coon JJ, Schroeder MJ, Shabanowitz J, Hunt DF: Peptide and protein sequence analysis by electron transfer dissociation mass spectrometry.

    Natl Acad Sci USA 2004, 101:9528-9533. Publisher Full Text OpenURL

  6. Hunt DF, Buko AM, Ballard JM, Shabanowitz J, Giordani AB: Sequence-analysis of polypeptides by collision activated dissociation on a triple quadrupole mass-spectrometer.

    Biomed Mass Spectrom 1981, 53:397-408. Publisher Full Text OpenURL

  7. Biemann K: Contributions of mass-spectrometry to peptide and protein-structure.

    Biomed Environ Mass Spectrom 1988, 16:99-111. PubMed Abstract | Publisher Full Text OpenURL

  8. Nesvizhskii AI, Aebersold R: Analysis, statistical validation and dissemination of large-scale proteomics datasets generated by tandem MS.

    Drug Discov Today 2004, 9(4):173-181. PubMed Abstract | Publisher Full Text OpenURL

  9. Dancík V, Addona TA, Clauser KR, Vath JE, Pevzner PA: De novo peptide sequencing via tandem mass spectrometry.

    J Comput Biol 1999, 6:327-342. PubMed Abstract | Publisher Full Text OpenURL

  10. Standing KG: Peptide and protein de novo sequencing by mass spectrometry.

    Curr Opin Struc Biol 2003, 13(5):595-601. Publisher Full Text OpenURL

  11. Eng JK, McCormack AL, Yates JR: An approach to correlate tandem mass spectral data of peptides with amino acid sequences in a protein database.

    J Am Soc Mass Spectrom 1994, 5:976-989. Publisher Full Text OpenURL

  12. Kapp EA, Schütz F, Connolly LM, Chakel JA, Meza JE, Miller CA, Fenyo D, Eng JK, Adkins JN, Omenn GS, Simpson RJ: An evaluation, comparison, and accurate benchmarking of several publicly available MS/MS search algorithms: sensitivity and specificity analysis.

    Proteomics 2005, 5(13):3475-3490. PubMed Abstract | Publisher Full Text OpenURL

  13. Keller A, Nesvizhskii A, Kolker E, Aebersold R: Empirical statistical model to estimate the accuracy of peptide identifications made by MS/MS and database search.

    Anal Chem 2002, 74:5383-5392. PubMed Abstract | Publisher Full Text OpenURL

  14. Qian W, Liu T, Monroe ME, Strittmatter EF, Jacobs JM, Kangas LJ, Petritis K, Camp DG, Smith RD: Probability-Based Evaluation of Peptide and Protein Identifications from Tandem Mass Spectrometry and SEQUEST Analysis: The Human Proteome.

    J Proteome Res 2005, 4:53-62. PubMed Abstract | Publisher Full Text OpenURL

  15. Zhang N, Aebersold R, Schwikowshi B: ProbID: a probabilistic algorithm to identify peptides through sequence database searching using tandem mass spectral data.

    Proteomics 2002, 2:1406-1412. PubMed Abstract | Publisher Full Text OpenURL

  16. Perkins DN, Pappin DJC, Creasy DM, Cottrell JS: Probability-based protein identification by searching sequence database using mass spectrometry data.

    Electrophoresis 1999, 20:3551-3567. PubMed Abstract | Publisher Full Text OpenURL

  17. Hansen BT, Jones JA, Mason DE, Liebler DC: SALSA: a pattern recognition algorithm to detect electrophile-adducted peptides by automated evaluation of CID spectra in LC-MS-MS analyses.

    Anal Chem 2001, 73:1676-1683. PubMed Abstract | Publisher Full Text OpenURL

  18. Mann M, Wilm M: Error tolerant identification of peptides in sequence databases by peptide sequence tags.

    Anal Chem 1994, 66:4390-4399. PubMed Abstract | Publisher Full Text OpenURL

  19. Bafna V, Edwards N: SCOPE: a probabilistic model for scoring tandem mass spectra against a peptide database.

    Bioinformatics 2001, 17:S13-S21. PubMed Abstract | Publisher Full Text OpenURL

  20. Colinge J, Masselot A, Giron M, Dessingy T, Magnin J: OLAV: towards high-throughput tandem mass spectrometry data identification.

    Proteomics 2003, 3:1454-1463. PubMed Abstract | Publisher Full Text OpenURL

  21. MacCoss MJ, Wu CC, Yates JR: Probability-based validation of protein identifications using a modified SEQUEST algorithm.

    Anal Chem 2002, 74:5593-5599. PubMed Abstract | Publisher Full Text OpenURL

  22. Havilio M, Haddad Y, Smilansky Z: Intensity-based statistical scorer for tandem mass spectrometry.

    Anal Chem 2003, 75:435-444. PubMed Abstract | Publisher Full Text OpenURL

  23. Sadygov RG, Yates JR: A hypergeometric probability model for protein identification and validation using tandem mass spectral data and protein sequence databases.

    Anal Chem 2003, 75:3792-3798. PubMed Abstract | Publisher Full Text OpenURL

  24. Sadygov RG, Liu H, Yates JR: Statistical models for protein validation using tandem mass spectral data and protein amino acid sequence databases.

    Anal Chem 2004, 76:1664-1671. PubMed Abstract | Publisher Full Text OpenURL

  25. Geer LY, Markey SP, Kowalak JA, Wagner L, Xu M, Maynard DM, Yang X, Shi W, Bryant SH: Open mass spectrometry search algorithm.

    J Proteome Res 2004, 3:958-964. PubMed Abstract | Publisher Full Text OpenURL

  26. Olsen JV, de Godoy LMF, Li G, Macek B, Mortensen P, Pesch R, Makarov A, Lange O, Horning S, Mann M: Parts per million mass accuracy on an Orbitrap mass spectrometer via lock mass injection into a C-trap.

    Mol Cell Proteomics 2005, 4(12):2010-2021. PubMed Abstract | Publisher Full Text OpenURL

  27. Clauser KR, Baker P, Burlingame AL: Role of accurate mass measurement (±10 ppm) in protein identification strategies employing MS or MS/MS and database searching.

    Anal Chem 1999, 71:2871-2882. PubMed Abstract | Publisher Full Text OpenURL

  28. Sullivan AG, Brancia FL, Tyldesley R, Bateman R, Sidhu K, Hubbard SJ, Oliver SG, Gaskell SJ: The exploitation of selective cleavage of singly protonated peptide ions adjacent to aspartic acid residues using a quadrupole orthogonal time-of-flight mass spectrometer equipped with a matrix-assisted laser desorption/ionization source.

    Int J Mass Spectrom 2001, 210/211:665-676. Publisher Full Text OpenURL

  29. Xu H, Freitas AF: MassMatrix: A Database Searching Program for Rapid Characterization of Proteins and Peptides from Tandem Mass Spectrometry Data.

    To be submitted OpenURL

  30. Paizs B, Suhai S: Fragmentation pathways of protonated peptides.

    Mass Spectrom Rev 2005, 24:508-548. PubMed Abstract | Publisher Full Text OpenURL