Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Research article

Stronger findings from mass spectral data through multi-peak modeling

Tommi Suvitaival1, Simon Rogers2 and Samuel Kaski13*

Author Affiliations

1 Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, 00076 Espoo, Finland

2 School of Computing Science, University of Glasgow, G12 8QQ, Glasgow, UK

3 Helsinki Institute for Information Technology HIIT, Department of Computer Science, University of Helsinki, Helsinki, Finland

For all author emails, please log on.

BMC Bioinformatics 2014, 15:208  doi:10.1186/1471-2105-15-208

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/15/208


Received:19 March 2014
Accepted:12 June 2014
Published:19 June 2014

© 2014 Suvitaival et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Abstract

Background

Mass spectrometry-based metabolomic analysis depends upon the identification of spectral peaks by their mass and retention time. Statistical analysis that follows the identification currently relies on one main peak of each compound. However, a compound present in the sample typically produces several spectral peaks due to its isotopic properties and the ionization process of the mass spectrometer device. In this work, we investigate the extent to which these additional peaks can be used to increase the statistical strength of differential analysis.

Results

We present a Bayesian approach for integrating data of multiple detected peaks that come from one compound. We demonstrate the approach through a simulated experiment and validate it on ultra performance liquid chromatography-mass spectrometry (UPLC-MS) experiments for metabolomics and lipidomics. Peaks that are likely to be associated with one compound can be clustered by the similarity of their chromatographic shape. Changes of concentration between sample groups can be inferred more accurately when multiple peaks are available.

Conclusions

When the sample-size is limited, the proposed multi-peak approach improves the accuracy at inferring covariate effects. An R implementation and data are available at http://research.ics.aalto.fi/mi/software/peakANOVA/ webcite.

Keywords:
ANOVA-type modeling; Bayesian modeling; Clustering; Mass spectrometry; Metabolomics; Lipidomics; Nonparametric Bayes

Background

The study of changes in the levels of metabolites and lipids has become essential for the comprehensive understanding of human health [1]. Chromatography-coupled mass spectrometry (MS) techniques have become the standard method for characterizing the human metabolome [2] and lipidome [3]. The technique generates a spectrum of peaks describing the sample in the plane defined by the retention time from the chromatograph and the mass-to-charge ratio from the mass spectrometer. Each peak in this plane is either generated by an ion arising from one of the compounds present in the sample, or is an artifact of the measurement without association to any of the compounds. The association between the peaks and compounds is unknown a priori. The produced peak data are noisy: First, sample preparation introduces sources of uncertainty that propagate to the analysis [4]. Second, the accuracy of the device is limited [5] and it produces biases. Third, peak identification, annotation and pre-processing steps produce additional layers of uncertainty [6]. The effect of errors at all these levels is exacerbated by the “small n, large p” problem: experiments cover a very limited number of samples, n, while the set of compounds measured, p, is potentially large.

However, there also is strong informative structure in the data: First, each compound may generate multiple adduct peaks [7] (Figure 1) and isotope peaks [8,9] (Figure 2), whose positions and shapes provide information about the identity of the compound. Second, the concentrations of different compounds generated by or participating in similar biological processes may be highly correlated [10]. An increasing number of machine learning algorithms are being developed for inferring such structure either from raw spectral data [11] or from processed intensity data [12]. The inference of covariate effects—the differences between sample groups determined by the controlled covariates of the experiment, such as an intervention—is in the core of the comparative analysis of spectral profiles [13]. In addition to the controlled covariates, confounding factors may affect the observations and are subject to the experiment design. In this work, we focus on inferring effects of the controlled covariates from the data.

thumbnailFigure 1. A schematic of the positions of typical adduct peaks [7] in the RT-m/z plane for two lipids, the ceramide Cer(d18:1/17:0) and the sphingomyelin SM(d18:1/22:0). An adduct peak is formed by an ion attaching to the compound. At the finer detail, each peak in the figure consists of multiple isotope peaks few atomic units apart, as shown for Cer(d18:1/17:0) in Figure 2. Even though the distinct isotope peaks are not visible to the eye here, they are clearly separable by the mass spectrometer. In the figure, adduct types and compounds are marked by colors and characters, respectively.

thumbnailFigure 2. Natural isotopic distribution of the mass of a typical lipid, the ceramide Cer(d18:1/17:0). The presence of atomic isotopes leads to the appearance of multiple mass spectral peaks from the compound. Some isotopes are very similar by their mass but still differentiable by the mass spectrometer. The isotope peaks have distinct mass-to-charge ratios at the same retention time (Figure 1).

The existence of additional peaks in the spectrum is usually seen as a problem and only the main peak of each identified compound is used for further analysis. All peaks are a result of the ionisation process where a charged particle is attached to or detached from a compound. Each such compound-ion pair produces a distinct adduct peak. Random variation in the ionisation process leads to inconsistencies between batches of samples, perceived as variation in the ratio of intensities of the peaks associated with one compound. This is a major source of error for all existing analysis approaches regardless of the choice of the peak used for the analysis. On the other hand, the distribution of the intensities of isotope peaks is by nature well preserved across both samples and compounds. Moreover, the natural isotopic distribution of a compound is known and can be used to make peak annotation more precise. In this way, isotope peaks provide reliable additional information about the differences in compound concentrations between sample groups.We propose a probabilistic approach for extending statistical analysis to all available peaks and demonstrate that the additional peaks can provide a real benefit to the inference of covariate effects (Figure 3). The approach is used to cluster the peaks that are likely to arise from a single compound together and to infer the changes in concentrations of the compounds more accurately based on all these peaks. By this approach, we are addressing the problem of inadequate sample-size by introducing additional data describing the compounds behind the noisy measurements.

thumbnailFigure 3. Flow chart of the method. (a) Peaks are clustered by their shapes. (b) Covariate effects are inferred based on the intensities of the clustered peaks.

To solve the problem we introduce the following assumptions about the generative process of the data within a Bayesian model: First, samples carry between-group differences in their compound concentrations and the differences arise from responses to controlled covariates. Second, multiple observed spectral peaks follow an identical generative process and their heights are a noisy reflection of the true concentration level of the compound. Third, shapes of the peaks from one compound are generated through an identical process following the properties of the measurement device, and thus these shapes are highly similar.

The approach presented in this paper consists of two stages of computational inference: (1) peaks that share a compound as their generative source are clustered together, and (2) the responses to controlled covariates of the experiment are inferred on these clusters of peaks.

The clustering part of the approach is based on a nonparametric Bayesian Dirichlet process model [14]. To improve the performance of this model, we have redefined the prior distributions from a normal distribution to a beta distribution to improve the match to the peak shape similarity observations.

The model for inferring the responses to covariates operates on clusters inferred in the first part. A Bayesian multi-way model [13] is suitable for this task. This model itself could be used for clustering summarized mass spectral intensity data, but in this work, we demonstrate that the clustering can be done more accurately based upon the similarity of chromatographic peak shapes.

Methods

This section describing the models consists of two parts: clustering of spectral peaks and inference of covariate effects. To maintain the mathematical rigor in the section, we use the terms “samples,” “variables” and “clusters” to refer to the experimental runs of the mass spectrometer, the peaks in the mass spectrometry data, and the yet unknown compounds in the experimental runs, respectively. In the equations, we denote them by the indices

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M1">View MathML</a>

(1)

respectively, where N, P and K are their respective total numbers. We use bold capital, bold non-capital and non-bold non-capital symbols to refer to matrices, vectors and scalars, respectively (e.g., V, v and v).

Clusters of peaks based on the similarity

Following earlier work [14], we measure the similarity between the shapes of two peaks by their Pearson correlation computed over a window of retention time after a standard peak alignment [15] across the samples. Truncating negative values to zero, this leads to a distinct similarity matrix Qi··∈[0,1]P×P for each sample i. In the notation, the operator “ ·” indicates that the entire dimension of the array is included, not only the single item j. Since a peak is not necessarily observed in every sample, there may be missing values in the matrices. Therefore, we construct an additional mask R∈{0,1}N×P×P with binary values <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M2">View MathML</a> indicating whether the peak pair (j,j) in sample i appears together within the window where the similarity is measured and whether both of the peaks are observed. An unidentified peak may still be present in the sample below the limit of detection of the mass spectrometer. However, then it is not useful for the inference of covariate effects and, thus, is treated as missing.

Model

We assume that the peaks are generated through a Dirichlet process [16]: there is an unknown number of clusters and an unknown and variable number of peaks that arise from each of the clusters. Peaks are assumed to have a one-out-of-many association: each peak is associated with only one of the unknown clusters. With these basic assumptions, we can infer the P-by-K clustering matrix V from the data Q. Value vjk=1 in the clustering matrix V assigns the peak j to the cluster k. To make the following equations more compact, we use an additional variable, <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M3">View MathML</a>, which is an inner product of the cluster indicator vectors of the peaks j and j, to denote whether the two peaks come from the same or different clusters (1 or 0, respectively).

We set a spike-and-slab prior [17] for the peak shape similarity to model the inherent sparse structure of the data. The similarity between any pair of observed peaks (j,j) is assumed to follow a beta distribution, but the shape of the distribution is assumed to depend on whether the pair comes from the same cluster or from different clusters (shape parameters (ain,bin) or (aout,bout), when <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M4">View MathML</a> or 0, respectively). Also the probability of a missing similarity value is assumed to depend on the cluster assignment of the pair ( <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M5">View MathML</a> or <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M6','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M6">View MathML</a>, when <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M7','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M7">View MathML</a> or 0, respectively). The distributional assumptions are

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M8','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M8">View MathML</a>

(2)

with the first and the second row of the equation stating the distributions of a peak pair from the same cluster and different clusters, respectively. The likelihood of the entire peak shape data,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M9','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M9">View MathML</a>

(3)

becomes a product over all peak pairs and samples following the distributional assumption of Equation 2.

We further assume that the observed peaks are generated from an unknown finite subset of an infinite set of clusters with an equal prior probability,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M10','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M10">View MathML</a>

(4)

for any pair of peaks to be generated from the same cluster. These assumptions define the Dirichlet process, controlled by the concentration parameter αDP, which determines the prior probability mass outside the existing clusters. Following from this prior assumption, the probability of assigning peak j to an existing cluster k,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M11','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M11">View MathML</a>

(5)

becomes weighted by the current size of the cluster, <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M12','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M12">View MathML</a>. In the notation, matrices V·,-k and V-j correspond to the matrix V with the column k and the row j omitted, respectively. Alternatively, with probability

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M13','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M13">View MathML</a>

(6)

the process may create a new cluster with the index K+1 and only the peak j inside. Then, the likelihood term is weighted by the Dirichlet process concentration parameter αDP, which can be seen as a pseudo-count for the number of peaks outside the current K clusters.

Inference

We infer the posterior distribution of the clustering via Gibbs sampling, which results in a set of S samples of the clustering V(s), s=1,…,S, from the true posterior distribution p(V|Q,R). The computational complexity of a Gibbs iteration is <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M14','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M14">View MathML</a>. Further analysis can operate on the entire posterior distribution of the clustering through integration, or on a point estimate of the distribution. We follow earlier work [18] and acquire a point estimate of the posterior distribution of the clustering through finding the least-squares clustering (Section 1 in Additional file 1).

Additional file 1. Supplementary material. More details of the experiments.

Format: PDF Size: 330KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Covariate effects based on peak heights

Having inferred the grouping of similar peaks into clusters that each correspond to a compound, we infer the differences in concentrations between sample groups for each cluster given the peak height data <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M15','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M15">View MathML</a> and the clustering V. Again, some values in the data may be missing.

Model

After a peak-specific centering based on the control group, the observed peak heights for each sample i are assumed to be normally distributed with a cluster-specific mean <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M16','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M16">View MathML</a>:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M17','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M17">View MathML</a>

(7)

where the diagonal matrix Λ contains the peak-specific variance parameters <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M18','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M18">View MathML</a>. The cluster-specific means are assumed to be normally distributed with a sample group-specific prior α,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M19','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M19">View MathML</a>

(8)

where ai∈{1,…,La} is an indicator of group membership (covariate level) for sample i and I is a K-by-K identity matrix. The corresponding covariate effects are arranged into an K-by- La matrix α and the effects are assumed to be independent and normally distributed,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M20">View MathML</a>

(9)

except for the first level, l=1, which is defined as the baseline level and thus is fixed to zero. The model is not limited to one covariate: the cluster-specific mean <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M21','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M21">View MathML</a> can be expressed as a sum of effects of multiple covariates and their interaction effects (Section 1 in Additional file 1). Further, the model is readily extensible for dependent covariate effects [19].

The peak-specific variance parameter,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M22','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M22">View MathML</a>

(10)

follows a scaled inverse- χ2 distribution with n0 prior samples and a scale <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M23','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M23">View MathML</a>.

Inference and analysis

We infer the covariate effects via Gibbs sampling. Now the clustering matrix V has been learned earlier, and is thus taken as known in the model. Computational complexity of a Gibbs iteration is <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M24">View MathML</a>. The clustering and the covariate effects can be inferred overnight on a standard desktop computer for a typical-sized data set. The posterior distributions of the covariate effects α are descriptive of the differences between the sample groups and, thus, interesting from the analysis point of view. To assess the significance of the difference between a sample group, c=l>1, and the control group, c=1, for a cluster k, we can study the posterior probability of the effect αkl being greater or less than zero.

Comparison methods

We call the method described above Model 1. We compared the performance of the following approaches and refer to them as Models 1, 2 and 3:

1. the multi-peak approach using both peak shape and height information, as proposed in this work (nonparametric clustering of peaks by their shape similarity, inference of covariate effects on the clusters based on the height of the peaks),

2. the multi-peak approach using peak height information only [13] (clustering of peaks and inference of covariate effects based on the height of the peaks only),

3. the typical single-peak approach (inference of covariate effects by the height of the strongest annotated peak only).

For the studied real data sets, we discovered that peak height information alone is not enough for clustering the peaks into individual compounds due to the high level of noise and strong correlations between compounds. Thus, for real data we compared Model 1 to Model 3 and highlight the benefit gained by using peak shape information.

Model 2 assumes the generative Gaussian latent variable model of the Equations 7–10 for the intensity observations X and a uniform multinomial prior for the clustering of the peaks. The clustering is inferred by Gibbs sampling together with the covariate effects.

Model 3 quantifies the difference between the covariate level, c=l, and the control level, c=1, as the difference of their means based on the main peak j,

<a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M25','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M25">View MathML</a>

(11)

The Kronecker delta function <a onClick="popup('http://www.biomedcentral.com/1471-2105/15/208/mathml/M26','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/15/208/mathml/M26">View MathML</a> selects the samples that have the covariate level l by receiving the value 1, when ai=l, and 0, otherwise. When the data are log-transformed, the mean difference corresponds to the fold change computed in many analysis platforms such as MZmine [15] and XCMS [6].

Experiments

We demonstrate the performance of the proposed method through three experiments: a simulated data experiment, a spike-in benchmark experiment with known changes in concentrations, and a gene silencing experiment with measurements of the lipidome of cancer cells.

Evaluation measures

Evaluation of the performance on real data sets is not a trivial task, as there is no ground truth available: neither the identity of the peaks nor the true effect sizes are known. Thus, we also used spike-in data, where the true covariate effects are known, although only a small number of the peaks are annotated.

For the simulated and benchmark experiments, we computed the mean squared error (MSE) between inferred and true covariate effects as an evaluation metric. As a result of the log-transformation of the intensity data, we were quantifying relative changes between sample groups, independent of the average height of each peak. In the model, we thus assumed that the change is preserved across the peaks of one compound, in relative terms. The significance of the difference in the MSE of the proposed approach and the comparison method was tested by the paired one-sided t-test. The false discovery rate was controlled by the Benjamini-Hochberg step-up procedure [20]. Additionally for the simulated experiment, we studied the inference of the statistical significance of effects, since the true distribution of the data was known.

To assess the sensitivity of the approaches to noise in natural lipidomic data lacking a ground truth, we used two types of indirect evaluation: First, we studied the consistency of the inferred covariate effects given a prior assumption about their similarity. Second, we examined the robustness of the inferred covariate effects to noise. Finally, we demonstrated differences between the multi-peak and single-peak approaches through examples of qualitative analysis of annotated peak clusters.

Simulated data

We started by investigating the performance of the proposed approach on synthetic data, where the true covariate effects are known. We focused on a usual task in exploratory analysis of biological data: the detection of significant non-zero covariate effects. We measured the performance by the accuracy at this task—the ratio of true positive and true negative significant differences among all effects. We used the 95% posterior quantiles to determine the significance. Additionally, we compared the approaches by the MSE to the true effects and studied the performance of the two clustering models by computing the normalized information distance (NID) [21] to the true clustering.

The approaches were tested across a set of potential experimental settings to study how the observation of additional peaks and samples affects the performance. Simulated data were generated by assuming the latent structure of Model 1. The following data parameters were varied on a grid: sample-size N=2×{3,7,15} and peak-specific noise σ2={1,5}. Additionally, the number of peaks per cluster was varied between 3, 7 and 15. Covariate effects α·2=[2,-1,0.5,0,0,0,0] were generated for each data set. The experiment was repeated 100 times with independent data sets. The results are reported in the Results and discussion section.

Benchmark data with known changes in concentrations

The benchmark data set of apple samples [22] includes a set of annotated spike-in compounds with increases of 20, 40 or 100% in concentrations. We started with the raw spectral data [23] in order to acquire the shapes of the peaks in addition to their heights. The mass spectra were pre-processed using MZmine 2 [15] (Section 4 in Additional file 1). We used standard pre-processing methodology also used in the original publications of the data sets, thus maintaining the focus of the work on the potential benefit gained from the multiple peaks. The compared approaches were on the same line in terms of the data.

We evaluated the approaches by the MSE between inferred and true covariate effects. If the cluster contained multiple annotated peaks, the effect of each annotated peak was evaluated separately for the single-peak approach. Clusters with no annotated peaks were considered to have a 0% true effect and the effect of the single-peak approach was inferred based on the strongest peak of the cluster.

Lipidomic data from a gene silencing study

The data come from a recent experiment [24] to study the effects of gene silencing treatments on lipidomic profiles and growth of breast cancer tissue. Driven by the lack of ground truth about the covariate effects, we evaluated the inferred effects indirectly in two ways: (1) by quantifying the consistency of the effects within a lipid family and (2) by quantifying the robustness of the magnitudes of the inferred effects across the lipidome in presence of additional noise. Additionally, we investigated the stability of the inferred clustering on the data and qualitatively analyzed differences between the covariate effects of single peaks and the effects inferred on clusters of peaks by Model 1.

The data included 32 lipidomic profiles of breast cancer cells from the ZR-75-1 cell line. We inferred the effects of seven distinct silencing interventions on metabolism- regulating genes (Section 5 in Additional file 1) at two time points. The raw spectra were pre-processed with MZmine 2 as described in the original publication [24], in addition to which the shape similarities of the peaks were computed.

Consistency of effect signs

In the first task, we quantified the consistency as the accuracy at predicting the covariate effect of a test lipid given the model on the covariate effects of other lipids of the same family. For instance, we predicted the effect of a gene silencing treatment on the sphingomyelin SM(d18:1/22:0) based on the sphingomyelin compounds in the training set. We examined the sign of the effect instead of the absolute effect, since even within a family of lipids the changes have a high variance and thus cannot be reliably predicted without imposing additional information about the biological system.

We predicted the signs of the covariate effects for test lipids in a three-fold cross-validation setting with 100 randomizations. The examined lipids included the annotated members from the three most abundant families of lipids that had two or more peaks identified with the clustering model (Section 5 in Additional file 1).

Further, we studied the influence of noise to the consistency by adding independent normally distributed noise (from σ=0 to σ=10) on the peak intensity observations. Added noise variance σ=1 was equal to the existing original variance in the data, and the upper bound for the signal-to-noise ratio then was 0.5 (Additional file 1: Table S4).

Robustness of effect magnitudes

To evaluate the inferred effects at the scale of the entire observed lipidome, we examined the consistency of inferred covariate effects between the original and noise-added data sets. This experiment simulated the situation where the true effects are known (effects from the original data set), but the data based on which the effects are inferred are noisy (the added-noise data set). To measure the consistency, we computed the Spearman correlation between the covariate effects inferred from the original and the added-noise data sets. We studied all clusters with two or more peaks, constituting 20% of the clusters.

Results and discussion

Simulated data

On a normal level of noise (σ2=1), the multi-peak approaches (Models 1 and 2) always performed better at detecting significant covariate effects than the single-peak approach (Model 3; Figure 4a) and only with enough samples the performance of Model 2 became comparable to Model 1. The inferred clustering of Model 1 was perfect while the clustering performance of Model 2 heavily depended on the number of samples available (Figure 4c).

thumbnailFigure 4. The use of data from multiple peaks and the peak shape information increased the accuracy at detecting significant covariate effects on simulated data. Accuracy of Models 1, 2 and 3 for simulated data is shown as a function of the sample-size in two settings: normal and high level of noise (left: σ2=1, and right: σ2=5, respectively). Top (a-b): Accuracy at inferring the significance of the generated covariate effects. Bottom (c-d): Normalized information distance (NID) between the inferred and the true clustering. An entirely random and an exactly correct clustering correspond to a NID of 1 and 0, respectively.

On a high level of noise (σ2=5), only Model 1 worked (Figure 4b). The reason for the failure of Model 2 was the imperfectly inferred clustering (Figure 4d). The good performance of Model 1 resulted from the clustering step, which is robust to noise in the peak heights. The peak shape similarity gave strong evidence for inferring the clusters already from a single sample.

The MSE between the inferred and true covariate effects for Model 1 was smaller compared to Model 3 in all the 24 setups of the experimental grid (Additional file 1: Table S1). The difference was statistically significant in 22 setups and in all setups at the high level of noise.The performance of Model 1 clearly improved, when more peaks from a cluster were present in the data (Figure 5). This was pronounced at a high level of noise, when the observation of a single peak is unreliable for inferring the covariate effects. In a similar way as in averaging over samples, the model is able to overcome peak-specific noise also by averaging over multiple peaks.

thumbnailFigure 5. The performance of Model 1 improved when more peaks per compound were available in the simulated data. The curves show the accuracy as a function of sample-size for simulated data with 15, 7 and 3 peaks per compound.

Benchmark data with known changes in concentrations

In the first demonstration on real UPLC-MS data [22], we show that Model 1 can infer the artificial perturbations in a spike-in experiment more accurately than the single-peak approach.

In the positive ion mode, the model inferred 794 clusters, among which 135 clusters included more than one peak. Seven clusters included annotated peaks from the spike-in compounds, four of which included more than one annotated peak (Additional file 1: Table S2). Peaks from two compounds were distributed to two and four clusters, respectively. In the negative ion mode, the model inferred 367 clusters, among which 113 clusters were non-singletons. Three clusters included annotated peaks from the spike-in compounds, all of these clusters included more than one annotated peak and all peaks from one compound were clustered together. In both the ion modes, all clusters with annotated peaks were specific to one compound.

Model 1 had a lower error than Model 3 at all magnitudes of the true effect with the strongest relative improvement occurring at the small magnitudes (Figure 6). The difference was statistically significant for covariate effects from 0 to 40% (Additional file 1: Table S3).

thumbnailFigure 6. Model 1 had a more accurate quantification of the covariate effects for the spike-in compounds as well as for the unchanged non-annotated compounds in the benchmark experiment. Root-mean-square error (RMSE; y-axis) between the inferred and true covariate effects is smaller for Model 1 (All peaks) than for the single-peak approach (Single peak) at all the magnitudes of the true effect (x-axis). Differences were statistically significant for changes of 0 to 40% (Additional file 1: Table S3).

Lipidomic data from a gene silencing study

In the second demonstration on real UPLC-MS data [24], we show that Model 1 can infer more consistent covariate effects in two ways even though the true effects are unknown.

Consistency and robustness of effects

When examining the consistency of effects within a lipid family, Model 1 was more consistent than Model 3 at all levels of noise (Figure 7). When no noise was added and also at moderate levels of noise, both approaches performed clearly better than expected by random chance. When noise was added, Model 3 suffered more and its performance reduced to the random level more rapidly. Given the assumption about the general similarity of lipids within a family is true, Model 1 inferred the covariate effects more consistently.When examining the robustness of effect magnitudes, Model 1 was more consistent than Model 3 when noise was added to the data (Figure 8). The confidence intervals from the 100 randomizations did not overlap at all at moderate levels of noise.

thumbnailFigure 7. Model 1 (All peaks) had a better accuracy at the prediction of signs of covariate effects for previously unseen lipids in the lipidomic gene-silencing data set compared to Model 3 (Single peak). The difference became pronounced when simulated noise was added to the data. The prediction was based on the inferred covariate effects of compounds from the same lipid family and was done in a cross-validation setting. In the task, the effects of the seven gene-silencing treatments were predicted on the three most abundant families of lipids in two time points. Points σ=0 and σ>0 on the x-axis show the prediction accuracy (y-axis) for the original data and the data with added noise, respectively.

thumbnailFigure 8. The covariate effects inferred by Model 1 (All peaks) were more robust to noise compared to Model 3 (Single peak). At moderate levels of noise, which is the regime of many biological experiments, the confidence intervals over 100 randomizations did not overlap at all. The robustness was quantified as the Spearman correlation (y-axis) between the effects inferred from the noisy and noise-free versions of the lipidomic gene silencing data set as a function of the level of noise (x-axis).

Stability

Since the proposed approach is sensitive to the inferred clustering of the data, we analyzed the stability of the inferred clustering on biological data, using the lipidomic gene silencing data as a case study. We tested the influence of the concentration parameter αDP in the Dirichlet process clustering model. The clustering result for the lipidomic gene silencing data was robust to changes in the magnitude of the concentration parameter (Additional file 1: Figure S2). As expected, the number of clusters increased, when the preset value of the concentration parameter increased, but the relative change was small.

Qualitative analysis

Finally, we give concrete examples of potential findings that the approaches can uncover and demonstrate how analysis based on a single peak may lead to a different outcome depending on the choice of the peak.The intervention-driven changes of individual peaks from two lipids along with the covariate effects inferred by Models 1 and 3 are shown in Figure 9. In the case of the sphingomyelin SM(d18:1/22:0), there were strong covariate effects inferred by Model 3 but many of these effects became weaker when inferred based on multiple peaks by Model 1. On the contrary, Model 3 inferred weak covariate effects for the ceramide Cer(d18:1/17:0) but based on multiple peaks and Model 1, one of the effects was actually among the top-5% strongest effects across the observed lipidome.

thumbnailFigure 9. Example clusters of peaks from the lipidomic gene silencing data with differences in the covariate effects inferred based on a single peak and multiple peaks. The heat maps show changes in the lipid concentrations driven by the gene silencing interventions (columns). Covariate effects inferred by Models 3 and 1 using a single peak and all peaks, respectively, are shown on the two bottom rows of each heat map. The log2 fold changes of each peak associated with the compound are shown on the top rows. Changes that by the magnitude fall to the top-5% across the entire observed lipidome are highlighted by the symbol ”T.“ Top (a): The sphingomyelin SM(d18:1-22:0) with three peaks. Many strong changes for SM(d18:1-22:0) became weaker when they were inferred based on all three peaks. Bottom (b): The ceramide Cer(d18:1-17:0) with six peaks. The effect of the SCAP silencing for Cer(d18:1-17:0) at 72 hours became strong when it was inferred based on all six peaks.

Conclusions

We have empirically demonstrated that a model-based integration of multiple peaks can lead to an improved accuracy in the inference of covariate effects, and we introduced a novel method for this task. While the sample-size is always restricted by external constraints such as the experiment budget or the availability of suitable patients, the inference based on multiple peaks gives a shortcut to extracting more information from the limited set of samples, thereby directly addressing the “small n, large p” problem. However, some types of systematic measurement error, such as some batch effects, escape this treatment and can only be reduced by introducing independent replicates. Based on the results presented in this work, we argue that additional peaks are especially useful when the signal-to-noise ratio is low and the differences between sample groups are small.

We suggest that all the detected peaks that can be associated with a compound should be taken into account in the comparative analysis. This is possible through the two-step generative modeling approach presented in this work: (1) by identifying the peaks that can be associated with one compound through clustering the peaks based on their shape similarity and (2) by the inference of covariate effects on the clusters, each representing one compound.

Abbreviations

ANOVA: Analysis of variance; Cer: Ceramide; SM: Sphingomyelin; UPLC-MS: Ultra performance liquid chromatography-mass spectrometry.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

The method was developed jointly by TS, SK and SR. TS had a lead role at implementing the model, designing and implementing the experiments, and at preparing the manuscript. All authors read and approved the manuscript.

Acknowledgements

The authors would like to thank Sandra Castillo, Peddinti V. Gopalacharyulu, Mika Hilvo and Matej Orešič for providing data and for useful discussions. The authors would also like to thank Rónán Daly and Joe Wandy for useful discussions. This work was supported by the Academy of Finland (Finnish Centre of Excellence in Computational Inference Research COIN, 251170; Computational Modeling of the Biological Effects of Chemicals, 140057), the Finnish Foundation for Technology Promotion (to TS) and the Finnish Doctoral Programme in Computational Sciences FICS (to TS). The calculations presented in the work were performed using computer resources within the Aalto University School of Science "Science-IT" project.

References

  1. Shevchenko A, Simons K: Lipidomics: coming to grips with lipid diversity.

    Nat Rev Mol Cell Bio 2010, 11(8):593-598. Publisher Full Text OpenURL

  2. Scalbert A, Brennan L, Fiehn O, Hankemeier T, Kristal BS, van Ommen B, Pujos-Guillot E, Verheij E, Wishart D, Wopereis S: Mass-spectrometrybased metabolomics: limitations and recommendations for future progress with particular focus on nutrition research.

    Metabolomics 2009, 5(4):435-458. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Orešič M, Hänninen VA, Vidal-Puig A: Lipidomics: a new window to biomedical frontiers.

    Trends Biotechnol 2008, 26(12):647-652. PubMed Abstract | Publisher Full Text OpenURL

  4. Dunn WB, Ellis DI: Metabolomics: current analytical platforms and methodologies.

    TrAC-Trend Anal Chem 2005, 24(4):285-294. OpenURL

  5. Windig W, Phalp JM, Payne AW: A noise and background reduction method for component detection in liquid chromatography/mass spectrometry.

    Anal Chem 1996, 68(20):3602-3606. Publisher Full Text OpenURL

  6. Smith CA, Want EJ, O’Maille G, Abagyan R, Siuzdak G: XCMS: processing mass spectrometry data for metabolite profiling using nonlinear peak alignment, matching, and identification.

    Anal Chem 2006, 78(3):779-787. PubMed Abstract | Publisher Full Text OpenURL

  7. Huang N, Siegel MM, Kruppa GH, Laukien FH: Automation of a Fourier transform ion cyclotron resonance mass spectrometer for acquisition, analysis, and e-mailing of high-resolution exact-mass electrospray ionization mass spectral data.

    J Am Soc Mass Spectr 1999, 10(11):1166-1173. Publisher Full Text OpenURL

  8. Kind T, Fiehn O: Metabolomic database annotations via query of elemental compositions: mass accuracy is insufficient even at less than 1 ppm.

    BMC Bioinformatics 2006, 7:234. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  9. Böcker S, Letzel MC, Lipták Z, Pervukhin A: SIRIUS: decomposing isotope patterns for metabolite identification.

    Bioinformatics 2009, 25(2):218-224. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Steuer R: Review: on the analysis and interpretation of correlations in metabolomic data.

    Brief Bioinform 2006, 7(2):151-158. PubMed Abstract | Publisher Full Text OpenURL

  11. Heinonen M, Shen H, Zamboni N, Rousu J: Metabolite identification and molecular fingerprint prediction through machine learning.

    Bioinformatics 2012, 28(18):2333-2341. PubMed Abstract | Publisher Full Text OpenURL

  12. Boccard J, Kalousis A, Hilario M, Lantéri P, Hanafi M, Mazerolles G, Wolfender JL, Carrupt PA, Rudaz S: Standard machine learning algorithms applied to UPLC-TOF/MS metabolic fingerprinting for the discovery of wound biomarkers in Arabidopsis thaliana.

    Chemometr Intell Lab 2010, 104:20-27. Publisher Full Text OpenURL

  13. Huopaniemi I, Suvitaival T, Nikkilä J, Orešič M, Kaski S: Two-way analysis of high-dimensional collinear data.

    Data Min Knowl Disc 2009, 19(2):261-276. Publisher Full Text OpenURL

  14. Rogers S, Daly R, Breitling R: Mixture model clustering for peak filtering in metabolomics. In Ninth International Workshop on Computational Systems Biology, WCSB 2012, June 4-6, 2012, Ulm, Germany, no. 61 in TICSP series. Edited by Larjo A, Schober S, Farhan M, Bossert M, Yli-Harja O. Tampere University of Technology: Tampere; 2012:71-74.

    [http://www.cs.tut.fi/wcsb12/WCSB2012.pdf webcite]

    OpenURL

  15. Pluskal T, Castillo S, Villar-Briones A, Orešič M: MZmine 2: modular framework for processing, visualizing, and analyzing mass spectrometry-based molecular profile data.

    BMC Bioinformatics 2010, 11:395. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  16. Escobar MD: Estimating normal means with a dirichlet process prior.

    J Am Stat Assoc 1994, 425:268-277.

    [http://www.jstor.org/stable/2291223 webcite]

    OpenURL

  17. Mitchell TJ, Beauchamp JJ: Bayesian variable selection in linear regression.

    J Am Stat Assoc 1988, 83(404):1023-1032. Publisher Full Text OpenURL

  18. Dahl DB: Bayesian Inference for Gene Expression and Proteomics. Cambridge: Cambridge University Press; 2006.

    Chap. Model-based clustering for expression data via a Dirichlet process mixture model, :201–218, [http://www.ddahl.org/papers/dahl-2006.pdf webcite]

    OpenURL

  19. Huopaniemi I, Suvitaival T, Orešič M, Kaski S: Graphical multi-way models. In Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2010, September 20–24, 2010, Barcelona, Spain, Volume 6321 of Lecture Notes in Computer Science. Edited by Balcázar JL, Bonchi F, Gionis A, Sebag M. Berlin/Heidelberg: Springer; 2010:538-553. OpenURL

  20. Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing.

    J Roy Stat Soc B Met 1995, 57:289-300.

    [http://www.jstor.org/stable/2346101 webcite]

    OpenURL

  21. Vinh N, Epps J, Bailey J: Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance.

    J Mach Learn Res 2010, 11:2837-2854.

    [http://dl.acm.org/citation.cfm?id=1953011.1953024 webcite]

    OpenURL

  22. Franceschi P, Masuero D, Vrhovsek U, Mattivi F, Wehrens R: A benchmark spike-in data set for biomarker identification in metabolomics.

    J Chemometr 2012, 26(1–2):16-24. OpenURL

  23. Franceschi P, Masuero D, Vrhovsek U, Mattivi F, Wehrens R: Spiked apple data. [http://cri.fmach.eu/Research/Computational-Biology/Biostatistics-and-Data-Management/download/data/Spiked-Apple-Data webcite] Accessed 11.06.2013.

  24. Hilvo M, Denkert C, Lehtinen L, Müller B, Brockmöller S, Seppänen-Laakso T, Budczies J, Bucher E, Yetukuri L, Castillo S, Berg E, Nygren H, Sysi-Aho M, Griffin J, Fiehn O, Loibl S, Richter-Ehrenstein C, Radke C, Hyötyläinen T, Kallioniemi O, Iljin K, Orešič M: Novel theranostic opportunities offered by characterization of altered membrane lipid metabolism in breast cancer progression.

    Cancer Res 2011, 71(9):3236-3245. PubMed Abstract | Publisher Full Text OpenURL