Abstract
Background
Some diseases, like tumors, can be related to chromosomal aberrations, leading to changes of DNA copy number. The copy number of an aberrant genome can be represented as a piecewise constant function, since it can exhibit regions of deletions or gains. Instead, in a healthy cell the copy number is two because we inherit one copy of each chromosome from each our parents.
Bayesian Piecewise Constant Regression (BPCR) is a Bayesian regression method for data that are noisy observations of a piecewise constant function. The method estimates the unknown segment number, the endpoints of the segments and the value of the segment levels of the underlying piecewise constant function. The Bayesian Regression Curve (BRC) estimates the same data with a smoothing curve. However, in the original formulation, some estimators failed to properly determine the corresponding parameters. For example, the boundary estimator did not take into account the dependency among the boundaries and succeeded in estimating more than one breakpoint at the same position, losing segments.
Results
We derived an improved version of the BPCR (called mBPCR) and BRC, changing the segment number estimator and the boundary estimator to enhance the fitting procedure. We also proposed an alternative estimator of the variance of the segment levels, which is useful in case of data with high noise. Using artificial data, we compared the original and the modified version of BPCR and BRC with other regression methods, showing that our improved version of BPCR generally outperformed all the others. Similar results were also observed on real data.
Conclusion
We propose an improved method for DNA copy number estimation, mBPCR, which performed very well compared to previously published algorithms. In particular, mBPCR was more powerful in the detection of the true position of the breakpoints and of small aberrations in very noisy data. Hence, from a biological point of view, our method can be very useful, for example, to find targets of genomic aberrations in clinical cancer samples.
Background
Lesions at DNA level represent the cause of cancer and of many congenital or hereditary disorders. The change of the number of copies of DNA in a genomic region is one of the most common aberrations. In normal cells each genomic segment is present in two copies, but, for example, in tumor cells the genome can present regions of deletions (copy number one or zero), gains (copy number three or four) or amplifications (copy number greater than four). Thus, in general, the DNA copy number along the genome can be represented as a piecewise constant function.
With microarray technology it is possible to simultaneously measure the copy number along the genome at hundred thousands of positions (see for example [1]). However, raw copy number data are generally very noisy. Hence, it is important to define a method which allows one to estimate the number of regions with different copy number, the endpoints of these regions (called breakpoints) and their copy number. Several methods have been developed to solve this issue. Many methods consider the log2 ratio of the data (the ratio is computed with respect to a normal reference sample) and model it as a normal random variable, since they assume that the errors are normally distributed. We can roughly subdivide all of these methods into two classes: those ones that estimate the copy numbers as a piecewise constant function and the others that estimate the copy numbers as a continuous curve. The methods belonging to the latter group are called smoothing methods.
Among the methods belonging to the first class, we can find the following. The Circular Binary Segmentation (CBS) approach is a recursive method in which the breakpoints are determined on the basis of a test of hypothesis, with null hypothesis that in the interval considered there is no change in copy number [2]. Picard et al. [3] used a piecewise constant regression model, where the parameters are estimated maximizing a penalized likelihood (i.e. the likelihood with the addition of a penalty function). This method is usually denoted with the abbreviation CGHseg. The GLAD method is another piecewise constant regression method, but in this case the parameters are estimated maximizing a weighted likelihood [4]. Fridlyand et al. [5] applied Hidden Markov Models (HMM), while Marioni et al. [6] defined an HMM method which takes into account the distance among the data points (BioHMM). Recently, Nilsson et al [7] derived a segmentation method based on total variation minimization, called Rendersome. It is optimized for gene expression data, but the authors affirm that it can be used also on copy number data.
Among the smoothing methods, Hsu et al. [8] used a wavelet regression method with Haar wavelet. Eilers and de Menez [9] applied a quantile smoothing regression (quantreg), with the solution found by minimizing a loss function based on the L1 norm, to obtain a flatter curve. Huang et al. [10] proposed smoothseg, i.e. a smooth segmentation method based on a doubly heavy-tailed random-effect model.
We propose a piecewise constant regression method, using Bayesian statistics, which appears appropriate when regions contain only few data points. The original version of the method (called Bayesian Piecewise Constant Regression, BPCR) was presented by Hutter [11,12]. In this paper we propose improved Bayesian estimators of the parameters involved and we apply the model to DNA copy number estimation. Finally, we compare our algorithm with some among the most cited or more recent methods, on artificial and real data.
Our method was implemented in R and is freely available at http://www.idsia.ch/~paola/mBPCR/ webcite or in Additional file 1. Furthermore, an R package will be soon available.
Additional file 1. mBPCR source code. This zipped file contains the source code of the mBPCR algorithm in R, including help files, sample data and examples.
Format: ZIP Size: 318KB Download file
Methods
In the first two subsections, we briefly describe the original Bayesian Piecewise Constant Regression method, explaining the hypothesis of the model and the estimation of its parameters with Bayesian regression. We emphasize the definitions of the original parameter estimators in order to show how we changed some of these estimators in the other subsections.
A brief explanation of the dynamic program for the computation of the estimators can be found in the Additional file 2 (more details can be found in [11,12]).
Additional file 2. Supplementary material. This file contains a brief description of the dynamic program used to implement the method, a formal definition of some error measure used, some supplementary tables and some supplementary figures.
Format: PDF Size: 1.4MB Download file
This file can be viewed with: Adobe Acrobat Reader
Regarding notations, we do not indicate explicitly the random variable to which a distribution is referred, if it is clear from the context. For example, pK(k) ≡ p(k) or fY, M(y, μ) ≡ f(y, μ).
Hypotheses of the model
Let Y ∊ ℝn be a random vector, such that each component (called data point or, if Y represents a quantity measured on part of the genome, probe) is conditionally normally distributed:
Suppose also that Y represents a noisy observation of a piecewise constant function, which consists of
k0 horizontal segments. Then, the segment level at a generic position i (
For the number of segments and the boundaries, we assume noninformative prior distributions:
where
About M, we assume that all its components are mutually independent and identically normally distributed,
where ν ∊ ℝk, such that νq = ν for each q = 1,...,k, and
Instead of these assumptions, we could assume a Cauchy distribution for each Yi or Mq in order to model an observation whose noise has heavier tails, as previously done by Hutter [11,12].
Original estimation: the BPCR method
The statistical procedure consists in a sequence of estimations due to the relationship among the parameters.
BPCR estimates the number of segments with the MAP (Maximum A Posteriori) estimate given the sample point y,
and, given
for all p = 1,...,
for all m = 1,...,
for all m = 1,...,
We can estimate the segment level
and the corresponding estimate of
for all s = 1,...,n. The vector
The probability distributions defined previously depend on the hyper-parameters ν, ρ2 and σ2 (respectively, the mean and the variance of the segment levels and the variance of the noise). Hutter [11,12] suggested the following estimators:
Improved estimators of the number of segments
To understand the real meaning of the MAP estimator
In general, a Bayesian estimator is defined in the following way. Let us suppose that Z is a random variable whose distribution depends on an unknown parameter θ, which we want to estimate. Since we cannot exactly know the true value of the parameter, we consider it as a random variable Θ with a given prior probability distribution. In order to measure the goodness of the estimation, we define an error (or loss function) and we choose the estimator that minimizes the expected error given the sample Z,
The 0–1 error (defined as 1 -δθ, θ') is commonly used for a parameter which can assume only a discrete number of values. The estimator corresponding to this error is the MAP estimator,
Obviously, if we use different types of errors, we can obtain different estimators.
In the following, we will use
Using the 0–1 error, we give the same penalty to each value different from the true value, whether it is close to or far away from the true one. To take into account the distance of the estimated value from the true one, we need to use other types of errors, which are based on different definitions of distance, such as,
If the parameter θ ∊ ℝ, then the estimators corresponding to these errors are the median and the mean
of its posterior distribution, respectively. In our case, we denote these estimators
of k0 with
Improved estimators of the boundaries
Similarly to the previous subsection, we derive alternative boundary estimators, by
considering different types of errors. We denote the MAP boundary estimator defined
in Equation (4) with
Meaning of the estimator
T
^
01
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaacbmGaf8hvaqLbaKaadaWgaaWcbaGaeGimaaJaeGymaedabeaaaaa@2F28@
The estimator
where
that is
Definition of the estimator
Τ
^
joint
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaacbmGaf8hvaqLbaKaadaWgaaWcbaGaeeOAaOMaee4Ba8MaeeyAaKMaeeOBa4MaeeiDaqhabeaaaaa@3435@
A problem of the latter estimator (Equation (17)) is its computational complexity,
because it needs the computation of all the ordered combinations of the boundaries.
On the other hand, there are two reasons for which
Definition of the estimators
Τ
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaaccmGaf8hXdqNbaKaaaaa@2DB2@
BinErr and
Τ
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaaccmGaf8hXdqNbaKaaaaa@2DB2@
BinErrAk
We must notice that the estimators considered until now have the same length of the
true vector of the boundaries. In practice, the number of segments k0 is unknown, so that we should use
A way to solve this issue is to map each boundary vector into a vector
We denote with
Now, for the two new vectors τ0 and τ, we define the following binary error,
Since the two-norm of the vectors involved is fixed, minimizing (20) is the same as minimizing the Euclidean distance between the two vectors or the sum 0–1 error. Furthermore, error (20) is consistent with the Russell-Rao dissimilarity measure defined on the space of the binary vectors. Its corresponding estimator is
Since we do not know the real value of k0, we should replace it with
Improved regression curve
As we saw in the previous subsections, there are cases in which the estimation of
a parameter of our interest can be made independently of other parameters by integration.
The computation of the BRC (see Equations (7) and (8)) suggests to average also over
the number of segments by considering the posterior probability of
Unfortunately, the computation of this quantity requires time
The same procedure cannot be applied for the level estimation, because in that case we need to know the partition of the whole interval.
Properties of the hyper-parameter estimators and definition of new estimators
In order to study the properties of the hyper-parameter estimators defined in Equations
(9), (11) and (10), first we need to compute the moments of the data
At first, let us consider only the data which belong to the qth segment. From the hypothesis of the model, we know that
hence the marginal distribution of any two data points Yi and Yj belonging to the qth segment is
It follows that the covariance between two data points, which belong to the same segment, is
and
for each j = 1,...,n, independently of the segment to which it belongs.
Furthermore, from the hypotheses of the model, given the segmentation t0, data points belonging to different segments are independent.
Expected value and variance of the estimator
ν
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGafqyVd4MbaKaaaaa@2D9D@
The estimator of ν is defined as
Hence, the variance is always greater than
New definition of the estimator
σ
2
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaecaaeaacqaHdpWCdaahaaWcbeqaaiabikdaYaaaaOGaayPadaaaaa@2F83@
and its expected value
A circular version of the σ2 estimator defined in Equation (11) is
where Yn+1 := Y1. Using the values of the moments of the data points, its expected value is
where we considered two cases in the computation: (a) when k0 = 1, Y1 and Yn belong to the same segment (thus they are dependent), (b) when k0 ≥ 2, we supposed that the first and the last segments have different levels and so
Y1 and Yn are independent. If the first and the last segments had the same level, then the two
segments would be joined together and thus Y1 and Yn would be dependent. In this case, the expected value would be the same but with k0 - 1 instead of k0, since the number of segments would be k0 - 1. In any case, for k0 = 1, the estimator
Expected value of the estimator
ρ
2
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaecaaeaacqaHbpGCdaahaaWcbeqaaiabikdaYaaaaOGaayPadaaaaa@2F80@
The expected value of the estimator
Note that when k0 = 1 (i.e. having only one segment),
Moreover, since
Hence, if n is large the expected value is between σ2 and σ2 + ρ2, so that, if ρ2 ≪ σ2, the estimator is almost unbiased for σ2 (instead of ρ2).
Definition of alternative estimator of ρ2:
ρ
1
2
^
MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaecaaeaacqaHbpGCdaqhaaWcbaGaeGymaedabaGaeGOmaidaaaGccaGLcmaaaaa@3070@
Since the covariance between data points belonging to the same segment is ρ2, we could try to use a circular version of the estimator of the autocovariance of a stationary time series
where Yn+1 := Y1. The expected value of the estimator turns out to be
In the computation we considered two cases: k0 = 1 and k0 ≥ 2. When k0 = 1, Y1 and Yn belong to the same segment and so they are dependent; when k0 ≥ 2, we suppose that the first and the last segment have not the same level value and so Y1 and Yn are independent. If k0 ≥ 2 and the first and the last segment had the same level value (event with a very low probability), then the first and the last segments would be joined together and so Y1 and Yn would be dependent. In this case, the expected value of the estimator would have the same formula, but with k0 - 1 instead of k0.
We can observe that, when k0 = 1, the expected value is negative, while, when k0 ≥ 2, it can be negative or positive. Moreover, the coefficient of σ2 is
The negativity of the expected value happens because the estimator is a generic estimator
of the covariance and, in general, this quantity can be negative. To prevent the negativity
of the estimator, we can use its absolute value. In this way, when the quantity in
(33) is negative, we use the same estimator but with the sign changed in one of the
factors of each product,
Results and discussion
In this section we show and discuss results obtained on both the simulated and the real data. We used the simulated data with a twofold aim. The first was to choose empirically the best estimators among those proposed in the previous section. The second was to compare the original version of BPCR/BRC and their modified versions with each other and with other existing methods estimating DNA copy number value [2-10]. On the basis of the results, we selected the best modified version of BPCR, called mBPCR, and of BRC.
Finally, we compared the performance of mBPCR, CBS, CGHseg, GLAD, HMM, BioHMM and Rendersome on the real data.
Simulation description
In the comparisons, we used several types of artificial data. We call sample a sequence of data which represents the copy number data of a genomic region, we call dataset a set of samples, while collection a set of datasets.
In order to experimentally evaluate the behavior of all the estimators proposed, we used the artificial datasets sampled from the priors, defined in the hypotheses of the model. We always chose ν = 0.2, while we changed the values of σ2 and ρ2 for each dataset, in order to study different situations of noise (some examples of data are in Figure 1 and the corresponding estimated profiles obtained applying several methods are in Figure S.1 in Additional file 2). The most problematic cases were the ones with ρ2 <σ2 (i.e. when the variance of the noise was higher than the variance of the segment levels), because in these cases it was hard to identify the true profile of the levels. We always used n = 200, similar to the mean number of probes of a small chromosome in the Affymetrix GeneChip Mapping 10K Array (hence it represented a difficult case due to the small sample size), and kmax = 40, in order to have at least 5 probes per segment on average.
Figure 1. Example of simulated data. The simulated data in the figure represent an easy, medium and difficult case, respectively.
Sometimes we needed datasets where all samples had the same true profile of the segment levels (i.e. K, T and M were sampled one time and only the noise varied in all samples). This type of dataset is called dataset with replicates. Otherwise, the dataset is called without replicates (i.e. each time we sampled K, T, M and added the noise to the profile). The number of samples per dataset was 100, for datasets with replicates, and 300 otherwise. We considered datasets with replicates in order to be able to compare the goodness of different types of estimations for a given profile.
We also compared the behavior of our boundary estimators using the artificial dataset already employed in [13], where three methods for copy number estimation were examined. This dataset contained 500 samples consisting of 20 chromosomes, each of 100 probes, which emulated the real copy number data. This dataset is referred to as Simulated Chromosomes.
To assess the performance of the several methods, we used three types of artificial datasets. The first type consisted of four datasets with replicates used in the comparison among the estimators. This collection of datasets is called Cases.
The second type consisted of datasets adapted from the datasets used in [14] to compare several methods for copy number estimation. In these datasets, each sample
was an artificial chromosome of 100 probes, where the copy number value was zero apart
from the central part where there was an aberration. The Authors considered several
widths of aberration: 40, 20, 10 and 5 probes. The noise was always distributed as
We defined our datasets in the following way. For a fixed SNR value, we constructed a chromosome with four aberrations of width of 40, 20, 10 and 5 probes, respectively, by joining the corresponding four types of chromosome of the previous datasets. This collection of datasets is called Four aberrations. In the following, we will consider only the datasets with SNR = 3 (medium noise) and SNR = 1 (high noise).
The third type of dataset used was the Simulated Chromosomes dataset.
Comparison among the estimators on simulated data
In this subsection, we present how we selected the best estimators among those proposed in the Section Methods, on the basis of their results obtained on the artificial datasets. The comparisons were accomplished using both the true and the estimated values of the other parameters involved in the estimation.
Comparison among the hyper-parameter estimators
We applied the hyper-parameter estimators on 8 datasets without replicates, considering different values for σ2 and ρ2. To evaluate the behavior of the hyper-parameter estimators in all these cases, for each dataset we computed the (estimated) Mean Square Error, MSE, with respect to the true value of the parameter (Table 1). To measure the accuracy of the estimators, we used the estimated mean relative error over all datasets (Table S.1 in Additional file 2).
Table 1. Comparison among the hyper-parameter estimators
From the results, we can deduce that
Comparison among the segment number estimators
We evaluated the quality of the estimators of the number of segments, using datasets with and without replicates for different values of the hyper-parameters σ2 and ρ2. The estimations were made using either the true values of the hyper-parameters or the estimated ones. In this way, we could also observe the behavior of the boundary estimators without the influence of the hyper-parameter estimation.
Comparing the absolute, squared and 0–1 errors, we found that
We should also observe that in general
Comparison among the boundary estimators
We compared the boundary estimators on the same datasets, previously used for the estimators of the number of segments, with both the estimated and the true value of the parameters involved. The following errors were taken into account: the sum 0–1 error, the joint 0–1 error and the binary error, defined in Section Methods, and the average square error,
which corresponds to the mean square error over the whole vector of estimated boundaries. As observed in Section Methods, when the estimated segment number is used in the estimation of the boundaries, we are only able to compute the binary error, because it does not require that the vector of estimated boundaries has the same length as the vector of the true boundaries.
We found (see, for example, Table 2 and Table S.2 in Additional file 2) that the best estimators were
Table 2. Comparison among the several boundary estimators
To choose between the estimators
In addition, we compared the behavior of our boundary estimators on dataset Simulated Chromosomes. To assess the goodness of their estimation, we measured the sensitivity (proportion of true breakpoints detected) and the false discovery rate (FDR, i.e. proportion of false estimated breakpoints among the estimated ones), while to assess the influence of the boundary estimation on the profile estimation, we calculated the sum of squared distance (SSQ), the median absolute deviation (MAD) and the accuracy (proportion of probes correctly assigned to an altered or unaltered state). The sensitivity and the FDR were computed not only looking at the exact position of the breakpoints (w = 0), but also accounting for a neighborhood of 1 or 2 probes around the true positions (w = 1, 2). We also computed the accuracy inside and outside the aberrations separately, since the samples of dataset Simulated Chromosomes contained only few small copy number changes and thus the accuracy depended more on the correct estimation/classification of the probes in the "normal" regions. A more detailed explanation of these measures can be found in [13].
Since we estimated
Table 3. Comparison among the boundary estimators on Simulated Chromosomes
In conclusion, we suggest to use
Comparison among the regression curves
We compared the estimation of the levels of BRC with the one of BRCAk, also taking
into account the influence of the different estimators of the parameters on the final
results. To valuate the performance of the methods, we used the root mean square error
(RMSE) per probe and per sample, computed with respect to the true profile of the
levels. For this purpose, we necessarily needed datasets with replicates. Using BRCAk
we generally obtained a better or equal result with respect to the BRC (see, for example,
Figures S.7 and S.8 in Additional file 2). Moreover, we observed that, using BRC, it was better to estimate the segment number
with
Note that we still have to solve the problem to determine which is the best estimator
of ρ2. In most cases, the profile obtained by using
Comparison with other methods on simulated data
In this subsection we compare the original and modified versions of BPCR and BRC, with other existing methods for genomic copy number estimation [2-10].
Error measures used in the comparison
We used two different measures to examine the behavior of the different methods on the collections Cases and Four aberrations: the root mean square error (for both) and the ROC curve (only for the latter). Each point of the ROC curve has as coordinates the false positive rate (FPR) and the true positive rate (TPR) for a certain threshold. The TPR is defined as the fraction of probes in the true aberrations whose estimated value is above the threshold considered, while the FPR consists in the fraction of probes outside the true aberrations whose estimated value is above the threshold. Hence, the ROC curve measures the accuracy of the method in the detection of the true aberrations.
Instead, the evaluation of the several methods on dataset Simulated Chromosomes was accomplished using the error measures described in [13], already used in the study of the boundary estimators.
Before showing the results, we need to remember that some methods estimate the copy numbers as a piecewise constant function, while other algorithms estimate them as a continuous curve. Hence, BPCR was compared to the former group of methods, while the Bayesian regression curves to the latter. Since some error measures of [13] suppose that the estimated profile is piecewise constant, we applied only the former group of methods on dataset Simulated Chromosomes.
The piecewise constant estimation
We compared the original and the modified versions of BPCR with CBS [2], CGHseg [3], GLAD [4], HMM [5], BioHMM [6] and Rendersome [7]. For thoroughness, in the modified versions of BPCR, we used both
Figure 2. Example of estimated piecewise constant profiles. The plots show the differences in the level estimation among the piecewise constant
methods on samples with SNR = 3 and SNR = 1: some are unable to identify the small
aberrations in presence of high noise. In each graph, the grey segments represent
the true profile.
In general, in presence of medium noise, the GLAD method performed worst, since it had a high error in the level estimation of the small peaks, while, for high noise, often both GLAD and Rendersome failed to detect the aberrations (Figures S.12 and S.13 in Additional file 2). The CGHseg method did not usually exhibit an appropriate level estimation except sometimes for segments of large width (for example in Figure S.11 in Additional file 2). This is due to the fact that CGHseg estimates the level of a segment with the arithmetic mean of the data points in the segment and this estimator performs poorly if the segment contains few data points and the breakpoint estimation is not accurate. The CBS method, in general, performed quite well, but it was unable to detect aberrations of small width, especially when the noise was high (Figure S.13 in Additional file 2).
On the collection Cases and the dataset of Four aberrations with SNR = 3, the RMSE plots and the ROC curves of the HMM method showed that it generally estimated the profile well, but sometimes it exhibited high errors near breakpoint positions (see, for example, Figure S.11 in Additional file 2), likely because it was unable to determine the true position of the breakpoints precisely. Moreover, on the dataset with SNR = 1, we recognized the true issues of the estimation with HMM. The RMSE plot showed that it had a high error outside the regions of the aberrations, while inside these regions the error was always more or less the same. Hence, it often failed also in the estimation of the largest aberration, the easiest one to detect (see the corresponding errors in Figure S.13 in Additional file 2). The reason of this behavior of the RMSE is the following. The method estimated the true profile either with only one segment, or more often with a profile consisting of a lot of small segments, but all with the same level. Since in the latter case the estimated levels were close to that one of the true aberrations, the RMSE was low in the regions of the aberrations but high outside them. However, the estimated profiles were not similar to the true one. In presence of medium noise (SNR = 3), the method BioHMM was more precise than HMM in the determination of the breakpoint positions and in the level estimation (Figure S.11 in Additional file 2), while for high noise it behaved similarly to HMM (Figure S.13 in Additional file 2).
In general we found that, when σ2 <ρ2 (when σ2 > ρ2), the version of BPCR with
Only on the dataset with SNR = 1, we could not choose the "best" method, because this
case showed the limits of all the methods considered. The problem regarding the modified
versions of BPCR was essentially the estimation of the number of segments. The ROC
curves (Figure S.12 in Additional file 2) of the modified versions of BPCR with
Finally, the comparison performed on dataset Simulated Chromosomes showed that CBS and mBPCR better estimated the profiles (see Table 4). Regarding the breakpoint error measures (see Figure S.14 in Additional file 2), we found that mBPCR had the highest sensitivity (hence, it was the best method in determining the exact position of the breakpoints), but also a higher FDR than CBS. We have already explained in the previous subsection the possible reason of the high FDR of mBPCR and we can observe again that this fact did not influence negatively the profile estimation (see the SSQ error in Table 4). The GLAD method showed a low sensitivity and low FDR, apart from the case regarding the exact position of the breakpoints (w = 0), which means that it underestimated the segment number and the estimated breakpoints were not located exactly at their true positions. Also CGHseg underestimated the number of segments because of low sensitivity and FDR, while HMM had low sensitivity and high FDR when w = 0 and vice versa in the other cases, which means that it often detected the true segment number, but it was unable to put the breakpoints at their exact position. Instead, BioHMM solved the issue of HMM with w = 0, but overall had a lower sensitivity than HMM. Rendersome missed several true aberrations (lowest sensitivity) and detected some false aberrations (medium FDR).
Table 4. Comparison among the piecewise constant methods on Simulated Chromosomes
Estimation with a continuous curve
We compared the several versions of the Bayesian regression curves with methods which
estimate the copy number as a continuous curve (lowess, wavelet, quantreg and smoothseg).
Lowess is the acronym of "Locally Weighted Smoothing" (implemented in the stats library
of R) and it is one of the methods considered in the comparison performed in [14]. As we saw previously, both the BRC, which uses
Figure 3. Example of estimated regression curves. The plots show the differences in the level estimation among the smoothing methods
on samples with SNR = 3 and SNR = 1: some oscillate more in the regions outside the
aberrations. In cases of high noise, the more oscillating the profiles are, the harder
it is to identify which regions correspond to the aberrations. In each graph, the
grey segments represent the true profile.
In general, we found that all methods detected the regions of aberration quite well (see, for example, Figures S.16 and S.18 in Additional file 2). The wavelet method showed a higher error in the level estimation of the aberrations in the datasets SNR = 3 and SNR = 1 (Figures S.16 and S.18 in Additional file 2). The methods lowess and quantreg had the highest RMSE in the collection Cases, while their error was not significantly different outside and inside the aberrations on datasets with SNR = 1, 3. Therefore, in the last cases the error was low inside the aberrations and high outside them in comparison with the other methods. The method smoothseg showed a similar behavior, but with a lower error.
Moreover, we found that the ROC measure was affected by oscillations in the estimated curve, which lead to ROC curves intersected and difficult to be interpreted (Figure S.15 in Additional file 2). This complex behavior is a consequence of the way in which lowess, wavelet, quantreg and smoothseg yielded oscillating curves with positive and negative values outside the aberrations; while BRCs estimated the true profile with a line almost flat and close to zero (see the examples in Figure 3).
In conclusion, the version of BRC with
Application to real data
In this subsection, we show how mBPCR performed compared to other piecewise constant estimation methods on the real data. We used samples from three mantle cell lymphoma cell lines (JEKO-1, GRANTA-519, REC-1) previously analyzed by us with the Affymetrix GeneChip Mapping 10K Array (Affymetrix, Santa Clara, CA), an oligonucleotides-based microarray [15]. We also used the data obtained on JEKO-1, by using the higher density Affymetrix GeneChip Mapping 250K Nsp Array. We considered eight recurrent gene regions of aberration in lymphoma plus other two gene regions (BIRC3 and LAMP1) and we compared the corresponding copy numbers obtained by the several piecewise constant methods with those obtained by the FISH technique in [15]. In the end, we also show a comparison among the estimated profiles of chromosome 11 of JEKO-1.
The 10K Array data used are freely available at the public repository Gene Expression Omnibus [16] with GEO accession: GSM95567, GSM95568 and GSM95570. The 250K Array data of cell line JEKO-1 will be soon available in the same repository.
With the current implementation, on a computer with dual CPU (AMD Opteron 250, 2.4 GHz) and 4 GB RAM, the algorithm needed about 4 minutes to analyze a 10K Array sample, while about 1 day to estimate the profile of a 250K Array sample. The computations were performed by chromosome (and by arm for the longest chromosomes in the 250K Array data) and using kmax = 100.
Gene copy number estimation
To properly evaluate the methods, the knowledge of the true underling profile is required. In general, large aberrations on chromosomes can be detected with conventional karyotype analysis or with SKY-FISH and one could use this information for the evaluation procedure, but the width of these aberrations is so large that all the methods can detect them well, leading to a useless comparison. For this reason, we decided to take into account only genes to compare the piecewise constant methods.
In the comparison, as previously published [15], when two FISH copy numbers had been assigned to one gene, the first number should correspond to the copy number detected in the majority of the cells. We assigned two estimated copy numbers to one gene, when the position of the gene is between two SNPs and the method assigned two different values to these SNPs.
The results on REC-1 (Table S.3 in Additional file 2) did not show any significant difference among the methods, instead those on GRANTA-519
(Table S.4 in Additional file 2) showed that GLAD was unable to detect the true copy number in five cases, while
HMM, BioHMM and Rendersome detected an amplification on MALT1 greater than what detected by FISH analysis. All methods did not detect the true copy
number of ATM, probably because the SNPs around ATM are far away from the corresponding FISH region (about 1 Mb) and the deletion affects
only this region. Only mBPCR with
Regarding the JEKO-1 data, since the cell line is triploid, to obtain more realistic
copy number value, we centered the estimated log2ratio around log2 3. With the denser 250K Array data, all methods behaved equally good. Only HMM had
a problem in the detection of the breakpoint corresponding to the C-MYC amplification (see Table S.5 in Additional file 2). On both arrays, all methods identified a gain (copy number 3 or 4) at the CCND1 position, while the copy number detected by FISH is 2. This fact cannot be explained
as previously for ATM, because this region is well covered by SNPs. Instead, on the JEKO-1 10K Array data
(Table 5), the noisiest among all samples, we can see several cases in which CBS, HMM and
GLAD did not detect correctly the gene copy number (for example, BCL2 and MALT1). This occurred more frequently to BioHMM and Rendersome, while only once to CGHseg
(LAMP1). The method mBPCR with
Table 5. Copy number estimation results obtained on 10K Array data of sample JEKO-1
Profile estimation
To compare the profile estimations, we chose the sample JEKO-1 because, using the results obtained on both types of array, we could at least understand which regions were more realistically estimated. For now, whole validated chromosomic profiles are not available. Among all chromosomes, we chose chromosome 11 since three of the previous genes belong to that: CCND1 (around 69.17 Mb), BIRC3 (around 101.7 Mb) and ATM (around 107.6 Mb).
From the graphs in Figure 4 we can observe that, among all the piecewise constant methods, only mBPCR with
Figure 4. Comparison among the estimated profiles of chromosome 11 of JEKO-1. The figure shows the comparison among the piecewise constant estimated profiles
of chromosome 11 of JEKO-1 using both 10K Array and 250K Array data. Only mBPCR with
Conclusion
We introduced new estimators for the parameters involved in BPCR and we selected the
best ones on the basis of theoretic and empirical results. In particular, we found
that the best way is to estimate the segment number with
Concerning the estimation of the variance of the segment levels, we found that the
original estimator
We also compared mBPCR with other methods which also estimate the copy number as a
piecewise constant function: CBS, HMM, CGHseg, GLAD, BioHMM and Rendersome. As a whole,
the results showed that mBPCR gave the best estimation on the dataset used. However,
when σ2 ≫ ρ2 it is hard to understand which method is the most appropriate. Most of the other methods
were not able to detect aberrations with a small width (5 and 10 probes) and the same
was true for mBPCR using
The new estimators improved also BRC, which is a Bayesian regression with a smooth
curve. Moreover, we derived a formula to estimate BRC without employing the estimated
number of segments. We referred to it as BRCAk. Applying these methods to artificial
data, the best estimators were found to be the BRC version with
Even though these smoothing methods seem to have less problems in the estimation and the error measures (for example, the ROC curve) suggest that their estimation is even better than the piecewise constant estimation, these methods do not detect the position of the breakpoints explicitly and hence the changes in the value of the segment level. Thus, they seem to be less adequate in practice.
For this reason, we feel that the ROC curve cannot be used as the only measure to compare methods, as previously done in [14]. The RMSE is generally an acceptable measure, but we observed that in some cases even this is not sufficient, due to the overfitting. Willenbrock and Fridlyand [13] proposed other measures to compare methods for copy number estimation, regarding both breakpoint and level estimation. In particular, the sensitivity measure of breakpoint estimation is useful to select which methods should be used, because it quantifies the precision of the methods in determining the position of the breakpoints.
Finally, we have applied mBPCR and all other piecewise constant regression methods to real data. The comparisons showed that mBPCR estimated well the copy number of the genes. On these data, in most cases the choice of the ρ2 estimator did not affect the analysis.
In comparison with the other methods, the current implementation of our algorithm is computationally intensive. The real computational time can be reduced linearly diminishing kmax and quadratically diminishing the number of probes. Moreover, the computation can be easily parallelized by arm and by chromosome, reducing further the calculation time.
In cancer research, the accuracy in the DNA copy number estimation is crucial for the correct determination of the mutations that characterize the disease. In particular, the estimation of the breakpoints must be precise to detect correctly which genes are affected by these genomic aberrations. As recently shown [17], SNP microarrays can also potentially detect the breakpoints involved in unbalanced translocations, allowing the identification of fusion genes (i.e. hybrid genes created by joining portions of two different genes). In this context, the use of our method can highly improve the disease investigation, because it accurately determines breakpoints, is less sensitive to high noise and generally outperforms all the methods considered in our comparisons. Moreover, smoothing algorithms are clearly not suitable for such analysis.
Availability and requirements
Project name: mBPCR.
Project home page: http://www.idsia.ch/~paola/mBPCR/ webcite.
Operating systems: the software should run in Linux, Mac-OS or Windows. Tests were performed on Windows and Linux systems.
Programming language: R.
Other requirements: none.
Licence: GNU GPL.
Any restrictions to use by non-academics: none.
Authors' contributions
PMVR carried out the study and wrote the manuscript. MH and IK supervised the statistical analysis. FB supervised the validation study and provided the real data. All authors read and approved the final manuscript.
Acknowledgements
This work was supported by the grant 205321-112430 of the Swiss National Science Foundation and by Oncosuisse Grant OCS 1939-08-2006.
References
-
Huang J, Wei W, Zhang J, Liu G, Bignell GR, Stratton MR, Futreal PA, Wooster R, Jones KW, Shapero MH: Whole Genome DNA Copy Number Changes Identified by High Density Oligonucleotide Arrays.
Human Genomics 2004, 1(4):287-299. PubMed Abstract | Publisher Full Text
-
Olshen AB, Venkatraman ES, Lucito R, Wigler M: Circular Binary Segmentation for the Analysis of Array-based DNA Copy Number Data.
Biostatistics 2004, 5(4):557-572. PubMed Abstract | Publisher Full Text
-
Picard F, Robin S, Lavielle M, Vaisse C, Daudin JJ: A Statistical Approach for Array CGH Data Analysis.
BMC Bioinformatics 2005., 6(27): PubMed Abstract | Publisher Full Text | PubMed Central Full Text
-
Hupé P, Stransky N, Thiery JP, Radvanyi F, Barillot E: Analysis of array CGH data: from signal ratio to gain and loss of DNA regions.
Bioinformatics 2004, 20(18):3413-3422. PubMed Abstract | Publisher Full Text
-
Fridlyand J, Snijders AM, Pinkel D, Albertson DG, Jain AN: Hidden Markov Models approach to the analysis of array CGH data.
Journal of Multivariate Analysis 2004, 90:132-153. Publisher Full Text
-
Marioni J, Thorne N, Tavare S: BioHMM: a heterogeneous hidden Markov model for segmenting array CGH data.
Bioinformatics 2006, 22:1144-1146. PubMed Abstract | Publisher Full Text
-
Nilsson B, Johansson M, Heyden A, Nelander S, Fioretos T: An improved method for detecting and delineating genomic regions with altered gene expression in cancer.
Genome Biology 2008., 9: PubMed Abstract | Publisher Full Text | PubMed Central Full Text
-
Hsu L, Self SG, Grove D, Randolph T, Wang K, Delrow JJ, Loo L, Porter P: Denoising array-based comparative genomic hybridization data using wavelets.
Biostatistics 2005, 6(2):211-226. PubMed Abstract | Publisher Full Text
-
Eilers PHC, de Menezes RX: Quantile smoothing of array CGH data.
Bioinformatics 2005, 21(7):1146-1153. PubMed Abstract | Publisher Full Text
-
Huang J, Gusnanto A, O'Sullivan K, Staaf J, Borg Å, Pawitan Y: Robust smooth segmentation approach for array CGH data analysis.
Bioinformatics 2007, 23(18):2463-2469. PubMed Abstract | Publisher Full Text
-
Hutter M: Bayesian Regression of Piecewise Constant Functions. In Bayesian Statistics 8: Proceedings of the Eighth Valencia International Meeting. Edited by Bernardo JM, Bayarri MJ, Berger JO, David AP, D Heckerman D, Smith AFM, West M. Oxford University Press; 2007:607-612.
-
Hutter M: Exact Bayesian Regression of Piecewise Constant Functions.
-
Willenbrock H, Fridlyand J: A comparison study: applying segmentation to array CGH data for downstream analyses.
Bioinformatics 2005, 21(7):4084-4091. PubMed Abstract | Publisher Full Text
-
Lai WR, Johnson M, Kucherlapati R, Park PJ: Comparative analysis of algorithms for identifying amplifications and deletions in array CGH data: from signal ratio to gain and loss of DNA regions.
Bioinformatics 2005, 21(19):3763-3770. PubMed Abstract | Publisher Full Text
-
Rinaldi A, Kwee I, Taborelli M, Largo C, Uccella S, Martin V, Poretti G, Gaidano G, Calabrese G, Martinelli G, Baldini L, Pruneri G, Capella C, Zucca E, Cotter FE, Cigudosa JC, Catapano CV, Tibiletti MG, Bertoni F: Genomic and expression profiling identifies the B-cell associated tyrosine kinase Syk as a possible therapeutic target in mantle cell lymphoma.
British Journal of Haematology 2006, 132:303-316. PubMed Abstract | Publisher Full Text
-
Gene Expression Omnibus [http://www.ncbi.nlm.nih.gov/geo/] webcite
-
Kawamata N, Ogawa S, Zimmermann M, Niebuhr B, Stocking C, Sanada M, Hemminki K, Yamatomo G, Nannya Y, Koeler R, Flohr T, Miller CW, Harbott J, Ludwing WD, Stanulla M, Shrappe M, Bartram CR, Koeffer HP: Cloning og genes involving in chromosomal translocations by high-resolution single nucleotide polymorphism genomic microarray.
Proceedings of the National Academy of Sciences 2008, 105(33):11921-11926. Publisher Full Text






