Abstract
Background
ChIPseq provides new opportunities to study allelespecific proteinDNA binding (ASB). However, detecting allelic imbalance from a single ChIPseq dataset often has low statistical power since only sequence reads mapped to heterozygote SNPs are informative for discriminating two alleles.
Results
We develop a new method iASeq to address this issue by jointly analyzing multiple ChIPseq datasets. iASeq uses a Bayesian hierarchical mixture model to learn correlation patterns of allelespecificity among multiple proteins. Using the discovered correlation patterns, the model allows one to borrow information across datasets to improve detection of allelic imbalance. Application of iASeq to 77 ChIPseq samples from 40 ENCODE datasets and 1 genomic DNA sample in GM12878 cells reveals that allelespecificity of multiple proteins are highly correlated, and demonstrates the ability of iASeq to improve allelic inference compared to analyzing each individual dataset separately.
Conclusions
iASeq illustrates the value of integrating multiple datasets in the allelespecificity inference and offers a new tool to better analyze ASB.
Keywords:
Allelespecific binding; Transcription factor; Histone modification; Data integration; Nextgeneration sequencing; Statistical modelBackground
In a diploid organism, each somatic cell has two copies of the genome. At certain genomic loci, gene expression, DNA methylation, transcription factor (TF) binding or histone modification (HM) can be allelespecific. In other words, the two alleles can behave differently. These phenomena, also known as allelespecific expression (ASE), allelespecific DNA methylation (ASM) and allelespecific binding (ASB, including both allelespecific TF binding and allelespecific histone modifications), can contribute to phenotypic diversity and may play important roles in adaptive evolution [13]. Many allelespecific (AS) events have been found to correlate with variants in genomic sequences [411]. Comprehensively characterizing allelespecificity therefore can help with linking genotypes to phenotypes. Abnormal AS events have also been linked to various diseases [1215]. For instance, loss of imprinting in IGF2 has been associated with increased risk of colorectal cancer [12]. This again highlights the importance of studying allelespecificity.
Early methods for analyzing AS events rely on lowthroughput technologies such as real time quantitative PCR [1]. Later, application of SNP arrays has made the AS analysis highthroughput [1619]. More recently, the rapidly evolving highthroughput sequencing technologies opened the door to produce digital readout of AS events genomewide without being constrained by any specific array design [5,14,15,2024]. This brings many new opportunities as well as analytical challenges.
ChIPseq, a technology that couples chromatin immunoprecipitation with highthroughput sequencing, has become the stateoftheart approach for mapping genomewide TF binding sites and HMs [2528]. However, so far the value of this technology for studying ASB has not been fully utilized. Detecting ASB from a single ChIPseq dataset often suffers from low statistical power. This is because only a small fraction of reads in each ChIPseq sample are mapped to heterozygote SNPs, and only these reads are informative for inferring allelespecificity. To make the ChIPseq based ASB analysis more useful, it is important to have either experimental or analytical innovations to increase the power for detecting allelespecificity.
ChIPseq data in public domains grow rapidly. A recently developed database hmChIP, for instance, has compiled over 450 human and mouse ChIPseq datasets representing approximately 2000 samples from 140+ different TFs and HMs [29,30]. The large volume of data provides a new opportunity to improve detection of ASB. Conceptually, an integrative analysis of ChIPseq data for different TFs and HMs from the same individual and cell type may allow one to discover the synergistic correlation patterns of allelespecificity among different proteins. These correlation patterns can then be utilized to integrate information from multiple datasets to improve the ASB detection. For example, if the allelic imbalance of TF A and HM B always cooccur, then analyzing their ChIPseq data jointly will increase the effective number of reads available for allelic inference which will then increase the statistical power. Unfortunately, existing data analysis tools cannot deal with this emerging opportunity. Methods available for analyzing ASE or ASB using the nextgeneration sequencing data are all designed for analyzing one dataset at a time. While a few methods are developed for solving problems such as read mapping biases [31], construction of individualized genome sequences [32], and combining multiple SNPs in the same gene to infer ASE [33], no methods and software tools are available for jointly analyzing multiple ChIPseq datasets together to discover synergy patterns of allelespecificity among multiple proteins and then use the correlation patterns to increase the power of ASB detection by borrowing information across datasets.
In this article, we present an integrated solution to this problem by developing a new approach, iASeq, for jointly analyzing allelespecificity in multiple ChIPseq datasets. iASeq uses a Bayesian hierarchical mixture model to describe unknown correlation patterns of allelespecificity among multiple datasets. These patterns can be discovered automatically from the data by fitting the model using an ExpectationMaximization (EM) algorithm. Using the identified correlation patterns, the model allows one to integrate information from multiple datasets to improve the ASB detection. Applying this approach, we analyzed 40 ENCODE [34] ChIPseq datasets in GM12878 cells, representing a total of 77 samples from 34 TFs and HMs. The analysis demonstrates the ability of iASeq to automatically integrate information from multiple datasets to significantly improve the detection of allelic imbalance. iASeq is implemented as an R package which is freely available from Bioconductor [35].
Methods
Data structure
Suppose there are D ChIPseq datasets generated using cells from the same individual and the same cell type. Each dataset d corresponds to one TF or HM, and has J_{d} replicate samples (Figure 1a). Different datasets represent different TFs or HMs, or data generated by different labs. For the individual in question, assume one is interested in analyzing I heterozygote SNPs with known genotypes. We want to know whether the two alleles of each SNP behave differently in each dataset, and if possible how the AS events are correlated among datasets. For each SNP, the allele consistent with the reference genome is called the reference allele, and the other allele is called the nonreference allele.
Figure 1. The iASeq model. (a) An example of the data structure. Each row represents a SNP and each column corresponds to either the reference allele (R) or the nonreference allele (N) read counts from a ChIPseq sample in a dataset. A dataset could be a TF ChIPseq experiment or a HM ChIPseq experiment, and can have multiple replicate samples (Rep). iASeq assumes the following data generating process. (b) First, SNPs belong to K + 1 classes with different ASB patterns. For each SNP, a class label a_{i}is randomly assigned according to a class abundance probability vector Π. Given the class label, a configuration [b_{id},c_{id}] is generated for each SNP in each dataset according to the probabilistic allelespecificity patterns specified by two vectors V_{k}and W_{k}. In the figure, the darkness of each cell in V and W represents the probability for b_{id}or c_{id}to be 1. (c) Next, a skewing probability p_{idj}is generated for each SNP i, dataset d and replicate sample j based on [b_{id},c_{id}]. The distribution of p_{idj}for NS SNPs in each sample follows a Beta distribution (blue lines). p_{idj}s for SR SNPs are uniformly distributed in the interval [p_{dj0},1] where p_{dj0}is the mean of the background Beta distribution (dark blue lines). p_{idj}s for SN SNPs are uniformly distributed in the interval [0,p_{dj0}] (light blue lines). (d) Finally, given the configuration [b_{id},c_{id}], skewing probability p_{idj}and a total read count n_{idj}for SNP i, dataset d and sample j, the read count for each allele is generated according to a binomial distribution. The length of the orange bar represents the nonreference allele read count, and the length of the red bar represents the reference allele read count.
After read mapping and data preprocessing (see Additional file 1: Supplemental Methods S.1), we count reads for each allele at each heterozygote SNP. For SNP i, dataset d and replicate sample j, let x_{idj} and y_{idj}be the read counts for the reference allele and nonreference allele respectively. Let n_{idj}=x_{idj} + y_{idj} be the total read count (See Figure 1a for a toy example). ProteinDNA binding can be skewed to the reference allele (SR), skewed to the nonreference allele (SN), or not allelespecific (NS). We use a binary variable b_{id} to indicate whether SNP i is SR (b_{id}=1) or not (b_{id}=0) in dataset d. If b_{id}=1, then SNP i is assumed to be SR in all replicate samples in dataset d. Similarly, we introduce another binary indicator c_{id} to indicate whether SNP i is SN or not in dataset d. b_{id}and c_{id} cannot be equal to one at the same time. If b_{id}=0 and c_{id}=0, then SNP i is NS in dataset d. The configuration at each SNP i can be described by two vectors B_{i}=(b_{i1},⋯,b_{iD}) and C_{i}=(c_{i1},⋯,c_{iD}) (See Figure 1d for a cartoon illustration). Based on these notations, (x_{idj},y_{idj}), or equivalently (x_{idj},n_{idj}), are the observed data for SNP i in sample (d,j), whereas the indicators b_{id} and c_{id} are unobserved.
Additional file 1. Supplemental Methods. A PDF file including: data preprocessing procedures; method of moment estimation in the beta distribution; parameter choice for the Dirichlet prior; derivation of the EM algorithm for iASeq; Bayesian Information Criterion for choosing K; data generation procedure in simulation studies; single dataset based EM analysis.
Format: PDF Size: 77KB Download file
This file can be viewed with: Adobe Acrobat Reader
Main intuition and challenge
Our primary goal is to infer for each SNP whether there is allelic imbalance in each dataset. This is equivalent to inferring b_{id} and c_{id}. A simple solution to this problem is to analyze each individual dataset separately, but this approach has low statistical power since the counts (x_{idj},n_{idj}) usually are small.
If one knows how different datasets are correlated in terms of allelic imbalance, this knowledge may be used to improve the data analysis. For instance, if the allelic imbalance of two proteins A and B are closely correlated, then observing skewed read counts for protein A will provide information for inferring the allelic imbalance of protein B. Integrating the data from both A and B will increase the effective number of reads available for statistical inference, which will then lead to increased statistical power.
In reality, how different proteins are correlated is usually unknown. However, one may learn it by studying the data from many SNPs. Each SNP has three possible states in each dataset: SR, SN and NS. For D datasets, there are 3^{D} possible configurations in total. From studying many SNPs, one can know the relative frequencies (or mixing proportions) of these 3^{D}configurations. The mixing proportions will tell how different datasets are correlated. For instance, let [s_{1},s_{2},⋯,s_{D}] be the skewness configuration of a SNP in the D datasets. If the mixing proportions for three configurations [NS,NS,⋯,NS], [SR,SR,⋯,SR] and [SN,SN,⋯,SN] are 0.9, 0.05 and 0.05, then no other configurations exist in the data and all datasets are perfectly correlated in terms of the allelic imbalance. In other words, at a particular SNP, if one dataset is SR, then all the other datasets are also SR. If one is SN, then all the others are also SN. On the other hand, if other configurations have nonzero mixing proportions, then not all datasets are perfectly correlated, and at a particular SNP, one allows the possibility that only a subset of datasets are correlated. For instance, if the mixing proportion for a configuration [SR,SR,NS,⋯,NS] is 0.03, then there will be 3% of SNPs that are skewed to the reference allele in the first two datasets but not skewed in the other datasets. Therefore, knowing the mixing proportions of all 3^{D}configurations will tell one the correlation structure in the data. This knowledge can then be used to improve statistical inference at each individual SNP by facilitating information sharing across datasets. For example, if the configuration [SR, SR, SN] has a much higher mixing proportion than [SR, SR, NS], then observing strong skewness towards the reference allele of a SNP in the first two datasets will imply that, a priori, the SNP is highly likely to be skewed to the nonreference allele in the third dataset and has much lower probability to be nonskewed for both alleles. The principle here is the same as the principle represented by the Bayesian hierarchical models in the statistical literature.
A limitation of this approach is that one has to enumerate all 3^{D} AS configurations in order to describe the correlation. As the number of datasets increases, the number of possible configurations increases exponentially. Thus this approach does not scale well with the increasing D. Later, in our analysis of GM12878 data, D=40 and 3^{D}>10^{19}. This simple approach is clearly intractable.
To circumvent the difficulty of documenting the frequencies of all 3^{D}configurations, iASeq employs a technique that can describe the major correlation patterns in the data using a few probability vectors whose values vary from 0 to 1 rather than being dichotomous (i.e., 0 or 1). This approach significantly reduces the model complexity but keeps the flexibility to account for all 3^{D}configurations. It is easily scalable to increasing dataset number. The correlation structure in the model can then be used to improve the statistical inference of allelic imbalance at each SNP in each individual dataset.
Probability model
iASeq is based on the Bayesian hierarchical mixture model below that uses several probability vectors to describe the major correlation patterns among multiple datasets (Figure 1). The model assumes that SNPs can be grouped into K + 1 classes with different allelespecificity patterns (K≪3^{D}), and the observed data are viewed as generated as follows:
● First, a class label a_{i}is randomly assigned to each SNP i according to a probability vector Π=(Π_{0},Π_{1},⋯,Π_{K}). Here, Π_{k}=Pr(a_{i}=k) is the prior probability to assign a SNP to class k. .
● If the class label a_{i}=0, then B_{i}=(0,⋯,0) and C_{i}=(0,⋯,0). In other words, all SNPs in class 0 are background SNPs, and they are NS in all datasets. If a_{i}=kand k≠0, then SNP i can be skewed, and its [b_{id};c_{id}]s in different datasets are generated independently according to the following probabilities: Pr(b_{id}=1,c_{id}=0a_{i}=k)=v_{kd}and Pr(b_{id}=0,c_{id}=1a_{i}=k)=w_{kd}. We assume v_{kd} + w_{kd}<1, i.e., Pr(b_{id}=0,c_{id}=0a_{i}=k)=1−v_{kd}−w_{kd}>0. The model implies that each class is associated with two vectors of probabilities V_{k}=(v_{k1},⋯,v_{kD}) and W_{k}=(w_{k1},⋯,w_{kD}). For SNPs in class k, B_{i}and C_{i}are generated according to the probabilities in V_{k}and W_{k}.
● Next, the observed read counts are generated based on the AS configurations specified by B_{i}s and C_{i}s. Consider SNP i and dataset d. If b_{id}=1, then (x_{idj},n_{idj}) in each replicate sample (d,j) is generated according to a probability distribution Pr(x_{idj},n_{idj}b_{id}=1,c_{id}=0)=Pr(n_{idj}b_{id}=1,c_{id}=0)Pr(x_{idj}n_{idj},b_{id}=1,c_{id}=0)≡Pr(n_{idj})f_{idj1}(x_{idj}). Here we assume that the marginal distribution of n_{idj}does not depend on b_{id}and c_{id}, and we use f_{idj1}(x_{idj}) to denote the conditional distribution Pr(x_{idj}n_{idj},b_{id}=1,c_{id}=0). Data in different replicate samples are assumed to be generated independently. Similarly, if c_{id}=1, then (x_{idj},n_{idj})s are generated according to Pr(x_{idj},n_{idj}b_{id}=0,c_{id}=1)=Pr(n_{idj})f_{idj2}(x_{idj}). If b_{id}=0 and c_{id}=0, then (x_{idj},n_{idj})s are generated according to Pr(x_{idj},n_{idj}b_{id}=0,c_{id}=0)=Pr(n_{idj})f_{idj0}(x_{idj}).
For SNP i and dataset d, we organize data from all replicates j=1,⋯,J_{d} into X_{id}=(x_{id1},⋯,x_{idJ}_{d}) and N_{id}=(n_{id1},⋯,n_{idJ}_{d}). For SNP i, X_{i}=(X_{i1},⋯,X_{iD}) and N_{i}=(N_{i1},⋯,N_{iD}) contain data from all datasets. The final observed data are X=(X_{1},⋯,X_{I}) and N=(N_{1},⋯,N_{I}) which are the ensemble of data from all SNPs.
Let A=(a_{1},⋯,a_{I}) be the collection of class membership indictors of all SNPs, and let B=(B_{1},⋯,B_{I}) and C=(C_{1},⋯,C_{I}) be the SR and SN indictors for all SNPs. A, B and C are the unobserved missing data one wants to infer.
Organize the probability vectors V_{k}and W_{k} from different classes into two matrices and . V, W, and the probability vector Π that describes the class abundance are the unknown model parameters. K is assumed to be fixed. The choice of K and specification of data generating distributions Pr(n_{idj}), f_{idj0}(x_{idj}), f_{idj1}(x_{idj}) and f_{idj2}(x_{idj}) will be discussed later.
Based on this model, each SNP class k (k≠0) is associated with two vectors of probabilities V_{k}and W_{k} which characterize the allelic imbalance preferences in different datasets for SNPs belonging to class k. For example, if a class has [V_{k};W_{k}] = [(0.8,0.7,0.1,0.1); (0.1,0.1,0.8,0.1)], then SNPs in this class have high probability to be SR in datasets 1 and 2, and high probability to be SN in dataset 3, but they have low probability to be allelespecific in dataset 4. Since V_{k} and W_{k}are probabilities rather than 01 vectors, each class k can generate all 3^{D} AS configurations. Therefore, SNPs in the same class are not required to have the same AS configuration (e.g., a class can have one SNP with configuration [SR,SR,NS,NS] while at the same time another SNP with configuration [SR,NS,SR,NS]), although they usually have similar AS configurations because SNPs in the same class are all generated using the same probability vectors. Meanwhile, there are K different classes, and each class has a different [V_{k};W_{k}] which specifies a different preference to generate the skewing configurations. Thus, whereas SNPs in the same class tend to have similar [B_{i};C_{i}] configurations, SNPs from different classes tend to have very different configurations. Conceptually, this is similar to a modelbased clustering analysis in which SNPs are grouped into K + 1 clusters based on their [B_{i};C_{i}] configurations. However, an important difference here is that [B_{i};C_{i}]s are unknown.
Our model assumes that [b_{id};c_{id}]s of the same SNP in different datasets are a priori independent conditional on the class membership a_{i}. However, [b_{id};c_{id}]s from different datasets are not independent marginally if one integrates out the class label a_{i}. For example, the marginal probability Pr([b_{id};c_{id}]= [1;0])=. On the other hand, the joint probability , which is clearly different from the product of the marginals . This explains why our model can be used to describe the correlation among multiple datasets despite the conditional independence assumption. Intuitively, if one views the model as a clustering analysis of SNPs based on [B_{i};C_{i}], then each cluster will represent a cooccurrence pattern of allelespecificity across multiple proteins. The marginal correlation among multiple datasets is described by multiple clusters, whereas within each cluster the data in different datasets are generated independently. In real data, a small K (i.e., a small number of SNP classes) usually is sufficient to describe the major correlation structure among datasets. Using Π, V and W to describe the correlation among datasets only requires O(KD) parameters, which is significantly less complex than O(3^{D}) parameters. At the same time, the iASeq model still provides the flexibility to accommodate all 3^{D} possible [B_{i};C_{i}] configurations as all of them have nonzero probability to occur.
Data generating distributions
To fully specify the model, one also needs to specify the data generating distributions Pr(x_{idj},n_{idj}b_{id},c_{id})=Pr(n_{idj})Pr(x_{idj}n_{idj},b_{id},c_{id}). The primary goal of iASeq is to infer whether two alleles are different. We assume that information on allelespecificity is only contained in Pr(x_{idj}n_{idj},b_{id},c_{id}), and therefore the exact form of Pr(n_{idj}), i.e., the marginal probability distribution of the total read count, is irrelevant for our purpose. As such, we mainly focus on modeling the conditional distribution of x_{idj}given n_{idj}, b_{id} and c_{id}, i.e., the three distributions f_{idj0}(x), f_{idj1}(x) and f_{idj2}(x).
iASeq models these distributions hierarchically in two steps. First, x_{idj} is assumed to follow a binomial distribution x_{idj}n_{idj},p_{idj}∼Bin(n_{idj},p_{idj}), where p_{idj} is the probability that a read generated at SNP i in sample (d,j) represents the reference allele. Next, we model p_{idj}depending on the values of b_{id}and c_{id}.
If b_{id}=0 and c_{id}=0, SNP i is NS in dataset d. In this case, we assume that p_{idj}follows a Beta distribution Beta(α_{dj}β_{dj}) with mean p_{dj0}=α_{dj}/(α_{dj} + β_{dj}). Note that a simpler model for p_{idj} would be to set it to a constant p_{dj0} which reflects the background ratio of read counts between two alleles. However, previous studies have shown that many background SNPs can have p_{idj} slightly different from the average background p_{dj0}even though they do not have biologically meaningful allelespecificity [33]. As a result, a constant p_{dj0} is not sufficient to describe the background variation. For this reason, we adopt the Beta distribution to describe p_{idj} instead of setting it to a constant (See the blue lines illustrated for f(p_{idj}b_{id}=0,c_{id}=0) in Figure 1c). In the ideal world, the mean of the Beta distribution, p_{dj0}, would be equal to 0.5. However, in reality p_{dj0}may be slightly different from 0.5 due to various sources of read mapping biases. For example, allowing the same number of mismatches, reads from the reference allele are easier to be mapped back to the reference genome than reads from the nonreference allele. Therefore, in iASeq p_{dj0}may take values different from 0.5. Indeed, it is determined by the parameters α_{dj} and β_{dj} in the Beta distribution which are estimated from the data using a moment matching approach (see Additional file 1: Supplemental Method S.2). Once estimated, α_{dj}, β_{dj} and p_{dj0}are treated as fixed and known parameters. Based on the model for p_{idj}, we integrate out all possible values of p_{idj} to obtain the distribution of x_{idj}conditional on b_{id}=0 and c_{id}=0, which is a betabinomial distribution:
Here is the binomial coefficients “n choose k”, and B(..) is the beta function.
If b_{id}=1 and c_{id}=0, SNP i is SR in dataset d. In this case, we assume that p_{idj} follows a uniform distribution U[p_{dj0},1](See the dark blue lines illustrated for f(p_{idj}b_{id}=1,c_{id}=0) in Figure 1c). Here p_{dj0}=α_{dj}/(α_{dj} + β_{dj}) is defined as above. After integrating out p_{idj}, the distribution of x_{idj}conditional on b_{id}=1 and c_{id}=0 is
If b_{id}=0 and c_{id}=1, SNP i is SN in dataset d, and we assume that p_{idj} follows a uniform distribution U[0,p_{dj0}] (See the light blue lines illustrated for f(p_{idj}b_{id}=0,c_{id}=1) in Figure 1c). After integrating out p_{idj}, the distribution of x_{idj}conditional on b_{id}=0 and c_{id}=1 is
Joint probabilities and model fitting
Based on the model above, the complete data likelihood can be derived as:
Define , and . Define δ(.) to be an indicator function. δ(.)=1 if its argument is true, and δ(.)=0 otherwise. We have
To infer Π, V and W, we employ a Bayesian approach by imposing a Dirichlet prior D(η,⋯,η) on Π and imposing independent Dirichlet priors D(η,η,η) on all triplets (v_{kd},w_{kd},1−v_{kd}−w_{kd}). The joint posterior distribution of unknown parameters and indicators given the observed data is:
Conditional on the observed data, Pr(N) is a constant that does not contain parameters of interest, therefore it is absorbed into a proportionality constant not shown in the formula above. Using this joint posterior, an EM algorithm can be derived to search for posterior mode of in which the missing indictors A, B and C are all integrated out (see Additional file 1: Supplemental Method S.4).
For the Dirichlet prior, we use η=2 (see Additional file 1: Supplemental Method S.3 for a discussion on the choice of parameter for the Dirichlet prior). In the EM algorithm, we assume that the class number K is given. In order to choose the optimal K, we run the algorithm multiple times using different values of K. We choose the best K using the Bayesian Information Criterion (BIC) (see Additional file 1: Supplemental Method S.5).
Statistical inference of allelespecificity
The estimated Π, V and W can describe the correlation patterns of allelespecificity among datasets. Given Π, V and W, one can infer whether SNP i belongs to class k based on the posterior probability Pr(a_{i} = kX_{i},N_{i},Π,V,W) (see Additional file 1: Supplemental Method S.4 equations S.12S.13). One can then infer whether each SNP i is skewed in each individual dataset d based on the posterior probability Π,V,W) after summing over all possible values of a_{i}(see Additional file 1: Supplemental Method S.4 equation S.14). Note that
Define
Using , SNPs can be rank ordered for biologists to choose candidates to design followup studies. For each top ranked SNP, one can determine its skewing direction by comparing Pr(b_{id}=1,c_{id}=0X_{i},N_{i},Π,V,W) and Pr(b_{id}=0,c_{id}=1X_{i},N_{i},Π,V,W). The one with the larger value determines the direction. Finally, the posterior probabilities of top N SNPs can be converted to an estimate of false discovery rate (FDR) using .
Formula 7 shows that two types of information contribute to Pr(b_{id},c_{id}X_{i},N_{i},Π,V,W): (1) Pr(a_{i}=kX_{i},N_{i},Π,V,W), which is determined using information from all D datasets, and (2) Pr(b_{id},c_{id}a_{i}=k,X_{i},N_{i},Π,V,W), which only uses information specific to dataset d conditional on Π, V and W. Thus for each particular dataset d, the datasetspecific information is weighted by information obtained from other datasets to determine the SNP ranking. Intuitively, if allelic imbalance in two datasets are correlated, then observing an AS event in one dataset will suggest that a relatively weak skewing event observed at the same SNP in the other dataset is very likely to be a true AS event. In contrast, if no AS event is observed in one dataset, then a relatively weak skewing event observed at the same SNP in the other dataset is likely to be a false positive. This is the underlying nature of using Pr(a_{i}=kX_{i},N_{i},Π,V,W) to reweigh information in Pr(b_{id},c_{id}a_{i}=k,X_{i},N_{i},Π,V,W), and it provides the foundation for improving SNP ranking by borrowing information across datasets. In real applications, Π, V,W are unknown, and they are replaced by the posterior mode obtained from the EM algorithm.
Results
GM12878 data and preprocessing
We collected 40 ENCODE [36] ChIPseq datasets with a total of 77 samples together with a genomic DNA sample in GM12878 lymphoblastoid cells (Additional file 2: Table S1). GM12878 is a female and is one of the most extensively studied cell lines in ENCODE. Within each dataset, the number of replicate samples varied from 1 to 3. We downloaded the raw sequence reads of all 78 samples and mapped them to human genome (hg18) (see details in Additional file 1). We removed repeated sequences from the ChIPseq datasets to avoid PCR duplicates, which may skew the determination of allelic biases. In other words, if multiple reads have exactly the same sequence, only one copy is retained. We obtained the genotype data for GM12878 from [37].
Additional file 2. Table S1. Description of all GM12878 ChIPseq and RNAseq studies. An excel file showing the name of TF and HM, the number of replicates for each dataset in GM12878 cells.
Format: XLS Size: 42KB Download file
This file can be viewed with: Microsoft Excel Viewer
As previously described in [31], there are two different types of read mapping biases that may affect the analysis of AS events: the reference bias and the inherent bias. The reference bias often occurs when one maps sequence reads to a reference genome. If one allows the same number of mismatches in the alignment, a read from the nonreference allele is less likely to be mapped back to the reference genome compared to a read from the reference allele, since the nonreference read has one more mismatch to the reference genome. This phenomenon is known as the reference bias. This type of bias, if it exists, is automatically taken care of by the iASeq model through the parameter p_{dj0} which models the background skewing probability and is estimated using all reads mapped to heterozygote SNPs in each sample. If there is reference mapping bias, p_{dj0}will take a value different from 0.5 to adjust for the bias. One may remove reference bias before the analysis by masking SNPs in the reference genome during the alignment or by aligning reads to a diploid personal genome. This situation will also be automatically recognized by iASeq through the estimation of p_{dj0} from the data (if there is no bias, p_{dj0}=0.5). Therefore, regardless of whether the reference bias has been removed from the data in the preprocessing or not, the iASeq model is able to automatically handle it and adjust the inference accordingly.
The intrinsic bias is a different type of bias. As shown by [31], even if the reference bias is removed (e.g., by masking SNPs in the reference genome), the inherent bias still exists. For example, suppose sequence 1 (e.g., xxxAxxx) and sequence 2(e.g., xxxTxxx) are two reads that differ only in one position (i.e., A/T). It is possible that sequence 1 is easier to be mapped back to its correct location in the genome than sequence 2 if the second sequence has many repeats in the genome. This bias reflects the inherent characteristics of the genome and cannot be removed by masking variants in the reference genome or by mapping reads to a diploid personal genome. In the above example, masking A and T in the original reads is also not a solution, since a priori one does not know which position in a read corresponds to a SNP position and therefore should be masked without first aligning the read to the genome. When a heterozygote SNP has inherent bias, one allele will have higher read counts than the other even if the two alleles have the same binding level. To avoid this bias, we used the approach described in [22,31] to remove SNPs with the inherent bias.
We began with 1,704,166 heterozygote SNPs and filtered out 149,996 (8.8%) SNPs with inherent bias. Next, we eliminated SNPs that were not bound by any TF or associated with any HM in any dataset (see Additional file 1: Supplemental Methods S.1.1, S.1.2 and Additional file 3: Table S2 for details). After applying these filters, 94,519 heterozygote SNPs remained. These 94,519 SNPs were then analyzed by iASeq.
Additional file 3. Table S2. Raw read count data for 94,519 analyzed SNPs.
Format: ZIP Size: 3.2MB Download file
A simulation study
Before we apply iASeq to the real data, we first tested its performance in simulations that took into account real data characteristics. Our simulations kept the same design as the real GM12878 ChIPseq data, with the same number of datasets and the same number of replicates within each dataset, except that the genomic DNA sample was not used here since we knew the truth in the simulations and did not need genomic DNA as a control for potential bias. To create the simulation data, we first applied iASeq to the real GM12878 data to identify 86,353 SNPs that were not skewed in any dataset using Pr(a_{i}=0X_{i},N_{i},Π,V,W)>0.5 as cutoff. To mimic the real background noise, these SNPs were resampled by a bootstrap procedure to create the background SNPs in the simulations, and we kept the read counts (x_{idj},n_{idj}) of each background SNP as is in the simulated data. Next, we simulated ASB SNPs and added them to the background. Simulations were carried out under two different scenarios (Figure 2).
● Scenario 1: Two types of ASB SNPs (classes 1 and 2) were created in addition to the background SNPs (class 0). The SNP number for class 0, 1, and 2 was 85,069, 4,725 and 4,725 respectively. Thus the true Π_{k}for the three classes was 0.90, 0.05 and 0.05 respectively. SNPs in class 1 were SR in datasets 1 to 30 (i.e., their b_{id}=1 for d=1,⋯,30). SNPs in class 2 were SN in datasets 1 to 30 (i.e., c_{id}=1 for d=1,⋯,30). In datasets 31 to 40, no SNPs had allelic imbalance. Class 2 can be viewed as the mirror image of class 1. This symmetric design reflects the symmetry of allelespecificity, that is, the skewing to the reference allele and to the nonreference allele is approximately symmetric. The class abundance (0.90,0.05,0.05) roughly matched the abundance observed in the analysis of real GM12878 data.
Figure 2. Simulation design and patterns discovered by iASeq. (a) The true ASB patterns in simulation 1. Two patterns were simulated in addition to the background pattern. The two nonbackground patterns are shown. Each pattern has 4725 SNPs. Each row in the plot represents a SNP class, and each column represents a dataset. Black means skewed, and white means not skewed. (b) The BIC values for different class number K in simulation 1. The BIC achieves the minimum at K=2. (c) Patterns discovered by iASeq in simulation 1. The plot shows the estimated V and W when K=2. Each row corresponds to a class. Each column represents a dataset. The color in the cell (k,d) demonstrates the estimated SR or SN probability in class k and dataset d. From white to dark, the probability increases from 0 to 1. The numbers shown under Πare the estimated number of SNPs in each class (i.e., the total number of SNPs). The numbers shown under a_{i}are the number of SNPs identified for the corresponding class using the posterior probability Pr(a_{i}=kX_{i},N_{i},Π,V,W)>0.9 as cutoff. (d) The true ASB patterns in simulation 2. Four patterns were simulated in addition to the background pattern. The four nonbackground patterns are shown. Each pattern has 2362 SNPs. (e) The BIC values for different class number K in simulation 2. The BIC achieves the minimum at K=4. (f) The patterns discovered by iASeq in simulation 2.
● Scenario 2: Four correlation patterns (classes 14) were created in addition to the background class (class 0). Class 1 and class 2 were the same as in simulation 1. Classes 3 and 4 were two new patterns. SNPs in class 3 were SR in datasets 2140, and SN in datasets 110. Class 4 was the mirror image of class 3. The abundance of the classes 0 to 4 was (0.90,0.025,0.025,0.025,0.025).
Given the simulated [B_{i};C_{i}] configurations, we then simulated the read count data for ASB SNPs as described in detail in Additional file 1: Supplemental Methods S.6. Simulations done in this way was able to keep the major characteristics of real data while allowing us to benchmark the performance of different methods since we knew the truth.
We applied iASeq to both simulations. In both cases, iASeq was able to identify the correct number of SNP classes using BIC (Figures 2a,b,d,e). Figures 2c and 2f show that the ASB patterns reported by iASeq matched the true patterns well. In order to test whether iASeq can improve the statistical power of detecting SNPs with allelic imbalance, we compared the SNP ranking provided by iASeq with rankings provided by five other methods that analyze each dataset separately (Figure 3). In iASeq, SNPs were ranked in each dataset d according to the posterior probability defined by Formula 8. Since we know the truth, we can count how many of the top N SNPs were true positives. Here the true positives were defined as SNPs that were truly allelespecific and also had the skewing direction correctly inferred. The five singledataset based methods for ranking SNPs include a deviation statistic d, naive z statistic, naive Bayes statistic, empirical Bayes statistic and single dataset EM. These methods were applied to each individual dataset. For each dataset d, we merged data from all replicates to obtain and . We then computed the statistics used for SNP ranking as described below.
1. Deviation statistic (d): SNPs were ranked based on x_{id}/n_{id}−p_{d0}. Here we estimated , where I^{′}is the number of SNPs for which n_{id}≠0.
Figure 3. The Receiver Operating Characteristic (ROC) curves for simulations. (a)(c) We plot the number of true allelespecific SNPs (i.e., true positives, TP) among the top q ranked SNPs in each dataset against the rank cutoff q. Results for different methods in three representative datasets in simulation 1 are shown. Results in all other datasets were similar. (d) For each ranking method and each dataset, we computed the area under the ROC curve (AUC) using the 2000 top ranked SNPs. dAUC, the proportion of improvement of AUC brought by iASeq over the best AUC obtained from the singledataset based methods, was computed for each dataset. dAUC>0 means iASeq brings improvement. The distribution of dAUC in all 40 datasets is shown for simulation 1. (e)(g) Results in three representative datasets from simulation 2. Results in all other datasets were similar. (h) The distribution of dAUC in all 40 datasets is shown for simulation 2.
2. Naive z statistic (z): SNPs were ranked based on . Here p_{d0}was estimated as in the deviation statistic d.
3. Naive Bayes statistic (b): SNPs were ranked using . Here where p_{d0}was estimated as in the deviation statistic d. The implicit assumption here is that x_{id}p_{id}∼Bin(n_{id},p_{id}) and p_{id}∼Beta(α_{d},β_{d}) with and . The posterior mean of p_{id}is used to construct the ranking statistic.
4. Empirical Bayes statistic (B): SNPs were ranked using . We estimated . The implicit assumption is the same as the naive Bayes statistic, but now we estimate α_{d}and β_{d}based on the observed data using the method of moments as in iASeq (see Additional file 1: Supplemental Method S.2).
5. Single dataset EM (singleEM): We fitted a mixture model of SR, SN and NS with distributions f_{idjp}(·),p=0,1,2 and mixing probabilities v_{d}, w_{d}and 1−v_{d}−w_{d}for each dataset d without considering other datasets. SNPs were ranked using a posterior probability similar to , but now determined based on information in dataset d only (see Additional file 1: Supplemental Method S.7 for details).
Figure 3 compares the number of true positives, TP_{d}(q), in the top q SNPs reported by each method in each dataset d. In Figures 3ac and 3eg, TP_{d}(q) is plotted as a function of q in a few representative datasets. These plots show that iASeq outperformed all singledataset based methods, and it was able to substantially improve the power for detecting allelespecificity.
In general, the observed differences between iASeq and the d, z, b and B statistics could be caused by many factors such as use of different statistical models, ranking statistics, or methods for parameter estimation. However, the comparison between iASeq and the single dataset EM represents a wellcontrolled comparison since these two methods used exactly the same distributional assumptions and parameter estimation methods. The only difference between them was that iASeq used information from multiple datasets whereas singleEM was based on one dataset only. This wellcontrolled comparison shows that jointly modeling multiple datasets is able to improve the allelic inference.
To examine whether iASeq was able to bring improvement in all datasets, we computed the Area under the Receiver Operating Characteristic (ROC) curves (AUC) for each method in each dataset using the top 2000 ranked SNPs. In each dataset, we computed the proportion of improvement in terms of AUC brought by iASeq over the best singledataset based ranking method (i.e., ). dAUC>0 means iASeq is able to bring improvement. Figures 3d and 3h show the distribution of dAUC across all 40 datasets as a histogram. The results show that iASeq was able to improve the SNP ranking in almost all datasets.
In Figure 4, we converted the iASeq posterior probabilities of top N SNPs to FDR estimates and plotted the estimated FDR against the true FDR. The figure shows that iASeq was able to provide reasonable FDR estimates as well. Shown in the figure are a few representative datasets. Results in all other datasets were similar.
Figure 4. Estimated FDR against true FDR in simulations. (a)(d) Results for four representative datasets in simulation 1. (e)(h) Results for four representative datasets in simulation 2. Results for all other datasets were similar.
Analysis of real data
Our simulation study demonstrates the ability of iASeq to discover correlation patterns of allelespecificity and improve the detection of skewed SNPs. Next, we applied iASeq to analyze the 41 real datasets (78 samples) in GM12878 cells. In real data, we do not have comprehensive knowledge about the truth. Therefore, unlike simulations, we were not able to assess the FDR estimates. For this reason, we mainly focused on analyzing the correlation patterns of allelespecificity and testing whether iASeq can improve the SNP ranking.
Correlation patterns of allelespecificity
Figure 5a shows the BIC in the real data. Based on BIC, the optimal K was 2. In other words, in addition to the background class (k=0), iASeq discovered two other SNP classes, representing different allelespecificity patterns. For these two nonbackground classes, Π_{k}was estimated to be 0.0696 and 0.0691 respectively, suggesting that they cover 6.96% and 6.91% of the analyzed SNPs. Due to the background noises, not all SNPs in these two classes can be confidently detected. At the 0.90 posterior probability cutoff, iASeq reported 1868 and 2138 SNPs for classes 1 and 2 respectively (Figure 5b). Note that our simulations had similar settings as the real data analysis, and they showed that iASeq was able to discover more than two patterns if they are supported by the data. Therefore our discovery of two correlation patterns here is likely driven by the data, that is, the information in the data is only sufficient for supporting robust discovery of two patterns.
Figure 5. Correlation patterns of allelespecificity among different TFs and HMs in GM12878 cells discovered by iASeq. (a) The BIC values for different class number K. The BIC achieves the minimum at K=2. (b) The estimated V and W when K=2. Each row corresponds to a class. Each column represents a dataset. The color in the cell (k,d) represents the SR or SN probability in class k and dataset d. From white to dark, the probability increases from 0 to 1. The bar plot and the numbers shown under Πare the estimated number of SNPs in each class (i.e., the total number of SNPs). The bar plot and the numbers shown under a_{i}are the number of SNPs identified for the corresponding class using the posterior probability Pr(a_{i}=kX_{i},N_{i},Π,V,W)>0.9 as cutoff. (c) A closer look at V and W in a number of representative datasets. The barplots show the estimated SR and SN probabilities v_{kd}and w_{kd}in a number of selected datasets. Left: the skewing probabilities in class 1. Right: the skewing probabilities in class 2. The height of each bar represents the SR or SN probability.
Figures 5b and 5c show the posterior mode of V_{k}and W_{k} for the two nonbackground classes. It turned out that these two classes corresponded to two global directions of allelespecificity, SR and SN, respectively. Since the assignment of reference or nonreference allele depends on the reference genome, the assignment per se is not of biological interest. However, recall that GM12878 is a single person, therefore at each single SNP, the nucleotide representing the reference or nonreference allele is the same across all datasets analyzed here. Given this fact, what these results essentially tell is that at each single SNP, most TFs and HMs in our analysis were highly correlated in terms of allelespecificity, and if they are skewed, they tend to be skewed toward the same direction (i.e., the same allele). For instance, for SNPs in class 1, both H3K4me3 (from the Broad Institute) and H3K27ac (Broad) had high probability to be SR, with (v_{kd},w_{kd}) equal to (0.9337,0.0070) and (0.9730,0.0041) respectively (Figure 5c). The probability that one is SR and the other one is SN was small. Similarly, for SNPs in class 2, both H3K4me3 and H3K27ac were highly likely to be SN simultaneously ((v_{kd},w_{kd})=(0.0061,0.9835) for H3K4me3 (Broad) and (0.0040,0.9897) for H3K27ac (Broad)). While the allelic imbalance of most TFs and HMs were highly correlated, H3K27me3, a HM involved in gene repression, was an exception. In both nonbackground classes, H3K27me3 had much lower skewing probabilities compared to the other proteins (Figure 5c). Within each class, the difference in the skewing probability between the two alleles was also much weaker for H3K27me3 as compared to the other proteins. For instance, in class 1, while most other proteins showed strong preference to be skewed toward the reference allele, H3K27me3 can be skewed to the reference allele at some SNPs and skewed to the nonreference allele at many other SNPs. Therefore, the allelic imbalance in H3K27me3 is not strongly correlated with the allelic imbalance of the other proteins analyzed here. For the genomic DNA which was used as control here, the skewing probabilities (v_{kd},w_{kd}) in both classes were fairly low as shown in Figure 5bc. In both classes, the probability for not being skewed in the genomic DNA (i.e., 1−v_{kd}−w_{kd}) was bigger than 0.95. This indicates that the high probability of skewing observed in the other datasets was not an artifact.
The coordinated allelic imbalance of different proteins toward the same allele has also been observed in a recent study [38]. In that study, the authors analyzed AS of 24 TFs and found that when multiple TFs bind to the same SNP, they frequently bind to the same allele. Moreover, those authors did not observe any pair of TFs that regularly bind the same position on alternate alleles. Our observation here therefore is consistent with their finding.
Increased power for detecting allelespecificity compared with single dataset analysis
We ranked SNPs based on the posterior probabilities in each dataset. The iASeq ranking was compared with the rankings provided by the five singledataset based methods described above. Since we do not know the truth, we used two types of independent information as gold standard to benchmark the ranking results.
First, we evaluated different methods by counting how many of their top ranked SNPs were located in the nonpseudoautosomal regions of chromosome X (chrXnpa) (Figure 6). GM12878 is a female lymphoblastoid cell line. In GM12878, SNPs in chrXnpa are expected to be allelespecific due to cells rapidly become clonal in culture leading to a skewed Xinactivation [5,38,39]. Therefore, given a fixed number of top SNPs, the more chrXnpa SNPs one can find, the more powerful a method is. Figure 6 shows that iASeq clearly increased the power for detecting allelespecificity in each dataset compared to the singledataset based analysis. For example, Figure 6a shows that in the H3K27ac dataset generated by the Broad Institute, iASeq was able to identify 122 chrXnpa SNPs among the top 500 SNPs. This represents 126% improvement compared to singleEM, the best singledataset based ranking method in that dataset, which only identified 54 chrXnpa SNPs. Figures 6ag show results in a few representative datasets. Figure 6h shows the distribution of dAUC (i.e., the proportion of improvement of AUC by iASeq over the best singledataset based ranking method in each dataset) in all 40 datasets. These plots clearly show that iASeq outperformed all singledataset based methods in all datasets and the average improvement in AUC was 354%.
Figure 6. The ROC curves with chrXnpa SNPs as gold standard in the GM12878 analysis. We plot the number of nonpseudoautosomal region X chromosome SNPs, denoted by TP_{d}(q), among the top q ranked SNPs in dataset d as a function of the rank cutoff q for each method. (a)(g) Results in 7 representative datasets. (h) In each dataset, we computed the area under the ROC curve (AUC) using the 2000 top ranked SNPs for each method. dAUC, the proportion of improvement of AUC brought by iASeq over the best AUC from the singledataset based methods, was computed for each dataset. The distribution of dAUC in all 40 datasets is shown.
Second, we evaluated different methods by using independent RNAseq data. From RNAseq, one can identify exonic ASE SNPs and use them as gold standard. We collected two RNAseq datasets in GM12878, one from the California Institute of Technology (Caltech) and the other from the Yale/Stanford University (Yale) (Additional file 2: Table S1). From each dataset, we identified the top 400 exonic ASE SNPs using the naive Bayes statistics. Using the other methods to identify the gold standard ASE SNPs produced similar results which, for simplicity, will not be shown here. Based on these exonic ASE SNPs, we defined a SNP in our ChIPseq analysis as truly allelespecific if there was an exonic ASE SNP in its Xkb neighborhood. Here we tried both X=10kb and X=1kb and obtained similar results. Below we illustrate the results using X=10kb as an example. The corresponding results for X=1kb are shown in Additional file 4: Figures S3S6. Among the 94,519 SNPs analyzed in the ChIPseq data, 20,526 had one or more exonic SNPs within its 10kb neighborhood and therefore could potentially be linked to an exonic ASE SNP. Figure 7 and Additional file 5: Figure S1 compare rankings of these SNPs provided by different methods in terms of how many of the top ranked SNPs are true positives (i.e., associated with ASE). iASeq again outperformed all the other singledataset based ranking methods. For instance, based on the Caltech gold standard, iASeq on average identified 144% more true positive SNPs among the top 500 SNPs (Figure 7ag). According to the Yale gold standard, iASeq achieved an average of 149% improvement in terms of the true positive rate among top 500 SNPs (Additional file 5: Figure S1). The average improvement in terms of AUC (i.e., dAUC) across all 40 datasets was 148% (Figure 7h) and 165% (Additional file 5: Figure S1h) for the Caltech and Yale gold standard respectively.
Additional file 4. Supplemental comparison of defining allelespecific SNPs as SNPs that have RNAseq exonic ASE SNPs in their 1kb neighborhood. Supplemental Figure 3 — ROC curves for GM12878 using Caltech Exonic RNAseq ASE SNPs as gold standard. Supplemental Figure 4 — ROC curves for GM12878 using Caltech autosomal exonic RNAseq ASE SNPs as gold standard. Supplemental Figure 5 — ROC curves for GM12878 using Yale Exonic RNAseq ASE SNPs as gold standard. Supplemental Figure 6 — ROC curves for GM12878 using Yale autosomal exonic RNAseq ASE SNPs as gold standard. Supplemental Table 4 — Comparison of iASeq and AlleleSeq using Caltech RNAseq exonic ASE SNPs as gold standard. Supplemental Table 5 — Comparison of iASeq and AlleleSeq using Yale RNAseq exonic ASE SNPs as gold standard.
Format: PDF Size: 74KB Download file
This file can be viewed with: Adobe Acrobat Reader
Additional file 5. Figure S1. ROC curves for GM12878 using Yale Exonic RNAseq ASE SNPs as gold standard.
Format: PDF Size: 30KB Download file
This file can be viewed with: Adobe Acrobat Reader
Figure 7. The ROC curves in GM12878 data using Caltech RNAseq ASE SNPs as gold standard. We plot TP_{d}(q), the number of true allelespecific SNPs among the top q ranked SNPs in dataset d, against the rank cutoff q for each method. The true allelespecific SNPs are defined as SNPs that have ≥1 RNAseq exonic ASE SNPs in their 10kb neighborhood. (a)(g) Results in 7 representative datasets. (h) In each dataset, we computed the area under the ROC curve (AUC) using the 2000 top ranked SNPs for each method. dAUC, the proportion of improvement of AUC brought by iASeq over the best AUC from the singledataset based methods, was computed for each dataset. The distribution of dAUC in all 40 datasets is shown.
To ensure that the increased statistical power was not completely attributed to X chromosome SNPs, we repeated the benchmark analysis based on RNAseq using only SNPs in autosomal chromosomes, and we obtained similar results (Figure 8, Additional file 6: Figure S2). This shows that the increased power is not only contributed by chrX SNPs.
Additional file 6. Figure S2. ROC curves for GM12878 using Yale autosomal exonic RNAseq ASE SNPs as gold standard.
Format: PDF Size: 29KB Download file
This file can be viewed with: Adobe Acrobat Reader
Figure 8. The ROC curves in GM12878 data using Caltech RNAseq autosomal ASE SNPs as gold standard. We plot TP_{d}(q), the number of true allelespecific SNPs among the top q ranked autosomal SNPs in dataset d, against the rank cutoff q for each method. The true allelespecific SNPs are defined as autosomal SNPs that have ≥1 RNAseq exonic ASE SNPs in their 10kb neighborhood. (a)(g) Results in 7 representative datasets. (h) In each dataset, we computed the area under the ROC curve (AUC) using the 2000 top ranked SNPs for each method. dAUC, the proportion of improvement of AUC brought by iASeq over the best AUC from the singledataset based methods, was computed for each dataset. The distribution of dAUC in all 40 datasets is shown.
Comparisons with other methods
Most existing studies on allelespecificity were conducted using inhouse data analysis pipelines. A tool developed by Skelly et al. [33] and AlleleSeq [32] are two software tools accessible to thirdparty users for AS analysis. The method proposed by Skelly et al. [33] is designed for analyzing ASE in RNAseq data. It first fits a background model using genomic DNA and then feeds the estimated parameters into a Bayesian model that combines information from multiple SNPs within a gene to infer ASE. When we applied this method to analyzing the GM12878 ChIPseq data, two problems occurred. First, the method uses Markov Chain Monte Carlo (MCMC) to fit the background model from the genomic DNA which, as alerted by [33], is wellknown for its slow speed and difficulties for users to monitor the convergence. Our genomic DNA data had 94,519 SNPs which covered 12,417 genes. Running this algorithm on this data using the parameter settings recommended by [33] on a machine with 2.7 GHz CPU and 4 Gb RAM took more than 60 days. Second, after feeding the background model parameters obtained from the first step to the inference model in the second step, the algorithm stopped execution after a few iterations. This is because the original model was developed for deeply sequenced RNAseq rather than ChIPseq, where the average read count covering a heterozygote SNP in a ChIPseq dataset is only 0.64. As a result, the model developed in [33] did not fit the real data in ChIPseq experiments. This lackoffit caused the program to stop early, likely due to the abnormally fitted parameters causing various computation problems (e.g., overflow). For this reason, although the method proposed by [33] represents an advanced solution for analyzing RNAseq ASE, it cannot be directly used to analyze ASB in ChIPseq data without significantly redesigning the model and algorithm. For this reason, it is not further compared here.
AlleleSeq [32] is another tool for AS analysis. It has been used to analyze ASB of several TFs in GM12878 [32]. AlleleSeq is more focused on the preprocessing step. Its pipeline first constructs a diploid personal genome sequence according to family trio data and then maps ChIPseq reads to this personal genome. After removing various biases, the method then analyzes allelespecificity in each individual ChIPseq dataset separately. [32] applied AlleleSeq to analyze 7 different TF datasets in GM12878, among them 5 were also included in our iASeq analysis. We compared iASeq and AlleleSeq using these same 5 datasets. We first obtained the ASB SNPs reported by AlleleSeq from [32]. Let T_{d}denote the number of reported ASB SNPs for each TF dataset d. We next obtained the top T_{d}SNPs ranked by iASeq. We then compared these two methods based on how many of their top T_{d} SNPs were in chrXnpa, and how many of them were associated with exonic ASE SNPs determined by RNAseq. For the benchmark analysis based on RNAseq, we associated exonic ASE SNPs with ChIPseq SNPs using both 10kb and 1kb neighborhood. We also performed the comparison after excluding the chromosome X SNPs. Table 1, Additional file 7: Table S3, Additional file 4: Tables S4S5 and Additional file 8: Figure S7 show that iASeq either outperformed or performed comparable to AlleleSeq in all datasets. Sometimes, the improvement was substantial (e.g., YaleMYC in Table 1).
Additional file 7. Table S3. Comparison of iASeq and AlleleSeq using Yale RNAseq exonic ASE SNPs as gold standard.
Format: PDF Size: 17KB Download file
This file can be viewed with: Adobe Acrobat Reader
Additional file 8. Figure S7. The ROC curves for comparison between AlleleSeq and iASeq.
Format: PDF Size: 29KB Download file
This file can be viewed with: Adobe Acrobat Reader
Table 1. Comparison of iASeq and AlleleSeq
Discussion
Interpretation of the correlation patterns
When analyzing the real data in GM12878, iASeq found two nonbackground AS patterns, representing two opposite directions of allelic imbalance. Since the assignment of reference and nonreference allele depends on the reference genome, whether a SNP is skewed toward reference or nonreference allele per se does not have direct biological meaning. What these two patterns essentially suggest is that the allelic imbalances of multiple proteins at a single SNP are correlated and have high preference to be skewed toward the same allele. In other words, the two patterns should be viewed as a pair and interpreted together.
In general, although one may view different allelic imbalance patterns in iASeq as different clusters of SNPs, these clusters only describe the similarities among SNPs in terms of their skewness directions, rather than the similarities in terms of their functions. The direction is defined using the reference/nonreference allele. The reference or nonreference allele for different SNPs can have different meanings (e.g., for one SNP, the maternal allele may be the reference allele, whereas for another SNP the paternal allele may be the reference allele). Therefore within each cluster, even though SNPs have similar skewness pattern, they are not necessarily functionally related to each other. One should not confuse the SNP clusters here with the clusters obtained from the traditional gene expression microarray data analysis, where coexpressed genes in a cluster often have similar functions. In iASeq, the clusters only serve as a tool to describe the correlation structure among different datasets (i.e., proteins), rather than the functional correlation among different SNPs. The correlation patterns among datasets are used by iASeq to inform one how to integrate information across datasets (i.e., which datasets are highly correlated and therefore can borrow information from each other) to improve detection of AS events for each individual SNP and dataset. In order to understand functions of the detected AS events, one needs to further correlate the iASeq results with other information (e.g., one may determine the parentoforigin of each SNP first and then study various phenomena such as imprinting).
Our observation that different proteins prefer to be skewed in the same direction is consistent with a recent observation reported in [38] that AS of 24 different TFs are skewed toward the same allele. A number of factors could contribute to the observed correlation. First, biologically it is plausible that functionally related HMs and TFs have correlated allelespecificity. For instance, both H3K4me2 and H3K4me3 are markers for active transcription. Therefore, for a specific SNP, if the reference allele is associated with a gene with active transcription but the nonreference allele is not, then it is very likely that both H3K4me2 and H3K4me3 will be skewed toward the reference allele. For another SNP, if the nonreference allele is transcribed but the reference allele is not, then both H3K4me2 and H3K4me3 will have high probability to be skewed toward the nonreference allele. In the genome, H3K4me2 and H3K4me3 are skewed toward reference allele for some SNPs, and skewed toward nonreference allele for some other SNPs. Therefore the skewed SNPs could naturally fall into two clusters, representing two opposite AS directions. Second, as pointed out by [38], the coordinated AS could also occur as a result of the difference in the chromatin landscape between the two alleles. For instance, if the chromatin on one allele is more open and accessible, it could increase the overall binding probability of multiple different proteins, leading to correlated allelic skewing.
While our results show that most analyzed TFs/HMs tend to be skewed toward the same direction, these results do not imply that these proteins are perfectly correlated in terms of allelespecificity at each and every SNP. In iASeq, the correlation patterns V_{k}and W_{k}are probabilistic patterns rather than 01 vectors. Each correlation class k can generate all 3^{D} AS configurations. For instance, for a class with [V_{k};W_{k}]= [(0.9,0.9,0.9,0.1); (0.1,0.1,0.1,0.1)], it is possible to have one SNP with configuration [SR,SR,NS,NS] and at the same time another SNP with configuration [SR,NS,SR,NS]. Therefore, SNPs in the same class are not required to have the same AS configuration, even though they tend to have similar AS configurations. The probabilistic patterns are used here to provide a parsimonious description of the complex correlation structure in the data, so that one can circumvent the difficulty of handling 3^{D} AS configurations whose complexity increases exponentially. As a consequence of using this parsimonious model, multiple weak correlation patterns without strong enough data support could be merged into a bigger class. For instance, consider two AS patterns [V_{k};W_{k}]=[(1,1,0,0);(0,0,0,0)] (i.e., [SR,SR,NS,NS]) and [V_{k};W_{k}]=[(0,0,1,1);(0,0,0,0)] (i.e., [NS,NS,SR,SR]). Suppose both patterns are equally likely to occur in the data. If each pattern is only associated with a small number of SNPs, then a parsimonious model will prefer merging them together into one single class with [V_{k};W_{k}]=[(0.5,0.5,0.5,0.5);(0,0,0,0)]. For this reason, iASeq only discovers correlation patterns that have sufficient data support so that they can be distinguished from other patterns. It will not report weak patterns, which could be real but do not have enough data support to allow them to be robustly recovered. For users, this means that at the cluster level, they may not be able to see weak but real AS correlation patterns if these patterns are not associated with enough number of SNPs. On the other hand, for the purpose of inferring whether or not each SNP is allelespecific in each dataset, these parsimonious correlation patterns are sufficient for describing the correlation structure in the data and serving as a prior to guide the information sharing across datasets. The information sharing will lead the increased ASB detection power, and the eventual AS configuration at each individual SNP will be determined by the posterior probabilities of (b_{id},c_{id}) (i.e., ) rather than the clusterlevel prior probabilities [V_{k};W_{k}]. Therefore, in the final AS calls, the model still allows each SNP to have its own AS configuration which may not necessarily be the same as the AS configurations of other SNPs from the same cluster.
Consistent with [38], in the two nonbackground AS patterns discovered here, proteins skewed toward the same direction did not always correspond to known proteinprotein interactions. As pointed out by [38], this could happen as a result of allelic imbalances of different proteins being caused by a common underlying factor such as allelic difference in chromatin landscape. It could also reflect unknown proteinprotein interactions. For iASeq specifically, there is a third reason, that is, multiple small patterns can be merged into a bigger probabilistic class as described before. For example, because of the use of probabilistic patterns, two patterns [SR,SR,NS,NS] and [NS,NS,SR,SR] may be merged into a single SNP class (e.g., V_{k};W_{k}=[(0.5,0.5,0.5,0.5);(0,0,0,0)]). As a result, only looking at the pattern represented by V_{k};W_{k}, one cannot tell the details of proteinprotein interactions, such as these interactions only exist between datasets 1 and 2, or between 3 and 4, but not between the other pairs of datasets. What one can tell from this merged pattern is that, when the allelic imbalance occurs in these four datasets, they will be skewed toward the same direction, i.e., the reference allele in this example.
In summary, while the correlation patterns in iASeq provide some insights on the correlation of allelic imbalance among different datasets, one should not overinterpret them. The primary goal of these patterns is to describe the correlation structure in the data so that information from different datasets can be shared in a principled way to increase the power of statistical inference. This also points to an important difference between this study and previous studies that reported coordinated allelespecificity among multiple proteins. The previous studies only reported the correlation as a biological finding, but did not provide a statistical method to further utilize the correlation structure to improve the statistical inference. In contrast, iASeq provides a general and rigorous statistical method that utilizes the automatically discovered correlation patterns to increase the statistical power of AS detection. As such, it represents a novel development for the analysis of allelespecificity.
Model, algorithm, and possible extensions
Unlike tools such as AlleleSeq which mainly focus on the preprocessing steps for the AS analysis (e.g., construction of diploid personal genome), iASeq is developed as a general model working downstream of the preprocessing pipelines. The input data for iASeq are the read counts in the format shown in Figure 1a. With this design, iASeq can be easily coupled with different data preprocessing protocols. For instance, some investigators may map their reads to a reference genome, while others may map their reads to a diploid personal genome. Both types of investigators can use iASeq to integrate information from multiple datasets once they obtained the allelic read counts.
In iASeq, we used an EM algorithm to find the posterior mode of parameters and carried out statistical inference accordingly. In principle, one may also use a full Bayesian approach and Markov Chain Monte Carlo (MCMC) to perform the posterior inference. However, since MCMC usually takes much longer to run for a big dataset and it is not easy for users to monitor convergence, we decided to use the posterior mode and EMbased approach in our implementation. For analyzing the GM12878 data with 94,519 SNPs, iASeq took 5 hours to run the EM algorithm to fit a single model with K=1 on a machine with 2.7 GHz CPU and 4Gb RAM. To fit a single model with K=10 on the same machine, the EM took 16 hours. Running the EM for all 10 Ks between 1 and 10 on a single core took 4.6 days. However, when we run these 10 jobs in parallel on 10 cluster nodes, we were able to select the best model within 1 day. Therefore, running the algorithm on a single machine is a little timeconsuming, but the computation time can be reduced by parallelization. Also, our analysis of GM12878 data indicates that the optimal K in that real data was 2. For a K not extremely large, even if running the full BIC selection on a single machine takes some time, it usually requires less than a week, which is acceptable compared to the time devoted to preparing samples and generating data.
In principle, the statistical model developed in iASeq may also be applied to analyze other types of AS events, such as ASE and ASM. In the future, we plan to improve the model by incorporating information from the spatial correlation among closely located SNPs. For example, for the ASE analysis, one may jointly model SNPs from the same gene, similar to [33].
Implications on future studies
The analysis of AS events using the highthroughput sequencing data frequently faces the problem of low statistical power due to the limited amount of information available at heterozygote SNPs. One way to increase the power is to increase the sequencing depth for one data type (e.g., MYC ChIPseq). An alternative approach is to spend the same amount of money to generate data for multiple different but related data types (e.g., ChIPseq for MYC, H3K4me1, H3K4me3, etc.), each with a lower coverage. One can then integrate the multiple datasets to increase the statistical power of allelespecificity analysis. The merit of the second approach is that one can collect multiple different types of information which might be useful for other purposes (e.g., in addition to studying MYC binding using MYC ChIPseq, one may couple H3K4me1 ChIPseq data with DNA motif information to locate active enhancers and predict binding sites of other TFs in the genome). If the second approach is used in the study design, then iASeq will offer a flexible, powerful and scalable framework for better analyzing the AS events in the data. As ChIPseq data continue to grow rapidly, this integrative approach will allow us to use the data more efficiently to characterize the allelespecificity.
Conclusions
In summary, we have proposed a Bayesian hierarchical mixture model iASeq to integrate multiple ChIPseq datasets for analyzing allelespecificity. The primary goal of iASeq is to increase the statistical power of AS detection, and it does so by taking the advantage of correlations among datasets. Since the correlation structure may not be known before the data analysis, iASeq learns it from the data automatically. Application of iASeq to the ENCODE GM12878 data shows that allelic imbalance of most analyzed TFs and HMs have strong preference to be skewed toward the same direction. Analysis of both the simulated and real data show the effectiveness of iASeq to improve detection of allelespecificity compared to singledataset based methods.
Abbreviations
AS: allelespecific; ASB: allelespecific binding, including both allelespecific TF binding and allelespecific histone modifications; ASE: allelespecific expression; ASM: allelespecific DNA methylation; AUC: area under receiver operating characteristic curve; EM: ExpectationMaximization algorithm; FDR: false discovery rate; HM: histone modification; NS: not allelespecific; ROC: receiver operating characteristic curve; SN: skewed to the nonreference allele; SR: skewed to the reference allele; TF: transcription factor.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Conceive study: HJ. Develop model: HJ, YW. Implementation: YW. Data collection: XL, QW. Data analysis: YW, XL. Write paper: HJ, YW, XL, QW. All authors read and approved the final manuscript.
Acknowledgements
This work was supported by the National Institute of Health grant R01HG006841 to HJ, the Strategic Priority Research Program of the Chinese Academy of Sciences, Grant No. XDA01010305 and Hundred Talents Program of the Chinese Academy of Sciences to QW. The authors would like to acknowledge Dr. Joel Rozowsky and Dr. Mark Gerstein for providing AlleleSeq data on GM12878 for the method comparisons.
References

Bell C, Beck S: Advances in the identification and analysis of allele specific expression.
Genome Med 2009, 1:56. PubMed Abstract  BioMed Central Full Text  PubMed Central Full Text

Graze R, Novelo L, Amin V, Fear J, Casella G, Nuzhdin S, McIntyre L: Allelic imbalance in Drosophila hybrid heads: exons, isoforms, and evolution.
Mol Biol Evol 2012, 29:15211532. PubMed Abstract  Publisher Full Text

Knight J: Allelespecific gene expression uncovered.
Trends Genet 2004, 20:113116. PubMed Abstract  Publisher Full Text

Chen R, Mias G, LiPookThan J, Jiang L, Lam H, Miriami E, Karczewski K, Hariharan M, Dewey F, Cheng Y, Clark M, Im H, Habegger L, Balasubramanian S, O’Huallachain M, Dudley J, Hillenmeyer S, Haraksingh R, Sharon D, Euskirchen G, Lacroute P, Bettinger K, Boyle A, Kasowski M, Grubert F, Seki S, Garcia M, WhirlCarrillo M, Gallardo M, Blasco M, et al.: Personal omics profiling reveals dynamic molecular and medical phenotypes.
Cell 2012, 148:12931307. PubMed Abstract  Publisher Full Text

McDaniell R, Lee B, Song L, Liu Z, Boyle A, Erdos M, Scott L, Morken M, Kucera K, Battenhouse A, Keefe D, Collins F, Willard H, Lieb J, Furey T, Crawford G, Iyer V, Birney E: Heritable individualspecific and allelespecific chromatin signatures in humans.
Science 2010, 328:235239. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kasowski M, Grubert F, Heffelfinger C, Hariharan M, Asabere A, Waszak S, Habegger L, Rozowsky J, Shi M, Urban A, Hong M, Karczewski K, Huber W, Weissman S, Gerstein M, Korbel J, Snyder M: Variation in transcription factor binding among humans.
Science 2010, 328:232235. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kerkel K, Spadola A, Yuan E, Kosek J, Jiang L, Hod E, Li K, Murty V, Schupf N, Vilain E, Morris M, Haghighi F, Tycko B: Genomic surveys by methylationsensitive SNP analysis identify sequencedependent allelespecific DNA methylation.
Nat Genet 2008, 40:904908. PubMed Abstract  Publisher Full Text

Morley M, Molony C, Weber T, Devlin J, Ewens K, Spielman R, Cheung V: Genetic analysis of genomewide variation in human gene expression.
Nature 2004, 430:743747. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Schilling E, El Chartouni C, Rehli M: Allelespecific DNA methylation in mouse strains is mainly determined by cisacting sequences.
Genome Res 2009, 19:20282035. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Tycko B: Allelespecific DNA methylation: beyond imprinting.
Hum Mol Genet 2010, 19:R210220. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Zhang K, Li J, Gao Y, Egli D, Xie B, Deng J, Li Z, Lee J, Aach J, Leproust E, Eggan K, Church G: Digital RNA allelotyping reveals tissuespecific and allelespecific gene expression in human.
Nat Methods 2009, 6:613618. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Cui H, CruzCorrea M, Giardiello F, Hutcheon D, Kafonek D, Brandenburg S, Wu Y, He X, Powe N, Feinberg A: Loss of IGF2 imprinting: a potential marker of colorectal cancer risk.
Science 2003, 299:17531755. PubMed Abstract  Publisher Full Text

Holt R, Zhang Y, Binia A, Dixon A, Vandiedonck C, Cookson W, Knight J, Moffatt M: Allelespecific transcription of the asthmaassociated PHD finger protein 11 gene (PHF11) modulated by octamerbinding transcription factor 1 (Oct1).
J Allergy Clin Immunol 2011, 127:10541062 e 1051–1052. PubMed Abstract  Publisher Full Text

Heap G, Yang J, Downes K, Healy B, Hunt K, Bockett N, Franke L, Dubois P, Mein C, Dobson R, Albert T, Rodesch M, Clayton D, Todd J, van HD, Plagnol V: Genomewide analysis of allelic expression imbalance in human primary cells by highthroughput transcriptome resequencing.
Human Mol Genet 2010, 19:122134. Publisher Full Text

Tuch B, Laborde R, Xu X, Gu J, Chung C, Monighetti C, Stanley S, Olsen K, Kasperbauer J, Moore E, Broomer A, Tan R, Brzoska P, Muller M, Siddiqui A, Asmann Y, Sun Y, Kuersten S, Barker M, De LVF, Smith D: Tumor transcriptome sequencing reveals allelic expression imbalances associated with copy number alterations.
PLoS One 2010, 5(2):e9317. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

BenDavid E, GranotHershkovitz E, MondererRothkoff G, Lerer E, Levi S, Yaari M, Ebstein R, Yirmiya N, Shifman S: Identification of a functional rare variant in autism using genomewide screen for monoallelic expression.
Hum Mol Genet 2011, 20:36323641. PubMed Abstract  Publisher Full Text

Lo H, Wang Z, Hu Y, Yang H, Gere S, Buetow K, Lee M: Allelic variation in gene expression is common in the human genome.
Genome Res 2003, 13:18551862. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Palacios R, Gazave E, Goni J, Piedrafita G, Fernando O, Navarro A, Villoslada P: Allelespecific gene expression is widespread across the genome and biological processes.
PLoS One 2009, 4(1):e4150. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Serre D, Gurd S, Ge B, Sladek R, Sinnett D, Harmsen E, Bibikova M, Chudin E, Barker D, Dickinson T, Fan J, Hudson T: Differential allelic expression in the human genome: a robust approach to identify genetic and epigenetic cisacting mechanisms regulating gene expression.
PLoS Genet 2008, 4:e1000006. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Chen P, Feng S, Joo J, Jacobsen S, Pellegrini M: A comparative analysis of DNA methylation across human embryonic stem cell lines.
Genome Biol 2011, 12:R62. PubMed Abstract  BioMed Central Full Text  PubMed Central Full Text

Montgomery S, Sammeth M, GutierrezArcelus M, Lach R, Ingle C, Nisbett J, Guigo R, Dermitzakis E: Transcriptome genetics using second generation sequencing in a Caucasian population.
Nature 2010, 464:773U151. PubMed Abstract  Publisher Full Text

Pickrell J, Marioni J, Pai A, Degner J, Engelhardt B, Nkadori E, Veyrieras J, Stephens M, Gilad Y, Pritchard J: Understanding mechanisms underlying human gene expression variation with RNA sequencing.
Nature 2010, 464:768772. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Ju Y, Kim J, Kim S, Hong D, Park H, Shin J, Lee S, Lee W, Kim S, Yu S, Park S, Seo S, Yun J, Kim H, Lee D, Yavartanoo M, Kang H, Gokcumen O, Govindaraju D, Jung J, Chong H, Yang K, Kim H, Lee C, Seo J: Extensive genomic and transcriptional diversity identified through massively parallel DNA and RNA sequencing of eighteen Korean individuals.
Nat Genet 2011, 43:745U747. PubMed Abstract  Publisher Full Text

Tang F, Barbacioru C, Nordman E, Bao S, Lee C, Wang X, Tuch B, Heard E, Lao K, Surani M: Deterministic and stochastic allele specific gene expression in single mouse blastomeres.
PLoS One 2011, 6(6):e21208. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Barski A, Cuddapah S, Cui K, Roh T, Schones D, Wang Z, Wei G, Chepelev I, Zhao K: Highresolution profiling of histone methylations in the human genome.
Cell 2007, 129:823837. PubMed Abstract  Publisher Full Text

Johnson D, Mortazavi A, Myers R, Wold B: Genomewide mapping of in vivo proteinDNA interactions.
Science 2007, 316:14971502. PubMed Abstract  Publisher Full Text

Mikkelsen T, Ku M, Jaffe D, Issac B, Lieberman E, Giannoukos G, Alvarez P, Brockman W, Kim T, Koche R, Lee W, Mendenhall E, O’Donovan A, Presser A, Russ C, Xie X, Meissner A, Wernig M, Jaenisch R, Nusbaum C, Lander E, Bernstein B: Genomewide maps of chromatin state in pluripotent and lineagecommitted cells.
Nature 2007, 448:553560. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Robertson G, Hirst M, Bainbridge M, Bilenky M, Zhao Y, Zeng T, Euskirchen G, Bernier B, Varhol R, Delaney A, Thiessen N, Griffith O, He A, Marra M, Snyder M, Jones S: Genomewide profiles of STAT1 DNA association using chromatin immunoprecipitation and massively parallel sequencing.
Nat Methods 2007, 4:651657. PubMed Abstract  Publisher Full Text

Chen L, Wu G, Ji H: hmChIP: a database and web server for exploring publicly available human and mouse ChIPseq and ChIPchip data.
Bioinformatics 2011, 27:14471448. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

hmChIP Database [http://jilab.biostat.jhsph.edu/database/cgibin/hmChIP.pl] webcite

Degner J, Marioni J, Pai A, Pickrell J, Nkadori E, Gilad Y, Pritchard J: Effect of readmapping biases on detecting allelespecific expression from RNAsequencing data.
Bioinformatics 2009, 25:32073212. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Rozowsky J, Abyzov A, Wang J, Alves P, Raha D, Harmanci A, Leng J, Bjornson R, Kong Y, Kitabayashi N, Bhardwaj N, Rubin M, Snyder M, Gerstein M: AlleleSeq: analysis of allelespecific expression and binding in a network framework.
Mol Syst Biol 2011, 7:522. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Skelly D, Johansson M, Madeoy J, Wakefield J, Akey J: A powerful and flexible statistical framework for testing hypotheses of allelespecific gene expression from RNAseq data.
Genome Res 2011, 21:17281737. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Consortium EP: The ENCODE (ENCyclopedia Of DNA Elements) Project.
Science 2004, 306:636640. PubMed Abstract  Publisher Full Text

Bioconductor iASeq package. [http://www.bioconductor.org/packages/release/bioc/html/iASeq.html]

The ENCODE Project Consortium. An integrated encyclopedia of DNA elements in the human genome
Nature 2012, 489:5774. PubMed Abstract  Publisher Full Text

GM12878 genotype [ftp:/ / ftptrace.ncbi.nih.gov/ 1000genomes/ ftp/ pilot_data/ release/ 2010_07/ trio/ snps] webcite

Reddy T, Gertz J, Pauli F, Kucera K, Varley K, Newberry K, Marinov G, Mortazavi A, Williams B, Song L, Crawford G, Wod B, Willard H, Myers R: Effects of sequence variation on differential allelic transcription factor occupancy and gene expression.
Genome Res 2012, 22:860869. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kucera K, Reddy T, Pauli F, Gertz J, Logan J, Myers R, Willard H: Allelespecific distribution of RNA polymerase II on female X chromosomes.
Hum Mol Genet 2011, 20:39643973. PubMed Abstract  Publisher Full Text  PubMed Central Full Text