Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Highly Accessed Methodology article

SNP-based pathway enrichment analysis for genome-wide association studies

Lingjie Weng1, Fabio Macciardi2, Aravind Subramanian3, Guia Guffanti2, Steven G Potkin2*, Zhaoxia Yu4* and Xiaohui Xie15*

Author Affiliations

1 Department of Computer Science, University of California, Irvine, CA, USA

2 Department of Psychiatry & Human Behaviour, University of California, Irvine, CA, USA

3 Broad Institute of MIT and Harvard, Cambridge, MA, USA

4 Department of Statistics, University of California, Irvine, CA, USA

5 Institute for Genomics and Bioinformatics, University of California, Irvine, CA, USA

For all author emails, please log on.

BMC Bioinformatics 2011, 12:99  doi:10.1186/1471-2105-12-99

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/12/99


Received:17 June 2010
Accepted:15 April 2011
Published:15 April 2011

© 2011 Weng et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Recently we have witnessed a surge of interest in using genome-wide association studies (GWAS) to discover the genetic basis of complex diseases. Many genetic variations, mostly in the form of single nucleotide polymorphisms (SNPs), have been identified in a wide spectrum of diseases, including diabetes, cancer, and psychiatric diseases. A common theme arising from these studies is that the genetic variations discovered by GWAS can only explain a small fraction of the genetic risks associated with the complex diseases. New strategies and statistical approaches are needed to address this lack of explanation. One such approach is the pathway analysis, which considers the genetic variations underlying a biological pathway, rather than separately as in the traditional GWAS studies. A critical challenge in the pathway analysis is how to combine evidences of association over multiple SNPs within a gene and multiple genes within a pathway. Most current methods choose the most significant SNP from each gene as a representative, ignoring the joint action of multiple SNPs within a gene. This approach leads to preferential identification of genes with a greater number of SNPs.

Results

We describe a SNP-based pathway enrichment method for GWAS studies. The method consists of the following two main steps: 1) for a given pathway, using an adaptive truncated product statistic to identify all representative (potentially more than one) SNPs of each gene, calculating the average number of representative SNPs for the genes, then re-selecting the representative SNPs of genes in the pathway based on this number; and 2) ranking all selected SNPs by the significance of their statistical association with a trait of interest, and testing if the set of SNPs from a particular pathway is significantly enriched with high ranks using a weighted Kolmogorov-Smirnov test. We applied our method to two large genetically distinct GWAS data sets of schizophrenia, one from European-American (EA) and the other from African-American (AA). In the EA data set, we found 22 pathways with nominal P-value less than or equal to 0.001 and corresponding false discovery rate (FDR) less than 5%. In the AA data set, we found 11 pathways by controlling the same nominal P-value and FDR threshold. Interestingly, 8 of these pathways overlap with those found in the EA sample. We have implemented our method in a JAVA software package, called SNP Set Enrichment Analysis (SSEA), which contains a user-friendly interface and is freely available at http://cbcl.ics.uci.edu/SSEA. webcite

Conclusions

The SNP-based pathway enrichment method described here offers a new alternative approach for analysing GWAS data. By applying it to schizophrenia GWAS studies, we show that our method is able to identify statistically significant pathways, and importantly, pathways that can be replicated in large genetically distinct samples.

Background

The power of genome-wide association studies (GWAS) to discover common genetic variants associated with complex traits has been empirically demonstrated [1-6]. The single-SNP analysis tests genetic association on individual SNPs and identifies only the most significant SNPs because of the stringent statistical criteria necessary for minimizing false positive hits. The identified SNPs, however, represent only a small fraction of the genetic variants contributing to complex traits; the majority of the variations remain hidden within the statistical ''noise'' [7,8]. Genetic variants with small individual effect sizes but jointly significant genetic effects would be missed by single-SNP analysis. As a result, identified genetic variants only explain a small fraction of heritability for most studied traits[9].

It is increasingly recognized that pathway-based analysis, which considers cumulative association between the outcome and a group of SNPs or genes in a biological pathway, can greatly complement the single-SNP approach in understanding genetic determinants of common diseases as well as providing insight into the biological process of complex diseases [10-15]. A pathway-based analysis by Baranzini et al [16] not only confirmed previously identified immunological pathways but also found that neural pathways might be responsible for multiple sclerosis. Joel Hirschhorn [11] pointed out that for many diseases, different risk loci are often clustered in a common pathway, so when a study highlights the role of one or a group of loci in a disease, it also provides important insights and predictive information on the role of other loci within the same biological group. He argued that the primary goal of genome-wide association studies should not be the prediction of individual risk loci but rather the discovery of biological pathways underlying polygenic diseases and traits. The genetic variants revealed in pathway-based analysis could be used to build predictive models for complex diseases, and provide insights on how multiple genetic variants jointly contribute to the etiology of complex human diseases.

One approach for pathway association analysis of GWAS is to extend the gene set enrichment analysis (GSEA) method, which has been successfully applied in gene expression data analysis [17]. However, a key difference between gene expression analysis and GWAS analysis is that each gene in GWAS is represented by many SNPs. The challenge is to determine the number as well as which SNPs are the best representatives for each gene.

Most of the current methods for pathway analysis of GWAS data are gene-based. Wang et al. [13] used the SNP with the strongest association to represent a gene. Choosing the smallest P-value for each gene might not be optimal in situations when the joint action of multiple SNPs within a gene explains more variance than the most significant SNP. For example, if a gene contains multiple causal variants, it might not be identified by the smallest P-value method, which reduces the power of the subsequent pathway enrichment analysis. Moreover, this approach is likely to favour genes of large sizes, as genes with a larger number of SNPs have a higher chance of having significant SNPs, by chance alone. Consequently, the effects of genes with smaller numbers of SNPs would be underestimated. Holmans et al. [10] proposed ALIGATOR (Association LIst Go AnnoTatOR) method to study the significance of pathways. Although this method corrects variable gene sizes by simulations, it requires a pre-determined P-value cutoff for selecting significant SNPs and the evaluation of pathways is gene-based, not SNP-based. Yu et al. [18] used an adjusted P-value for each gene, and also treated gene as the basic unit for analysis. Since the gene-based approaches focused on testing significance at the gene-level, they may have low power to detect pathways containing only a few genes[19].

Recently, Holden et al. [20] proposed a SNP-based pathway analysis, which used all available SNPs to represent a gene. This approach is computationally intensive and might not be practical for genome-wide studies with millions of SNPs. O'Dushlaine et al. [21] developed a SNP ratio test (SRT) method which computed the ratio of the number of significant (P < 0.05) to the number of non-significant (P >= 0.05) SNPs for each pathway and used permutations to identify the significant pathways. The SNP ratio test (SRT) method computes the ratio of the number of significant (P < 0.05) to the number of non-significant (P >= 0.05) SNPs for each pathway, and uses permutations to quantify its statistical significance. If there is only one gene that contains significant SNPs, the SRT method would reduce the pathway signal to a gene signal. By contrast, our method uses adaptive rank truncated product and permutations to determine the number of representative SNPs for each gene, and each gene includes at least one SNP. Therefore contributions from multiple genes are emphasized in the pathway analysis. Another disadvantage of the SRT method is that it treats all significant SNPs equally, which can lead to a reduction of power in detecting significant pathways.

To address these limitations, we propose a new SNP-based pathway analysis method, called SNP Set Enrichment Analysis (SSEA), for GWAS studies. SSEA consists of two main steps: selecting representative SNPs for each gene, and performing pathway enrichment analysis using all selected SNPs. In the first step, we exploit an adaptive rank truncated product method with permutations to choose the most significant subset of SNPs for each gene. The number of SNPs representing a gene is not predetermined, but data driven. Then for each pathway, we calculate the average number of representative SNPs for the genes within this pathway and re-select SNPs using this number. In the second step, we modify the existing GSEA algorithm [17] to conduct the pathway enrichment analysis using all selected SNPs. We rank all SNPs selected from the first step based on their strength of association with the trait, and then test whether the set of SNPs associated within a pathway is significantly enriched with high ranks using a weighted Kolmogorov-Smirnov test. Because this test is rank-based, SNPs with smaller P-values tend to contribute more in a pathway.

Methods

Adaptive Rank Truncated Product of SNP Association

One difficulty in extending the pathway enrichment analysis of genes to SNPs is the many-to-one mapping from SNPs to genes. Generally, assigning the most significant SNP to a gene might miss other informative SNPs, while assigning too many SNPs to a gene might introduce noise and decrease statistical power. Both would introduce bias into the following pathway enrichment analysis. We select the best representative subgroup of SNPs for each gene in the following way.

For each SNP, a P-value is obtained by comparing the genotype frequencies between the cases and controls using the Pearson's chi-square test with two degrees of freedom. Extending the work of Yu et al. [18], we use an adaptive rank truncated product method. The L P-values of the L SNPs mapped to a gene are sorted from smallest to largest: p(1) p(2) ≤ ... ≤ p(L), with p(l) being the lth smallest P-value. We use to combine the first K P-values, where K is the truncation point. Permuting the phenotypes and computing the statistic in permutated data allows us to assess the overall significance of the K SNPs. In the permutation procedure, we permute the phenotype values N times to obtain N permutated datasets. For the nth permutated dataset, we denote the resulting P-values as , and calculate the corresponding . Then the P-value for evaluating W(K) is calculated by . To maximize the association of the subset of SNPs and the trait, all possible values of K are calculated and the one with the smallest P-value is chosen. The corresponding SNPs are used to represent the gene.

To avoid genes with larger number of SNPs dominating a pathway in the following SNP set enrichment analysis, and to let the contributions by more genes be emphasized in pathway analysis, we require genes in the same pathway have the same number of representative SNPs. Therefore, for each pathway, we calculate the average number of representative SNPs of genes and re-select SNPs using this number in the given pathway.

The computation needed for selecting representative SNPs for genes involves hundreds of permutations of thousands of subjects, recalculating the test statistic in each permutation based on about half a million SNPs, and testing on multiple values of the cutoff (i.e. threshold) point K. One way to limit the computational effort is to set the upper limit Kupper to 10 for the truncation point K. To further reduce the computational cost, we discard SNPs with large nominal P-values. On the other hand, if too few SNPs are selected, we might miss SNPs have low or moderate individual effects but jointly show a moderate or large effect. To seek a balance, we set a nominal threshold that is generous, say 0.05, i.e, only SNPs with P-values less than or equal to 0.05 will be selected. However, if none of the SNPs for a gene passes the threshold, the smallest SNP would be selected to avoid missing too many genes in pathway analysis. Both Kupper and P-value thresholds are changeable in our software; other values can be used depending on the situation. In our experiment, we found that 10 as Kupper and 0.05 as the P-value threshold are useful choices.

SNP-based Pathway Enrichment Analysis

To conduct pathway analysis of SNP data from GWAS, we modified an existing gene set enrichment analysis (GSEA) algorithm [17]. The original GSEA algorithm ranks all genes by their significance of differential expression and then looks for groups of biologically relevant genes that are enriched at either the top or bottom of the ranked list. To apply this idea to SNP data, we take the N selected representative SNPs across all the genes to form the SNP list, and compute the P-values for comparing genotype frequencies between cases and controls. To measure their strength of association, we define ri = Φ-1(1 - pi), i = 1,..., N, where Φ-1 is the quantile function for the standard normal distribution. Let r(1) r(2) ≥ ... ≥ r(N) be the sorted values from largest to smallest. A gene set sharing the same functional pathway is converted to a pathway consisting of SNPs. For a SNP-based pathway with NH SNPs, we calculate a weighted Kolmogorov-Smirnov-like running sum [22] to measure the deviation of the pathway from a set of randomly picked SNPs in the genome:

with. Here p is a parameter that controls the weights to ensure SNPs with higher r values tend to contribute more in the pathway level. Following the original GSEA algorithm, we set p = 1.

Statistical significance evaluation

The enrichment score is expected to be high if most SNPs within a pathway are at the top of the list. We examine the statistical significance of a pathway by a permutation procedure. In each permutation, we permute (i.e. exchange) the phenotype labels, re-compute the P-values for SNPs and the corresponding enrichment score (denoted as perm_ES). Due to the size of large-scale genetic data, computational complexity would become extremely high when the number of permutations is very large. We used 1,000 permutation-cycles to generate the permutated datasets. The nominal P-value is obtained by comparing the enrichment score for the observed phenotypes with scores computed from permutated phenotypes.

Adjustment for multiple testing is applied to control false positives. When many hypotheses are tested simultaneously, the probability that at least one type I error is committed is large. One common approach for accounting for multiple testing is to control the false discovery rate (FDR) [23]. The FDR is the expected proportion of falsely rejected hypotheses out of the rejected hypotheses. One can also control the family wise error rate (FWER), which is the probability of making one or more type I errors among the family of hypothesis tests. When the number of tests is large and some of the test hypotheses are in fact false, FWER is too conservative. Since multiple pathways might be involved in a complex trait, FDR, which controls the expected proportion of false discoveries, is more suited to identifying pathways relevant to a trait. To account for multiple testing in our pathway analyses, we used a robust method to estimate the false discovery rate proposed by Pounds and Cheng [24]. The q-value is the minimum FDR at which the test is called significant. For a given significant level α, the point estimate of q-value (α) is defined as

where FDR(t) denotes an estimate of the proportion of tests when rejecting all null hypotheses with P-values less than or equal to the significance threshold t.

Results

To perform SNP-based pathway enrichment analysis of GWAS data, we developed a JAVA based software package called SNP Set Enrichment Analysis (SSEA) by extending the original GSEA code. SSEA consists of four procedures as outlined in Figure 1: 1) calculating the P-value of the association of each SNP to a trait of interest, 2) selecting representative SNPs for each gene using an adaptive SNP combination method, calculating the average number of representative SNPs for genes in each pathway and reselecting SNPs for gene in each pathway, 3) ranking all selected SNPs by their P-values and testing if the SNPs from a pathway are enriched with high ranks, and 4) calculating the FDR of the discovered pathways. See Methods for details.

thumbnailFigure 1. A diagram of procedures involved in SNP set enrichment analysis (SSEA).

We applied SSEA to two large genetically distinct GWAS data sets for schizophrenia from the Genetic Association Information Network (GAIN, http://www.genome.gov/19518664 webcite) studies [25], available at the database of Genotype and Phenotype (dbGaP) [26]. The study version we reported here is phs000021.v2.p1 with general research use consent, which includes two samples; one is from the European American (EA) ancestry and the other one is from African American (AA) ancestry. Individuals in those two cohorts represent two genetically distinct populations [27,28]. However, we should note that the two data sets were collected and quality controlled in a similar way, which might affect the independence of the two data sets. Both samples were genotyped by the Affymetrix SNP array 6.0. With GAIN quality-control criteria and after removing redundant subjects, the data sets included 1172 cases and 1378 controls in EA and 921 cases and 954 controls in AA. Since Linkage Disequilibrium (LD) is an important concern for selecting representative SNPs for each gene, we used Plink http://pngu.mgh.harvard.edu/~purcell/plink/ webcite to prune SNPs that are in strong LD (Plink uses 0.5 as the default pairwise R2 threshold, Supplementary Table 3 in Additional file 1). The final data used in our study consisted of 245,216 SNPs in EA and 482,914 SNPs in AA. The SNPs were assigned to genes on the basis of being located within the gene or up to 20 kb from the gene. Most genes are associated with more than one SNP; we applied the adaptive rank truncated product of SNP association algorithm described in Method to selected representative SNPs for each gene. For pathways, we used 215 experimentally validated pathways from the KEGG database[29] (Release 55, accessed 12 September).

Additional file 1. Supplementary tables and figures on genes and pathways. Supplementary tables and figures on genes and pathways discovered by SSEA.

Format: PDF Size: 167KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Application of SSEA to the two schizophrenia data sets resulted in the discovery of 22 pathways in the EA data set and 11 pathways in the AA data set with the nominal P-value less than or equal to 0.001. Using this P-value cut-off, the overall FDR is controlled within 5% for both data sets. The list of identified pathways from each sample is shown in Additional file 1 and 2, together with the related gene information.

Additional file 2. Detailed information on replicated pathways. A excel file containing detailed information on replicated pathways.

Format: XLSX Size: 63KB Download fileOpen Data

Interestingly, the two data sets share 8 significant pathways; we used Monte Carlo simulation to assess the significance of sharing and found the P-value is less than 1.0E-6. To examine whether our method detects biologically relevant pathways or random combinations of genes, we permutated genes and generated 215 random pathways for both EA and AA data sets; Our method only detected 6 significant pathways (P <= 0.001) in EA and 3 in AA, and none of them is shared, indicating that the number of significant pathways detected by our methods is more than what expected by chance, and those significant pathways are likely to be biologically relevant. The list of the 8 replicated pathways are shown in Table 1, together with their nominal P-values, the gene set sizes and the SNP set sizes associated with each pathway, and the full list of 22 significant pathways in EA and 11 significant pathways in AA are shown in Additional file 2.

Table 1. Eight significant pathways (P <= 0.001) discovered in both European-American ancestry and African-American ancestry data sets of schizophrenia

Schizophrenia [MIM 181500] is a complex brain disorder characterized by disturbances in multiple domains of brain function, including cognitive, emotional, and perceptual processes [30]. Evidence for schizophrenia as a neurodevelopment disorder began more than 30 years ago [31] and has been accepted commonly [32]. It is intriguing to note that the 8 pathways discovered by SSEA in both the EA and AA samples included 4 pathways important for neurodevelopment and neuronal functioning, such as axon guidance pathway, neuroactive ligand-receptor interaction pathway, long-term depression pathway and long-term potentiation pathway. Axon guidance pathway and neuroactive ligand-receptor interaction pathway are directly related to neuroplasticity and neuropathology, and thus are important to the genetic mechanism of schizophrenia [33]. Long-term depression pathway and long-term potentiation pathway were reported to be important for synaptic plasticity development and related to schizophrenia [34,35]. Besides, axon guidance pathway, long-term depression pathway and long-term potentiation pathway were reported in a recent study where pathways were overrepresented by genes disrupted by copy number variants in schizophrenia cases [36]. Genes in the focal adhesion pathway are principally involved in the biological processes for synaptic transmission and cell adhesion [37]. In addition, arrhythmogenic right ventricular cardiomyopathy (ARVC) pathway is related to cardiovascular disease, which supports the previous study that patients with schizophrenia had higher rates of cardiovascular disease and mortality compared with the general population [38,39]. We took a further investigation of gene intersections in the remaining two non-schizophrenia specific pathways. We found the calcium signalling pathway shared 40 (24%) genes with long-term potentiation pathway, while vascular smooth muscle contraction shared 40(37%) genes with long-term depression pathway; the same genes implicated in different pathways might be a reason for their enrichment in our study.

As a comparison, we also applied another two methods, smallest P-value and PLINK set-based tests [40], to the two GAIN data sets. The smallest P-value method, which only used the SNP with the smallest P-value to represent a gene, detected 6 and 2 significant pathways in EA and AA data sets, respectively; only one was shared by both data sets. This showed our method could improve the power of detecting causal pathways by using multiple SNPs to represent a gene. For the set-based test method (with parameters --set-p 0.05, --set-r2 0.5, the same as that in our method), 3 significant pathways were detected in EA, and 2 in AA, but none was shared between the two data sets. One reason for the loss of power of these two methods might be their favouring of pathways containing large numbers of genes and genes with large number of SNPs, as larger pathways are expected to show more significant genes or SNPs just by chance. We checked several potential factors that might affect pathway significance: pathway size, gene size, total bp content, and average content. We found these factors are uncorrelated with pathway significance (Supplementary Figure 1a,b,c,d in Additional file 1), confirming that using multiple representative SNPs per gene and permutations are able to reduce the bias introduced by gene and pathway sizes.

Relaxing the nominal P-value cut-off to 0.01, with FDR q-value controlled within 10%, resulted in 40 significant pathways detection in EA data set, and 27 significant pathways in AA data set. Among them, 17 pathways are shared (Monte Carlo simulation P-value for sharing is less than 1.0e-6). The full list of 17 shared pathways is shown in Table 2.

Table 2. Seventeen significant pathways (P <= 0.01) discovered in both European-American and African-American ancestry samples of schizophrenia

Discussion

The traditional strategy for GWAS studies tests one SNP at a time. Although widely used, single-SNP GWAS analysis does not have adequate power to detect SNPs that have marginally weak, but jointly strong genetic effects. Jointly analyzing SNPs within the same biological pathway simultaneously complements the single-SNP analysis and can reveal new insights to the understanding of complex human traits. Our SNP set enrichment analysis operates on representative SNPs of genes and then combines the effects of SNPs within the same pathway by a weighted Kolmogorov-Smirnov running sum statistic test [22]. This strategy has the potential to increase the chance of identifying genetic variants that that individually have a modest risk.

Compared to gene set enrichment analysis, the SNP set enrichment analysis is a much larger scale and is more computationally challenging. Several pathway-based methods have recently been developed to analyse GWAS [13,20,41-44]. In general, these methods can be classified into two categories, depending upon how representative SNPs for each gene are chosen: one selects the most significant SNP per gene, and the other selects all SNPs located within a gene [20]. Both approaches have limitations. Using all available SNPs per gene not only poses computational challenges, but also introduces significant amounts of noise into the analysis. Using the most significant SNP per gene might miss SNPs with moderate strength individually but strong effects jointly, and in addition it introduces biases of favouring large extensive pathways and genes with greater numbers of SNPs. The SSEA method we proposed uses an adaptive approach to choose SNPs in each gene, and can eliminate the limitations of other strategies.

It is also worthy to point out that the number of selected SNPs varies between genes. This is because we used permutations to decide both the number and the set of SNPs to represent each gene. The permutation of phenotypes and recalculation of statistical values for about half a million SNPs and thousands of subjects is computationally expensive. To seek a balance between the computational complexity and not losing too much information from SNPs, we set a nominal significance threshold chose only SNPs with smaller P-value for pathway analysis. To further reduce computation, we recommend using an upper limit for the number of representative SNPs for each gene.

Our method has a critical assumption. In combing P-values of SNPs in a gene we assume that the P-values are independent, although in reality some SNPs in a gene are in linkage disequilibrium (LD). When comparing the results with and without removing SNPs in strong LD, we found there is no big difference between them. However, a future direction is to relax this assumption and develop a SNP selection method that explicitly takes the LD patterns into account rather than remove SNPs in LD. It is interesting to note that Peng et al. [15] also found that ignoring LD could actually lead to better results than methods with very conservative multiple testing corrections. The permutation test we consider might partially alleviate the effect due to LD.

A critical component for the success of the pathway-based analysis is the availability of a comprehensive collection of relevant gene sets related to the disease/genetic trait of interest. Current understanding of gene functions and pathways is still very limited. This is especially the case for neuropsychiatric diseases, as most of the gene sets currently available were generated based on experiments done on tumor cell lines. As a consequence, we have only limited knowledge regarding the pathways involved in brain development, and normal and pathological activities. In this regard, the pathways discovered by SSEA for schizophrenia are likely to be substantially incomplete. We expect the performance would improve as better and more comprehensive disease-related pathways become available. A future challenge is to curate pathways and gene sets in a disease specific way, possibly by taking advantage of the high-throughput functional genomics tools.

Conclusion

In summary, we have developed a new SNP-based method, called SNP Set Enrichment Analysis (SSEA), for pathway analysis of GWAS data. SSEA selects a multiple and varying number of SNPs to represent each gene using an adaptive truncated product statistic. The selected SNPs are then ranked and enrichment of pathways is tested using a weighted Kolmogorov-Smirnov test. We tested SSEA in two genetically distinct GWAS studies of schizophrenia with large samples, and discovered 22 significant pathways in the European-American sample and 11 significant pathways in the African-American sample. Eight important pathways were found in both distinct samples providing support for our method.

The SSEA method is coded in a JAVA software package with a user-friendly interface. The software is freely available at http://cbcl.ics.uci.edu/SSEA/ webcite.

Authors' contributions

Designed the experiments: WL, SGP, YZ and XX; Performed the experiments: WL; Wrote the paper: WL, FM, YZ, and XX; All authors contributed to the analysis, and approved the paper.

Acknowledgements

We would like to thank helpful discussions with Daniel Newkirk, and Anita Lakatos and Alvin Chon. The research was partly supported by an NIH grant to SGP, an NIH grant to YZ, and a NSF grant to XX.

References

  1. Nb F, C S: Human genetics: variants in common diseases.

    Nature 2007, 445:828-830. PubMed Abstract | Publisher Full Text OpenURL

  2. Control TWTC: Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls.

    Nature 2007, 447:661-678. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. R S, G R, J REA: A genome-wide association study identifies novel risk loci for type 2 diabetes.

    Nature 2007, 445:881-885. PubMed Abstract | Publisher Full Text OpenURL

  4. Zeggini E, Weedon MN, Lindgren CM, Frayling TM, Elliott KS, Lango H, Timpson NJ, Perry JRB, Rayner NW, Freathy RM, et al.: Replication of genome-wide association signals in UK samples reveals risk loci for type 2 diabetes.

    Science (New York, NY) 2007, 316:1336-1341. Publisher Full Text OpenURL

  5. Gudmundsson J, Sulem P, Gudbjartsson DF, Blondal T, Gylfason A, Agnarsson Ba, Benediktsdottir KR, Magnusdottir DN, Orlygsdottir G, Jakobsdottir M, et al.: Genome-wide association and replication studies identify four variants associated with prostate cancer susceptibility.

    Nature genetics 2009, 41:1122-1126. PubMed Abstract | Publisher Full Text OpenURL

  6. Ca H, N P, Ml FEA: Multiple regions within 8q24 independently affect risk for prostate cancer.

    Nat Genet 2007, 39:638-644. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Dc T: The need for a systematic approach to complex pathways in molecular epidemiology.

    Cancer Epidemiol Biomarkers Prev 2005, 14:557-559. PubMed Abstract | Publisher Full Text OpenURL

  8. D S, Lk V, Ma P: Problems with genome-wide association studies.

    Science 2007, 316:1840-1842. PubMed Abstract | Publisher Full Text OpenURL

  9. Goldstein DB: Common genetic variation and human traits.

    The New England journal of medicine 2009, 360:1696-1698. PubMed Abstract | Publisher Full Text OpenURL

  10. Holmans P, Green EK, Pahwa JS, Ferreira MaR, Purcell SM, Sklar P, Owen MJ, O'Donovan MC, Craddock N: Gene ontology analysis of GWA study data sets provides insights into the biology of bipolar disorder.

    American journal of human genetics 2009, 85:13-24. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Hirschhorn JN: Genomewide association studies--illuminating biologic pathways.

    The New England journal of medicine 2009, 360:1699-1701. PubMed Abstract | Publisher Full Text OpenURL

  12. Curtis RK, Oresic M, Vidal-Puig A: Pathways to the analysis of microarray data.

    Trends in biotechnology 2005, 23:429-435. PubMed Abstract | Publisher Full Text OpenURL

  13. Wang K, Li M, Bucan M: Pathway-Based Approaches for Analysis of Genomewide Association Studies.

    American journal of human genetics 2007, 81:1278-1283. Publisher Full Text OpenURL

  14. Kraft P, Raychaudhuri S: Complex diseases, complex genes: keeping pathways on the right track.

    Epidemiology (Cambridge, Mass) 2009, 20:508-511. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Peng G, Luo L, Siu H, Zhu Y, Hu P, Hong S, Zhao J, Zhou X, Reveille JD, Jin L, et al.: Gene and pathway-based second-wave analysis of genome-wide association studies.

    European journal of human genetics: EJHG 2010, 18:111-117. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Baranzini SE, Galwey NW, Wang J, Khankhanian P, Lindberg R, Pelletier D, Wu W, Uitdehaag BM, Kappos L, Polman CH, et al.: Pathway and network-based analysis of genome-wide association studies in multiple sclerosis.

    Hum Mol Genet 2009, 18:2078-2090. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  17. Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, et al.: Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles.

    Proceedings of the National Academy of Sciences 2005, 102:15545-15550. Publisher Full Text OpenURL

  18. Yu K, Li Q, Bergen AW, Pfeiffer RM, Rosenberg PS, Caporaso N, Kraft P, Chatterjee N: Pathway Analysis by Adaptive Combination of P-Values.

    Cancer 2009, 1-10. OpenURL

  19. Cantor RM, Lange K, Sinsheimer JS: Prioritizing GWAS results: A review of statistical methods and recommendations for their application.

    American journal of human genetics 2010, 86:6-22. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  20. Holden M, Deng S, Wojnowski L, Kulle B: GSEA-SNP: applying gene set enrichment analysis to SNP data from genome-wide association studies.

    Bioinformatics (Oxford, England) 2008, 24:2784-2785. PubMed Abstract | Publisher Full Text OpenURL

  21. C Od, E K, Ea H, R S, M G, Dw M: The SNP ratio test: pathway analysis of genome-wide association datasets.

    Bioinformatics 2009, 25:2762-2763. PubMed Abstract | Publisher Full Text OpenURL

  22. Hollander M, Wolfe DA: Nonparametric statistical methods. New York: Wiley; 1999.

  23. Benjamini Y, Hochberg Y: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.

    Journal of the Royal Statistical Society, Series B (Methodological) 1995, 57:289-300. OpenURL

  24. Pounds S, Cheng C: Robust estimation of the false discovery rate.

    Bioinformatics 2006, 22(16):1979-1987. PubMed Abstract | Publisher Full Text OpenURL

  25. Manolio TA, Rodriguez LL, Brooks L, Abecasis G, Ballinger D, Daly M, Donnelly P, Faraone SV, Frazer K, Gabriel S, et al.: New models of collaboration in genome-wide association studies: the Genetic Association Information Network.

    Nat Genet 2007, 39(9):1045-1051. PubMed Abstract | Publisher Full Text OpenURL

  26. Mailman MD, Feolo M, Jin Y, Kimura M, Tryka K, Bagoutdinov R, Hao L, Kiang A, Paschall J, Phan L, et al.: The NCBI dbGaP database of genotypes and phenotypes.

    Nat Genet 2007, 39(10):1181-1186. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  27. Bowcock AM, Kidd JR, Mountain JL, Hebert JM, Carotenuto L, Kidd KK, Cavalli-Sforza LL: Drift, admixture, and selection in human evolution: a study with DNA polymorphisms.

    Proc Natl Acad Sci USA 1991, 88(3):839-843. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Tishkoff SA, Dietzsch E, Speed W, Pakstis AJ, Kidd JR, Cheung K, Bonne-Tamir B, Santachiara-Benerecetti AS, Moral P, Krings M: Global patterns of linkage disequilibrium at the CD4 locus and modern human origins.

    Science 1996, 271(5254):1380-1387. PubMed Abstract | Publisher Full Text OpenURL

  29. Kanehisa M, Goto S: KEGG: kyoto encyclopedia of genes and genomes.

    Nucleic Acids Res 2000, 28(1):27-30. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  30. Lewis DA, Lieberman JA: Catching Up on Schizophrenia: Natural History and Neurobiology.

    2000, 28:325-334. PubMed Abstract | Publisher Full Text OpenURL

  31. Weinberger DR, Cannon-Spoor E, Potkin SG, Wyatt RJ: Poor premorbid adjustment and CT scan abnormalities in chronic schizophrenia.

    Am J Psychiatry 1980, 137(11):1410-1413. PubMed Abstract | Publisher Full Text OpenURL

  32. Miyamoto S, LaMantia AS, Duncan GE, Sullivan P, Gilmore JH, Lieberman JA: Recent advances in the neurobiology of schizophrenia.

    Mol Interv 2003, 3(1):27-39. PubMed Abstract | Publisher Full Text OpenURL

  33. Skinner MK, Anway MD, Savenkova MI, Gore AC, Crews D: Transgenerational epigenetic programming of the brain transcriptome and anxiety behavior.

    PLoS One 2008, 3(11):e3745. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  34. Collingridge GL, Peineau S, Howland JG, Wang YT: Long-term depression in the CNS.

    Nat Rev Neurosci 11(7):459-473. PubMed Abstract | Publisher Full Text OpenURL

  35. Guo AY, Sun J, Riley BP, Thiselton DL, Kendler KS, Zhao Z: The dystrobrevin-binding protein 1 gene: features and networks.

    Mol Psychiatry 2009, 14(1):18-29. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Walsh T, McClellan JM, McCarthy SE, Addington AM, Pierce SB, Cooper GM, Nord AS, Kusenda M, Malhotra D, Bhandari A, et al.: Rare structural variants disrupt multiple genes in neurodevelopmental pathways in schizophrenia.

    Science 2008, 320(5875):539-543. PubMed Abstract | Publisher Full Text OpenURL

  37. Ertel A, Tozeren A: Switch-like genes populate cell communication pathways and are enriched for extracellular proteins.

    BMC Genomics 2008, 9:3. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  38. Buda M, Tsuang MT, Fleming JA: Causes of death in DSM-III schizophrenics and other psychotics (atypical group). A comparison with the general population.

    Arch Gen Psychiatry 1988, 45(3):283-285. PubMed Abstract | Publisher Full Text OpenURL

  39. Curkendall SM, Mo J, Glasser DB, Rose Stang M, Jones JK: Cardiovascular disease in patients with schizophrenia in Saskatchewan, Canada.

    J Clin Psychiatry 2004, 65(5):715-720. PubMed Abstract | Publisher Full Text OpenURL

  40. Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MA, Bender D, Maller J, Sklar P, de Bakker PI, Daly MJ, et al.: PLINK: a tool set for whole-genome association and population-based linkage analyses.

    Am J Hum Genet 2007, 81(3):559-575. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  41. Kishi T, Ikeda M, Kitajima T, Yamanouchi Y, Kinoshita Y, Kawashima K, Okochi T, Inada T, Ozaki N, Iwata N: Genetic association analysis of tagging SNPs in alpha4 and beta2 subunits of neuronal nicotinic acetylcholine receptor genes (CHRNA4 and CHRNB2) with schizophrenia in the Japanese population.

    Journal of neural transmission (Vienna, Austria: 1996) 2008, 115:1457-1461. PubMed Abstract | Publisher Full Text OpenURL

  42. Torkamani A, Topol EJ, Schork NJ: Pathway analysis of seven common diseases assessed by genome-wide association.

    Genomics 2008, 92:265-272. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  43. Hong M-G, Pawitan Y, Magnusson PKE, Prince Ja: Strategies and issues in the detection of pathway enrichment in genome-wide association studies.

    Human genetics 2009, 126:289-301. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  44. Zhong H, Yang X, Kaplan LM, Molony C, Schadt EE: Integrating pathway analysis and genetics of gene expression for genome-wide association studies.

    American journal of human genetics 2010, 86:581-591. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL