Email updates

Keep up to date with the latest news and content from BMC Genomics and BioMed Central.

Open Access Database

Neurocarta: aggregating and sharing disease-gene relations for the neurosciences

Elodie Portales-Casamar, Carolyn Ch’ng, Frances Lui, Nicolas St-Georges, Anton Zoubarev, Artemis Y Lai, Mark Lee, Cathy Kwok, Willie Kwok, Luchia Tseng and Paul Pavlidis*

Author Affiliations

Centre for High-Throughput Biology and Department of Psychiatry, University of British Columbia, 2125 East Mall, Vancouver, BC V6T1Z4, Canada

For all author emails, please log on.

BMC Genomics 2013, 14:129  doi:10.1186/1471-2164-14-129


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2164/14/129


Received:31 July 2012
Accepted:23 February 2013
Published:26 February 2013

© 2013 Portales-Casamar et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Understanding the genetic basis of diseases is key to the development of better diagnoses and treatments. Unfortunately, only a small fraction of the existing data linking genes to phenotypes is available through online public resources and, when available, it is scattered across multiple access tools.

Description

Neurocarta is a knowledgebase that consolidates information on genes and phenotypes across multiple resources and allows tracking and exploring of the associations. The system enables automatic and manual curation of evidence supporting each association, as well as user-enabled entry of their own annotations. Phenotypes are recorded using controlled vocabularies such as the Disease Ontology to facilitate computational inference and linking to external data sources. The gene-to-phenotype associations are filtered by stringent criteria to focus on the annotations most likely to be relevant. Neurocarta is constantly growing and currently holds more than 30,000 lines of evidence linking over 7,000 genes to 2,000 different phenotypes.

Conclusions

Neurocarta is a one-stop shop for researchers looking for candidate genes for any disorder of interest. In Neurocarta, they can review the evidence linking genes to phenotypes and filter out the evidence they’re not interested in. In addition, researchers can enter their own annotations from their experiments and analyze them in the context of existing public annotations. Neurocarta’s in-depth annotation of neurodevelopmental disorders makes it a unique resource for neuroscientists working on brain development.

Keywords:
Phenotype; Genes; Knowledgebase; Brain development

Background

There is a tremendous amount of research focusing on understanding the genetic basis of disease. Studies use a wide range of strategies, including targeted gene approaches, genome-wide screens, and animal models. As such studies continue to proliferate and provide insights on specific disorders, it is important to integrate the information in order to make the best use of the data and increase the level of insight that can be gained from new studies. Knowledge that crosses studies and disorders can be used to perform meta-analyses, to uncover commonalities among conditions, and to tease apart the factors that contribute to phenotypes that make up a disorder. However, currently, information about the genetic and molecular basis of diseases is distributed among a range of specialized or generic data resources, hindering its optimal use [1]. Examples of more or less generic databases are Online Mendelian Inheritance in Man (OMIM) [2], the Rat Genome Database (RGD) [3], and the Comparative Toxicogenomics Database (CTD) [4]. While these different resources overlap in their disease coverage and data sources, they are also complementary in that each of the curation teams making the annotations has different criteria for inclusion and different biases. Other databases are dedicated to specific disorders, these include the Simons Foundation Autism Research Initiative Gene Database (SFARI Gene) for autism [5], PDGene for Parkinson’s disease [6], Alzgene for Alzheimer’s disease [7], MSGene for multiple sclerosis [8], ADHDgene for Attention Deficit Hyperactivity Disorder [9], and CADgene for Coronary Artery Disease [10].

The resource we describe was motivated by the establishment of a large Canadian research network “NeuroDevNet”, with the goal of translating knowledge into improved diagnosis, prevention and treatment of neurodevelopmental disorders [11,12]. To facilitate the design and interpretation of genetics studies, we recognized the need for a resource that captures existing information, but none of the resources mentioned above was sufficiently comprehensive. This was in part because genetic investigations of two of the disorders of interest to NeuroDevNet, Fetal Alcohol Spectrum Disorder (FASD) and Cerebral Palsy (CP) were not well covered by any existing database.

Neurocarta is an online resource focusing on the genetic basis of neurodevelopmental disorders. In addition to containing manually curated information on disorders of interest to neurodevelopmental researcher, Neurocarta aggregates data from multiple disease gene resources so that the neurodevelopmental annotations can be examined in the context of other disease annotations, providing a better understanding of how generic the function of the gene might be.

Construction and content

Database schema and implementation

Neurocarta was developed as an extension of Gemma [13], a database and software system for the meta-analysis of functional genomics data. Figure 1 shows a simplified schematic of our data model used to capture information linking genes and phenotypes. The “Gene” information is retrieved automatically as part of the Gemma framework from the NCBI Gene database [14]. Gemma currently focuses on a set of selected species: human, mouse, rat, zebrafish, fly, worm, and yeast. The “Phenotype” information includes terms describing diseases, symptoms, and abnormal physical characteristics, drawn from three distinct ontologies: (i) Disease Ontology [15]; (ii) Human Phenotype Ontology [16]; and (iii) Mammalian Phenotype Ontology [17]. The “Evidence” corresponds to annotations linking a specific gene to a specific phenotype. This evidence can be of several types: (i) Literature (reference from PubMed [18]); (ii) Experimental (details about experimental design, from a published article or not); and (iii) User comment. Where possible, links are provided to the original source of the evidence (e.g., public database, review article), and can be defined as “positive” or “negative”, where “negative” means that the evidence shows that there is no association between a gene and a phenotype. All evidence annotations use standardized terminologies such as the Ontology for Biomedical Investigations [19] to facilitate users’ interpretation and enable computational analysis. Currently we do not attempt to capture information on the specific genetic variants associated with the disease as such information is frequently not readily available in computable form, making acquisition challenging.

thumbnailFigure 1. Gene-to-phenotype association data model in Neurocarta.

Neurocarta benefits from the registration system implemented in Gemma [13] allowing users the option of registering and entering their own annotations. The annotations can be set to be either public or private. When private, the owner can decide whom to share them with, using a group-based authorization framework.

Database content

Our database currently contains more than 30,000 lines of evidence linking over 7,000 genes to 2,000 different phenotypes (For detailed statistics, see http://www.chibi.ubc.ca/Gemma/neurocartaStatistics.html webcite). Figure 2 shows the distribution of genes (2A) and phenotypes (2B) based on how many distinct associations they are a part of. Tables 1 and 2 detail the top ten genes and phenotypes, respectively, with the most distinct associations. The associations are derived from manual annotations from the literature and automatic annotations from public databases.

thumbnailFigure 2. Distribution of genes (2A) and phenotypes (2B) based on their number of distinct associations. Each ontology term is considered a distinct phenotype regardless of its position in the ontology tree. Therefore, a gene will be counted as associated with two distinct phenotypes if different lines of evidence link it to a child term and its parent term.

Table 1. Top ten genes with the most associated phenotypes

Table 2. Top ten phenotypes with the most associated genes

Data extraction from external sources

We have defined stringent criteria for automatic inclusion of data from external sources, with the goal of limiting the inclusion of unreliable data or information that we deem of limited utility to our target audience. In this section we provide details of procedures for each resource. As we are continuing to add resources to the system, information on the inclusion criteria and import procedures is also maintained on the Neurocarta website at http://gemma-doc.chibi.ubc.ca/neurocarta/data-sources webcite.

OMIM [2]: The OMIM data files (morbidmap.txt and mim2gene.txt) are downloaded from the OMIM FTP site. We extract unique mappings between Phenotype MIM numbers and Gene MIM numbers from morbidmap.txt and map the genes to their NCBI identifiers in mim2gene.txt.

RGD [3]: The RGD Gene-Disease association files (homo_genes_rdo, mus_genes_rdo, rattus_genes_rdo) are downloaded from the RGD FTP site. Annotations with the following evidence codes are ignored: ISS (redundant across species), NAS (non-traceable author’s statements are debatable), and IEA (electronic annotations come from other sources, GAD for example) and we prefer to get these annotations directly from the source). Annotations without a PubMed reference are ignored as well.

CTD [4]: The CTD Gene-Disease association file (CTD_genes_diseases.tsv) is downloaded from the CTD website. We only consider curated annotations with Direct Evidence set to “marker/mechanism” or “therapeutic”, and at least one PubMed reference.

Disease-specific databases: The SFARI [5] annotation files (autism-gene-dataset.csv, gene-score.csv) are downloaded form the SFARI Gene website. Each PubMed reference is imported as separate literature evidence in Neurocarta, with the option of it being defined as “negative” whenever specified in the annotation file. The PDGene [6], AlzGene [7], and MSGene [8] “Top Results” are extracted from their respective websites. All three databases assess their results for their epidemiological credibility using two methods: (1) The HuGENet interim criteria for the cumulative assessment of genetic associations [20,21], and (2) Bayesian analyses [22,23]. Only meta-analysis results with P-values <0.00001 are considered. The “Hot gene list” from ADHDgene [9] is extracted from their website. This list includes all genes that have been identified in at least five independent studies. The ALSoD [24] top 20 genes are identified through the credibility score analysis provided on their website. The genes are ranked by the number of affected patients and by the number of mutations per gene, and the ranks are summed to determine the final rank for each gene. For the IDGene [25] and EpiGAD [26] databases, we wanted to extract more information than what was readily accessible through respective websites. We manually reviewed the genes listed in each database and used that information as a seed for targeted PubMed searches and manual curation of relevant publications.

Disease mapping from external sources to Disease Ontology (DO) terminology

For the disorder-specific databases we use the corresponding appropriate terms in DO (e.g., “autism spectrum disorder” for SFARI and “amyotrophic lateral sclerosis” for ALSoD). As described next, for other databases we used a combination of automatic and semi-automatic methods for mapping.

OMIM, RGD, and CTD: These three resources provide OMIM or MeSH terms that we mapped to DO terms as follows. First, we use the Xref mappings provided in the Human_DO.obo ontology file, which covers about 50% of the phenotype-gene mappings in these resources. For the remaining that use terms lacking a DO Xref, we use the NCBO Annotator Web service [27] followed by manual quality control to resolve partial matches, increasing coverage substantially. In total about 2/3 of the phenotype-gene associations present in OMIM, RGD, or CTD could be mapped to a DO term. This is due to non-disease terms that are listed in OMIM but not in DO (e.g., “Blood type”, “Ig levels”), and some disease terms missing from DO (mostly syndromic, e.g., TARP syndrome, Jawad syndrome), or missed mappings. We have notified the DO maintainers of these gaps and expect to eventually be able to import a greater fraction of these annotations into Neurocarta.

Manual curation of the literature

While the Neurocarta framework is generic, our curation team is focusing on annotations relevant to our primary research interest, neurodevelopmental disorders. In-depth annotations have been produced on the following Disease Ontology terms (including respective children terms): (i) “Autism Spectrum Disorder” (ASD; DOID_0060041); (ii) “Cerebral Palsy” (CP; DOID_1969); (iii) “Fetal Alcohol Spectrum Disorder” (FASD; DOID_0050696); (iv) “Epilepsy” (DOID_1826); and (v) and “Intellectual disability” (DOID_1059). When necessary, phenotype descriptions were complemented with more descriptive Human or Mammalian Phenotype Ontology terms such as “Memory impairment” (HP_0002354), “EEG abnormality” (HP_0002353), or “decreased brain size” (MP_0000774). Curators review the literature using PubMed searches across all fields (that is, the default PubMed setting) using queries such as “epilepsy” AND “genetics”. We avoid making searches that are gene-centric, except as a secondary mechanism to find additional citations on a gene-phenotype relationship identified through initial screening. When possible, review papers are used to identify primary research papers, which are then curated as “Experimental Type Evidence”. The curators record details about the experiment using controlled vocabularies, categorized as (for example) “Bio Source”, “Experiment Design”, or “Developmental Stage”. The criterion for inclusion is an experimentally-supported statement linking the gene to the phenotype. The exception is genome-wide studies where the results were not yet confirmed by follow-up experiments. The curated papers involve a wide variety of experiments including both animal models and human studies. For the former, if the authors describe the animal model as a specific model for the disorder of interest, the curators associate the gene studied in the paper directly to the human disease. If the authors describe an endophenotype that is related to the disease, the gene is associated to the endophenotype only. In some cases, review papers are used as the source of the annotations instead of drilling down to the original research papers. In that case, it is curated as “Literature Type Evidence” with no details about the experiments. To help users navigate through the evidence, we are, when possible, associating phenotypes to genes in a species-specific way. So, for instance, if the evidence comes from an experiment done in rats, it will be linked in Neurocarta to the rat gene.

Utility and discussion

User interface

Figure 3 shows the main Neurocarta user interface, which is divided into three panels. The left panel lists all phenotypes currently annotated in our system, displayed as a tree of terms in the ontologies, or as a simple list. By clicking on a checkbox next to the phenotype term, one or more phenotypes can be selected and it affects the display in the other two panels. The top-right panel shows the list of genes associated with the selected phenotype(s). If more than one phenotype are selected, only genes that are associated with all of the phenotypes are listed (i.e., the intersection of genes associated with each phenotype). A download button allows users to download the displayed gene lists. Once a gene of interest is selected, the bottom-right panel shows the list of evidence for all phenotype associations annotated for this gene, each row being expandable to provide more details. Evidence for the currently selected phenotype(s) and their children terms are highlighted in red. Evidence for other phenotypes associated with the gene are shown in black. Evidence inferred from an orthologous gene, as defined in the NCBI Homologene resource [14], are displayed in grey. Links are provided to the original source of the evidence when available. Users can filter the data displayed to restrict to a specific species, or to the annotations they have entered in Neurocarta.

thumbnailFigure 3. Neurocarta user interface.

Use cases

Neurocarta was originally conceived to help researchers identify candidate genes that might be involved in their disorder of interest, based on existing knowledge, and put that information in the context of other phenotypes associated with the genes. Neurocarta allows users to extract the list of genes that have been associated to a specific disorder, look at the detail of the evidence, and apply further selection criteria. It can also be used to identify relevant literature pertaining to a gene or phenotype of interest. By aggregating data from multiple sources, we enable a global view of each gene’s involvement in diseases, facilitating the identification of genes specifically involved in one disorder versus genes involved in many disease processes. Such candidate gene lists can be used by researchers who perform genome-wide studies, helping them identifying the most likely candidates in their results. It can also inform more targeted approaches as to which gene to include in the study. Another unique aspect of Neurocarta is the ability that users have to enter their own annotations. This enables them to share unpublished results with collaborators as well as put their findings in the context of existing data and facilitate interpretation.

Investigating gene-to-phenotype associations for neurodevelopmental disorders

We gathered positive associations from Neurocarta (March 12, 2012). There were 14,983 unique gene-phenotype associations, consisting of many-to-many relationships between 4,560 genes and 1,555 phenotypes (Disease Ontology terms only). We decided to focus our analysis on neurodevelopmental disorders since we performed in-depth annotations on them. We categorized the genes based on which disease they were annotated for (ASD, CP, or FASD) and defined them as being “specific” if they were only associated with this one disease (Table 3). We observed that ASD has the largest fraction of specific genes. To try to better understand where the difference might come from, we decided to investigate whether or not biases might be present in the data. Previous work in our lab [28] showed that genes associated with diseases tend to be more “multifunctional” (i.e., they have more Gene Ontology (GO) [29] annotations). Therefore, we predicted that genes in Neurocarta would have a multifunctionality bias, and that the genes associated with multiple disorders would be even more multifunctional. Indeed, we found that genes in Neurocarta tend to be associated with a large number of GO annotations on average (aggregate multifunctionality score = 0.8, where 1.0 is the highest possible bias and 0.5 would be no bias). When we separated the genes specific to one disease versus the rest, we confirmed our hypothesis that genes associated with multiple disorders tend to be more multifunctional than specific genes (Figure 4; Mann–Whitney test, p-values: ASD = 2.6 × 10-15; FASD = 5.9 × 10 -3; CP = 7.8 × 10-2). In addition, our results suggested that genes associated with FASD were more multifunctional than those associated with ASD or CP. We hypothesized that this might be due to the experimental approaches used to study FASD. Indeed, 98% of the FASD studies in Neurocarta are targeted (i.e., they use a candidate gene approach) against only 55% for ASD and 72% for CP, respectively. The multifunctionality bias in FASD candidate genes might thus be due to researchers choosing well-characterized genes for their studies rather than the genome-wide approaches mostly used in ASD research represented in the database. This might also explain the fact that, in Neurocarta, ASD has the largest fraction of specific genes, as mentioned above.

thumbnailFigure 4. Genes associated with multiple diseases in Neurocarta are more multifunctional than specific genes. Mann–Whitney test: * P ≤ 0.1; ** P ≤ 0.01; *** P ≤ 0.001.

Table 3. Genes in Neurocarta associated with neurodevelopmental disorders

Comparison to similar existing resources

Several genotype to phenotype databases have been created with the idea of aggregating data from several sources in a common standardized online tool [1]. Some of existing tools rely entirely on OMIM annotations and only provide a more sophisticated portal to access data [29-31]. Others automatically aggregate data from a collection of resources, including OMIM, but they either focus only on human annotations [32], or on only one major phenotype database for a selection of model organisms [33]. Finally, some of the tools have been designed for human genetic association studies only and aggregate data from automatic or curated review of the literature [34-37]. Neurocarta is unique compared to these various initiatives in that it aggregates data from different organisms (human and animal models of diseases) and different kinds of studies (from genetic association to basic molecular experiments). It puts side-by-side data automatically extracted from public resources as well as manually curated from selected papers in the literature. All data goes through a review process where only the most reliable annotations are kept to reduce noise in the system. Finally, Neurocarta is the only publicly-available online tool that allows users to enter their own genotype to phenotype associations, share them with other users, and analyze them in the context of all existing annotations.

Future development

We are planning several lines of improvements to Neurocarta’s data and software layers. Neurocarta currently includes very few data from genome-wide association studies because of the high rate of false positives that can arise from these data. We have included data from PDGene, AlzGene, and MSGene but only the top results that reached significance in their meta-analyses of the data. In the case of ADHDgene, we have decided to incorporate their Hot Gene list even though it was only based on the number of studies a gene was identified in. We are currently investigating different options to incorporate the most significant results from additional genetic association data from public resources such as GAD [35], GWASdb [36], or the GWAS catalog [37]. Another development that we feel will add value to Neurocarta is to incorporate automated Gemma differential expression analysis results. Neurocarta is part of Gemma but currently does not take a full advantage of this integration. In Gemma, gene expression datasets comparing control vs. disease cases are tagged and easily identifiable. We will apply differential expression analysis to these datasets using stringent thresholds to identify genes differentially expressed in specific diseases. We will then incorporate this analysis result as a new type of evidence linking genes to phenotypes in Neurocarta. Finally, a challenge in making the best use of the data is that different sources have different levels of evidence quality associated with them. For example, human geneticists would generally rate evidence from animal models as weak. Neurocarta does not directly capture such distinctions, so we are in the process of devising an evidence-rating scheme that will be used to automatically rank genes with respect to their strength of evidence in association with each disorder.

Conclusions

Neurocarta is a new online resource linking genes to phenotypes. It brings together data from a wide variety of public resources and from manual curation of the literature. It is unique in that it allows users to enter their own annotations and keep them private if they wish to. In-depth annotations of genes involved in brain development disorders are available but Neurocarta is not restricted to a single disease. Instead, Neurocarta enables users to visualize all diseases their gene of interest might be associated with. This allows users not only to extract candidate gene lists from the system, but also to identify which of these genes are the most specific to their disorder of interest and to quickly find papers supporting these associations. Our analysis of the data in the context of neurodevelopmental disorders demonstrates that existing annotations linking genes to phenotypes are skewed to genes that are well known and involved in many biological functions. Neurocarta exposes this problem and makes it easier for researchers to focus their attention on more “specific” genes.

Availability and requirements

Neurocarta is publicly available at http://neurocarta.chibi.ubc.ca webcite.

Abbreviations

ADHDgene: Attention deficit hyperactivity disorder gene database; AlzGene: Alzheimer’s disease gene database; ASD: Autism spectrum disorder; CP: Cerebral palsy; CTD: Comparative toxicogenomics database; FASD: Fetal alcohol spectrum disorder; GAD: Genetic association database; GO: Gene ontology; GWASdb: Genome-wide association study database; IEA: Inferred from electronic annotation; ISS: Inferred from sequence or structural similarity; MSGene: Multiple sclerosis gene database; NAS: Non-traceable author statement; NCBI: National Center for Biotechnology Information; OMIM: Online mendelian inheritance in man; PDGene: Parkinson’s disease gene database; RGD: Rat genome database; SFARI: Simons Foundation Autism Research Initiative.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

EPC oversaw the development of Neurocarta and drafted the manuscript. CC conducted the data analysis. FL, NSG, and AZ developed Neurocarta. AL, ML, CK, WK, LT curated the data and tested the user interface. PP led the project and helped draft the manuscript. All authors read and approved the final manuscript.

Acknowledgements

This work was supported by the NeuroDevNet Network of Centres of Excellence (Neuroinformatics Core and Opportunities Initiatives grants to PP) and NIH grant RO1-GM076990 to PP. We thank Sanja Rogic for comments on the manuscript, Thea Van Rossum for software and graphics contributions, James Reynolds, Michael Shevell, Lonnie Zwaigenbaum, Steven Scherer, and Marie-Pierre Dubé for advice and encouragement.

References

  1. Thorisson GA, Muilu J, Brookes AJ: Genotype-phenotype databases: challenges and solutions for the post-genomic era.

    Nat Rev Genet 2009, 10:9-18. OpenURL

  2. Amberger J, Bocchini CA, Scott AF, Hamosh A: McKusick’s Online Mendelian Inheritance in Man (OMIM).

    Nucleic Acids Res 2009, 37:D793-D796. OpenURL

  3. Laulederkind SJF, Tutaj M, Shimoyama M, Hayman GT, Lowry TF, Nigam R, Petri V, Smith JR, Wang S-J, De Pons J, Dwinell MR, Jacob HJ: Ontology searching and browsing at the Rat Genome Database.

    Database 2012, 2012:bas016. OpenURL

  4. Davis AP, King BL, Mockus S, Murphy CG, Saraceni-Richards C, Rosenstein M, Wiegers T, Mattingly CJ: The Comparative Toxicogenomics Database: update 2011.

    Nucleic Acids Res 2011, 39:D1067-D1072. OpenURL

  5. Banerjee-Basu S, Packer A: SFARI Gene: an evolving database for the autism research community.

    Dis Model Mech 2010, 3:133-135. OpenURL

  6. Lill CM, Roehr JT, McQueen MB, Kavvoura FK, Bagade S, Schjeide B-MM, Schjeide LM, Meissner E, Zauft U, Allen NC, Liu T, Schilling M, Anderson KJ, Beecham G, Berg D, Biernacka JM, Brice A, DeStefano AL, Do CB, Eriksson N, Factor SA, Farrer MJ, Foroud T, Gasser T, Hamza T, Hardy JA, Heutink P, Hill-Burns EM, Klein C, Latourelle JC, Maraganore DM, Martin ER, Martinez M, Myers RH, Nalls MA, Pankratz N, Payami H, Satake W, Scott WK, Sharma M, Singleton AB, Stefansson K, Toda T, Tung JY, Vance J, Wood NW, Zabetian CP, Young P, Tanzi RE, Khoury MJ, Zipp F, Lehrach H, Ioannidis JPA, Bertram L: Comprehensive research synopsis and systematic meta-analyses in Parkinson’s disease genetics: The PDGene database.

    PLoS Genet 2012, 8:e1002548. OpenURL

  7. Bertram L, McQueen MB, Mullin K, Blacker D, Tanzi RE: Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database.

    Nat Genet 2007, 39:17-23. OpenURL

  8. Lill CM, Roehr JT, McQueen MB, Bagade S, Schjeide BM, Zipp F, Bertram L: The MSGene Database.

    Alzheimer Research Forum

    Available at http://www.msgene.org/ webcite

    OpenURL

  9. Zhang L, Chang S, Li Z, Zhang K, Du Y, Ott J, Wang J: ADHDgene: a genetic database for attention deficit hyperactivity disorder.

    Nucleic Acids Res 2011, 40:D1003-D1009. OpenURL

  10. Liu H, Liu W, Liao Y, Cheng L, Liu Q, Ren X, Shi L, Tu X, Wang QK, Guo A-Y: CADgene: a comprehensive database for coronary artery disease genes.

    Nucleic Acids Res 2010, 39:D991-D996. OpenURL

  11. Shevell M, Goldowitz D: Inter-disciplinary research in the pediatric neurosciences: the NeuroDevNet model, Introduction.

    Semin Pediatr Neurol 2011, 18:1. OpenURL

  12. Portales-Casamar E, Evans A, Wasserman W, Pavlidis P: The NeuroDevNet Neuroinformatics Core.

    Semin Pediatr Neurol 2011, 18:17-20. OpenURL

  13. Zoubarev A, Hamer KM, Keshav KD, McCarthy EL, Santos JRC, Rossum TV, McDonald C, Hall A, Wan X, Lim R, Gillis J, Pavlidis P: Gemma: A resource for the re-use, sharing and meta-analysis of expression profiling data.

    Bioinformatics 2012, 28:2272-2273. OpenURL

  14. Sayers EW, Barrett T, Benson DA, Bolton E, Bryant SH, Canese K, Chetvernin V, Church DM, Dicuccio M, Federhen S, Feolo M, Fingerman IM, Geer LY, Helmberg W, Kapustin Y, Krasnov S, Landsman D, Lipman DJ, Lu Z, Madden TL, Madej T, Maglott DR, Marchler-Bauer A, Miller V, Karsch-Mizrachi I, Ostell J, Panchenko A, Phan L, Pruitt KD, Schuler GD, Sequeira E, Sherry ST, Shumway M, Sirotkin K, Slotta D, Souvorov A, Starchenko G, Tatusova TA, Wagner L, Wang Y, Wilbur WJ, Yaschenko E, Ye J: Database resources of the National Center for Biotechnology Information.

    Nucleic Acids Res 2012, 40:D13-25. OpenURL

  15. Schriml LM, Arze C, Nadendla S, Chang Y-WW, Mazaitis M, Felix V, Feng G, Kibbe WA: Disease Ontology: a backbone for disease semantic integration.

    Nucleic Acids Res 2012, 40:D940-946. OpenURL

  16. Robinson PN, Mundlos S: The human phenotype ontology.

    Clin Genet 2010, 77:525-534. OpenURL

  17. Smith CL, Eppig JT: The mammalian phenotype ontology: enabling robust annotation and comparative analysis.

    Wiley Interdiscip Rev Syst Biol Med 2009, 1:390-399. OpenURL

  18. Lu Z: PubMed and beyond: a survey of web tools for searching biomedical literature.

    Database (Oxford) 2011, 2011:baq036. OpenURL

  19. Brinkman RR, Courtot M, Derom D, Fostel JM, He Y, Lord P, Malone J, Parkinson H, Peters B, Rocca-Serra P, Ruttenberg A, Sansone S-A, Soldatova LN, Stoeckert CJ Jr, Turner JA, Zheng J: Modeling biomedical experimental processes with OBI.

    J Biomed Semantics 2010, 1(Suppl 1):S7. OpenURL

  20. Ioannidis JPA, Boffetta P, Little J, O’Brien TR, Uitterlinden AG, Vineis P, Balding DJ, Chokkalingam A, Dolan SM, Flanders WD, Higgins JPT, McCarthy MI, McDermott DH, Page GP, Rebbeck TR, Seminara D, Khoury MJ: Assessment of cumulative evidence on genetic associations: interim guidelines.

    Int J Epidemiol 2008, 37:120-132. OpenURL

  21. Khoury MJ, Bertram L, Boffetta P, Butterworth AS, Chanock SJ, Dolan SM, Fortier I, Garcia-Closas M, Gwinn M, Higgins JPT, Janssens ACJW, Ostell J, Owen RP, Pagon RA, Rebbeck TR, Rothman N, Bernstein JL, Burton PR, Campbell H, Chockalingam A, Furberg H, Little J, O’Brien TR, Seminara D, Vineis P, Winn DM, Yu W, Ioannidis JPA: Genome-wide association studies, field synopses, and the development of the knowledge base on genetic variation and human diseases.

    Am J Epidemiol 2009, 170:269-279. OpenURL

  22. Ioannidis JPA: Effect of formal statistical significance on the credibility of observational associations.

    Am J Epidemiol 2008, 168:374-383.

    discussion 384–390

    OpenURL

  23. Stephens M, Balding DJ: Bayesian statistical methods for genetic association studies.

    Nat Rev Genet 2009, 10:681-690. OpenURL

  24. Abel O, Powell JF, Andersen PM, Al-Chalabi A: ALSoD: A user-friendly online bioinformatics tool for amyotrophic lateral sclerosis genetics.

    Hum Mutat 2012, 33:1345-1351. OpenURL

  25. ID Database Home.

    http://gfuncpathdb.ucdenver.edu/iddrc/iddrc/home.php webcite

    OpenURL

  26. Tan NCK, Berkovic SF: The Epilepsy Genetic Association Database (epiGAD): analysis of 165 genetic association studies, 1996–2008.

    Epilepsia 2010, 51:686-689. OpenURL

  27. Musen MA, Noy NF, Shah NH, Whetzel PL, Chute CG, Story M-A, Smith B: The National Center for Biomedical Ontology.

    J Am Med Inform Assoc 2012, 19:190-195. OpenURL

  28. Gillis J, Pavlidis P: The Impact of Multifunctional Genes on “Guilt by Association” Analysis.

    PLoS One 2011, 6:e17258. OpenURL

  29. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology, The Gene Ontology Consortium.

    Nat Genet 2000, 25:25-29. OpenURL

  30. Gefen A, Cohen R, Birk OS: Syndrome to gene (S2G): in-silico identification of candidate genes for human diseases.

    Hum Mutat 2010, 31:229-236. OpenURL

  31. Van Triest HJW, Chen D, Ji X, Qi S, Li-Ling J: PhenOMIM: an OMIM-based secondary database purported for phenotypic comparison.

    Conf Proc IEEE Eng Med Biol Soc 2011, 2011:3589-3592. OpenURL

  32. Wall DP, Pivovarov R, Tong M, Jung J-Y, Fusaro VA, DeLuca TF, Tonellato PJ: Genotator: A disease-agnostic tool for genetic annotation of disease.

    BMC Med Genomics 2010, 3:50. OpenURL

  33. Groth P, Pavlova N, Kalev I, Tonov S, Georgiev G, Pohlenz H-D, Weiss B: PhenomicDB: a new cross-species genotype/phenotype resource.

    Nucleic Acids Res 2007, 35:D696-699. OpenURL

  34. Yu W, Clyne M, Khoury MJ, Gwinn M: Phenopedia and Genopedia: Disease-Centered and Gene-Centered Views of the Evolving Knowledge of Human Genetic Associations.

    Bioinformatics 2010, 26:145-146. OpenURL

  35. Becker KG, Barnes KC, Bright TJ, Wang SA: The Genetic Association Database.

    Nat Genet 2004, 36:431-432. OpenURL

  36. Li MJ, Wang P, Liu X, Lim EL, Wang Z, Yeager M, Wong MP, Sham PC, Chanock SJ, Wang J: GWASdb: a database for human genetic variants identified by genome-wide association studies.

    Nucleic Acids Res 2012, 40:D1047-1054. OpenURL

  37. Hindorff LA, Sethupathy P, Junkins HA, Ramos EM, Mehta JP, Collins FS, Manolio TA: Potential etiologic and functional implications of genome-wide association loci for human diseases and traits.

    Proc Natl Acad Sci U S A 2009, 106:9362-9367. OpenURL