Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Highly Accessed Research article

Quantification of protein group coherence and pathway assignment using functional association

Meghana Chitale1, Shriphani Palakodety1 and Daisuke Kihara123*

Author Affiliations

1 Department of Computer Science, Purdue University, 305 N. University Street, West Lafayette, Indiana, 47907, USA

2 Department of Biological Sciences, Purdue University, 915 W. State Street, West Lafayette, Indiana, 47907, USA

3 Markey Center for Structural Biology, College of Science, Purdue University, 915 W. State Street, West Lafayette, Indiana, 47907, USA

For all author emails, please log on.

BMC Bioinformatics 2011, 12:373  doi:10.1186/1471-2105-12-373

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/12/373


Received:16 February 2011
Accepted:19 September 2011
Published:19 September 2011

© 2011 Chitale et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Genomics and proteomics experiments produce a large amount of data that are awaiting functional elucidation. An important step in analyzing such data is to identify functional units, which consist of proteins that play coherent roles to carry out the function. Importantly, functional coherence is not identical with functional similarity. For example, proteins in the same pathway may not share the same Gene Ontology (GO) terms, but they work in a coordinated fashion so that the aimed function can be performed. Thus, simply applying existing functional similarity measures might not be the best solution to identify functional units in omics data.

Results

We have designed two scores for quantifying the functional coherence by considering association of GO terms observed in two biological contexts, co-occurrences in protein annotations and co-mentions in literature in the PubMed database. The counted co-occurrences of GO terms were normalized in a similar fashion as the statistical amino acid contact potential is computed in the protein structure prediction field. We demonstrate that the developed scores can identify functionally coherent protein sets, i.e. proteins in the same pathways, co-localized proteins, and protein complexes, with statistically significant score values showing a better accuracy than existing functional similarity scores. The scores are also capable of detecting protein pairs that interact with each other. It is further shown that the functional coherence scores can accurately assign proteins to their respective pathways.

Conclusion

We have developed two scores which quantify the functional coherence of sets of proteins. The scores reflect the actual associations of GO terms observed either in protein annotations or in literature. It has been shown that they have the ability to accurately distinguish biologically relevant groups of proteins from random ones as well as a good discriminative power for detecting interacting pairs of proteins. The scores were further successfully applied for assigning proteins to pathways.

Background

Elucidating the role of proteins is a central problem in molecular biology. Computational methods play indispensable roles in various aspects of the functional elucidation of proteins, including database searches [1,2], capturing motifs and features in sequences [3-7], structures [8-10], and in experimental data [11], as well as clustering of proteins by functional similarity [12]. The importance and expectations of computational methods are further highlighted in the systems biology where a flood of sequenced genomes and various types of omics data are awaiting functional elucidation [13-18].

Realizing weaknesses of conventional homology search methods, e.g. limited coverage in genome annotations and the need for homologous proteins [17-20], various new approaches for function prediction have been developed in the past decade. Those include methods which use the sequence information in an elaborated fashion [21-27], those which compare the global and local tertiary structure information [8], and methods which use large-scale experimental data of proteins [11,28-35].

Besides function prediction, computational methods are also required for the interpretation of large-scale experimental data in the biological context [12]. Omics data, such as protein-protein interaction networks [36-40], microarray gene expression data [41,42], expression data by mass spectrometry [43] or by RNAseq [44,45], provide rich source of information for systems-level understanding of the protein interplay. Clustering genes by functional similarity is an indispensable step in finding the underlying biological principles behind the observed data.

To enable the above mentioned computational function analyses, it is necessary to establish a measure that quantifies functional associations between proteins. Controlled vocabularies of annotation terms, such as the Gene Ontology (GO) [46], provide a convenient platform for handling text description of the roles of gene products (RNA and protein). GO classifies annotation terms into three domains, Biological Process (BP), Molecular Function (MF), and Cellular Component (CC). Terms in each domain are organized in a hierarchical fashion as a Directed Acyclic Graph (DAG). The similarity between a pair of GO terms or, more generally between two sets of GO terms can be defined in several different ways. Most simply, two sets of GO terms can be compared by head to head matching where the similarity can be determined by the number of common annotations from both the sets [47]. Based on the GO hierarchy, the similarity of two GO terms can be defined as the minimum path length between them on the GO DAG [47,48]. A better alternative to the minimum path is to consider the Lowest Common Ancestor (LCA) for a pair of GO terms in the hierarchy, for which the Information Content (IC) is computed [49-51]. Schlicker et al. have developed a score named funsim, which combines the similarity of GO terms in BP and MF domains based on IC of LCA [52]. In the Methods section we discuss their scoring scheme in details.

The pairwise functional similarity may be suitable for certain purposes, e.g. for evaluating the accuracy of function prediction or for investigating functional similarity between a particular protein to others (e.g. homologous proteins). However, the situation can be different in omics data analyses, where many genes rather than a pair need to be handled to identify the set of gene products that are working in functionally coherent fashion. Functional coherence is exhibited in biologically relevant protein sets, for example, in the same biological pathways, subcellular localizations, the same protein complexes, proteins involved in the same stage of development, and disease. Importantly, proteins in a functionally coherent set may not necessarily have the same or similar GO terms in all the three GO domains, but their GO terms should be coherent with respect to each other so that the aimed function can be performed in a coordinated fashion. As an illustration, consider proteins in the same KEGG pathway. These proteins have different MF annotations because they carry out different enzymatic reactions. Moreover, interestingly, in general they also do not necessarily share a common BP annotation. For example, the pyruvate metabolism pathway (KEGG pathway ID: 00620) has 33 proteins, which are annotated with 48 unique BP domain terms. Among them there are only 8 proteins that are annotated with pyruvate metabolic process (GO:0006090) and each of the rest of the 47 GO BP terms are assigned to fewer number of proteins. The data for all the 101 KEGG pathways of yeast has been made available as Additional File 1. This can be caused by several reasons. One of the reasons is that the classification of the whole metabolic pathway into sub-pathways may differ from database to database. For example, the KEGG pathway database is not constructed by referring to the Gene Ontology annotations of genes. Another reason is that sometimes proteins are annotated with a BP term at a different specificity (child/parent terms). And of course the incompleteness of GO annotation could be another reason. Thus, even if all the BP domain annotations for the set of proteins are known, it would not be trivial to decide if the set is coherent by simply applying the existing pairwise functional similarity measures.

Additional file 1. Analysis of GO Biological Process (BP) annotations of proteins in the KEGG yeast pathways. For 101 KEGG pathways in yeast, the Biological Process (BP) GO annotations assigned to proteins in each pathway are counted. The pathway name, the number of proteins in the pathway, and the number of unique GO BP annotations have been provided in this file.

Format: PDF Size: 134KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

There are only a handful of previous works done for assessing the functional coherence. A type of related works consider GO terms that are enriched in a protein group [30,34,35,53,54]. However, it was discussed that statistically significant enrichment of certain GO terms evaluated using the hypergeometric distribution often does not indicate functional units in biological pathways [55]. Recently, Chagoyen et al. treated BP annotations of proteins as a vector of GO terms and computed pairwise protein similarity using the cosine distance [56]. They compute overall homogeneity of a set by averaging all the pairwise similarities between proteins in the set, and further assess the statistical significance of the coherence score. Pandey et al. have extended the concept of pairwise common ancestors of GO terms to the set of most specific common ancestors of the annotation sets of two proteins [57,58]. They have studied this functional coherence measure in the context of topological proximity of proteins in PPI and domain-domain interaction networks. Zheng et al. [55] performed text mining on research papers in the MEDLINE database [59] to represent the semantic content of a document in terms of presence of topics in the document. The documents are associated with proteins, which provide the protein-topic association as a graph. Then, closeness of proteins on this graph is used to determine the functional coherence of a group of proteins.

In this work, we propose two association scores for GO terms, which are aimed to evaluate the functional coherence of sets of proteins. The proposed scores quantify the associations of GO terms as the frequency of co-occurrence in two different biological contexts, in the GOA [60] protein sequence annotations and in the PubMed database literature [59]. The former score is named the Co-occurrence Association Score (CAS) while the latter is named the PubMed Association Score (PAS). We quantify the GO term associations by applying a method used for computing the knowledge-based statistical potentials for amino acid contacts [61,62], which is widely used in protein structure prediction. Unlike existing works which define similarity based on the GO hierarchy, our scores directly reflect how well terms are associated in the actual biological context. Since the associations are not restricted to the GO hierarchy, we can quantify association between terms across different GO domains. The novel and advantageous characteristic of our scores is that they quantify the functional coherence and not necessarily the similarity. Recently the GO database has newly introduced the relationships between Molecular Function (MF) and Biological Process (BP) domains to represent biological knowledge about the pathways and roles of genes [63]. Compared with their recent effort, our approach is more general, flexible, and automatic in the sense that the considered associations include knowledge from within the GO hierarchy as well as outside its structure. Resulting GO term associations reflect the current actual annotations in the databases.

We demonstrate that the developed association scores can identify functionally coherent protein sets, i.e. proteins in the same KEGG pathways, cellular locations, and protein complexes better than the above mentioned existing methods. In addition, we also show that these functional coherence score can accurately assign proteins to the KEGG pathways where the proteins belong. The current approach can be easily applied to other biological data sources to mine the associations and other ontologies as well, since it is not assuming any underlined structure in the ontology.

Results

CAS and PAS coherence scores

We have developed two function association scores, the CAS and the PAS. The CAS quantifies the frequency of GO terms that co-occur in the gene annotations, while the PAS takes into account co-occurrence of GO terms in the PubMed abstracts. The Gene Ontology database used in this study contains 17,316 Biological Process (BP), 2,534 Cellular Component (CC), and 9,428 Molecular Function (MF) domain terms, which result in a total of 29,278 terms. Among over 857,201,284 possible GO term pairs, 5,610,201 pairs (0.654%) obtained a non-zero value for the CAS while 3,320,265 pairs (0.387%) had a non-zero PAS.

A characteristic of the CAS and the PAS is that they capture the cross-domain associations between the GO terms. Out of 5,610,201 non-zero CAS, 1,996,485 (35.6%) are for cross-domain term pairs. As for PAS, which has in total of 3,320,265 GO terms pairs with non-zero scores, 1,194,900 (36.0%) are cross-domain terms. Distributions of GO term associations within the same domain (Figure 1) and across different domains (Figure 2) are compared. The CAS for the same domain (Figure 1ABC) and for the cross-domain (Figure 2ABC) shows similar distribution. On the other hand, a smaller number of high scoring cross-domain associations (Figure 2DEF) are observed for the PAS as compared with the same domain (Figure 1DEF). The peak observed at around 1400 in most of the histograms in Figures 1 and 2 are GO term pairs which only occur once in the GOA database or PubMed abstracts. Overall, the two figures show that a large number of cross-domain GO term associations were captured by the CAS and the PAS, which include pairs with significantly high scores.

thumbnailFigure 1. CAS and PAS distribution for the same domain GO term pairs. A, CAS distribution for GO term pairs in MF; B, CAS distribution for BP; C, CAS distribution in CC; D, PAS distribution for MF; E, PAS distribution for in BP; F, PAS distribution in CC. Out of 5,610,201 non-zero CAS values for GO term pairs, 107,673 (1.91%) were MF pairs, 3,430,135 (61.14%) were BP pairs, and 73,909 (1.31%) were CC pairs. Out of 3,320,265 non-zero PAS values for GO term pairs, 73,556 (2.21%) were MF pairs, 1,999,993 (60.23%) were BP pairs, and 51,816 (1.56%) were CC pairs.

thumbnailFigure 2. CAS and PAS distribution for cross domain GO term pairs. A, MF-BP CAS distribution; B, BP-CC CAS distribution; C, CC-MF CAS distribution; D, MF-BP PAS distribution; E, BP-CC PAS distribution; F, CC-MF PAS distribution. Out of 5,610,201 non-zero CAS values for GO term pairs, 1,026,484 (18.3%) were MF-BP pairs, 787,000 (14.0%) were BP-CC pairs and 183,001 (3.3%) were CC-MF pairs. Out of 3,320,265 non-zero PAS values for GO term pairs, 614,509 (18.5%) were MF-BP, 471,879 (14.2%) were BP-CC pairs, and 108,512 (3.3%) were CC-MF pairs.

Figure 3 examines the correlations between the raw score values of the CAS and the PAS taken from 29,474 randomly sampled GO term pairs with positive scores for both CAS and PAS. The CAS and the PAS show a moderate correlation coefficient of 0.308. There are many GO term pairs like GO:0034087 establishment of mitotic sister chromatid cohesion and GO:0030892 mitotic cohesin complex where we observe higher CAS (19.3644) corresponding to higher PAS (4.2390). But for some cases, such as GO:0000404 loop DNA binding and GO:0032139 dinucleotide insertion or deletion binding, we obtained a higher CAS of 116.1866 and a lower PAS of 3.6299 × 10-6. Also for some cases like GO:0019219 regulation of nucleobase, nucleoside, nucleotide and nucleic acid metabolic process and GO:0034404 nucleobase, nucleoside and nucleotide biosynthetic process we find a lower CAS (0.00679) corresponding to a higher PAS (10.3277). Thus with the use of two scores that are based on different data sources we are able to capture much diverse relationships between terms.

thumbnailFigure 3. Relationship between CAS and PAS for a sample set of GO terms pairs. Out of the 5,610,201 GO term pairs for which CAS has been computed and 5,255,249 pairs for which PAS has been computed, we randomly sampled 50,000 pairs. Out of this 29,474 pairs were selected where both CAS and PAS are non zero values. The correlation coefficient of the two scores is 0.3084.

We further compared the CAS and the PAS with the funsim score in Figure 4. Comparison was made separately for the three GO domains, because the funsim score is defined only for the GO term pairs in the same domain. Overall, the CAS and the PAS exhibit moderate correlation to the funsim score, with correlation coefficient values ranging from 0.504 (Figure 4A) to 0.171 (Figure 4E). However, there are interesting differences observed between the CAS and the PAS against the funsim score. There are GO pairs which are scored very low by the funsim score, close to zero, but have high CAS or PAS (right bottom corner of the plots). These examples include GO term pairs GO:0051095 regulation of helicase activity and GO:0043570 maintenance of DNA repeat elements, GO:0000920 cytokinetic cell separation and GO:0034407 cell wall 1,3-beta-D-glucan metabolic process in the BP domain by CAS (Figure 4B), and GO:0009523 photosystem II and GO:0010287 plastoglobule in the CC domain by PAS (Figure 4F). On the other hand, high scoring GO pairs by the funsim score are almost always scored high by the CAS and PAS. Thus, the CAS and the PAS do not lose the functional similarity that the funsim score captures and identify additional GO term pairs that are highly associated.

thumbnailFigure 4. Relationship of CAS and PAS with the semantic similarity scores. A, CAS vs. semantic similarity for MF pairs (correlation coefficient: r = 0.5037); B, CAS vs. semantic similarity for BP pairs (r = 0.3450); C, CAS vs. semantic similarity for CC pairs (r = 0.4202); D, PAS vs. semantic similarity for MF pairs (r = 0.3023); E, PAS vs. semantic similarity for BP pairs (r = 0.1711); F, PAS vs. semantic similarity for CC pairs (r = 0.2613). The GO term pairs used in these plots are the same as the one used in Figure 3 (29,474 pairs). The semantic similarity has been computed using Eqn. 10. Since semantic similarity describes relationship between the terms of the same GO domain, the plots only include GO term pairs from the same domain (646 MF pairs, 17,731 BP pairs and 492 CC pairs).

In Table 1 we show examples of the GO term pairs across different domains, which have a large score either by the CAS or the PAS. Because these are cross-domain associations, the funsim score is not defined. The first ten examples are cases with a large CAS and a small PAS. The first example is GO annotations assigned to luciferin 4-monooxygenase (UniProt Accession: e.g., Q27757 (Photuris pennsylvanica (Pennsylvania firefly), Q01158 (Luciola lateralis (firefly))), which emits florescent light. The second annotations are for chloroplastic ATP synthase gamma chain 1, (UniProt AC: Q01908). This protein is a component of the CF0 complex, which is embedded in thylakoid membrane and is important in regulating ATPase activity [64]. The next one is a DEAD box protein from the family of mitochondrial ATP-dependent RNA helicase (UniProt AC: P15424), which is an RNA chaperone and functions in mitochondrial group I and II intron splicing [65]. The fourth example is annotation for the ATP-binding cassette transporter sub-family G member 1 (UniProt AC P45844), which is a glycoprotein transporter responsible for negative regulation of cholesterol storage [66]. The fifth example with a high CAS is for lipopolysaccharide-binding protein (UniProt AC: P18428). It is involved in the acute-phase immunologic response to the gram-negative bacterial infections. Gram-negative bacteria contain a glycolipid, lipopolysaccharide (LPS), on their outer cell wall. Together with bactericidal permeability-increasing protein (BPI), the lipopolysaccharide-binding protein binds LPS and interacts with the cell surface pattern recognition receptor CD14 [67,68]. The Gene Ontology consortium has recently started providing links capturing the part-of relationship from Molecular Function (MF) term to the Biological Process (BP) term in which proteins plays the role [63]. The latter five examples in the upper half of the table provide links between MF terms and BP terms based on high CAS values, such that the same links are not currently present as part-of relationships in the latest version of GO database (2011-06). Thus the CAS and the PAS can be used to computationally obtain missing process-function links, for example, GO:0019064 viral envelope fusion with host membrane and GO:0046812 host cell surface binding, that can help increase the completeness of the relationships between the GO vocabulary terms.

Table 1. Examples of cross-domain GO term pairs which have a high CAS or PAS

The latter ten examples are cases where the PAS is higher than the CAS. Since the PAS ranges at lower values than the CAS (Figure 3), the substantial difference of the PAS and the CAS in these examples is more significant than they seem from the absolute score values. The first of these, TRAMP polyadenylation complex (e.g. UniProt AC: Q9P795), is involved in the post-transcriptional quality control mechanisms, including RNA surveillance and degradation of a wide range of nuclear RNAs including some of the non-protein coding RNA transcriptions (ncRNAs), by stimulating the 3' to 5' exonuclease activity of the exosome [69]. The second example is about BRCA1-A complex (e.g. UniProt AC: Q9NWV8), which binds to the k63 linked polyubiquitin chains present on the histone at the DNA damage sites and may facilitate the deubiquitinating activity of the deubiquitination enzyme BRCC36 [70]. The third GO pair is mined from the literature which reports the role of microtubules and actin filament networks in directed cell migration [71]. The cell leading edge refers to the area of a motile cell closest to the direction of motion which clearly requires actin microtubules for the movement. The next GO pair captures the information about sister chromatid cohesion during meiotic differentiation, which is mediated by a cohesion complex [72]. The fifth example is about the Calf 5' to 3' exo/endonuclease (the human counterpart of which is flap endonuclease-1) (e.g. UniProt AC: P39748) that is involved in the structure specific cleavage of DNA and processes Okazaki fragments during DNA replication [73]. The last five examples provide the missing links between MF and BP terms based on high PAS values, for example MF term GO:0001735 prenylcysteine oxidase activity is frequently mentioned in literature discussing a protein that plays a role in GO:0030328 prenylcysteine catabolic process.

In Table 2 and Table 3 we further provide examples of GO annotations that have high CAS or PAS for the certain GO terms. Table 2 lists five GO terms with highest CAS, thus, concurrent GO annotations of the query GO term which frequently co-annotate gene products. Table 3 is based on PAS, thus, the GO terms listed are frequently co-mentioned in the same PubMed abstracts. These concurrent GO annotations captured by the CAS and the PAS contribute to identification of proteins that are not necessarily annotated with the exact same highly related GO terms.

Table 2. Examples of concurrent GO terms based on CAS

Table 3. Examples of concurrent GO terms based on PAS

QuickGO [74], which is a recently built Gene Ontology browser, also provides functionality to browse co-occurring GO terms. This is similar to what the CAS captures but they have notable differences due to their diverse purposes. As the primary purpose of QuickGO is to browse the GO easily, it shows co-occurring GO terms for a specific query GO term. The score (named the S% score) used to sort the co-occurring terms for a specified GO term has direction (i.e. the score for A to B and B to A can be different). In contrast, the CAS is not directional as it is designed for identifying the biologically coherent protein groups by capturing the GO term association. Moreover, CAS also considers the associations of parental GO terms to capture more associations. And, of course, the PAS is totally different because it captures co-mentions in PubMed abstracts.

To summarize, the CAS and the PAS have moderate correlation with an existing score, funsim. The CAS and the PAS capture associations within the same domain as well relationship between cross-domain GO terms unlike funsim, which only defines the similarity between pair of GO terms from the same domain. Notably, CAS and PAS capture many biologically relevant cross-domain GO term associations (like MF-BP, BP-CC examples from Table 1) and thus can be used to obtain missing process-function links between GO terms as well as to find concurrent annotations across all the three GO domains.

Coherence scores computed for biologically related protein sets

Next, we examine how the CAS and the PAS scored, when accessing the functional coherence of biologically related protein sets. The functional coherence scores were developed using the CAS and the PAS (see Methods), which are aimed to capture the biologically related protein sets. Significance of the coherence scores is decided based on how well they are able to separate the biologically relevant protein sets from the randomly generated protein sets. This experiment is to show the proof of principle for the proposed functional coherence scores. We have used three datasets of functionally coherent protein sets in yeast, namely, KEGG pathways [75], proteins complexes [76], and protein groups annotated with the same GO Cellular Component terms (GOcc set) (Figure 5). There are 101 KEGG pathways with the number of proteins in each pathways ranging from 2 to 123 (Figure 5A). The number of protein complex sets is 400 (Figure 5B) [76]. The GOcc dataset includes 481 protein sets with the number of proteins in each set ranging from 2 to 100 (Figure 5C shows total number of sets). See Methods for more information.

thumbnailFigure 5. The size of protein sets in the three datasets. A, the KEGG pathway dataset; B, the protein complex dataset; C, the GOcc dataset.

In addition to the CAS and the PAS coherence scores developed here, we have also used three existing functional similarity scores, the modified funsim score [23], a score proposed by Chagoyen et al. [56] (termed the Chagoyen score), and a score by Pandey et al. [57,58] (the Pandey score). Briefly, the Chagoyen score computes the dot product of the information content of BP terms of proteins while the Pandey score considers the fraction of proteins in the database which are annotated by a common GO ancestor set of two proteins in question. An example of most specific pairwise common ancestor of terms GO:0001948 glycoprotein binding and GO:0030492 hemoglobin binding is their deepest shared GO ancestor term GO:0005515 protein binding. See Methods for derivation of the Chagoyen and the Pandey scores. For all the five scores, the coherence of a set of proteins is defined as the average of the scores for all the pairs of proteins.

Before analyzing the protein datasets in Figure 5, we have examined the dependence of the five scores to the size of the protein sets (Additional File 2: Figure S1). The verification was performed using 500 random yeast protein sets of sizes varying from 10 to 100 with an interval of 10. Since Figure S1 from Additional File 2 shows that the average scores do not significantly change by set sizes for all the five scores, we concluded that there is no need for normalization of the scores by the size of protein sets. To evaluate the statistical significance of the scores, we compute the p-value for all the coherence scores. The p-value assesses the number of proteins in the set that have a significantly higher coherent score as compared with the random chance (see Methods).

Additional file 2. Supplementary Figures S1-S4. Coherence score distribution for different datasets.

Format: PDF Size: 344KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

In Figure 6, we computed the p-value of the five coherence scores for protein sets in the three datasets, the KEGG pathway sets (Figure 6A), protein complex sets (Figure 6B), and the GOcc sets (Figure 6C). The cumulative percentage of the protein sets with a p-value cutoff (x-axis) is counted. The same analyses were also performed on the randomly generated protein sets (Figure 6D). The raw score distributions for each of the three datasets are shown in the Additional File 2 (Figures S2, S3, S4). For the KEGG pathway sets (Figure 6A), the coherence scores by the CAS (Eqn. 5), the PAS (Eqn. 6), and the Chagoyen score (Eqn. 18) identified the majority of the sets with a significant p-value, as contrasted with the funsim score (Eqn. 12) and the Pandey score (Eqn. 23). At the p-value of 0.05, the CAS, the PAS, and the Chagoyen score identified 96.03%, 95.04%, and 91.08% of the KEGG pathways, respectively, while the funsim and the Pandey score recognized only 14.85% and 22.77%. Among the CAS, the PAS, and Chagoyen, the CAS showed the highest coverage at p-value of 0.05. The only KEGG pathways that did not have a significant p-value of less than 0.05 by the CAS were Benzoate degradation via hydroxylation (2 proteins; p-value: 0.2513), Pentose and glucuronate interconversions (7 proteins; p-value: 0.05783), Ethylbenzene degradation (3 proteins; p-value: 0.2738), and alpha-Linolenic acid metabolism (2 proteins; p-value: 0.3652).

thumbnailFigure 6. Percentage of protein sets identified at different p-value cutoffs. Each protein set is evaluated by p-value of the five coherence scores, CAS, PAS, funsim, Chagoyen, and Pandey, and those which have more significant p-value than the cutoff are counted. A, the KEGG pathway dataset; B, the protein complex dataset; C, the GOcc set; D, the random set.

Similar trends were observed for the protein complex sets (Figure 6B) and the GOcc sets (Figure 6C). For both datasets, the three scores (CAS, PAS, and Chagoyen) showed significantly better performance than Pandey and funsim scores. For the protein complex sets (Figure 6B), CAS, PAS, Chagoyen, Pandey, and funsim scores recognized 76.25%, 77.0%, 69.25%, 44.25%, and 3.25% of the protein sets, respectively, at the p-value cutoff of 0.05. In the case of the GOcc sets (Figure 6C), 99.79%, 99.16%, 95.42%, 67.35%, and 7.27% of the sets are recognized by CAS, PAS, Chagoyen, Pandey, and funsim scores, respectively. Figure 6D shows that the five scores do not provide significant p-value (0.05 or lower) to most of the randomly generated protein sets. Overall the CAS and the PAS showed better discriminative performance in identifying the functionally related protein sets than the other three existing scores compared.

In Figure 7, the p-values of the CAS and the PAS computed for the three datasets are compared. The p-values for the CAS coherence score showed a lower (i.e. more significant) value than the PAS p-values for many cases in the KEGG pathway sets (Figure 7A), the protein complex sets (Figure 7B), and the GOcc sets (Figure 7C), indicating that the CAS has higher discriminative power to select coherent groups of proteins than PAS. These differences in the p-value of the CAS and the PAS are also reflected in the previous results in Figure 6, where the CAS captured more protein sets than the PAS at a significant p-value cutoff.

thumbnailFigure 7. Comparison of p-value of CAS_coherence and PAS_coherence scores. A, Comparison on the pathway set; B, the protein complex dataset; C, the GOcc set.

Coherence scores excluding obvious GO domain

Proteins in the same KEGG pathways are likely to share the similar GO terms in the BP domain (child/parent terms) used to describe the same biological process. Also proteins in the same group in the GOcc dataset have the same CC term by design. Here we reevaluate the CAS and the PAS coherence score for the KEGG pathway dataset and the GOcc dataset by excluding the apparently related GO domain. Note that the other three scores compared in Figure 6 also integrate BP and/or CC terms: The funsim score combines GO terms from all the three domains while the Pandey score uses BP and MF terms. The Chagoyen score only evaluates terms in the BP domain. However, we did not examine the effect of removing BP or CC terms from these three scores because the funsim and the Pandey score performed significantly more poorly than the PAS and the CAS (Figure 6) and removing BP or CC terms would simply further deteriorate the results. As for the Chagoyen score, it cannot be defined without BP terms.

Figure 8 compares the CAS and the PAS coherence scores computed with and without BP or CC terms. The CAS and the PAS values drop for the majority of the KEGG pathways (Figures 8A, B) when BP terms were excluded, with an average score drop of 50.98% and 22.03%, respectively. When the CC terms are discarded in computing the CAS and the PAS for the GOcc data set, on average the score decreased by 55.62% (Figure 8C) and 50.46% (Figure 8D), respectively.

thumbnailFigure 8. Coherence score comparisons with/without obviously related GO domain. For the pathway sets, the coherence scores were compared with and without the BP domain annotations. A, The CAS with all the three domains (the x-axis) while CAS_Coherence(BP-) (y-axis) is the CAS computed without BP terms. B, PAS coherence scores with and without BP terms. For the GOcc sets coherence scores were compared with and without (CC-) the use of CC domain annotations. C, CAS coherence; D, PAS coherence.

The drop of the scores (Figure 8) certainly results in the decrease of the fraction of protein sets recognized with a significant p-value. Figure 6 showed that 96.03% and 95.04% of KEGG pathway sets are recognized within the p-value cutoff of 0.05 by the original CAS and PAS, respectively. This fraction dropped to 90.09% and 91.08% when the BP terms were discarded for the CAS and the PAS (Figures 9A, B). These fractions of recognized KEGG pathways are still higher than those recognized by the Pandey and the funsim score (Figure 6A). Similarity, in the case of the GOcc dataset (Figures 9C, D), the fraction of the identified protein sets decreased from 99.79% to 98.33% by CAS and from 99.16% to 96.46% by PAS when CC terms are discarded (at the p-value cutoff of 0.05). These results are still better than the funsim and the Pandey score and comparable with the Chagoyen score (95.42%). Thus, removing the GO domain terms that are obviously related to the sets being analyzed, from both the coherence scores did not make a large reduction in the fraction of the identified protein sets.

thumbnailFigure 9. Percentage of protein sets identified at different p-value cutoffs using partial annotation information. The p-value of the CAS and the PAS coherence scores were computed with and without (BP-) BP domain annotations for the pathway dataset. A, CAS coherence; B, PAS coherence. The GOcc sets were evaluated with and without (CC-) CC domain annotations. C, CAS coherence; D, PAS coherence.

Detecting protein-protein interactions

Next, we test the proposed functional coherence scores on the protein-protein interaction (PPI) networks of yeast and human. We examine if the scores are able to detect the interacting proteins (true positives) as opposed to the non-interacting protein pairs (true negatives). The yeast PPI network contains 72,053 interacting protein pairs while 33,099 interactions are included in the human PPI data (see Methods). The same number of non-interacting protein pairs as the interacting protein pairs are extracted from the proteins included in the PPI networks. The p-value for pairs of proteins is computed for the CAS (Eqn. 3), the PAS (Eqn. 4), the funsim (Eqn. 11), the Chagoyen (Eqn. 17), and the Pandey (Eqn. 21) scores, and they are sorted in ascending order of the p-value. Then we computed the Receiver Operator Characteristic (ROC) curves for each scores on the yeast and the human PPI datasets.

The results on the yeast PPI dataset (Figure 10A) show that the CAS and the PAS obtained the maximum area under the ROC curves (AUC), 0.855 and 0.849, among the five scores compared. With the p-value cutoff of 0.05, CAS recognized 61.1% of the correct interacting pairs while the PAS identified 61.8% of them. The Chagoyen score came third, while using the funsim and the Pandey scores resulted in a significantly smaller AUC values. The five scores showed consistent results on the human PPI dataset (Figure 10B), although the AUC values decreased as compared to the results on the yeast PPI dataset. The CAS and the PAS showed almost identical AUC values, 0.791, and 0.800, and the Chagoyen score followed with an AUC value of 0.696. These results clearly show that the CAS and the PAS are better at distinguishing the positive interacting pairs from the non-interacting pairs. Indeed the performance of the five scores is also consistent with what was observed on the coherent protein datasets (Figure 6).

thumbnailFigure 10. ROC curves for detection of interacting protein pairs by functional similarity/association scores. Protein pairs with significant p-value of the functional similarity/association scores (CAS, PAS, funsim, Chagoyen, and Pandey) were predicted to be interacting with each other. A, yeast PPI data; B, human PPI data.

KEGG pathway assignment

Finally, we used the functional coherence scores to predict the most likely KEGG pathway in which the protein plays a role. For a query protein the coherence score is computed against each KEGG pathway and then the pathways are sorted and ranked based on the coherence score. We examined if the correct pathway is scored at the top ranks. For this experiment, the KEGG pathway dataset which contains 101 pathways was used and cumulative percentages of proteins that are assigned correctly to their pathway were computed. Eight scores were compared. In addition to the CAS_coherence (Eqn. 7), PAS_coherence (Eqn. 8), funsim_coherence (Eqn. 14), GOscore_coherenceBP (Eqn. 15) Chagoyen_coherence (Eqn. 19), and the Pandey_coherence (Eqn. 24), the CAS and the PAS were also computed without the BP annotations, CAS(BP-) and PAS(BP-). This is to remove the potentially apparent information of pathways encoded in the BP terms (i.e. proteins in the same KEGG pathway share the same BP terms in many cases). As for the funsim score, we have also used only BP annotations, which is referred as GOscore_coherenceBP, because the funsim score did not perform well in the previous experiments in Figures 6 and 10.

As shown in Figure 11, the CAS and the PAS performed best with a remarkably high accuracy in identifying the KEGG pathway in which the query protein participates. For 74.2% of proteins CAS identified the correct KEGG pathway at the first rank while the PAS made correct assignment for 69.9% of the cases. When the top ten scoring KEGG pathways were considered, the CAS and the PAS assigned 93.38% and 90.76% of the proteins correctly to their KEGG pathways, respectively. Removing BP terms from the CAS and the PAS lowered the assignment accuracy, however, still maintained highly accurate KEGG pathway assignment relative to the other scores. The CAS(BP-) assigned 63.22% and 80.60% proteins at the first rank and within the top ten ranks, respectively, whereas the PAS(BP-) has similar accuracy with 60.56% (at the first rank) and 79.12% (within top ten ranks). The Chagoyen score made the correct pathway assignment for 58.4% of proteins at the first rank and 89.73% within the top ten ranks. The accuracy using the Chagoyen score within the tenth ranks is very close to those by the CAS and PAS and better than CAS(BP-) and PAS(BP-). However, note again that the Chagoyen score consists solely of BP terms and it is not defined without the BP domain. The funsim score and the Pandey score performed significantly worse than the CAS and the PAS in this experiment, too.

thumbnailFigure 11. Pathway assignment for yeast proteins. Coherence score of the query protein with each KEGG pathway is used for ranking the KEGG pathways to indicate where the query protein is more likely to be assigned. The cumulative percentages of query proteins assigned to their correct pathway within the top X ranks are plotted. CAS, CAS(BP-) (without BP annotations), PAS, PAS(BP-) (without BP annotations), funsim, GOscore_coherenceBP (using only BP annotations), Chagoyen, and Pandey were used.

Discussion

We have developed and critically analyzed coherence measures for a set of proteins, which can distinguish the biologically relevant sets from the random ones. By moving away from conventional methods, which rely on the hierarchical structure of the GO terms, we have designed a novel technique that can incorporate knowledge about the GO terms to find the strength of their association. The scores are computed based on the observed associations of the GO terms. The first score, Co-occurrence Association Score (CAS), considers the frequency that pairs of GO terms have been annotated to the same proteins. On the other hand, the PubMed Association Score (PAS) quantifies the number of occurrences that GO term pairs appear in literature abstracts as compared to the random chance. While most common form of the relationship defined by the GO is between the terms of the same domain (is a relation) where one term is a more specific representation of the other, there are some new relationships which connect MF-BP terms (part of, regulates relations). By using the CAS and the PAS we can automatically find the strength of associations between terms from any two domains of GO like MF-BP or BP-CC or CC-MF, and these associations are not restricted to the relationships provided by the GO hierarchy. About 36% of the CAS and the PAS associations are for cross-domain GO term pairs, and their scores are comparable to the same domain terms (Figures 1 & 2). The CAS and the PAS capture different aspects of GO associations. While the CAS focuses on molecular level relationships of functional descriptions, the PAS often reveals the background knowledge of biologists.

To investigate the characteristics of the CAS and the PAS, we evaluated the two scores on three biologically coherent datasets, namely, the proteins in the same KEGG pathways, proteins that physically interact, and proteins which co-localize in a cell. The CAS and the PAS identified proteins in the same KEGG pathways, complexes, and co-localization with statistically significant scores (Figure 6) and were able to distinguish proteins which physically interact from those which do not (Figure 10). Moreover, the CAS and the PAS correctly assigned about 80-94% of proteins to the KEGG pathways they belong to within the top ten ranks. To the best of our knowledge, this is the first attempt to assign proteins to the KEGG pathways by evaluating the functional coherence. The performance of the CAS and the PAS was superior to the other related existing scores compared.

Counting associations of data is simple yet very powerful in revealing hidden rules behind the observed phenomena. Advanced techniques on considering data associations have been studied in the data mining and the machine learning area, which are applied, for example, in marketing [77-79]. Instead of the rather straightforward way of counting associations, using advanced methods, such as a measure of interestingness of association rules [80] and relational rule learning [81], would further improve the performance of the coherence scores. Specifically, the PAS may be further polished by applying text mining techniques that analyze the grammatical structure of sentences and relationships between phrases [82,83]. Furthermore, it will also be interesting to apply the same technique for evaluating the GO term co-occurrence in different biological contexts, such as gene expression data, regulatory pathways, and directly from PPI networks.

In this work we showed that the CAS and the PAS can identify biologically coherent proteins by capturing the GO term associations. The PAS and the CAS will also benefit for predicting biological function of un-annotated genes. Indeed there are previous works which use the GO term associations for predicting the gene function. King et al. [84] used co-occurring GO terms for predicting gene function by modeling relationships of GO terms with decision trees and Bayesian networks. Our group has developed a gene function prediction method, named PFP [22,23], which considers the GO term associations observed in a database in a similar way to the CAS. PFP first retrieves similar sequences to a query from a sequence database using PSI-BLAST [85], then, extracts GO terms which directly annotate the retrieved sequences as well as strongly associated GO terms to the GO annotations of the retrieved sequences. GO associations are described as conditional probabilities. The extracted GO terms are finally scored according to the frequency of the occurrence in the retrieved sequences and the E-values of the sequences. PFP achieved significantly higher prediction accuracy as compared with a naive way of using PSI-BLAST and some existing methods. Moreover, we can first predict the GO terms for un-annotated proteins by PFP and then apply PAS/CAS to identify which biological context the proteins play a role in.

An ultimate goal of biological studies is to understand the underlined structures and relationships of the biological entities which realize the observed phenomena. Such systematic understanding is accompanied with constructions of networks of relationships of terms in vocabularies that describe and label the biological entities. We believe that this work provides a pivotal step that brings us forward towards systematic understanding and description of a functions and mechanisms of proteins, organelle, cells, and higher level structures of life.

Conclusions

Two function coherence scores were developed, one which reflects the co-occurrence of GO terms in protein annotations (CAS) and one which considers co-mentions of terms in the literature (PAS). The CAS and the PAS are shown to have the ability to accurately separate biologically relevant groups of proteins, i.e. proteins in the same pathways, protein complexes, and those with the same localization, from random sets. It was also shown that the CAS and the PAS can be used to detect physically interacting protein pairs. The scores were further successfully applied for assigning proteins to the KEGG pathways. The method can be readily applied to mine the functional associations between proteins from various biologically relevant sets.

Methods

Gene Ontology database

The hierarchical structure of Gene Ontology (GO) and GO term definitions are obtained from the Gene Ontology Consortium [46,86]http://archive.geneontology.org/ webcite database version 2009-08. The Gene Ontology Annotation (GOA) database [60] version 2009-10 is used for the association between UniProt [87] identifiers and GO terms http://www.ebi.ac.uk/GOA/archive.html webcite. Inferred Electronic Annotations (IEA) were excluded to increase the reliability of functional data. There are 46,686 protein - GO term association pairs for Saccharomyces cerevisiae (yeast) and 90,823 associations for Homo sapiens (human).

PubMed Database

We used the NCBI's Entrez ESearch utility for obtaining the count of PubMed abstracts related to the particular GO terms. For example, for computing the PubMed association between terms GO:0003700 and GO:0051169, we first obtain their respective term definitions as 'transcription factor activity' and 'nuclear transport' from the GO database and remove words 'and, or, not' from their definitions. The remaining words in the definition are used to construct URL, e.g. http://eutils.ncbi.nlm.nih.gov/entrez/eutils/esearch.fcgi?db=pubmed&retmode=xml&rettype=full&term=transcription+factor+activity webcite, which yields an xml that is then parsed to obtain the count of PubMed abstracts associated with the given term. For retrieving the counts of abstracts with two GO terms we appended the terms in the query URL and obtain the count. The ESearch query interface uses the MeSH indexing to incorporate the synonyms and the term variations. This provides us with a convenient way to retrieve the information that has been represented using different terms for the same concepts. The January 2010 version of the PubMed database was used.

Biologically coherent sets of proteins

A coherent set of proteins are those which take part in the same biological context in a cell. For example, they can be a set of proteins playing roles in the same pathway, proteins involved in a disease or those responsible in a certain stage of development. Here we have prepared three types of coherent sets of yeast proteins: proteins in the same KEGG pathways, proteins included in the same protein complexes, and those which have the same subcellular localization. Along with these, two datasets of interacting protein pairs from yeast and human were prepared Details are described below. All the datasets are available at http://kiharalab.org/functionSim/ webcite.

Yeast KEGG pathway dataset

We downloaded yeast pathways from the ftp site of the Kyoto Encyclopedia of Genes and Genomes (KEGG) database [75]. This dataset consists of proteins in 101 pathways. The pathway size (the number of proteins in a pathway) ranges from 2 to 123 proteins with most of the pathways having around 20 proteins (Figure 5A). UniProtKB/Swiss-Prot database [87] (Version 2009-03) has been used for obtaining identifier mapping from KEGG database [75] identifiers and yeast SGD [88] identifiers.

Yeast protein complex dataset

For the yeast protein complex dataset, we have used a latest catalogue, YHTP2008 of 400 protein complexes compiled from genome-wide high throughput studies by Pu et al. [76]http://wodaklab.org/cyc2008/downloads webcite. The catalogue provides protein complexes with Saccharomyces Genome Database (SGD) [88] identifiers, which are transferred to UniProt identifiers for associating them with the corresponding GOA annotations. The set sizes are shown in Figure 5B. Most of the protein complexes have about five or less component proteins with a few exceptions such as ribosomal complex whose size is 176.

Yeast GO cellular component (GOcc) datasets

We have constructed sets of yeast proteins with the same cellular component (CC) GO terms. Yeast proteins with non IEA GO annotations in the CC domain are selected from the GOA database. Then, for each such yeast proteins, CC terms are enriched by using the parental annotation transfers based on the true path in the GO hierarchy. Thus all ancestors of a GO term are incorporated as annotations for a protein. A total of 560 protein sets were obtained with sizes ranging from 2 to 4814. Very large protein sets contain proteins with a too general CC term. Therefore 481 sets with a size up to 100 were selected for analysis (Figure 5C).

Protein-Protein Interaction (PPI) data

We have used Saccharomyces cerevisiae (budding yeast) and Homo sapiens (human) interaction data available at the BioGRID database [37] (version BIOGRID-2.0.56). In BioGRID data, only physical interactions and proteins with a UniProt identifier and with at least one GO annotation are used. The interactions are binary and thus no weight is associated with the edges in the PPI networks. For yeast and human, we have 72,053 and 33,099 interacting protein pairs, respectively. The number of proteins involved in the interactions is 4833 for yeast and 6241 for human.

In addition to the experimentally identified PPI networks, we have generated random protein-protein interactions. This is for two purposes, one for the null distribution of functional similarity scores for interacting proteins, and the other for computing the ROC curve. For both yeast and human proteins, 100,000 pairs each are randomly generated comprising of null distribution. For the ROC curve computation, we generate the same number of random interactions (false positive) as the actual interaction in each of the organisms.

Co-occurrence Association Score (CAS)

The Co-occurrence Association Score (CAS) quantifies the frequency that two GO terms co-occur in annotation of a single gene relative to random chance. The CAS for two GO terms, i and j, is computed as follows:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M1">View MathML</a>

(1)

Here C(i) is the number of sequences in the database which have GO term i. Similarly, C(i,j) is the number of sequences in the database which have a pair of GO terms, i and j. Thus, the numerator quantifies the fraction of sequences with annotations i and j relative to the total number of GO term pairs annotating the same proteins. The denominator is the expected number of times the two GO terms, i and j, co-occur in single proteins. This formulation is essentially similar to the method to compute a knowledge-based statistical amino acid contact potential [61,62].

For the GO terms annotating sequences in the GOA database, those with the evidence code of Inferred electronic annotations (IEA) are discarded. Along with the original annotations, parental GO terms to the original GO term annotations following the true path rule are also considered in computing the CAS. This procedure adds information of the GO hierarchy in the scoring scheme in an implicit fashion. GO pairs which do not co-occur in a gene are assigned with zero for their CAS.

PubMed Association Score (PAS)

This score is based on the number of times a given pair of GO terms co-occurs in abstracts in the PubMed database at the National Center for Biotechnology Information (NCBI). Text definition of GO terms is obtained from the GO database. The text definition of two GO terms, i and j, are input in the Entrez ESearch web query interface to obtain the number of PubMed abstracts that have a given pair of terms. Along with a pair of terms, we obtain the number of PubMed abstracts which contain each individual term. Using the same equation (Eqn. 1) used for computing the CAS, the PubMed Association Score (PAS) for two GO terms, i and j, are defined as

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M2">View MathML</a>

(2)

where Pub(i, j) is the number of PubMed abstracts which have two GO terms i and j, and Pub(i) is the number of abstracts which have a GO term i. Because PubMed includes nearly 19 million references, it is computationally challenging to obtain the exact total number of abstracts for all the co-occurring pairs in the database, Σk, lPub(k, l). Thus, for the second term, which can be considered as a scaling factor for PAS(i, j), the corresponding value computed for the CAS in Eqn. 1 is used.

Protein pair association measure

A protein is usually annotated with multiple GO terms. Using the CAS and the PAS, we evaluate how well two sets of annotations from two proteins are associated. For two proteins, Px and Py with Ax and Ay number of annotations, respectively, the score is defined as follows:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M3">View MathML</a>

(3)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M4">View MathML</a>

(4)

Pxi refers to the ith annotation of protein Px. Thus, each annotation for Px is compared with all GO terms from Py, and the one which gives the maximum score is chosen. Then the best matching score for each Pxi is averaged by 1/Ax. The same procedure is performed for Py, and a larger value is taken as the CAS or the PAS association between the two proteins, Px and Py. This matrix based comparison is proposed by Schlicker et al. [52].

Protein set coherence score

Now we compute the functional homogeneity of a set S of n proteins, termed as a coherence score of a set, using either CAS_prot or PAS_prot score. Note that these scores are commutative, i.e. CAS_prot (A, B) = CAS_prot(B, A) and PAS_prot(A, B) = PAS_prot(B, A).

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M5">View MathML</a>

(5)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M6','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M6">View MathML</a>

(6)

Specifically, the coherence of a protein P to a set of proteins, S, is defined as

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M7','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M7">View MathML</a>

(7)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M8','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M8">View MathML</a>

(8)

Semantic Similarity based coherence score

We compare the CAS and the PAS coherence score with three existing related scores, the semantic similarity score [52], a score designed by Chagoyen et al. [56] and another one by Pandey et al. [57,58]. The latter two scores will be explained in the subsequent sections.

The Semantic similarity measure was proposed to obtain the functional similarity between a pair of proteins [52]. The similarity between a pair of GO terms, c1 and c2, is quantified using the information content of the common ancestors of the two terms:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M9','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M9">View MathML</a>

(9)

p(c) is the fraction of proteins in the GOA database that are annotated with the GO term c, which is common ancestor of terms c1 and c2. Similarity between annotations of two proteins Px and Py, is defined in the same way as Eqns. 3 & 4:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M10','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M10">View MathML</a>

(10)

where the GO domain is either BP, MF, or CC. Note that GOscore is only computed for sets of GO terms in the same domain, since the semantic similarity score (Eqn. 9) uses the GO hierarchy structure. sim(Pxi, Pyj) is the semantic similarity score for two GO terms Pxi and Pyj, Ax and Ay are the number of terms in the two sets. A comprehensive score, funsim, combines the scores for the three domains [23]:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M11','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M11">View MathML</a>

(11)

Each GOscore is squared following to the original funsim score proposed by Schlicker et al.

Parallel to Eqns. 5 and 6, the coherence score for a set of proteins, S, is defined as the average score between pairs of proteins in the set.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M12','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M12">View MathML</a>

(12)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M13','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M13">View MathML</a>

(13)

where n is the number of proteins in the set. Eqn. 12 quantifies coherence using the funsim score while Eqn. 13 is for GO terms of individual domain, BP, MF, or CC. The coherence of a protein P to a set of proteins, S, with n proteins, is defined as

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M14','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M14">View MathML</a>

(14)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M15','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M15">View MathML</a>

(15)

Chagoyen coherence score

Chagoyen et al. have designed a functional coherence score using solely BP annotations [56]. A protein is represented as a vector of weights for each of its BP annotations, where the weight of each term i is computed as the information content based on the number of proteins annotated with i, and C(i) is normalized by the total number of protein-GO term associations in the reference database (Eqn. 16).

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M16','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M16">View MathML</a>

(16)

Here s denotes a sequence in the database and st denotes a GO term in the sequence s. The functional similarity of two proteins, Pi and Pj, is defined as the dot product between vectors of w(t) for all GO terms (Eqn. 17). Parental terms for original GO annotations are also considered to incorporate the GO hierarchy.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M17','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M17">View MathML</a>

(17)

The functional coherence of a set of proteins and the coherence between a protein P and a set S are defined as the average of the score:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M18','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M18">View MathML</a>

(18)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M19','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M19">View MathML</a>

(19)

Pandey coherence score

This functional similarity score for a protein pair uses a set of common ancestors of annotations of two proteins instead of aggregating pairwise similarity between annotations of both proteins [57,58]. Only the BP and the MF terms are used. The similarity of two GO terms, ci and cj, is defined as

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M20">View MathML</a>

(20)

Ancestorci is the set of ancestors of the terms ci in the GO hierarchy. Gc is the set of proteins associated with the term c and Gr is the total set of proteins in the database. The functional similarity between a pair of proteins, Pi and Pj, with annotation sets Si and Sj, respectively, is given by

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M21','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M21">View MathML</a>

(21)

GΛ(pi, pj) is the set of proteins that are annotated by all the terms from the set Λ(Pi, Pj), the non redundant set of common ancestors between Si and Sj. It is defined as

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M22','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M22">View MathML</a>

(22)

where cl ≤ ck indicates ck is ancestor of cl.

The coherence score of a set of proteins S and that of between a protein P and set S are referred as Pandey_coherence. It is defined in the same way as aforementioned scores:

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M23','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M23">View MathML</a>

(23)

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M24">View MathML</a>

(24)

Statistical significance of coherence score of a protein set

We use the method proposed by Chagoyen et al. [56] to compute the statistical significance of the coherence score of a set of proteins with reference to the entire yeast (or human) genome. They have designed three methods for evaluating statistical significance, which showed similar performance in identifying functionally coherent sets in their work. Here we have used one of their methods. First we compute the coherence score for set S given by coherence(S), then number of proteins P in set S which satisfy the criteria sim(P, S) ≥ coherence(S) are obtained as s. Similarly for each protein P in the reference set R (whole genome), we find r proteins that satisfy the same criteria sim (P, S) ≥ coherence(S). R is the entire set of proteins in an organism. Now we can compute the p-value of coherence score of set S using hyper-geometric distribution for the number of proteins satisfying the given criteria. P-value is given by Eqn. 25 as the probability of observing s or more proteins satisfying the criteria, given that r proteins from reference set R satisfy the criteria.

<a onClick="popup('http://www.biomedcentral.com/1471-2105/12/373/mathml/M25','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/12/373/mathml/M25">View MathML</a>

(25)

Authors' contributions

MC participated in design, implemented the algorithms for analysis, and comparison of different techniques, and drafted the paper. DK conceived of the study, participated in its design, and finalized the manuscript. SP implemented the Chagoyen score. All authors read and approved the final manuscript.

Acknowledgements

MC is supported by a grant from Purdue Research Foundation and Showalter Trust. DK is supported by grants from National Institutes of Health (R01GM075004) and National Science Foundation (DMS800568, EF0850009, and IIS0915801).

References

  1. Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool.

    J Mol Biol 1990, 215:403-410. PubMed Abstract OpenURL

  2. Pearson WR: Rapid and sensitive sequence comparison with FASTP and FASTA.

    Methods Enzymol 1990, 183:63-98. PubMed Abstract OpenURL

  3. Attwood TK, Bradley P, Flower DR, Gaulton A, Maudling N, Mitchell AL, Moulton G, Nordle A, Paine K, Taylor P, et al.: PRINTS and its automatic supplement, prePRINTS.

    Nucleic Acids Res 2003, 31:400-402. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  4. Finn RD, Mistry J, Schuster-Bockler B, Griffiths-Jones S, Hollich V, Lassmann T, Moxon S, Marshall M, Khanna A, Durbin R, et al.: Pfam: clans, web tools and services.

    Nucleic Acids Res 2006, 34:D247-D251. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  5. Gaulton A, Attwood TK: Motif3D: Relating protein sequence motifs to 3D structure.

    Nucleic Acids Res 2003, 31:3333-3336. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. Hulo N, Bairoch A, Bulliard V, Cerutti L, Cuche BA, de CE, Lachaize C, Langendijk-Genevaux PS, Sigrist CJ: The 20 years of PROSITE.

    Nucleic Acids Res 2008, 36:D245-D249. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Hunter S, Apweiler R, Attwood TK, Bairoch A, Bateman A, Binns D, Bork P, Das U, Daugherty L, Duquenne L, et al.: InterPro: the integrative protein signature database.

    Nucleic Acids Res 2009, 37:D211-D215. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  8. Chikhi R, Sael L, Kihara D: Real-time ligand binding pocket database search using local surface descriptors.

    Proteins 2010, 78:2007-2028. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. La D, Esquivel-Rodriguez J, Venkatraman V, Li B, Sael L, Ueng S, Ahrendt S, Kihara D: 3D-SURFER: software for high-throughput protein surface comparison and analysis.

    Bioinformatics 2009, 25:2843. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Sael L, Kihara D: Binding Ligand Prediction for Proteins Using Partial Matching of Local Surface Patches.

    International Journal of Molecular Sciences 2010, 11:5009-5026. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Brun C, Chevenet F, Martin D, Wojcik J, Guenoche A, Jacq B: Functional classification of proteins for the prediction of cellular function from a protein-protein interaction network.

    Genome Biol 2003, 5:R6. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  12. Hawkins T, Chitale M, Kihara D: Functional enrichment analyses and construction of functional similarity networks with high confidence function prediction by PFP.

    BMC Bioinformatics 2010, 11:265. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  13. Chitale M, Hawkins T, Kihara D: Automated prediction of protein function from sequence. In Prediction of protein strucutre, functions, and interactions. Edited by Bujnick J. Wiley Online Library; 2009:63-86. OpenURL

  14. Chitale M, Kihara D: Computational protein function prediction: Framework and challenges. In Protein function prediction for omis era. Volume Chapter 1. Edited by Kihara D. Springer Verlag; 2011::1-17. OpenURL

  15. Chitale M, Kihara D: Enhanced Sequence-Based Function Prediction Methods and Application to Functional Similarity Networks. In Protein Function Prediction for Omics Era. Volume Chapter 2. Edited by Kihara D. Springer Verlag; 2011::19-34. OpenURL

  16. Eisenberg D, Marcotte EM, Xenarios I, Yeates TO: Protein function in the post-genomic era.

    Nature 2000, 405:823-826. PubMed Abstract | Publisher Full Text OpenURL

  17. Friedberg I: Automated protein function prediction--the genomic challenge.

    Brief Bioinform 2006, 7:225-242. PubMed Abstract | Publisher Full Text OpenURL

  18. Valencia A: Automatic annotation of protein function.

    Curr Opin Struct Biol 2005, 15:267-274. PubMed Abstract | Publisher Full Text OpenURL

  19. Bork P, Koonin EV: Predicting functions from protein sequences--where are the bottlenecks?

    Nat Genet 1998, 18:313-318. PubMed Abstract | Publisher Full Text OpenURL

  20. Devos D, Valencia A: Practical limits of function prediction.

    Proteins 2000, 41:98-107. PubMed Abstract | Publisher Full Text OpenURL

  21. Chitale M, Hawkins T, Park C, Kihara D: ESG: extended similarity group method for automated protein function prediction.

    Bioinformatics 2009, 25:1739-1745. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. Hawkins T, Luban S, Kihara D: Enhanced automated function prediction using distantly related sequences and contextual association by PFP.

    Protein Sci 2006, 15:1550-1556. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Hawkins T, Chitale M, Luban S, Kihara D: PFP: Automated prediction of gene ontology functional annotations with confidence scores using protein sequence data.

    Proteins 2009, 74:566-582. PubMed Abstract | Publisher Full Text OpenURL

  24. Martin DM, Berriman M, Barton GJ: GOtcha: a new method for prediction of protein function assessed by the annotation of seven genomes.

    BMC Bioinformatics 2004, 5:178. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  25. Vinayagam A, del VC, Schubert F, Eils R, Glatting KH, Suhai S, Konig R: GOPET: a tool for automated predictions of Gene Ontology terms.

    BMC Bioinformatics 2006, 7:161. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  26. Wass MN, Sternberg MJ: ConFunc--functional annotation in the twilight zone.

    Bioinformatics 2008, 24:798-806. PubMed Abstract | Publisher Full Text OpenURL

  27. Zehetner G: OntoBlast function: From sequence similarities directly to potential functional annotations by ontology terms.

    Nucleic Acids Res 2003, 31:3799-3803. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Chua HN, Sung WK, Wong L: Exploiting indirect neighbours and topological weight to predict protein function from protein-protein interactions.

    Bioinformatics 2006, 22:1623-1630. PubMed Abstract | Publisher Full Text OpenURL

  29. Gao L, Li X, Guo Z, Zhu M, Li Y, Rao S: Widely predicting specific protein functions based on protein-protein interaction data and gene expression profile.

    Sci China C Life Sci 2007, 50:125-134. PubMed Abstract | Publisher Full Text OpenURL

  30. Hishigaki H, Nakai K, Ono T, Tanigami A, Takagi T: Assessment of prediction accuracy of protein function from protein--protein interaction data.

    Yeast 2001, 18:523-531. PubMed Abstract | Publisher Full Text OpenURL

  31. Letovsky S, Kasif S: Predicting protein function from protein/protein interaction data: a probabilistic approach.

    Bioinformatics 2003, 19(Suppl 1):i197-i204. PubMed Abstract | Publisher Full Text OpenURL

  32. Markowetz F, Troyanskaya OG: Computational identification of cellular networks and pathways.

    Mol Biosyst 2007, 3:478-482. PubMed Abstract | Publisher Full Text OpenURL

  33. Nariai N, Kolaczyk ED, Kasif S: Probabilistic protein function prediction from heterogeneous genome-wide data.

    PLoS One 2007, 2:e337. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  34. Schwikowski B, Uetz P, Fields S: A network of protein-protein interactions in yeast.

    Nat Biotechnol 2000, 18:1257-1261. PubMed Abstract | Publisher Full Text OpenURL

  35. Sharan R, Ulitsky I, Shamir R: Network-based prediction of protein function.

    Mol Syst Biol 2007, 3:88. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Aranda B, Achuthan P, am-Faruque Y, Armean I, Bridge A, Derow C, Feuermann M, Ghanbarian AT, Kerrien S, Khadake J, et al.: The IntAct molecular interaction database in 2010.

    Nucleic Acids Res 2010, 38:D525-D531. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Breitkreutz BJ, Stark C, Reguly T, Boucher L, Breitkreutz A, Livstone M, Oughtred R, Lackner DH, Bahler J, Wood V, et al.: The BioGRID Interaction Database: 2008 update.

    Nucleic Acids Res 2008, 36:D637-D640. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  38. Jensen LJ, Kuhn M, Stark M, Chaffron S, Creevey C, Muller J, Doerks T, Julien P, Roth A, Simonovic M, et al.: STRING 8--a global view on proteins and their functional interactions in 630 organisms.

    Nucleic Acids Res 2009, 37:D412-D416. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  39. Pagel P, Kovac S, Oesterheld M, Brauner B, Dunger-Kaltenbach I, Frishman G, Montrone C, Mark P, Stumpflen V, Mewes HW, et al.: The MIPS mammalian protein-protein interaction database.

    Bioinformatics 2005, 21:832-834. PubMed Abstract | Publisher Full Text OpenURL

  40. Salwinski L, Miller CS, Smith AJ, Pettit FK, Bowie JU, Eisenberg D: The Database of Interacting Proteins: 2004 update.

    Nucleic Acids Res 2004, 32:D449-D451. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  41. Hubble J, Demeter J, Jin H, Mao M, Nitzberg M, Reddy TB, Wymore F, Zachariah ZK, Sherlock G, Ball CA: Implementation of GenePattern within the Stanford Microarray Database.

    Nucleic Acids Res 2009, 37:D898-D901. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  42. Parkinson H, Sarkans U, Kolesnikov N, Abeygunawardena N, Burdett T, Dylag M, Emam I, Farne A, Hastings E, Holloway E, et al.: ArrayExpress update--an archive of microarray and high-throughput sequencing-based functional genomics experiments.

    Nucleic Acids Res 2010. OpenURL

  43. Ahrens CH, Brunner E, Qeli E, Basler K, Aebersold R: Generating and navigating proteome maps using mass spectrometry.

    Nature Reviews Molecular Cell Biology 2010, 11:789-801. PubMed Abstract | Publisher Full Text OpenURL

  44. Van Vliet AHM: Next generation sequencing of microbial transcriptomes: challenges and opportunities.

    FEMS microbiology letters 2010, 302:1-7. PubMed Abstract | Publisher Full Text OpenURL

  45. Nagalakshmi U, Waern K, Snyder M: RNA-Seq: a method for comprehensive transcriptome analysis.

    Curr Protoc Mol Biol 2010, 89:1-13. OpenURL

  46. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al.: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium.

    Nat Genet 2000, 25:25-29. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Sheehan B, Quigley A, Gaudin B, Dobson S: A relation based measure of semantic similarity for Gene Ontology annotations.

    BMC Bioinformatics 2008, 9:468. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  48. Lee JH, Kim MH, Lee YJ: Information retrieval based on conceptual distance in IS-A hierarchies.

    Journal of Documentation 1993, 49:188-207. Publisher Full Text OpenURL

  49. Resnik P: Using information content to evaluate semantic similarity in a taxonomy.

    The proceedings of 14th International Joint Conference on Artificial Intelligence 1995, 448-453. OpenURL

  50. Lord PW, Stevens RD, Brass A, Goble CA: Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation.

    Bioinformatics 2003, 19:1275-1283. PubMed Abstract | Publisher Full Text OpenURL

  51. Lin D: An information-theoretic definition of similarity.

    The proceedings of the 15th International Conference on Machine Learning 1998, 296-304. OpenURL

  52. Schlicker A, Domingues FS, Rahnenfuhrer J, Lengauer T: A new measure for functional similarity of gene products based on Gene Ontology.

    BMC Bioinformatics 2006, 7:302. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  53. Curtis RK, Oresic M, Vidal-Puig A: Pathways to the analysis of microarray data.

    Trends Biotechnol 2005, 23:429-435. PubMed Abstract | Publisher Full Text OpenURL

  54. Draghici S, Khatri P, Martins RP, Ostermeier GC, Krawetz SA: Global functional profiling of gene expression.

    Genomics 2003, 81:98-104. PubMed Abstract | Publisher Full Text OpenURL

  55. Zheng B, Lu X: Novel metrics for evaluating the functional coherence of protein groups via protein semantic network.

    Genome Biol 2007, 8:R153. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  56. Chagoyen M, Carazo JM, Pascual-Montano A: Assessment of protein set coherence using functional annotations.

    BMC Bioinformatics 2008, 9:444. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  57. Pandey J, Koyuturk M, Subramaniam S, Grama A: Functional coherence in domain interaction networks.

    Bioinformatics 2008, 24:i28-i34. PubMed Abstract | Publisher Full Text OpenURL

  58. Pandey J, Koyuturk M, Grama A: Functional characterization and topological modularity of molecular interaction networks.

    BMC Bioinformatics 2010, 11(Suppl 1):S35. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  59. Wheeler DL, Barrett T, Benson DA, Bryant SH, Canese K, Chetvernin V, Church DM, DiCuccio M, Edgar R, Federhen S, et al.: Database resources of the National Center for Biotechnology Information.

    Nucleic Acids Res 2007, 35:D5-12. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  60. Barrell D, Dimmer E, Huntley RP, Binns D, O'Donovan C, Apweiler R: The GOA database in 2009--an integrated Gene Ontology Annotation resource.

    Nucleic Acids Res 2009, 37:D396-D403. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  61. Skolnick J, Jaroszewski L, Kolinski A, Godzik A: Derivation and testing of pair potentials for protein folding. When is the quasichemical approximation correct?

    Protein Sci 1997, 6:676-688. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  62. Yang YD, Park C, Kihara D: Threading without optimizing weighting factors for scoring function.

    Proteins 2008, 73:581-596. PubMed Abstract | Publisher Full Text OpenURL

  63. The Gene Ontology in 2010: extensions and refinements

    Nucleic Acids Res 2010, 38:D331-D335. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  64. Inohara N, Iwamoto A, Moriyama Y, Shimomura S, Maeda M, Futai M: Two genes, atpC1 and atpC2, for the gamma subunit of Arabidopsis thaliana chloroplast ATP synthase.

    Journal of Biological Chemistry 1991, 266:7333. PubMed Abstract | Publisher Full Text OpenURL

  65. Del Campo M, Lambowitz AM: Structure of the Yeast DEAD box protein Mss116p reveals two wedges that crimp RNA.

    Molecular cell 2009, 35:598-609. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  66. Klucken J, Bnchler C, Ors£ E, Kaminski WE, Porsch-+zcnrnmez M, Liebisch G, Kapinsky M, Diederich W, Drobnik W, Dean M: ABCG1 (ABC8), the human homolog of the Drosophila white gene, is a regulator of macrophage cholesterol and phospholipid transport.

    Proc Natl Acad Sci USA 2000, 97:817-822. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  67. Schumann RR, Leong SR, Flaggs GW, Gray PW, Wright SD, Mathison JC, Tobias PS, Ulevitch RJ: Structure and function of lipopolysaccharide binding protein.

    Science 1990, 249:1429-1431. PubMed Abstract | Publisher Full Text OpenURL

  68. Wilde CG, Seilhamer JJ, McGrogan M, Ashton N, Snable JL, Lane JC, Leong SR, Thornton MB, Miller KL, Scott RW: Bactericidal/permeability-increasing protein and lipopolysaccharide (LPS)-binding protein. LPS binding properties and effects on LPS-mediated cell activation.

    Journal of Biological Chemistry 1994, 269:17411-17416. PubMed Abstract | Publisher Full Text OpenURL

  69. Houseley J, Tollervey D: The nuclear RNA surveillance machinery: The link between ncRNAs and genome structure in budding yeast?

    Biochimica et Biophysica Acta (BBA)-Gene Regulatory Mechanisms 2008, 1779:239-246. Publisher Full Text OpenURL

  70. Wang B, Hurov K, Hofmann K, Elledge SJ: NBA1, a new player in the Brca1 A complex, is required for DNA damage resistance and checkpoint control.

    Genes & development 2009, 23:729-739. PubMed Abstract | Publisher Full Text OpenURL

  71. Wadsworth P: Regional regulation of microtubule dynamics in polarized, motile cells.

    Cell motility and the cytoskeleton 1999, 42:48-59. PubMed Abstract | Publisher Full Text OpenURL

  72. Diaz-Martinez LA, Gimenez-Abian JF, Clarke DJ: Chromosome cohesion-rings, knots, orcs and fellowship.

    Journal of cell science 2008, 121:2107-2114. PubMed Abstract | Publisher Full Text OpenURL

  73. Murante RS, Rust L, Bambara RA: Calf 5 to 3 exo/endonuclease must slide from a 5 end of the substrate to perform structure-specific cleavage.

    Journal of Biological Chemistry 1995, 270:30377-30383. PubMed Abstract | Publisher Full Text OpenURL

  74. Binns D, Dimmer E, Huntley R, Barrell D, O'Donovan C, Apweiler R: QuickGO: a web-based tool for Gene Ontology searching 5.

    Bioinformatics 2009, 25:3045-3046. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  75. Kanehisa M, Goto S: KEGG: kyoto encyclopedia of genes and genomes.

    Nucleic Acids Res 2000, 28:27-30. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  76. Pu S, Wong J, Turner B, Cho E, Wodak SJ: Up-to-date catalogues of yeast protein complexes.

    Nucleic Acids Res 2009, 37:825-831. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  77. Agrawal R, Imieli ski T, Swami A: Mining association rules between sets of items in large databases.

    ACM SIGMOD Record 1993, 22:207-216. Publisher Full Text OpenURL

  78. Brijs T, Goethals B, Swinnen G, Vanhoof K, Wets G: A data mining framework for optimal product selection in retail supermarket data: the generalized PROFSET model.

    300-304.

  79. Lawrence RD, Almasi GS, Kotlyar V, Viveros MS, Duri SS: Personalization of supermarket product recommendations.

    Data Mining and Knowledge Discovery 2001, 5:11-32. Publisher Full Text OpenURL

  80. Smyth P, Goodman RM: An information theoretic approach to rule induction from databases.

    Knowledge and Data Engineering, IEEE Transactions on 2002, 4:301-316. OpenURL

  81. Quinlan JR: Learning logical definitions from relations.

    Machine learning 1990, 5:239-266. OpenURL

  82. Koike A, Niwa Y, Takagi T: Automatic extraction of gene/protein biological functions from biomedical text.

    Bioinformatics 2005, 21:1227-1236. PubMed Abstract | Publisher Full Text OpenURL

  83. Krallinger M, Padron M, Valencia A: A sentence sliding window approach to extract protein annotations from biomedical articles.

    BMC bioinformatics 2005, 6:S19. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  84. King OD, Foulger RE, Dwight SS, White JV, Roth FP: Predicting gene function from patterns of annotation 1.

    Genome Res 2003, 13:896-904. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  85. Altschul SF, Madden TL, Schaffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs 2.

    Nucleic Acids Res 1997, 25:3389-3402. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  86. Harris MA, Clark J, Ireland A, Lomax J, Ashburner M, Foulger R, Eilbeck K, Lewis S, Marshall B, Mungall C, et al.: The Gene Ontology (GO) database and informatics resource.

    Nucleic Acids Res 2004, 32:D258-D261. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  87. The Universal Protein Resource (UniProt) 2009

    Nucleic Acids Res 2009, 37:D169-D174. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  88. Dwight SS, Harris MA, Dolinski K, Ball CA, Binkley G, Christie KR, Fisk DG, Issel-Tarver L, Schroeder M, Sherlock G, et al.: Saccharomyces Genome Database (SGD) provides secondary gene annotation using the Gene Ontology (GO).

    Nucleic Acids Res 2002, 30:69-72. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL