Abstract
Background
It is currently accepted that the perturbation of complex intracellular networks, rather than the dysregulation of a single gene, is the basis for phenotypical diversity. Highthroughput gene expression data allow to investigate changes in gene expression profiles among different conditions. Recently, many efforts have been made to individuate which biological pathways are perturbed, given a list of differentially expressed genes (DEGs). In order to understand these mechanisms, it is necessary to unveil the variation of genes in relation to each other, considering the different phenotypes. In this paper, we illustrate a pipeline, based on Structural Equation Modeling (SEM) that allowed to investigate pathway modules, considering not only deregulated genes but also the connections between the perturbed ones.
Results
The procedure was tested on microarray experiments relative to two neurological diseases: frontotemporal lobar degeneration with ubiquitinated inclusions (FTLDU) and multiple sclerosis (MS). Starting from DEGs and dysregulated biological pathways, a model for each pathway was generated using databases information biological databases, in order to design how DEGs were connected in a causal structure. Successively, SEM analysis proved if pathways differ globally, between groups, and for specific path relationships. The results confirmed the importance of certain genes in the analyzed diseases, and unveiled which connections are modified among them.
Conclusions
We propose a framework to perform differential gene expression analysis on microarray data based on SEM, which is able to: 1) find relevant genes and perturbed biological pathways, investigating putative subpathway models based on the concept of disease module; 2) test and improve the generated models; 3) detect a differential expression level of one gene, and differential connection between two genes. This could shed light, not only on the mechanisms affecting variations in gene expression, but also on the causes of genegene relationship modifications in diseased phenotypes.
Keywords:
Structural equation modeling (SEM); Model generation; Pathway analysis; Perturbed models; Perturbed edgesBackground
Most of known diseases are complex diseases. This means that they are caused by the combination of genetic and environmental factors. The introduction of the concept of network biology [1] allowed the application of network based approaches for studying this type of diseases. These approaches rely on the possibility to represent molecules, as proteins or genes, as interaction networks. Microarray experiments of gene expression represent a useful tool to examine the change of gene expression profile in diseases. Many efforts were performed to build, starting from gene expression, molecular networks. This activity is sometimes referred to as reverse engineering of gene regulatory networks [2]. One type of method applied for this goal, relies on the Structural Equation Modeling (SEM), a general methodology used to address questions about complex systems [3]. SEM finds a number of applications in biological networks, for example in the inference of causal phenotype networks (see [4] for a review), genomewide association studies (GWAS) and geneenvironment interactions [5,6], as well as to measure effects of quantitative trait loci (QTLs) in linkage analyses [79]. The use of SEM in the analysis of microarray is not new. One of the first applications is shown by [10], who demonstrated that covariance structure analysis is a useful statistical method to find common transcriptional factors for a set of genes and to specify and evaluate hypothesized biological pathways. [11] applied SEM systematically for gene network reconstruction using gene expression data preprocessed with genetic algorithms. In most of the applications of SEM the aim is to infer networks starting from data. Thus, we can define these approaches as exploratory approaches. More recently, [12] described a confirmatory approach in microarray analysis.
In this paper we propose a SEM pipeline that, from initial and revised a priori network models, obtained by pathway analysis [13], is able to compare the path strengths between several groups and to determine the effect of factors analyzed on the paths. Our framework takes into consideration the generation of pathway models based on the principles of network theory such as the small network phenomena and the detection of modules [14]. Firstly considering how differentially expressed genes (DEGs) are connected by other genes in the microarray, we try to bring out which modifications in the gene network could be responsible of the differences observed between groups considered. Our approach relies on: 1) curated biological pathway databases, 2) the principles that characterize disease genes in biological networks, 3) grouping genes in Protein Information Resource (PIR) superfamilies [15] for facilitating the interpretation of the model. The proposed SEM pipeline is a combination of datadriven and knowledgedriven approaches. In fact, in order to generate perturbed pathway modules, we used curated biological pathways, representing the a priori biological knowledge about genes and their connections. The hardest part is to highlight which portion of the pathway is actually distinctive of the phenomenon being analyzed. We consider, as initial model, the one obtained from the shortest paths between every couple of DEGs. This process preserves the biological knowledge completely, as the connections in the new model are not inferred, but already present in the original pathway. The model is then fitted with SEM and improved by balancing between datadriven and knowledgedriven evidences obtained by the combination of SEM with the knowledge enclosed in public databases, relative to real and putative connections among genes. Finally, SEM with multiple group analyses supplies useful information to clinicians and biologists about experimental group differences, unveiling which connections and genes are statistically significant in the perturbed pathway models.
Methods
Illustration of the proposed pipeline
The pipeline, similar to that described by [12], is illustrated in Figure 1. In step1, DEGs were obtained by Significance Analysis of Microarray (SAM) [16] and the perturbed pathways by Signaling Pathway Impact Analysis (SPIA) [17] using KEGG database [18]; in step2, the pathway models were generated by network analysis and evaluated with SEM in step3 for: 1) improving the models generated by the biological pathways found; 2) testing if the pathway models differ across groups by multiple group analysis; 3) screening of single differences in expression (gene nodes) and in regulation (genegene edges) across groups. We used the implementation provided by the R packages samr [19] and SPIA [20] for SAM/SPIA procedures.
Figure 1. Pipeline proposed to generate and evaluate genetic pathway models.
Structural equations models (SEM)
SEM is a statistical procedure for confirmatory causal inference originated from path analysis proposed in 1921 by the American geneticist Sewall Wright [21]. It is based on multivariate linear regression equations, where the response variable in one regression equation may appear as a predictor in another equation. Indeed, variables may influence oneanother reciprocally, either directly or through other variables as intermediaries. Additionally, correlated or uncorrelated unmeasured variables may indicate the presence of unobserved factors that influences observed variables.
In general, a SEM consists of a structural model describing (causal) relationships among latent (hidden) variables and a measurement model describing the relationships between the observed measurements and the underlying latent variables [22]. Here we consider SEM with observed variables only, and therefore no measurement models have been used [23]. Specifically, let V to be the index set of the Y observed variables, represented as the “parent” set {pa(i)i ∈ V}, i.e. the explanatory variables of Y_{i}, or as the “siblings” set {sib(i)i ∈ V}, i.e. the unmeasured linked variables with Y_{i}, respectively. These sets determine a system of linear equations:
and a covariance structure:
The system of linear equations affirms that every node is characterized by the relationships with his parents, while the covariance structure describes the relationships between unobserved nodes.
They encode two distinct causal assumptions: (1) a “weak” assumption on the possible existence of (direct) casual influences of explanatory variables on Y_{i}, and (bidirected) correlated unmeasured variables U_{i}, quantified by the regression (path) coefficients β_{ij}, and the covariances ψ_{ij}, respectively; and 2) a “strong” assumption based on the absence of (direct) causal influences or (bidirected) correlations of any observed/unobserved variables neither in the “parents” set pa(i) nor in the “siblings” set sib(i). In other terms, a weak assumption excludes some values for a parameter (the null value zero), but permits a range of other values; while, strong assumptions assume that parameters take specific values (null value zero or a fixed a priori value). The linear equations and the covariance structure can be encoded and visualized in a “path diagram”, that is, a mixed graph G = (V,E) featuring both directed (→) and bidirected (↔) edges. The vertex set V includes the genes and the edge set E represents relations or reactions among vertexes. The “activity” of a given gene is embedded in a path diagram: the actions performed by a gene on downstream molecules, and the signals that it receives from upstream regulators. “Directed edges” between two genes (j→i, if and only if j ∈ pa(i)), measured by path coefficients (ranging usually from 1 to 1, if genes are standardized), represent expected change in the activity of the downstream gene, given a unit of change in the upstream gene while the values of the other genes remain constant. Considering that paths reflect a direct influence of one gene on another, negative path coefficients indicate ensemble inhibition (negative control) and positive paths measure net activation (positive control). “Bidirected edges” between two genes (j↔i if and only if j ∈ sib(i), or equivalently, if and only if i ∈ sib(j)) encode a hidden common cause that may be interpreted as latent or unobserved measurement of upstream regulators that could account for the observed covariances (correlations) between the two genes.
One important feature of SEM is that direct and indirect effects can be computed and compared. “Directed paths” between two genes are the sequence of all the directed edges (j → k_{1},… → …, k_{m} → i) from genes Y_{j} to Y_{i}. Each directed path is a channel along which information (gene’s activities) can flow, and so a “total effect” (TE) of gene Y_{j} on gene Y_{i} is defined as the total sum of the products of the sequence of arrows (edges) along all directed paths from Y_{j} to Y_{i}. Accordingly, a “indirect effect” (IE) of gene Y_{j} on gene Y_{i} represents the portion of the total effects not considering the directed edge effect (DE), i.e. TE = DE + IE.
The wellknown SEM analysis consists of four steps [22]: a) definition and identification of an initial path model, b) estimation of parameters, c) evaluation of the fitting, and d) model modification.
Initial model building
Specification of initial pathway models (step a) was obtained taking the perturbed pathways and converting them in directed graphs or gene networks. Generalizing, each pathway can be seen as a mixed graph. The idea is to understand how DEGs are connected in the perturbed pathways by other microarray genes. A natural way to solve this problem is to identify the shortest paths (geodesic distance) between DEGs. The geodesic distance d_{geo}(y_{i}, y_{j}) between two DEGs, y_{i} and y_{j}, is defined as the minimum distance between these two genes. The function get.shortest.paths( ) of the R package igraph was used to compute all the shortest paths [24]. Define the microarray genes, DEGs, and not DEGs in the following way: MG = {mg_{1}, mg_{2}, …, mg_{m}}; DEG = {deg_{1}, deg_{2} ,…, deg_{n}} and NDEG = {ndeg_{1}, ndeg_{2},…,ndeg_{mn}}, where MG = DEG ∪ NDEG and DEG ∩ NDEG = {∅}. Each shortest path could be represented as a list of nodes Y_{k}= (y_{i}, y_{i+1} ,..., y_{j1,}y_{j}) and a list of the corresponding edges E_{k} = (e_{i(i+1)}, ..., e_{(j1)j}) where (y_{i}, y_{j}) ∈ DEG; (y_{i+1} ,…, y_{j1}) ∈ (DEG ∨ NDEG); Y_{k} ⊆ Y and E_{k} ⊆ E. The shortest paths for each pathway constitute k (k = 1, …, K) subgraphs G_{k} = {Y_{k},E_{k}} of the original pathway, G = {Y, E}. Not all DEGs and NDEGs will be included in the shortest paths. Therefore, we define two new sets: DEG(s) and NDEG(s) respectively, the sets of DEGs and the set of not DEGs that include all genes in shortest paths, where DEG(s) ⊆ DEG and NDEG(s) ⊆ NDEG.
To reach the final model the NDEG(s) that connect DEG(s) are grouped in basis to their PIR superfamily (PIRSF). Based on the evolutionary relationships of whole proteins, this classification system allows annotation of both specific biological and generic biochemical functions. The PIRSF can be represented as SUPF = {supf_{1}, supf_{2},…, supf_{g}}, where ∀ supf_{i} ⊆ NDEG(s) and ∀_{i≠j} supf_{i} ∩ supf_{j} = {∅}. Using this information, each original shorthest path G_{k} = {Y_{k},E_{k}} is transformed in a new shortest paths, G*_{k} = {Y*_{k} = (y*_{i}, y*_{i+1},…, y*_{j1,} y*_{j}), E*_{k} = (e*_{i(i+1)},…, e*_{(j1)j}) }, where (y*_{i+1},…, y*_{j1}) ∈ (DEG(s) ∨ SUPF ∨ NDEG(s)) and E* ⊆ E. The function to obtain the final graph, G* = (Y*,E*), is described in the following pseudocode:
The graph G* = (Y*,E*) is the fusion of all shortest paths found, where each node and each edge cannot be present more than once, the selfloops are not considered but the feedbacks and cycles were preserved. To ensure the identification of the initial models, the “blockrecursive” criterion of Rigdon [25] and the “bow free” criterion of Brito and Pearl [26] were applied. The first affirms that reciprocal relationships, feedback loops, or covariances are segregated into groups, or blocks, with no more than two equations per block. The second affirms that a model is ensured if variables standing in direct causal relationships (directed edges) do not have correlated errors (bidirected edges). So a new graph is attained in which the DEGs are connected by other DEGs, PIRSFs or NDEGs. In this way a model was created for each significant pathway found.
Successively, PIRSFs composite variables are defined considering not DEGs, present in shortest paths, as causal indicators of latent (hidden) constructs [27]. To generate the PIRSFs, a principal component analysis (PCA) was performed on genes belonging to a PIRSF and the principal component scores of the first principal component (PC1) were considered as the values that characterize the PIRSF. Only PIRSFs for which the PC1 represents 50% or more of the total variance are considered. At the end of process we have the initial SEM model.
The pathway graph conversion, the graph analysis, and the PC1 scores are obtained by graphite [28], igraph [24] and stats [29] R packages, respectively, while R functions for network analysis are implemented ad hoc, and are available Additional file 1.
Additional file 1. R codes for a demonstration of the procedure for the Multiple Sclerosis (MS) example.
Format: ZIP Size: 2MB Download file
SEM fitting
For parameter estimation (stepb), the classic derivation of the Maximum Likelihood estimation (MLE) is used, that assumes all observed variables are jointly Gaussian. The system of structural equations and covariance structure of unmeasured variables can be written compactly in a matrix form as: Y = BY + U, and Cov(U) = Ψ. This specification induces a structure on the covariance matrix of the joint distribution of the genes Y as:
where θ=(β; ψ) is the list of the free parameters in the model of dimension t. The unknown parameters are estimated so that the implied covariance matrix Σ(θ) is close to the observed sample covariance matrix S.
The assessment of the model (stepc) involves the Likelihood Ratio test (LRT) converted to a Chisquare test of the fitted model. Specifically, let Σ_{0} = E(S) to be the true population covariance matrix, and Σ(θ) the modelimplied covariance matrix. The hypothesis to be tested is:
The chisquare test is then χ^{2} = 2logLRT = 2[logL(Σ(θ))  logL(Σ_{0})] with d = p(p + 1)/2t degree of freedom (d.f.). logL( ) represents the loglikelihood of the model, p the number of genes, t the number of parameters of the fitted model. Notsignificant Pvalues (P >0.05) indicate that the model provides a good fit to the data. The Pvalues are derived by using the χ^{2}(d) distribution or a resampling bootstrap distribution [30].
An alternative procedure [31] assumes that in the population, a modelimplied covariance matrix Σ(θ_{0}), which is approximately correct, is in the neighborhood of Σ_{0}. So the null hypothesis of “exact fit” is replaced by the null hypothesis of “close fit”:
and the Root Mean Square Error of Approximation (RMSEA) measures the discrepancy ε for the fitted model:
Pvalues for RMSEA are set up from the noncentral χ^{2}(λ,d) distribution with noncentrality parameter, λ = (n1) × d × 0.05^{2} or from a resampling bootstrap distribution. The null hypothesis of close fit is not rejected if P > 0.05.
We also consider the Standardized RootMeansquare Residual (SRMR), one of the most used SEM fit indices. SRMR is a measure based on the differences between observed (s) values and the ones obtained from the model (σ) of the covariance matrix:
SRMR values <0.10 are assumed as an adequate fitting measure, whereas values <0.05 may be considered as a good fit [32].
Finally, the model refinement (stepd) is obtained adding new directed or bidirected edges to the initial model. This modification was needed considering that the initial model is only a simplified representation of the whole pathway. The criteria used for the refinement are based on the combination of three elements. First, the modification indexes (MI), that is an estimate of the decrease in the χ^{2}score statistic that would result by freeing each fixed (=0) parameter in the model; second, ztests (=parameter estimate/standard error) of the MLE; and finally, biological evidences obtained by STRING database [33] and by the existence of a direct path between the nodes that MI proposes to connect. The following heuristic stepwise strategy was used:
Heuristic stepwise procedure:
Input: list of the fixed (=0) parameters (paths and/or covariances) in the model.
Output: new free parameters (paths and/or covariances) in the model.
Steps:
1. freeing just a single parameter (path coefficient or covariance) at a time, and these in turn are sorted in descending order of magnitude using MI;
2. verify if the edge (path coefficient or covariance) to add is present in STRING or when the edge is a path coefficient, if it represents a direct path that connects the nodes in the pathway selected, and then add this new edge in the model;
3. fit the model and if the new edge is statistically not significant (P > 0.05, onesided), using a z value (z<1.64), remove it and repeat step 12;
4. STOP the selection procedure if the model achieves a non significant LRT (P > 0.05) or RMSEA (P of “close” fit > 0.05) or SRMR < 0.1, otherwise repeat step 13
Multiplegroup analysis
When data are observed from multiple subsamples, the representation of groups with “indicator variables”, considered as nodes, allows to recognize DEGs. Instead, “multiplegroup analysis” allows to identify differentially regulated genes (DRGs) across groups.
Specifically, define μ_{1}(θ) and Σ_{1}(θ) as the modelimplied mean vector and covariance matrix of group 1 (experimental group) respectively and μ_{2}(θ) and Σ_{2}(θ) as the corresponding moments of group 2 (control group). For each models, two omnibus tests are performed considering the two experimental conditions (groups), one for the differential expression genes (nodes) and the other for the strength of the edges. In the first case, the hypothesis to be tested is:
while, in the second case, is:
In the “null” model (H_{0}), the mean or covariance estimates are constrained to be equal across groups; in the “alternative” model (H_{1}), they are allowed to differ across groups. The statistical significance is determined by comparison of LRT chisquare (χ^{2}diff) values at a given degree of freedom (d.f. diff). If there is a significant difference (P < 0.05) in the chisquared goodnessoffit index, the groups differ significantly for one or more specific gene expression (nodes) and/or generelationships (edges). Finally, three pathcoefficient differences are screened: 1) “up/down” expression (gene nodes), testing the “zero value” for the group indicator variable (C = experimental =1, and C = control = 0) path coefficients; 2) “up/down” regulation (gene edges), testing the “zero value” for the differences of path coefficients across groups; 3) “on/off” regulation (gene edges) with respect to a priori KEGG gene regulation target, testing the “zero value” of the edge coefficients across groups.
Specifically, assume C to be the path coefficient matrix of the group indicator variables and c_{i} be an element of the matrix C. Let B_{1} and B_{2} to be the corresponding path coefficient matrices in the experimental and control groups; D = B_{1} – B_{2} and d_{ij} be an element of the matrix D. We consider the test statistics:
where SE( ) is the estimated standard error of the parameters. The statistic t_{C} can be used to test the conditional “up/down” expression level difference of one gene between groups, given the parents of the gene in the network. Similarly, t_{D} checks the conditional “up/down” expression regulatory differences of one gene on another between groups. Moreover, t_{1} and t_{2} check the “on/off” regulatory differences compared to a priori KEGG pathway. The Pvalues of these statistics (twosided, for t_{C} and t_{D} and onesided, for t_{1} and t_{2}) are derived either asymptotically from the N(0,1)distribution or empirically from the nonparametricbased or using modelbased bootstrap distribution with B bootstrap samples (usually, B = 100, or 1000).
Note that the marginal bivariate test of DEGs with SAM approach can be regarded as the special case of the conditional test with t_{C,} when the pathway graph is G = (Y, ∅), so pa(y) = ∅ for all genes ∈Y.
We use the implementation provided by the lavaan [34] R package for estimation, evaluation, and modification of SEM data analysis, and R codes is available in Additional file 1.
Results
The above described method was applied to two gene expression microarrays datasets, one from a study on FTLDU and the other on MS.
FTLDU analysis
The data were obtained from a microarray experiment that analyzes various brain regions of patients affected by FTLDU in presence of the mutation in the progranulin gene. Two groups were selected: one affected by FTLD with mutation in the progranulin gene (15 samples) and the other constituted by the control (17 samples). Data are freely available at Gene Expression Omnibus (GEO) database with ID GSE13162. For our analysis, we used normalized expression values submitted in the database. In the first step, SAM was performed using a delta value of 1.03 and a minimum foldchange of 2. The number of genes upexpressed was 207 while the number of gene downexpressed 244. Using this list of DEGs, the SPIA analysis found seven important pathways for the explanation of the role of the progranulin mutation on the FTLDU, as showed in the Table 1.
Table 1. Perturbed pathways obtained by SPIA on FTLDU data
The most of the dysregulated pathways, as the MPAK signalling pathway, the calcium signalling pathway, the gap junction and the ECMreceptor interaction, confirm the analysis of [35]. The dysregulated pathways with a significant pPERT were the glutamatergic synapse and GABAergic synapse. The role of the glutamate in the acute and neurodegenerative processes were well described in literature [3538]. Meldrum [36] illustrated three different pathological mechanisms of action of the glutamate in the neurodegeneration. Glutamate can be neurotoxic through an agonist effect on the NmethylDaspartate (NMDA), αaminohydroxy5methyl4isoaxaleproprionicacid (AMPA), kainate or Group I metabotropic receptors. The relative contribution of these different classes of receptors vary according to the neurons involved and a variety of other circumstances. Selective neuronal death subsequent to the epileptics status appears to be highly dependent on NMDA receptor activation. Acute neuronal degeneration after transient global or focal cerebral ischemia seems to be dependent on both NMDA and AMPA receptors. Regarding the GABAergic pathway, a loss of glutamatergic pyramidal cells and calbindinD28kimmunoreactive GABAergic neurons in the frontal and temporal cortices of patients with FTLD [39] and FTLD with motor neuron disease [40] was reported.
SEM analysis of glutamatergic synapse KEGG pathway
For sake of brevity, model specification was obtained only for the glutamatergic synapses pathway, but the same procedure could be used for all significant pathways. We started from the original KEGG pathway and then, passing through the shortest paths model, we reached the PIRSF model. Four composite variables (PCA1) were generated: 1) PLCbeta (PIRSF000956) by entrez ID genes 5330, 5331, 23236: variance explained 66%; 2) adenylate cyclase (PIRSF001445) by entrez ID genes 113, 114, 155: variance explained 68%; 3) GTPbinding regulatory protein Gs alpha chain (PIRSF002400) by entrez ID genes 2776, 2778: variance explained 53%; 4) ionotropic glutamate receptor (PIRSF002437) by entrez ID genes 2902, 2903, 2905: variance explained 54%. The graph reduction of the model specification process was the following: from KEGG (mean degree = 11.431, number nodes(edges) = 92 (526)) to DEGs shortest paths model (mean degree = 3.769 , number nodes(edges) = 26 (49)), and to PIRSF model (mean degree = 2.947, number nodes(edges) = 19 (28)). The initial fitting indices were poor (χ^{2} (df) = 600.1 (25), P < 0.001, RMSEA (Pclose) =0.320 (<0.001), SRMR = 0.450). This is likely because the existing pathway databases do not even contain all pathway information presented in the public literature [41], and because the model generated was a simplification of the real connections between nodes. Twentytwo directed edges were added, six using STRING database and sixteen using graph information. The final pathway model was an adequate approximation of the observed covariance matrix, as demonstrated by the SRMR index (0.092). Twogroup analysis of the final pathway model revealed a significant global mean (χ^{2} diff(df) = 48.5 (19), P < 0.001 of H_{0}: μ_{1} = μ_{2} subject to Σ_{1} = Σ_{2}) and covariance differences (χ^{2} diff (df) = 110.9 (51), P < 0.001 of H_{0}: Σ_{1} = Σ_{2} subject to μ_{1}≠ μ_{2}). The specific tests that consider the effect of the progranulin mutation on every gene and every edge are summarized in Tables 2 and 3.
Table 2. Single node and edge differences found between FTLDU with progranulin mutation and control groups
Table 3. Not significant (null edge) in FTLDU with progranulin mutation and in control groups
Four genes and one PIRSF of the glutamatergic model resulted influenced by the group: genes 1742 or PSD95, 5532 or PPP3CB, 2785 or GNG3, 5534 or Ppp3r1 and the PIRSF of the glutamate receptor. An important role could be played by PSD95 gene that is believed to be involved in the synapse maturation, in the induction of a network of neurotransmitter receptors, scaffolding proteins and ionotropic glutamate receptors [42]. The gene PPP3CB and the gene GNG3 are associated to the Wnt signalling correlated to the dysregulation in the case of progranulin deficiency [43]. To note that four of the nodes influenced by the group were involved in the perturbed edges described in the Table 1. Giving a look to the significant edges found, the relationships 22941 <1742 and 22941 <PIRSF “glutamate receptors” are well note in the literature. In fact, the gene 229141 or SHANK2 plays a critical role both in the integration of the various postsynaptic membrane proteins, celladhesion molecules, signal components, scaffolding proteins, and actinbased cytoskeleton, part of the PSD protein network (activated by the PSD95) [44], and in the organization of the glutamate receptors [45]. The edges 3708 <9456 that involves the gene Itpr1 and the gene HOMER1 were very interesting. The relationships are involved in the spinocerebellar ataxia in human as described by [46]. Also other links that include the PIRSF adenylate cyclase, GTPbinding regulatory protein and the PLCbeta could be useful to interpret the role of mutation in the progranulin gene group.
The comparison with KEGG edges revealed that 17 edges were not active (off) in the “mutant” group and 21 in the “control”. In contrast the edges activated (on) was 9 and 5 in mutant and control, respectively (cf. Table 3). The Figure 2 illustrates the model and the links found statistically significant between the yes/no mutant groups.
Figure 2. Final model of the Glutamatergic synapse pathway. The graph displays which nodes and edges are different between the yes/no mutant groups. The nodes (with “Entrez” name) or edges are mapped with different colours according to up/down expression or regulation, respectively.
Multiple sclerosis
MS is a neurodegenerative disease with a presumed autoimmune component. The genomewide expression study in peripheral blood mononuclear cells (PBMC), from 12 MS patients and 15 controls, was performed in order to identify DEGs and dysregulated pathways. Data are freely available at GEO database with ID GSE21942. For the analysis, we used expression values submitted in the database. The SAM was performed using a delta value of 0.95 and a minimum foldchange of 2. The number of genes upexpressed was of 133 while the number of gene downexpressed of 92. Using this list of DEGs, the SPIA analysis found three important pathways that could be involved in the mechanism of the development of the MS, as showed in the Table 4.
Table 4. Perturbed pathways obtained by SPIA on MS data
The first, B cell receptor (BCR) signaling pathway, is an important component of adaptive immunity. B cells produce and secrete millions of different antibody molecules, each of which recognizes a different antigen. This signalling ultimately results in the expression of immediate early genes that further activate the expression of other genes involved in B cell proliferation, differentiation and immunoglobulin (Ig) production as well as other processes. The role of B cells is well known in MS [47,48]. The second one, Fc gamma Rmediated phagocytosis pathway, includes specialized cell types as macrophages, neutrophils, and monocytes that take part in hostdefence mechanisms. Expression of the inhibitory Fc gamma receptor IIB (FcγRIIB) plays an important role during peripheral B cell development, which prevents memory B cells with low affinity or selfreactive receptors from entering the germinal center and becoming IgG positive plasma cells [49]. Furthermore, the decreased expression of Fc gamma RIIB or nonfunctional Fc gamma RIIB variants are consistently associated with the development of autoimmune tissue inflammation [49]– [51]. Considering the connection between the Fc gamma Rmediated phagocytosis and B cells, and the association of this pathway with autoimmune inflammation, we could conclude that also this pathway could be implicated in the MS phenotype.
Salmonella infection, the third pathway, may appear less interesting, nevertheless it is connected with response to infections that, as showed for the two previous pathways, plays an important role in MS.
SEM analysis of Fc gamma Rmediated phagocytosis KEGG
As an example, we analyzed the Fc gamma Rmediated phagocytosis pathway. The model was obtained starting from the KEGG pathway and finding the shortest paths between DEGs (no PIRSF reduction was performed). The graph reduction of the model specification was from KEGG pathway (mean degree = 10.404, number nodes(edges) = 94 (489)) to DEGs shortest paths model (mean degree = 3.647, number nodes(edges) = 17(31)). The initial model had a poor fit (χ^{2} (df) = 339.410 (105), P < 0.001, RMSEA (Pclose) =0.288 (<0.001), SRMR = 0.321) and the final model was adequate considering the SRMR index (0.098) and RMSEA (Pclose) 0.111 (0.059). To reach the final model, twenty edges were added: fifteen using as driving criteria the presence of a directed path between the nodes in the original pathway, and five using STRING database information.
Twogroup analysis of the final pathwaymodel revealed a significant global mean (χ^{2} diff(df) = 40.3 (16), P < 0.001 of H_{0}: μ_{1} = μ_{2} subject to Σ_{1} = Σ_{2}) and covariance differences (χ^{2} diff (df) = 124.4 (48), P < 0.001 of H_{0}: Σ_{1} = Σ_{2} subject to μ_{1}≠ μ_{2}).
The specific tests, that analyze the effect of the diseasemodel on genes and edges, are reported in Tables 5 and 6. Five genes resulted groupsensitive: the genes 382 or ARF6, 10093 or ARPC4, 5580 or PRKCD, 5321 or plag2g4a, 1399 or CRKL. The gene ARF6, as showed by [52], could be implicated in the disruptive effects of IL1b, a gene recently associated with MS [53]. In addition, other group sensitive genes could be associated with MS [54,55]. Considering the edges perturbed, the links between the gene 382 or ARF6 and the gene 1399 or CRKL resulted very interesting. The IL1 beta, as reported [52], has an effect on the endothelial stability by the cascade MYD88 – ARNO and ARF6, a known regulator of adherents protein localization. In turn the gene CRKL, an adapter protein required for the spreading of epithelial colonies and breakdown of epithelial colonies and the breakdown of adherents junctions in response to hepatocyte growth factor, modulates the gene ARF6 [56]. So the genes IL1b, ARF6 and CRKL could be involved in the same pathological mechanism. Other interesting significant edges were the connections between gene 23396 or PIP5K1C with gene 8612 or Ppap2c and with gene 8613 or Ppap2b. The gene PIP5K1C catalyzes the synthesis of phosphatidylinositol 4,5bisphosphate, an essential lipid molecule in various cellular processes. As described by [57] the phosphatidylinositol4, 5bisphosphate synthesis has a critical role in the regulation of multiple steps of the synaptic vesicle cycle. This gene is connected with Ppap2c and Ppap2b, genes that have a role in metabolic pathways controlling the synthesis of glycerophospholipids and triacylglycerols, and in receptoractivated signal transduction mediated by phospholipase D, considered a susceptibility factor in sclerosis [58].
Table 5. Single node and edge differences found between MS and control groups
Table 6. Not significant (null edge) in MS and in control groups
The comparison with KEGG edges showed that in the model pathway, 22 edges were not active (off) in the MS patients and 18 in controls. In contrast, the edges activated (on) were 6 and 10 in MS patients and control subjects respectively (cf. Table 6). The Figure 3 illustrates the pathway model and the links found statistically significant between the MS/control groups.
Figure 3. Final model of Fc gamma Rmediated phagocytosis pathway. The graph displays which nodes and edges are different between the disease/control groups. The nodes (with “Entrez” name) or edges are mapped with different colours according to up/down expression or regulation, respectively.
Discussion
This work illustrated a new procedure based on Structural Equation Modeling (SEM) to discover and compare perturbed pathwaymodules, similar to that proposed by [12]. Unlike these authors, new pathway analysis (SPIA) and new model generation, based on mixed graph theory and principles of network biology, were added. Starting from the significant dysregulated pathways, a model for each pathway was generated, that allowed both to verify how DEGs were connected between them in a causal structure and to improve the model interpretation by grouping not DEGs in PIR superfamilies. To note that the initial model is not inferred by data, because connections among genes represent the biological knowledge enclosed in the pathway and in PIRSFs. The use of SEM proved to be very versatile in the downstream analysis of microarray data. It was used to: 1) test and improve the generated models (this could be a useful way to overcome the limitation of accuracy relative to the public pathway database); 2) verify the overall differences between groups, and 3) individuate differential expression level of one gene and differential connection between two genes.
Our procedure was tested on two experiments of gene expression microarray data finalized to unravel the biological mechanisms that allowed us to explain the differences between yes/no mutant groups and disease/healthy groups. Starting from the output of SPIA, the model generation procedure, illustrated in this paper, was applied. The first step was to obtain a subgraph for each perturbed pathway containing only the genes present in the microarray. Then, the connections between DEGs through shortest paths were found, and finally not DEGs were grouped in PIRSFs. The models generated were tested and improved using an integrate approach based on the combination between SEM and other type of evidences as explicated in the STRING database. Once a good model has been determined, a twogroups SEM analysis has been performed to unveil significant differences between groups. Studying each link present in the final perturbed model, we hypothesized which connections could be altered. For example in FTLDU experiment, we found the connection between SHANK2 and PSD95, and in MS we hypothesized that the genes IL1b, ARF6 and CRKL could be involved in a same pathological mechanism. These results confirmed and could be able to elucidate the mechanisms that lead to the pathogenesis and progression of the observed diseases.
The framework illustrated, being a composition of different methods, could be easily adapted to new solutions. The idea is to have a general and modular framework where different other methods could be taken in consideration in each step of the pipeline.
First, alternative ways to select DEGs and perturbed pathways could be considered. In [59] a unified framework was proposed to jointly find significant perturbed pathways and DEGs by sparse Linear Discriminant Analysis (sLDA). Other methods for identifying DEGs and differential connections, based on Graphical Gaussian Modeling (GGM), are the following: a first one generates networks directly from very high dimensional data, determining the pattern of zeros in the inverse covariance matrix [60]; a second one defines Bayesian networks (directed acyclic graph: DAGs) on a structure of dependence derived from external resources [61]; the last one derives DAGs from external resources converting them into undirected cyclefree graphs [62]. An additional approach for conducting a differential analysis of networks directly from data by measuring gene association/interaction with connectivity scores, based on Partial Least Squares (PLS), was suggested by [63].
Second, we used PCA to create new observed composite variables that represent PIRSFs. Another plan could be to take advantage of the potentiality of SEM in the creation of latent variables as proposed by [64] in transcriptional regulation of proteinDNA interactions. A valid alternative to the modification indices of SEM could be the PCalgorithm [65], that allow to infer causal information from data. The idea in this case is to fix an initial model, provided by the perturbed pathways model, and then use the PCalgorithm to add new links supervised by STRING knowledge. Lastly, since in SEM multigroup analysis numerous hypothesis are tested, multiple testing control procedures using the method of [66] can be desirable.
Conclusions
The pipeline proposed introduces in the analysis of gene expression data the main principles that govern biological networks as well described by [14]. Otherwise from reverseengineering gene regulatory networks, that build networks directly from data, our initial models are obtained by a biological curated pathway database (KEGG) and then modified on the basis of the knowledge provided by another database (STRING). The principal evidence is that the manifestation of a particular phenotype depends on the interactions existing among many causal agents. This was obtained taking in consideration not only DEGs but also how genes interact. The pipeline has been validated on two expression datasets. In both the cases, we tested the models, improved them and individuated the gene expression levels and the connections that were perturbed and that could justify the different phenotypes observed. The results were satisfactory and strongly coherent with experimental findings available in literature, considering that most of the genes in the model are known to characterize the phenomena analyzed and that links perturbed were previously connected to the progression of the diseases.
Competing interests
The authors declare that they have no competing interests.
Authors’ contribution
DP defined the procedure to generate models. MG supervised the work, in particular the statistical part, and together with DP, developed the procedure to test the models. DP and MG wrote jointly the paper. All the authors read and approved the final manuscript.
Acknowledgements
This work was funded by Laboratory of Multivariate Statistics, Department of Brain and Behavioural Sciences, Medical and Genomic Statistics Unit, University of Pavia, Pavia Italy. We want to thank, the PhD student Fernando Palluzzi and the PhD Valeria Carossa for their advice and helping.
References

Barabási AL, Oltvai ZN: Network biology: understanding the cell’s functional organization.
Nat Rev Genet 2004, 5:101113. PubMed Abstract  Publisher Full Text

Hartemink AJ: Reverse engineering gene regulatory networks.
Nat biotech 2005, 23:554555. Publisher Full Text

Shipley B: Cause and Correlation in Biology. A User’s Guide to Path Analysis, Structural Equations, and Causal Inference. New York: Cambridge University Press; 2000.

Rosa GJ, Valente BD, de los Campo G, Wu XL, Gianola D, Silva MA: Inferring causal phenotype networks using structural equation models.
Gen Select Evol 2011, 43:6. BioMed Central Full Text

Kim J, Namkung J, Lee S, Park T: Application of structural equation models to genomewide association analysis.
Genomics & Informatics 2010, 8:150158. Publisher Full Text

Mi X, Eskridge KM, George V, Wang D: Structural equation modeling of gene–environment interactions in coronary heart disease.
Ann Hum Genet 2011, 75:255265. PubMed Abstract  Publisher Full Text

Rao DC, Province MA: The future of path analysis, segregation analysis, and combined models for genetic dissection of complex traits.

Province MA, Rice TK, Borecki IB, Gu C, Kraja A, Rao DC: Multivariate and multilocus variance components method, based on structural relationships to assess quantitative trait linkage via SEGPATH.
Genet Epidemiol 2003, 24(2):128138. PubMed Abstract  Publisher Full Text

Li R, Tsaih SW, Shockley K, Stylianou IM, Wergedal J, Paigen B, Churchill GA: Structural model analysis of multiple quantitative traits.
PLoS Genet 2006, 2(7):e114. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Xie J, Bentler PM: Covariance structure models for gene expression microarray data.
Struct Equ Model 2003, 10:566582. Publisher Full Text

Xiong M, Li J, Fang X: Identification of genetic networks.
Genetics 2004, 166(2):10371052. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Wu X, Sharpe K, Zhang T, Chen H, Zhu W, Li E, Taghavi S, Van Der Lelie D: Comparative genetic pathway analysis using structural equation modeling. In Proceeding of IEEE First International Conference on Computational Advances in Bio and Medical Sciences (ICCABS 2011): 3–5 February 2011; Orlando. Washington, DC, USA: IEEE Computer Society; 2011:190195.

Khatri P, Sirota M, Butte A: Ten years of pathway analysis: current approaches and outstanding challenges.

Barabási AL, Gulbahce N, Loscalzo J: Network medicine: a networkbased approach to human disease.
Nat Rev Genet 2011, 12:5668. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Nikolskaya AN, Arighi CN, Huang H, Barker WC, Wu CH: PIRSF family classification system for protein functional and evolutionary analysis.

Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to the ionizing radiation response.
Proc Natl Acad Sci U S A 2001, 98:51165121. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Tarca AL, Draghici S, Khatri P, Hassan S, Mital P, Kim J, Kim C, Kusanovic JP, Romero R: A novel signaling pathway impact analysis for microarray experiments.
Bioinformatics 2009, 25:7582. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kanehisa M, Goto S: KEGG: Kyoto encyclopedia of genes and genomes.
Nucleic Acids Res 2000, 28(1):2730. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Tibshirani R, Chu G, Balasubramanian N, Jun L: samr: SAM: Significance Analysis of Microarrays.
R reference manual: August 29, 2013
[ http://cran.rproject.org/web/packages/samr/samr.pdf webcite]

Tarca AL, Kathri P, Draghici S: SPIA: Signaling Pathway Impact Analysis (SPIA) using combined evidence of pathway overrepresentation and unusual signaling perturbations.
R reference manual: May 27, 2014
[ http://www.bioconductor.org/packages/release/bioc/manuals/SPIA/man/SPIA.pdf webcite]

Bollen KA: Structural Equations with Latent Variables. New York: Wiley; 1989.

Pearl J: Graphs, causality, and structural equation models.
Socio Meth Res 1998, 27:226284. Publisher Full Text

Csardi G, Nepusz T: igraph: network analysis and visualization.
R reference manual: April 22, 2014
[ http://cran.rproject.org/web/packages/igraph/igraph.pdf webcite]

Rigdon E: A necessary and sufficient identification rule for structural models estimated in practice.
Multivar Behav Res 1995, 30:359383. Publisher Full Text

Brito C, Pearl J: A new identification condition for recursive models with correlated errors.
Struct Equ Model 2002, 9:459474. Publisher Full Text

Grace JB, Bollen KA: Representing general theoretical concepts in structural equation models: the role of composite variables.
Environ Ecol Stat 2008, 15:191213. Publisher Full Text

Sales G, Calura E, Romualdi C: Graphite: GRAPH Interaction from pathway Topological Environment. R reference manual: May 27, 2014, [ http://www.bioconductor.org/packages/release/bioc/manuals/graphite/man/graphite.pdf webcite]

R Development Core Team: The R Stats package: In A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2012.
http://cran.rproject.org/ webcite

Bollen KA, Stine RA: Bootstrapping goodnessoffit measures in structural equation models.
Sociol Methods Res 1992, 21:205229. Publisher Full Text

Browne MW, Cudeck R: Alternative ways of assessing model fit.

Hu LT, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives.
Struct Equ Modeling 1999, 6:155. Publisher Full Text

Franceschini A, Szklarczyk D, Frankild S, Kuhn M, Simonovic M, Roth A, Jensen LJ: STRING v9. 1: proteinprotein interaction networks, with increased coverage and integration.
Nucleic Acids Res 2013, 41(D1):D808D815. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Rosseel Y: lavaan: An R Package for Structural Equation Modeling.
J Stat Softw 2012, 48(2):136.
http://www.jstatsoft.org/v48/i02/ webcite

ChenPlotkin AS, Geser F, Plotkin JB, Clark CM, Kwong LK, Yuan W, Lee VMY: Variations in the progranulin gene affect global gene expression in frontotemporal lobar degeneration.
Hum Mol Genet 2008, 17:13491362. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Meldrum BS: Glutamate as a neurotransmitter in the brain: review of physiology and pathology.
J Nutr 2000, 130(Suppl 4):1007S1015S. PubMed Abstract  Publisher Full Text

Sheldon AL, Robinson MB: The role of glutamate transporters in neurodegenerative diseases and potential opportunities for intervention.
Neurochem Int 2007, 51:333355. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Hynd MR, Scott HL, Dodd PR: Glutamatemediated excitotoxicity and neurodegeneration in Alzheimer’s disease.
Neurochem Int 2004, 45:583595. PubMed Abstract  Publisher Full Text

Ferrer I: Neurons and their dendrites in frontotemporal dementia.
Dement Geriatr Cogn Disord 1999, 10(Suppl 1):5560. PubMed Abstract  Publisher Full Text

Ferrer I, Tunon T, Serrano MT, Casas R, Alcantara S, Zujar MJ, Rivera RM: D28 k and parvalbumin immunoreactivity in the frontal cortex in patients with frontal lobe dementia of nonAlzheimer type associated with amyotrophic lateral sclerosis.
J Neurol Neurosurg Psychiatry 1993, 56:257261. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Adriaens ME, Jaillard M, Waagmeester A, Coort SL, Pico AR, Evelo CT: The public road to highquality curated biological pathways.
Drug Discov Today 2008, 13:856862. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Gong Y, Lippa CF: Review: disruption of the postsynaptic density in Alzheimer’s disease and other neurodegenerative dementias.
Am J Alzheimers Dis Other Demen 2010, 25:547555. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Rosen EY, Wexler EM, Versano R, Coppola G, Gao F, Winden KD, Geschwind DH: Functional genomic analyses identify pathways dysregulated by progranulin deficiency, implicating Wnt signaling.
Neuron 2011, 71:10301042. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kim E, Sheng M: PDZ domain proteins of synapses.
Nat Rev Neurosci 2004, 5:771781. PubMed Abstract  Publisher Full Text

Gong Y, Lippa CF, Zhu J, Lin Q, Rosso AL: Disruption of glutamate receptors at Shankpostsynaptic platform in Alzheimer’s disease.
Brain Res 2009, 1292:191198. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

van de Leemput J, Chandran J, Knight MA, Holtzclaw LA, Scholz S, Cookson MR, Houlden H, GwinnHardy K, Fung HC, Lin X, Hernandez D, SimonSanchez J, Wood NW, Giunti P, Rafferty I, Hardy J, Storey E, Gardner RJ, Forrest SM, Fisher EM, Russell JT, Cai H, Singleton AB: Deletion at ITPR1 underlies ataxia in mice and spinocerebellar ataxia 15 in humans.
PLoS Genet 2007, 3:e108. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Owens GP, Bennett JL, Gilden DH, Burgoon MP: The B cell response in multiple sclerosis.
Neurol Res 2006, 28:236244. PubMed Abstract  Publisher Full Text

von Büdingen HC, Kuo TC, Sirota M, van Belle CJ, Apeltsin L, Glanville J, Cree BA, Gourraud PA, Schwartzburg A, Huerta G, Telman D, Sundar PD, Casey T, Cox DR, Hauser SL: B cell exchange across the blood–brain barrier in multiple sclerosis.
J Clin Investig 2012, 122:4533. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Nimmerjahn F, Ravetch JV: Fcgamma receptors as regulators of immune responses.
Nat Rev Immunol 2008, 8:3447. PubMed Abstract  Publisher Full Text

Mackay M, Stanevsky A, Wang T, Aranow C, Li M, Koenig S, Diamond B: Selective dysregulation of the FcγIIB receptor on memory B cells in SLE.
J Exp Med 2006, 203:21572164. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Tackenberg B, Jelčić I, Baerenwaldt A, Oertel WH, Sommer N, Nimmerjahn F, Lünemann JD: Impaired inhibitory Fcγ receptor IIB expression on B cells in chronic inflammatory demyelinating polyneuropathy.
Proc Natl Acad Sci 2009, 106:47884792. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Zhu W, London NR, Gibson CC, Davis CT, Tong Z, Sorensen LK, Shi DS, Guo J, Smith MC, Grossmann AH, Thomas KR, Li DY: Interleukin receptor activates a MYD88ARNOARF6 cascade to disrupt vascular stability.
Nature 2012, 492:252255. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Mori F, Nisticò R, Mandolesi G, Piccinin S, Mango D, Kusayanagi H, Berretta N, Bergami A, Gentile A, Musella A, Nicoletti CG, Nicoletti F, Buttari F, Mercuri NB, Martino G, Furlan R, Centonze D: Interleukin1β promotes longterm potentiation in patients with multiple sclerosis.
NeuroMolecular Med 2013.
Epub ahead of print

Iglesias AH, Camelo S, Hwang D, Villanueva R, Stephanopoulos G, Dangond F: Microarray detection of E2F pathway activation and other targets in multiple sclerosis peripheral blood mononuclear cells.
J Neuroimmunol 2004, 150:163177. PubMed Abstract  Publisher Full Text

Gilli F: Role of differential expression of interferon receptor isoforms on the response of multiple sclerosis patients to therapy with interferon beta.
J Interf Cytokine Res 2010, 30:733741. Publisher Full Text

Lamorte L, Rodrigues S, Sangwan V, Turner CE, Park M: Crk associates with a multimolecular Paxillin/GIT2/βPIX complex and promotes Racdependent relocalization of Paxillin to focal contacts.
Mol Biol Cell 2003, 14:28182831. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Di Paolo G, Moskowitz HS, Gipson K, Wenk MR, Voronov S, Obayashi M, Flavell R, Fitzsimonds RM, Ryan TA, De Camilli P: Impaired PtdIns(4,5)P(2) synthesis in nerve terminals produces defects in synaptic vesicle trafficking.
Nature 2004, 431:415422. PubMed Abstract  Publisher Full Text

Terao C, Ohmura K, Kawaguchi Y, Nishimoto T, Kawasaki A, Takehara K, Mimori T: PLD4 as a novel susceptibility gene for systemic sclerosis in a Japanese population.
Arthritis Rheum 2013, 65:472480. PubMed Abstract  Publisher Full Text

Wu MC, Zhang L, Wang Z, Christiani DC, Lin X: Sparse linear discriminant analysis for simultaneous testing for the significance of a gene set/pathway and gene selection.
Bioinformatics 2009, 25:11451151. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kiiveri HT: Multivariate analysis of microarray data: differential expression and differential connection.
BMC Bioinforma 2011, 12:42. BioMed Central Full Text

Edwards D, Wang L, Sørensen P: Networkenabled gene expression analysis.
BMC Bioinforma 2012, 13:167. BioMed Central Full Text

Martini P, Sales G, Massa MS, Chiogna M, Romualdi C: Along signal paths: an empirical gene set approach exploiting pathway topology.
Nucl Acids Res 2013, 41:e19. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Gill R, Datta S, Datta S: A statistical framework for differential network analysis from microarray data.
BMC Bioinforma 2010, 11:95. BioMed Central Full Text

Aburatani S: Application of structure equation modeling for inferring a serial transcriptional regulation in yeast.
Gene Regul Syst Bio 2011, 5:7588. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Kalisch M, Mächler M, Colombo D, Maathuis MH, Bühlmann P: Causal inference using graphical models with the R package pcalg.

Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing.