Email updates

Keep up to date with the latest news and content from BMC Systems Biology and BioMed Central.

Open Access Methodology article

Inference of complex biological networks: distinguishability issues and optimization-based solutions

Gábor Szederkényi12*, Julio R Banga1* and Antonio A Alonso1

Author affiliations

1 (Bio)Process Engineering Group, IIM-CSIC, Spanish National Research Council, C/Eduardo Cabello, 6, 36208 Vigo, Spain

2 Process Control Research Group, MTA SZTAKI, Kende u. 13-17, H-1111 Budapest, Hungary

For all author emails, please log on.

Citation and License

BMC Systems Biology 2011, 5:177  doi:10.1186/1752-0509-5-177

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1752-0509/5/177


Received:31 May 2011
Accepted:28 October 2011
Published:28 October 2011

© 2011 Szederkényi et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The inference of biological networks from high-throughput data has received huge attention during the last decade and can be considered an important problem class in systems biology. However, it has been recognized that reliable network inference remains an unsolved problem. Most authors have identified lack of data and deficiencies in the inference algorithms as the main reasons for this situation.

Results

We claim that another major difficulty for solving these inference problems is the frequent lack of uniqueness of many of these networks, especially when prior assumptions have not been taken properly into account. Our contributions aid the distinguishability analysis of chemical reaction network (CRN) models with mass action dynamics. The novel methods are based on linear programming (LP), therefore they allow the efficient analysis of CRNs containing several hundred complexes and reactions. Using these new tools and also previously published ones to obtain the network structure of biological systems from the literature, we find that, often, a unique topology cannot be determined, even if the structure of the corresponding mathematical model is assumed to be known and all dynamical variables are measurable. In other words, certain mechanisms may remain undetected (or they are falsely detected) while the inferred model is fully consistent with the measured data. It is also shown that sparsity enforcing approaches for determining 'true' reaction structures are generally not enough without additional prior information.

Conclusions

The inference of biological networks can be an extremely challenging problem even in the utopian case of perfect experimental information. Unfortunately, the practical situation is often more complex than that, since the measurements are typically incomplete, noisy and sometimes dynamically not rich enough, introducing further obstacles to the structure/parameter estimation process. In this paper, we show how the structural uniqueness and identifiability of the models can be guaranteed by carefully adding extra constraints, and that these important properties can be checked through appropriate computation methods.

Background

During the last decade, the wide availability of high-throughput biological data has made it possible to produce new knowledge via a systems biology approach [1-3]. The inference of biochemical networks (i.e. the mathematical mapping of the molecular interactions in the cell) is therefore a question of key importance in the field. During the last decade, many methods have been developed to solve the network-inference (sometimes called reverse-engineering [4]) problems arising in e.g. gene expression [5-13], signal transduction [14-17] and metabolic networks [18-25].

In this context, it is particularly worth mentioning the DREAM initiative (Dialogue for Reverse Engineering Assessments and Methods) [26], which targeted the problems of cellular network inference and quantitative model building in systems biology. DREAM tries to address two fundamental questions: (i) how can we assess how well we are describing the networks of interacting molecules that underlie biological systems? and (ii) how can we know how well we are predicting the outcome of previously unseen experiments from our models? Interestingly, one of the main conclusions of the DREAM3 event was that the vast majority of the teams' predictions were statistically equivalent to random guesses. Moreover, even for particular problem instances like gene regulation network inference, there was no one-size-fits-all algorithm [27].

The use of a performance profiling framework with the DREAM3 benchmark problems revealed that current inference methods are affected by different types of systematic prediction errors [6]. These authors conclude that reliable network inference from gene expression data remains an unsolved problem. Further, they highlight two major difficulties in the case of gene-network reverse engineering: limited data (which may leave the inference problem underdetermined), and the difficulty of distinguishing direct from indirect regulation. Prill et al [27] further explored the issue of intrinsic impediments to network inference, designating identifiability of certain network edges and systematic false positives as the main barriers. In this paper, we consider the widely used reaction kinetic formalism, where dynamic models of biological networks are described by a set of ordinary differential equations (see, e.g. [28-30] and the related literature). In particular, we consider the central question of the identifiability of such a network as understood in the systems and control area [31,32].

Identifiability analysis studies whether there is a theoretical chance of uniquely determining the parameters of a mathematical model assuming perfect noise-free measurements and error-free modeling [33-35]. One of the early approaches for identifiability testing of nonlinear models is based on the Taylor-series expansion of the system output using the fact that the Taylor coefficients are unique [36]. A similar but more general method uses the generating series or Volterra-series coefficients of the system which is the nonlinear generalization of the Laplace-transform method used for linear systems [37]. In [38] a similarity transformation approach is proposed that gives necessary and sufficient conditions on local and global identifiability through the checking of nonlinear controllability and observability conditions. The appearance of differential algebra methods in systems and control theory [39,40] opened the possibility for new types of identifiability tests that have gained significant popularity [41-43]. Further theoretical developments in the field include the identifiability conditions of rational function state space models [43], the possible effect of initial conditions on identifiability [44], and the application of Lie-algebras [45]. While identifiability is the property of a certain parameterized model, a related notion called distinguishability addresses the problem whether two or more parameterized models (with the same or with different structure) can produce the same output for any allowed input [46-48]. The literature about identifiability and distinguishability of biological and chemical system models is relatively wide: Compartmental systems (that form a special subclass of general mass-action networks) are studied in [38,49,50]. The authors treat general nonlinear CRNs in [51,52] and [53] where it is shown that for thermodynamically meaningful models, nonlinearity reduces the chance of indistinguishability compared to the linear case [54]. Geometric conditions for the indistinguishability of CRNs are given in [55] with a related comment in [56]. Computer algebra tools can be successfully used for the symbolic computations needed for identifiability and distinguishability testing of complex models [57-60].

The importance of identifiability has been recognized previously in systems biology, too [14,61-64]. However, and despite a number of works illustrating ways to test the structural and practical identifiability of models [65-67], a significant portion of modeling studies in systems biology continue to ignore this key property.

It has been known for long that chemical reaction networks with different structure and/or parametrization may produce the same dynamical models describing the time-evolution of species concentrations [28,55]. A related problem, namely the non-unique structure of Petri nets associated to reaction network dynamics, is studied in [68]. Additionally, the value of prior information in biological network inference was clearly shown in [69,70] by applying Bayesian network models. However, a constructive optimization-based approach for the study of dynamically equivalent (or similar) reaction networks is a recent development [71-74], which we further extend in this paper.

As a novelty, we present in this paper the definition and a computational method to find the so-called core reactions that are present in any dynamically equivalent reaction network if the set of complexes is given a priori. Moreover, a computationally improved method is introduced for the computation of dense realizations of CRNs together with a modified algorithm to check the uniqueness of a constrained reaction network structure. Structural non-uniqueness and the use of the proposed computational methods will be illustrated with the help of biological models known from the literature.

The structure of the paper is the following. The 'Methods' section introduces the notions of chemical reaction networks, structural identifiability and distinguishability of dynamical models. Moreover, it contains the procedures to obtain core reactions of a network and its sparse and dense representations, which rely on standard methods of linear programming (LP) and mixed integer linear programming (MILP) [75-78]. The analysis of four biological system models can be found in the 'Results and discussion' section, followed by the conclusions.

Methods

The model class considered in this paper is of the following form

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M1">View MathML</a>

(1)

where x ∈ ℝn is the state vector, y ∈ ℝm is the output, u ∈ ℝk is the input, and θ ∈ ℝd denotes the parameter vector. We assume that the functions f and h are polynomial in the variables x, u and θ. Clearly, mass action type CRNs described in the following subsection (where θ is typically the set of reaction rate coefficients), and simple deterministic models of gene regulation such as the one in Example 4 belong to this model class.

Basic notions and known results related to mass-action models

In this subsection, the basic definitions for the description of CRNs will be given together with the already published results on finding dynamically equivalent network realizations with certain prescribed properties.

Structural and dynamical description of mass-action networks

Following [79] and several other works, we will characterize CRNs with the following three sets.

1. <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M2">View MathML</a> is the set of species or chemical substances.

2. <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M3">View MathML</a> is the set of complexes. Formally, the complexes are represented as linear combinations of the species, i.e.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M4">View MathML</a>

(2)

where αij are nonnegative integers and are called the stoichiometric coefficients.

3. <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M5">View MathML</a>, and Ci is transformed to Cj in the CRN} is the set of reactions. The relation <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M6','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M6">View MathML</a> will be denoted as Ci Cj. Moreover, a nonnegative weight, the reaction rate coefficient denoted by kij is assigned to each reaction Ci Cj. Naturally, if the reaction Ci Cj is not present in the CRN then kij = 0.

The above characterization naturally gives rise to the following graph structure (often called 'Feinberg-Horn-Jackson graph' or simply reaction graph) of a CRN [29]. The weighted directed graph G = (V, E) of a CRN consists of a finite nonempty set V of vertices and a finite set E of ordered pairs of distinct vertices called directed edges. The vertices correspond to the complexes, i.e. V = {C1, C2, ... Cm}, while the directed edges represent the reactions, i.e. (Ci, Cj) ∈ E if complex Ci is transformed to Cj in the CRN. The positive reaction rate coefficients kij are assigned as weights to the corresponding directed edges Ci Cj in the graph. (Edges corresponding to zero rate coefficients are not drawn in the reaction graph.) A set of complexes {C1, ..., Ck} is called a linkage class of a CRN, if the complexes of the set are linked to each other in the reaction graph but not to any other complex. It is remarked that loops (i.e. directed edges that start and end at the same vertex) are not allowed in reaction graphs.

Assuming mass-action kinetics, the following dynamical description will be used to describe the time-evolution of species concentrations [29,79]:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M7','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M7">View MathML</a>

(3)

where xi denotes the concentration of species Xi. Let us denote the transpose and the (i, j)th element of an arbitrary matrix W by WT and Wi,j, respectively, where i is the row index and j is the column index. The jth column of Y contains the composition of complex Cj, i.e. Yi,j = αji. The structure and parameters of the reaction graph are stored in the column conservation matrix Ak (also called the Kirchhoff matrix of the CRN) as follows

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M8','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M8">View MathML</a>

(4)

Finally, ψ : ℝn ↦ℝm is a monomial-type vector mapping defined by

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M9','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M9">View MathML</a>

(5)

Dynamical equivalence of mass-action networks

As it is known even from the early literature [28], CRNs with different structures and/or parametrization can give rise to the same kinetic differential equations. Therefore, we will call two CRNs given by the matrix pairs <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M10','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M10">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M11','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M11">View MathML</a>dynamically equivalent, if

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M12','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M12">View MathML</a>

(6)

where for <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M13','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M13">View MathML</a> have nonnegative integer entries, <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M14','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M14">View MathML</a> are valid Kirchhoff matrices, and

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M15','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M15">View MathML</a>

(7)

In this case, <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M16','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M16">View MathML</a> for i = 1, 2 are called realizations of a kinetic vector field f (see, e.g. [80] for more details). It is also appropriate to call <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M10','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M10">View MathML</a> a realization of <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M11','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M11">View MathML</a> and vice versa.

We will assume throughout the paper that the set of complexes (i.e. the stoichiometric matrix Y) is fixed and known before the computations. In this case, the condition (6) for dynamical equivalence can be written as

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M17','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M17">View MathML</a>

(8)

where <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M18','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M18">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M19','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M19">View MathML</a> are valid Kirchhoff matrices and M is the invariant matrix containing the coefficients of the monomials.

Among the dynamically equivalent realizations, it is important to recall the following characteristic ones described in [71,72]. A sparse realization contains the minimal number of reactions that is needed for the exact description of the corresponding dynamics (3). A dense realization contains the maximal number of reactions among dynamically equivalent realizations with a fixed complex set given by Y. While sparse realizations are generally structurally non-unique (as it will be illustrated for the constrained case, too, in Example 1), the structure of dense realizations with a given complex set is unique, and it contains every possible dynamically equivalent structure as a proper subgraph (i.e. a dense realization is a kind of super-structure) [71].

Known computation approaches for finding preferred CRN realizations

Here we briefly summarize the already published results corresponding to the computation of preferred dynamically equivalent CRN realizations (more details of these methods can be found in the publications [71-73,81]). The computation of dense and sparse realizations can be traced back to mixed integer linear programming (MILP) where the decision variables are the non-diagonal elements of Ak, the linear constraints encode the kinetic properties of the model, and the objective function contains integer variables for minimizing/maximizing the number of nonzero reaction rate coefficients [72]. It is remarked that the computation of sparse realizations is an NP-hard problem, where generally mixed integer linear programming cannot be avoided [82]. There exist certain conditions under which the problem can be solved in polynomial time [83] but these are often not fulfilled in the case of CRNs. Moreover, there are effective heuristics to address the problem [84], but convergence to one of the truly sparsest structures is not guaranteed. Luckily, the MILP-based computation of sparse CRN realizations can be parallelized effectively thus allowing a larger number of complexes to be treated. The computation of realizations having the minimal/maximal number of complexes or the reversibility property can also be solved in the MILP framework [71]. Moreover, it was shown in [73] that finding detailed balanced and complex balanced realizations of CRNs is a simple linear programming (LP) problem. Finally, weakly reversible dynamically equivalent CRN realizations can also be determined (if they exist) using MILP [85].

Constrained realizations of CRNs and testing their structural uniqueness

The following is a straightforward extension of the results published in [71]. To prove the uniqueness of a CRN structure given a set of simple constraints, we have to extend the notions of dense and sparse realizations. The constraint set denoted by <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M20">View MathML</a> will be used for the exclusion of selected reactions from the CRN, i.e. it is of the form:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M21','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M21">View MathML</a>

(9)

where s is the number of individual constraints, and ik jk for k = 1, ..., s. Now we can introduce the following definitions. A dynamically equivalent constrained realization of a CRN (Y, Ak) is a reaction network <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M22','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M22">View MathML</a> such that <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M23','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M23">View MathML</a> and the prescribed constraints <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M20">View MathML</a> in the form of eq. (9) are fulfilled for <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M24">View MathML</a>. A dynamically equivalent constrained dense realization of a CRN (Y, Ak) is a constrained realization that contains the maximal number of nonzero elements in <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M24">View MathML</a>. Similarly, the constrained sparse realization is a constrained realization with the minimal number of nonzeros in <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M24','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M24">View MathML</a>. To characterize constrained dense/sparse realizations, the results of [71] can be adapted easily as follows.

P1 Given a CRN (Y, Ak) and a constraint set <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M20','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M20">View MathML</a>, the unweighted reaction graph of any constrained realization is the subgraph of the unweighted reaction graph of the constrained dense realization.

P2 If the sets of complexes and constraints are fixed, then for any CRN, the structure of the constrained dense realization is unique.

P3 The reaction graph structure of a CRN with given sets of complexes and constraints is unique if and only if the unweighted directed graphs of its constrained dense and sparse realizations are identical.

The proofs of P1, P2 and P3 follow similar (although not completely identical) lines that were published in [71], and they are given for convenience in the Appendix at the end of the paper.

New concepts and computation results related to dynamically equivalent networks

This subsection contains new methodological contributions that extend the previously published results.

Making the computation of dense realizations more efficient

Computing dense realizations is treated originally also in a MILP-framework in [72]. However, using the structural uniqueness of such realizations given by P1, it is easy to give a polynomial-time algorithm based on a finite series of linear programming (LP) optimization steps. The idea of the improved algorithm is simple: the reaction Ci → Cj belongs to the (constrained) dense realization if and only if there exists any dynamically equivalent (constrained) realization where [Ak]j,i > 0. The result directly follows from the fact that the unweighted reaction graphs of (constrained) dense realizations give a unique super-structure. This allows us to formulate a polynomial-time method based on pure LP to determine (constrained) dense realizations as follows.

The task of determining which reactions of a CRN belong to the dense realization can be effectively solved through the following problem set consisting of m(m - 1) LP computation steps, where m is the number of complexes in the CRN.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M25','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M25">View MathML</a>

(10)

where the decision variables are the off-diagonal entries of Ak, and Uij are appropriately large positive upper bounds for [Ak]i,j to exclude the possibility of unbounded feasible solutions. The reaction Cq Cp is in the dense realization if and only if the maximal objective function value for fpq in (10) is positive. Let us denote the solution of (10) corresponding to (p, q), p q by <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M26','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M26">View MathML</a>. Since the linear equality and inequality constraints in (10) are trivially convex, we will use the average of the obtained solutions <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M26','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M26">View MathML</a> as a lower bound to compute a possible dense realization in the final optimization step. For this, we define

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M27','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M27">View MathML</a>

(11)

By construction, εij ≥ 0 ∀i j, and εij > 0 if and only if the reaction <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M28','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M28">View MathML</a> is in the dense realization. Then the actual dense realization can be determined by solving the following LP feasibility problem for Ak (with arbitrary linear objective function):

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M29','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M29">View MathML</a>

(12)

It is important to remark that the definition of εij in the form of (11) guarantees the solvability of (12). Naturally, the above described method can also be used for determining constrained dense realizations by adding constraints of the form (9) to the LP problems (10) and (12).

Using the notion and described properties of constrained realizations, we are now able to test the structural uniqueness of given CRNs. To accomplish this, only the (constrained) dense and sparse realizations have to be computed and compared (see P3). This method will be illustrated in Example 2.

Definition and computation of core and non-core reactions

We will call a reaction a core reaction, if it is present in any dynamically equivalent realization of a CRN with a given complex set (and possibly an additional constraint set). Other reactions, the rate coefficient of which can be zero in certain realizations, are called non-core reactions. It clearly follows from the definition, but is remarked separately that the set of core reactions is generally not identical to the set of reactions of a sparse realization. The identification of core reactions of a CRN has not been published yet, therefore we give the outline of the corresponding computation method. Firstly, a dense realization of the network has to be computed to get all the mathematically possible reactions. Then, for each reaction Cp Cq in the dense realization, the feasibility of the following constraint set has to be checked:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M30','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M30">View MathML</a>

(13)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M31','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M31">View MathML</a>

(14)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M32','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M32">View MathML</a>

(15)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M33','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M33">View MathML</a>

(16)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M34','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M34">View MathML</a>

(17)

where the matrix Ak contains the decision variables, and the known matrices are Y and M. It is well-known that this task is equivalent to an LP problem where the objective function is an arbitrary linear function of the elements of Ak [76]. Then, reaction Cp Cq is a core-reaction if and only if the set defined by (13)-(17) is empty (i.e. the corresponding LP problem is infeasible), because in this case there is no dynamically equivalent CRN realization where Cp Cq is not present. We remark here that the presented procedures for determining constrained dense realizations and computing core reactions are parallel in their original forms since the individual LP steps are independent of each other. Therefore the proposed methods can be very effectively implemented in a grid or multi-core hardware environment [86].

Basic concepts on structural identifiability and distinguishability

Let us recall eq. (1). Shortly speaking, global structural identifiability means that

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M35','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M35">View MathML</a>

(18)

where

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M36','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M36">View MathML</a>

(19)

and x(t, θ) denotes the solution of (1) with parameter vector θ. According to (18), a structurally non-identifiable model can produce exactly the same observed output with different parametrization. This is clearly a fundamental obstacle of determining the true model parameters from measurements even if the selected model structure is considered to be correct.

Let us denote two parameterized models with possibly different structure by <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M37','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M37">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M38','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M38">View MathML</a>, respectively, where θi denote the parameter vector. Then <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M39','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M39">View MathML</a> is called distinguishable from <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M40','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M40">View MathML</a> if for any θ1 (possibly except for a finite number of values) there is no θ2 such that the input-output behaviour of <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M39','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M39">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M40','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M40">View MathML</a> is the same [47]. Clearly, if <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M39','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M39">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M40','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M40">View MathML</a> are indistinguishable and both model structures are feasible in a certain application, then there is no way to decide from input-output measurements to which one corresponds to the true model that generated the data.

In the case of CRNs, we will assume that all species concentrations are measured (i.e. y = x), the input is zero (i.e. we study autonomous systems), and that the set of possible chemical complexes is given. Generally, the model parameter vector θ is the set of reaction rate coefficients which are the off-diagonal elements of Ak. Clearly, if a CRN has several different dynamically equivalent realizations, then these realizations are not distinguishable without additional constraints, and the model cannot be identifiable if all the rate coefficients are to be determined [55]. This situation can be improved by using prior knowledge in the form of adding further constraints on the model parameters such as the simple ones given by eq. (9). This way, the number of parameters to be estimated can be reduced and/or their feasibility region can be shrinked. It is important to note that although the structural uniqueness of a CRN definitely reduces the degree of non-identifiability (since zero and non-zero parameters are separated), it does not necessarily imply structural identifiability [53], and this latter property has to be checked by further numerical methods [31,32].

Results and discussion

In this section, the application of the previously mentioned methods for finding different dynamically equivalent structures will be illustrated using biological models taken from the literature. The detailed numerical data corresponding to Examples 1-3 are contained in a standard spreadsheet form with brief explanations in Additional file 1: CRN_data.xls.

Additional file 1. Detailed numerical data of the CRNs shown in Examples 1-3. This file contains the detailed data (i.e. stoichiometric matrices and reaction rate coefficients) of the dynamically equivalent reaction networks studied in Examples 1,2 and 3. The individual sheets correspond to the different examples.

Format: XLS Size: 120KB Download file

This file can be viewed with: Microsoft Excel ViewerOpen Data

Example 1: a positive feedback motif

The first example is a positive feedback motif shown in Figure 1a and taken from [87] containing 5 species, 11 complexes and 9 reactions. This basic motif is also discussed in [88]. The network contains a gene that promotes its own transcription and translation after dimerization. In the model, X1 and X2 denote the concentrations of protein monomers and dimers, respectively. X3 and X4 are the concentrations of unoccupied and occupied promoters, respectively, and X5 corresponds to the mRNA. The degradation of dimers is ignored. The roles of the reaction rate coefficients are the following: k1 and k2 are the dimerization and re-dimerization rates, respectively. k3 and k4 are the binding and dissociation rates of the dimer to the promoter, while k5 and k6 denote the activated and basal transcription rates, respectively. k7 is the degradation rate of the mRNA, k8 is the degradation rate of the monomer, and k9 denotes the translation rate. The time-evolution of the species-concentrations is described by the following ODEs:

thumbnailFigure 1. Positive feedback motif: original reaction graph and dense realization structure. (a) This subfigure shows the reaction graph of a gene regulation network model with positive feedback described originally in [87] and used in Example 1. (b) This subfigure shows all the mathematically possible reactions that can result in the same dynamical behaviour as the original biologically meaningful network shown in Figure 1. The core-reactions in the dense realization are shown with solid arrows, while the non-core reactions are indicated by dashed arrows.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M41','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M41">View MathML</a>

(20)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M42','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M42">View MathML</a>

(21)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M43','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M43">View MathML</a>

(22)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M44','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M44">View MathML</a>

(23)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M45','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M45">View MathML</a>

(24)

Our starting point is that we have a dynamic model of the process in the standard polynomial form of (20)-(24), the parameters of which are known from the results of identification and/or from literature. As we will see below, without well-defined constraints on the possible set of complexes and reactions, exactly the same dynamics can be realized in principle by a wide range of mechanisms.

The matrices characterizing the stoichiometry and graph structure of the system are the following (indicating only the nonzero non-diagonal elements of Ak):

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M46','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M46">View MathML</a>

(25)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M47','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M47">View MathML</a>

(26)

We used the following parameter values that were taken from the Appendix of [87].

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M48','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M48">View MathML</a>

(27)

where the units of measure are [M-1] for k1, ..., k4, and [min-1] for k5, ..., k9. The dynamically equivalent dense realization of the network is shown in Figure 1b, where the 8 core and 4 non-core reactions are indicated separately. The three different sparse structures are shown in the subplots of Figure 2. The first subplot is identical to the original structure shown in Figure 1a. This means that the mechanism cannot be described exactly with less than 9 reactions. It turns out from the second and third subplots that (at least mathematically), the degradation of mRNA is dynamically not a necessary element of the model. However, the biological plausibility of the mathematically possible structures and reactions always has to be carefully examined.

thumbnailFigure 2. Sparse realization structures for the positive feedback motif. Three different dynamically equivalent structures can be given for the positive feedback motif with the minimal number of reactions. The core and non-core reactions are indicated in the same way as in Figure 1.b.

As it is expected, the possible structures of sparse/dense realizations and the corresponding core and non-core reactions can change with the modification of parameter values. This is illustrated in Figure 3a, where the following randomly generated parameter values were used:

thumbnailFigure 3. The effect of modifying the complex set and the parameters. (a) The core and non-core reactions of the dense realization of the positive feedback motif are shown in this subfigure with a randomly selected parametrization that is different from the one given in [87]. (b) The core and non-core reactions of the dense realization of the positive feedback motif can be seen in this subfigure when an additional complex X2 + X4 is involved into the model.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M49','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M49">View MathML</a>

(28)

It is visible that the structure of the dense realization is the same as in Figure 1b but the core reactions are different from the ones shown there. Here the degradation of mRNA is described by a core reaction but interestingly, the reaction corresponding to translation is not a core one. Naturally, this implies that the possible sparse realization structures with the second parametrization are different from the ones shown in Figure 2. Note that here the only goal was to illustrate the possible change of core and non-core reactions, and therefore the biological relevance of the parameter values in eq. (28) is not assumed in this case.

In the next step, let us assume that another complex, namely X2 + X4 is allowed in the model (again not necessarily assuming biological meaningfulness in this particular case). With the addition of this new complex, the stoichiometric matrix of the system can be written as

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M50','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M50">View MathML</a>

(29)

The dense CRN realization of the dynamics (20)-(24) with the updated Y' matrix given in eq. (29) using the original parameters described in (27) is shown in Figure 3b, where the core and non-core reactions are again indicated. It is apparent that now there are only 5 core reactions, and none of the remaining 12 reactions are essential to represent the dynamics (20)-(24). This means that the introduction of a new complex increased the flexibility of the network (i.e. mathematically, the majority of the reactions can be substituted by other ones and the network still maintains its original dynamics). Of course, not any combination of the non-core reactions can be omitted from the network, because the sparse realizations show that at least 9 reactions are needed to keep dynamical equivalence. It can be computed easily that the theoretical maximum number of sparse realizations with different structures is <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M51','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M51">View MathML</a>. However, as the numerical experiments show, majority of these structures do not give a practically feasible dynamically equivalent realization.

The above results clearly show that certain mechanisms may remain undetectable (or they are falsely detected) even if we have complete species concentration measurements and full information about possible complex formation, that are not very realistic assumptions. Moreover, the sparsest dynamically equivalent structure of mass-action models is not unique, therefore sparsity enforcing approaches for determining 'true' reaction structures are not enough in themselves without the necessary amount of prior information given in the form of additional constraints. The practical situation is most often even worse than that, since the measurements are typically incomplete, noisy and sometimes dynamically not rich enough, that may introduce further obstacles to the structure/parameter estimation process [66,89].

Example 2: a biochemical switch in yeast cells

The following example is taken from [90] and it describes a 'switching device' in yeast cycle regulation. The detailed system description can be found in [90] and in the accompanying supporting information document. The order of state variables, corresponding to concentrations, is the same as in the original article, and is shown below:

x1: [Sic1], x2: [Sic1P], x3: [Clb], x4: [Clb·Sic1], x5: [Clb·Sic1P], x6: [Cdc14], x7: [Sic1P·Cdc14], x8: [Clb·Sic1P·Cdc14], x9: [Clb·Sic1·Clb]. The original structure with 18 reactions is shown in Figure 4a. The Y matrix of the network is given by

thumbnailFigure 4. Model of a biochemical switch in yeast cells. (a) The subfigure shows the original structure of a CRN describing a biochemical switch published in [90]. The numbering of species and rate coefficients is identical to the description in the original paper. (b) The dense realization of the network is depicted in this subfigure and contains 28 reactions, out of which only 12 belong to the set of core reactions.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M52','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M52">View MathML</a>

(30)

The non-zero off-diagonal elements of Ak are (the diagonal ones can be computed using the column conservation property):

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M53','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M53">View MathML</a>

(31)

Since there are no parameter values published in [90], we used the following randomly selected rate coefficients:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M54','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M54">View MathML</a>

(32)

The structure of the dense realization indicating the 12 core and 16 non-core reactions can be seen in Figure 4b.

It can be shown using the computational methods described in the 'Methods' section that the only possible sparse realization structure is identical to that of the original network. Therefore in this special case, there is only one possible reaction structure containing the minimal number of reactions. A straightforward approach to ensure the structural uniqueness of the whole network is to exclude all reactions that are not meaningful from the examined application's point of view or that are contradictory to modeling assumptions. For the current example, the removal of an unexpectedly low number of reactions is enough to obtain a unique structure. It can be shown by computing the corresponding constrained dense and sparse realizations, that excluding the reactions X5 X3 + X5, X4 X3 + X4, X2 + X3 X3 + X5, and X3 + X1 X3 + X4 is enough to make the reaction structure unique that is identical to the original structure shown in Figure 4. In other words, the exclusion of 4 well-selected reactions leads to the removal of an additional 6 reactions leaving only 18.

Example 3: a repressilator structure with 5 nodes and auto-activation

Consider the repressilator model shown in Figure 5 with 5 nodes where also auto-activation is assumed. Similarly to [91], we make the following assumptions: cooperative regulator binding, genes are present in constant amounts, transcription and translation are modeled by single-step kinetics, and finally, proteins are degraded by first order reactions. We note that complex dynamic phenomena such as multiple steady states or oscillations have been shown with a wide range of parameters in similar systems, especially in the case when the number of genes is odd [91]. We also assume that there is some protein production (leakage) when both the activator and the repressor are bound to the genes (although this assumption does not affect the main results of the forthcoming analysis). It is clearly shown in [92] that kinetic models with simple mass-action kinetics very effectively describe complex dynamics in genetic regulatory networks, therefore we follow the same modeling methodology. Using the assumptions listed above, the CRN describing the system is the following:

thumbnailFigure 5. A standard repressilator structure. A repressilator structure with 5 nodes and auto-activation is shown in the figure. The mass-action type CRN model of this structure contains 51 distinct complexes and 55 reactions.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M55','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M55">View MathML</a>

(33)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M56','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M56">View MathML</a>

(34)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M57','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M57">View MathML</a>

(35)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M58','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M58">View MathML</a>

(36)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M59','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M59">View MathML</a>

(37)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M60','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M60">View MathML</a>

(38)

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M61','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M61">View MathML</a>

(39)

for the index pairs (i, j) ∈ {(1, 5), (2, 1), (3, 2), (4, 3), (5, 4)}. In eqs. (33)-(39), Gi and Pi represent the ith gene and protein, respectively. For the genes, superscripts A and R refer to activated and repressed states, respectively. Let us denote with ri,k the reaction with rate coefficient ki,k in eqs. (33)-(39).

Two cases with different sets of randomly selected rate coefficients were studied, and the structures of the obtained results were the same. The numerical details can be found on the 3rd sheet of Additional File 1: CRN_data.xls. The total number of reactions for the repressilator model is 55 that is equal to the number of reactions in the sparse realization. The dense realization contains 70 reactions which means that there are a maximum of 15 more mathematically possible reactions while maintaining exactly the same dynamics as the original biological model. These additional reactions are the following:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M62','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M62">View MathML</a>

(40)

The number of core reactions in the model are 45. The set of non-core reactions (that, in principle can be substituted by other reactions) is given by

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M63','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M63">View MathML</a>

(41)

In particular, it is easy to show (see also Additional File 1: CRN_data.xls) that reactions <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M64','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M64">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M65','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M65">View MathML</a> are always indistinguishable. Similarly, the reaction <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M66','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M66">View MathML</a> can be substituted with the combination of reactions <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M67','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M67">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M68','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M68">View MathML</a>. It can be seen from these results that in order to have a model with unique structure, it is very important to a priori exclude all reactions that are not meaningful for the particular application.

Example 4: sparse linear gene regulation network models

For structural identification, gene regulation networks are often modeled as linear time-invariant systems [84,93] of the form

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M69','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M69">View MathML</a>

(42)

where A ∈ ℝn×n contains the connectivity information of the network. Ai,j > 0 indicates activation from node j to node i, while Ai,j < 0 means repression, diagonal elements of A represent auto-activation or auto-repression depending on their sign. x ∈ ℝn is the fully or partially measurable state of the system describing the time evolution of concentrations, and the input part Bu represents experimental perturbation (e.g. activation) of the genes. It is also a common assumption that the network is 'sparse' which means that there are only a limited number of activation or repression links between the nodes (i.e. the matrix A is 'sparse', too). But assuming sparsity can be a serious obstacle to identifiability as it will be shown.

First, consider the 'true' genetic network structure that was simulated and inferred in [93] and that is redrawn in Figure 6a. From the figure, we can reconstruct the structure of the corresponding A matrix as follows (the exact parameter values are not described in the paper, but the investigated structural properties do not depend on the individual parameter values)

thumbnailFigure 6. A sparse gene regulation network and their structural identifiability properties. (a) This subfigure is the reproduction of one of the sparse gene regulation networks used for structural identification in [93]. The network has 11 activation (solid edges), 6 suppression (dashed edges), and 3 autoregulation links (at nodes 1, 3 and 6) with undefined sign. (b) The subfigure shows that the vast majority of the randomly generated models in the case when N = 2 and K = 2 are structurally unidentifiable, because not all nodes of the network are reachable from the perturbed one. (c) As the network becomes less sparse (N = 10, K = 3), the structural identifiability properties are quickly improving. In this case, more than 80% of the randomly generated models are structurally identifiable.

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M70','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M70">View MathML</a>

(43)

where '+', '-' and '*' represent positive, negative and nonzero (but otherwise undefined) parameter values, respectively. If there are no prior assumptions about the structure of the interconnection matrix or about the relations between certain parameters, we can easily test the structural non-identifiability of the model by checking whether all nodes are reachable from the perturbed node on a directed path in the interconnection graph or not [33]. The reachability of nodes can be tested by several methods, e.g. a depth- or breadth-first-search (DFS or BFS) of the corresponding directed graphs that are fast polynomial-time algorithms [94]. To give a very simple example, it is clear from Figure 6a, that if nodes 1 or 2 were excited by an input signal, then the connections between the other nodes (3-10) would be undetectable by any method, however sophisticated it is. To examine whether situations like this one are common, we generated 10000 random state space models using the same method, and assuming zero initial conditions as in [93]. The connectivity of the corresponding directed graphs was tested using DFS. For 10 nodes and 2 nonzero elements in each row of A (i.e. N = 10, K = 2), we obtained that 73.38% of the generated models are structurally non-identifiable. The histogram showing the number of reachable states is shown in Figure 6b. The situation is dramatically improving if K is increased to 3 as shown in Figure 6c. In this case, around 17% of the models are structurally non-identifiable. When we have 20 nodes and 5 nonzero elements in each row of A (the second case investigated in [93]), then only 1.6% of the generated models are structurally non-identifiable. The results show that 'sparsity' has a clearly negative effect on structural identifiability because of limited information transmission between nodes. And finally, we did not speak at all about practical identifiability which is known to be a challenging issue even if the required structural properties are fulfilled [66].

Relation between high level networks and CRN structure

As shown in Example 3, the various possible dynamically equivalent CRN structures do not correspond to a different GRN structure, if all species concentration measurements are available and the mapping described in [92] is used for transforming the models into each other. Hence, exact matching of the dynamics of different GRN structures may generally be a too severe restriction. To extend this line of research, the relaxation of dynamical equivalence to 'close dynamical similarity' seems to be more meaningful but the corresponding definitions and computational methods are much more complex than in the case of dynamical equivalence. One promising recent approach to assess dynamical similarity of CRNs (that also adds more degrees of freedom to the computations) is the concept of 'linear conjugacy' [74]. However, it might happen that dynamically completely equivalent GRN structures will be shown in the future.

Conclusions

It has been shown in this paper using illustrative examples that biological network structures modeled by CRNs often cannot be uniquely determined even if the structure of the corresponding mathematical model is assumed to be known and all dynamical variables are measurable. The structural uniqueness and identifiability of the models often require additional constraints.

The main new contributions of the paper are the following. Firstly, core reactions present in any dynamically equivalent CRN realizations with a given complex set have been defined and a simple procedure with polynomial time-complexity has been given for determining them. Clearly, the core reactions are mandatory elements of every dynamically equivalent CRN realization assuming a fixed complex set. Secondly, a polynomial-time method based on linear programming for computing dense realizations has been outlined that is more scalable and therefore presents a clear improvement over the previously used MILP-based method. As an additional minor extension of previous results, constrained realizations of CRNs have been defined, and a computational method has been proposed to check the uniqueness of constrained realizations.

The presented concepts and algorithms were illustrated on previously published models describing biological processes. It was shown that the set of core reactions may change with the modification of the complex set. The examples also show that the frequently applied sparsity assumption alone is not enough for structural uniqueness of CRNs. Moreover, in the case of simple linear genetic network models, too sparse structures can degrade identifiability properties. The results further support the fact that as much prior information as possible should be incorporated in structural and parametric inference problems.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors contributed to the conception and design of the work. JRB and GS selected and evaluated the examples. GS performed the numerical computations. All authors contributed to the writing of the manuscript. All authors read and approved the final manuscript.

A Appendix

Proof of P1. Let us denote the ith column of any matrix W by W·,i. The proof is based on the following well known fact of linear algebra. Consider an inhomogeneous set of linear equations:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M71','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M71">View MathML</a>

(44)

If x = p is any particular solution of (44) then the entire solution set for (44) can be characterized as

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M72','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M72">View MathML</a>

(45)

The matrix equation Y · Ak = M (see eqs. (3) and (8)) obviously defines m sets of linear equations of the form

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M73','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M73">View MathML</a>

(46)

Let us choose any i indexing the sets of equations in (46). For simplicity, let p = [Ak]·,i, b = M·,i. Let us assume that there are z elements of the constraint set (9) where jk = i for k = 1, ..., s. (If z is 0, then we get the earlier result proved in [71].) These constraints can be expressed by further linear equations of the form:

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M74','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M74">View MathML</a>

(47)

The equation sets (46) and (47) can be written into a single set of equations as

<a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M75','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M75">View MathML</a>

(48)

where <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M76','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M76">View MathML</a> and <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M77','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M77">View MathML</a>. Let us assume now that p is a dense solution for (48), i.e. it contains the maximal possible number of nonzero elements. If p has no zero elements, then the result to be proved is trivially satisfied. Therefore, without the loss of generality we can assume that the first l < m elements of p are nonzero, while the rest are zero, i.e. pj ≠ 0 for j = 1, ..., l, and pj = 0 for j = l + 1, ..., m. This can always be achieved by the appropriate reordering of the elements of p. Assume now that p' ∈ ℝm is also a solution for (48), but <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M78','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M78">View MathML</a> for some c ∈ ℤ, l + 1 ≤ c m. Then p' = p + v, where <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M79','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M79">View MathML</a>, and vc ≠ 0. In this case, p″ = p + λ · v is also a solution for (48) for any λ ∈ ℝ and λ can always be chosen so that <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M80','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M80">View MathML</a> for j = 1, ..., l, and there is at least one index l + 1 ≤ c m for which <a onClick="popup('http://www.biomedcentral.com/1752-0509/5/177/mathml/M81','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1752-0509/5/177/mathml/M81">View MathML</a>. However, this contradicts to the assumption that p is a dense solution for (48).

Proof of P2. This is a straightforward consequence of P1, since the unweighted directed graphs of all constrained dense realizations must be identical.

Proof of P3. If the graph structure of the constrained realization is unique, then it trivially implies that the structures of the constrained dense and sparse realizations are identical, since there exists only one possible constrained reaction structure. If the structures of the constrained dense and sparse realizations are identical, then the number of nonzero reaction rates is the same in any constrained realizations including the constrained dense ones. Then it follows from P1 that the constrained reaction structure is unique.

Acknowledgements

This work was financially supported by project CAFE (Computer Aided Food Process Engineering) FP7-KBBE-2007-1 (Grant no: 212754). The authors acknowledge the support by the Spanish government, MICINN project 'MultiSysBio' (ref. DPI2008-06880-C03-02), and by CSIC intramural project 'BioREDES' (ref. PIE-201170E018). GS acknowledges the partial support of the Hungarian Scientific Research Fund through grant no. K83440. The authors thank Dr. Irene Otero Muras (Dept. of Computational Systems Biology, ETH Zurich) and Prof. Zsolt Tuza (MTA SZTAKI) for the fruitful discussions. The authors wish to thank the anonymous reviewers for their helpful comments.

References

  1. Wolkenhauer O: Systems biology: The reincarnation of systems theory applied in biology?

    Briefings in Bioinformatics 2001, 2:258-270. PubMed Abstract | Publisher Full Text OpenURL

  2. Stelling J: Mathematical models in microbial systems biology.

    Current Opinion in Microbiology 2004, 7:513-518. PubMed Abstract | Publisher Full Text OpenURL

  3. Kitano H: Computational systems biology.

    Nature 2002, 420:206-210. PubMed Abstract | Publisher Full Text OpenURL

  4. Csete M, Doyle J: Reverse engineering of biological complexity.

    Science 2002, 295:1664-1669. PubMed Abstract | Publisher Full Text OpenURL

  5. De Jong H: Modeling and simulation of genetic regulatory systems: a literature review.

    Journal of Computational Biology 2002, 9:67-103. PubMed Abstract | Publisher Full Text OpenURL

  6. Marbach D, Prill R, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G: Revealing strengths and weaknesses of methods for gene network inference.

    Proceedings of the National Academy of Sciences of the United States of America 2010, 107:6286-6291. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Ay A, Arnosti D: Mathematical modeling of gene expression: a guide for the perplexed biologist.

    Critical Reviews in Biochemistry and Molecular Biology 2011, 46:137-151. PubMed Abstract | Publisher Full Text OpenURL

  8. Hecker M, Lambeck S, Toepfer S, Van Someren E, Guthke R: Gene regulatory network inference: data integration in dynamic models - a review.

    Biosystems 2009, 96:86-103. PubMed Abstract | Publisher Full Text OpenURL

  9. Bansal M, Belcastro V, Ambesi-Impiombato A, Di Bernardo D: How to infer gene networks from expression profiles.

    Molecular Systems Biology 2007., 3

    article number 78

    OpenURL

  10. Tegner J, Yeung M, Hasty J, Collins J: Reverse engineering gene networks: integrating genetic perturbations with dynamical modeling.

    Proceedings of the National Academy of Sciences of the United States of America 2003, 100:5944-5949. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. de la Fuente A, Brazhnik P, Mendes P: Linking the genes: inferring quantitative gene networks from microarray data.

    Trends in Genetics 2002, 18:395-398. PubMed Abstract | Publisher Full Text OpenURL

  12. Ronen M, Rosenberg R, Shraiman B, Alon U: Assigning numbers to the arrows: parameterizing a gene regulation network by using accurate expression kinetics.

    Proceedings of the National Academy of Sciences of the United States of America 2002, 99:10555-10560. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  13. Thomas R, Paredes CJ, Mehrotra S, Hatzimanikatis V, Papoutsakis ET: A model-based optimization framework for the inference of regulatory interactions using time-course DNA microarray expression data.

    BMC Bioinformatics 2007, 8:228-239. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  14. Schaber J, Klipp E: Model-based inference of biochemical parameters and dynamic properties of microbial signal transduction networks.

    Current Opinion in Biotechnology 2010, 22:109-116. PubMed Abstract | Publisher Full Text OpenURL

  15. Li S, Assmann S, Albert R: Predicting essential components of signal transduction networks: a dynamic model of guard cell abscisic acid signaling.

    PLoS Biology 2006, 4:1732-1748. OpenURL

  16. Saez-Rodriguez J, Kremling A, Conzelmann H, Bettenbrock K, Gilles E: Modular analysis of signal transduction networks.

    IEEE Control Systems Magazine 2004, 24:35-52. OpenURL

  17. Klamt S, Saez-Rodriguez J, Lindquist J, Simeoni L, Gilles E: A methodology for the structural and functional analysis of signaling and regulatory networks.

    BMC Bioinformatics 2006, 7:56.

    (pp. 1-26)

    PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  18. Arkin A, Shen P, Ross J: A test case of correlation metric construction of a reaction pathway from measurements.

    Science 1997, 277:1275-1279. Publisher Full Text OpenURL

  19. Stelling J, Klamt S, Bettenbrock K, Schuster S, Gilles E: Metabolic network structure determines key aspects of functionality and regulation.

    Nature 2002, 420:190-193. PubMed Abstract | Publisher Full Text OpenURL

  20. Jeong H, Tombor B, Albert R, Oltvai Z, Barabási A: The large-scale organization of metabolic networks.

    Nature 2000, 407:651-654. PubMed Abstract | Publisher Full Text OpenURL

  21. Forster J, Famili I, Fu P, Palsson B, Nielsen J: Genome-scale reconstruction of the Saccharomyces cerevisiae metabolic network.

    Genome Research 2003, 13:244. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. Kell D: Metabolomics and systems biology: making sense of the soup.

    Current Opinion in Microbiology 2004, 7:296-307. PubMed Abstract | Publisher Full Text OpenURL

  23. Sauer U: Metabolic networks in motion: 13C-based flux analysis.

    Molecular Systems Biology 2006., 2

    article number 62

    OpenURL

  24. Crampin E, Schnell S, McSharry P: Mathematical and computational techniques to deduce complex biochemical reaction mechanisms.

    Progress in Biophysics and Molecular Biology 2004, 86:77-112. PubMed Abstract | Publisher Full Text OpenURL

  25. Yuan Y, Stan GB, Warnick S, Goncalves J: Robust dynamical network structure reconstruction.

    Automatica 2011, 47:1230-1235. Publisher Full Text OpenURL

  26. Stolovitzky G, Monroe D, Califano A: Dialogue on Reverse-Engineering Assessment and Methods.

    Annals of the New York Academy of Sciences 2007, 1115:1-22. PubMed Abstract | Publisher Full Text OpenURL

  27. Prill R, Marbach D, Saez-Rodriguez J, Sorger P, Alexopoulos L, Xue X, Clarke N, Altan-Bonnet G, Stolovitzky G: Towards a rigorous assessment of systems biology models: the DREAM3 challenges.

    PLoS ONE 2010, 5:e9202.

    (pp. 1-18)

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Horn F, Jackson R: General mass action kinetics.

    Archive for Rational Mechanics and Analysis 1972, 47:81-116. OpenURL

  29. Feinberg M: Chemical reaction network structure and the stability of complex isothermal reactors - I. The deficiency zero and deficiency one theorems.

    Chemical Engineering Science 1987, 42:2229-2268. Publisher Full Text OpenURL

  30. Érdi P, Tóth J: Mathematical Models of Chemical Reactions. In Theory and Applications of Deterministic and Stochastic Models. Manchester, Princeton: Manchester University Press, Princeton University Press; 1989. OpenURL

  31. Ljung L: System Identification: Theory for the User. 2nd edition. Prentice Hall; 1999. OpenURL

  32. Walter E, Pronzato L: Identification of Parametric Models. Springer; 1997. OpenURL

  33. Bellmann R, Aström KJ: On structural identifiability.

    Mathematical Biosciences 1970, 7:329-339. Publisher Full Text OpenURL

  34. Walter E: Identification of State Space Models. Springer; 1982. OpenURL

  35. Walter E: Identifiability of Parametric models. Pergamon Press, Oxford; 1987. OpenURL

  36. Pohjanpalo H: System identifiability based on the power series expansion of the solution.

    Mathematical Biosciences 1978, 41:21-33. Publisher Full Text OpenURL

  37. Walter E, Lecourtier Y: Global approaches to identifiability testing for linear and nonlinear state space models.

    Mathematics and Computers in Simulation 1982, 24:472-482. Publisher Full Text OpenURL

  38. Vajda S, Godfrey K, Rabitz H: Similarity transformation approach to identifiability analysis of nonlinear compartmental models.

    Mathematical Biosciences 1989, 93:217-248. PubMed Abstract | Publisher Full Text OpenURL

  39. Diop S, Fliess M: On nonlinear observability.

    First European Control Conference, ECC'91, Grenoble 1991, 152-157. OpenURL

  40. Fliess M, Glad T: An algebraic approach to linear and nonlinear control. In Essays on Control: Perspectives in the Theory and its Applications. Edited by Treutelman HL, Willeuis JC. Boston: Birkhauser; 1993:223-267. OpenURL

  41. Ljung L, Glad T: On global identifiability of arbitrary model parametrizations.

    Automatica 1994, 30:265-276. Publisher Full Text OpenURL

  42. Margaria G, Riccomagno E, White LJ: Structural identifiability analysis of some highly structured families of statespace models using differential algebra.

    Journal of Mathematical Biology 2004, 49:433-454. PubMed Abstract | Publisher Full Text OpenURL

  43. Margaria G, Riccomagno E, Chappell MJ, Wynn HP: Differential algebra methods for the study of the structural identifiability of rational function state-space models in the biosciences.

    Mathematical Biosciences 2001, 174:1-26. PubMed Abstract | Publisher Full Text OpenURL

  44. Saccomani M, Audoly S, D'Angio L: Parameter identifiability of nonlinear systems: the role of initial conditions.

    Automatica 2003, 39:619-632. Publisher Full Text OpenURL

  45. Yates J, Evans N, Chappell M: Structural identifiability analysis via symmetries of differential equations.

    Automatica 2009, 45:2585-2591. Publisher Full Text OpenURL

  46. Walter E, Lecourtier Y, Happel J: On the structural output distinguishability of parametric models, and its relations with structural identifiability.

    IEEE Transactions on Automatic Control 1984, AC-29:56-57. OpenURL

  47. Walter E, Pronzato L: On the identifiability and distinguishability of nonlinear parametric models.

    Mathematics and Computers in Simulation 1996, 42:125-134. Publisher Full Text OpenURL

  48. Evans ND, Chappell MJ, Chapman MJ, Godfrey KR: Structural indistinguishability between uncontrolled (autonomous) nonlinear analytic systems.

    Automatica 2004, 40:1947-1953. Publisher Full Text OpenURL

  49. Pohjanpalo H, Wahlström B: On the uniqueness of linear compartmental systems.

    International Journal of Systems Science 1977, 8:619-632. Publisher Full Text OpenURL

  50. Yates J, Jones R, Walker M, Cheung S: Structural identifiability and indistinguishability of compartmental models.

    Expert Opinion on Drug Metabolism and Toxicology 2009, 5:295-302. PubMed Abstract | Publisher Full Text OpenURL

  51. Godfrey K, Chapman M, Vajda S: Identifiability and indistinguishability of nonlinear pharmacokinetic models.

    Journal of Pharmacokinetics and Pharmacodynamics 1994, 22:229-251. OpenURL

  52. Davidescu F, Jorgensen S: Structural parameter identifiability analysis for dynamic reaction networks.

    Chemical Engineering Science 2008, 63:4754-4762. Publisher Full Text OpenURL

  53. Vajda S, Rabitz H: Identifiability and distinguishability of general reaction systems.

    Journal of Physical Chemistry 1994, 98:5265-5271. Publisher Full Text OpenURL

  54. Vajda S, Rabitz H: Identifiability and distinguishability of first-order reaction systems.

    Journal of Physical Chemistry 1988, 92:701-707. Publisher Full Text OpenURL

  55. Craciun G, Pantea C: Identifiability of chemical reaction networks.

    Journal of Mathematical Chemistry 2008, 44:244-259. Publisher Full Text OpenURL

  56. Szederkényi G: Comment on "Identifiability of chemical reaction networks" by G. Craciun and C. Pantea.

    Journal of Mathematical Chemistry 2009, 45:1172-1174. Publisher Full Text OpenURL

  57. Pohjanpalo H, Wahlström B: Software for solving identification and identifiability problems, e.g. in compartmental systems.

    Mathematics and Computers in Simulation 1982, 24:490-493. Publisher Full Text OpenURL

  58. Raksányi A, Lecourtier Y, Walter E, Venot A: Identifiability and distinguishability testing via computer algebra.

    Mathematical Biosciences 1985, 77:245-266. Publisher Full Text OpenURL

  59. Bellu G, Saccomani M, Audoly S, D'Angio L: DAISY: A new software tool to test global identifiability of biological and physiological systems.

    Computer Methods and Programs in Biomedicine 2007, 88:52-61. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  60. Saccomani M, Audoly S, Bellu G, D'Angio L: Examples of testing global identifiability of biological and biomedical models with the DAISY software.

    Computers in Biology and Medicine 2010, 40:402-407. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  61. Liao J, Boscolo R, Yang Y, Tran L, Sabatti C, Roychowdhury V: Network component analysis: reconstruction of regulatory signals in biological systems.

    Proceedings of the National Academy of Sciences of the United States of America 2003, 100:15522-15527. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  62. Yue H, Brown M, Knowles J, Wang H, Broomhead D, Kell D: Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF- κB signalling pathway.

    Molecular Biosystems 2006, 2:640-649. PubMed Abstract | Publisher Full Text OpenURL

  63. Zak D, Gonye G, Schwaber J, Doyle F: Importance of input perturbations and stochastic gene expression in the reverse engineering of genetic regulatory networks: insights from an identifiability analysis of an in silico network.

    Genome Research 2003, 13:2396-2405. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  64. Chen WW, Niepel M, Sorger PK: Classic and contemporary approaches to modeling biochemical reactions.

    Genes & Development 2010, 24:1861-1875. PubMed Abstract | Publisher Full Text OpenURL

  65. Jaqaman K, Danuser G: Linking data to models: data regression.

    Nature Reviews Molecular Cell Biology 2006, 7:813-819. PubMed Abstract | Publisher Full Text OpenURL

  66. Banga JR, Balsa-Canto E: Parameter estimation and optimal experimental design.

    Essays in Biochemistry 2008, 45:195-209. PubMed Abstract | Publisher Full Text OpenURL

  67. Ashyraliyev M, Fomekong-Nanfack Y, Kaandorp J, Blom J: Systems biology: parameter estimation for biochemical models.

    FEBS Journal 2009, 276:886-902. PubMed Abstract | Publisher Full Text OpenURL

  68. Soliman S, Heiner M: A unique transformation from ordinary differential equations to reaction networks.

    PLoS ONE 2010, 5:e14284.

    (pp. 1-6)

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  69. Werhli AV, Husmeier D: Reconstructing gene regulatory networks with Bayesian networks by combining expression data with multiple sources of prior knowledge.

    Statistical Applications in Genetics and Molecular Biology 2007., 6

    article no. 15

    OpenURL

  70. Mukherjee S, Speed TP: Network inference using informative priors.

    Proceedings of the National Academy of Sciences of the United States of America 2008, 105:14313-14318. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  71. Szederkényi G, Hangos KM, Péni T: Maximal and minimal realizations of reaction kinetic systems: computation and properties.

    MATCH Communications in Mathematical and in Computer Chemistry 2011, 65:309-332. OpenURL

  72. Szederkényi G: Computing sparse and dense realizations of reaction kinetic systems.

    Journal of Mathematical Chemistry 2009, 47:551-568. OpenURL

  73. Szederkényi G, Hangos KM: Finding complex balanced and detailed balanced realizations of chemical reaction networks.

    Journal of Mathematical Chemistry 2011, 49:1163-1179. Publisher Full Text OpenURL

  74. Johnston MD, Siegel D: Linear conjugacy of chemical reaction networks.

    Journal of Mathematical Chemistry 2011, 49:1263-1282. Publisher Full Text OpenURL

  75. Wang Y, Zhang XS, Chen L: Optimization meets systems biology.

    BMC Systems Biology 2010, 4(Suppl 2):S1.

    (pp. 1-4)

    PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  76. Dantzig GB, Thapa MN: Linear Programming 1: Introduction. Springer-Verlag; 1997. OpenURL

  77. Floudas C: Nonlinear and Mixed-Integer Optimization. Oxford University Press; 1995. OpenURL

  78. Raman R, Grossmann IE: Integration of logic and heuristic knowledge in MINLP optimization for process synthesis.

    Computers and Chemical Engineering 1992, 16:155-171. Publisher Full Text OpenURL

  79. Feinberg M: [http://www.che.eng.ohio-state.edu/%7efeinberg/LecturesOnReactionNetworks/] webcite

    Lectures on chemical reaction networks.Notes of lectures given at the Mathematics Research Center, University of Wisconsin. 1979. OpenURL

  80. Hárs V, Tóth J: On the inverse problem of reaction kinetics. In Qualitative Theory of Differential Equations. Volume 30. Edited by Farkas M, Hatvani L. North-Holland, Amsterdam; 1981::363-379. OpenURL

  81. Hangos KM, Szederkényi G: Mass action realizations of reaction kinetic system models on various time scales.

    Journal of Physics: Conference Series (5th International Workshop on Multi-Rate Processes and Hysteresis) 2011, 268:012009. OpenURL

  82. Jokar S, Pfetsch ME: Exact and approximate sparse solutions of underdetermined linear equations.

    SIAM Journal on Scientific Computing 2008, 31:23-44. Publisher Full Text OpenURL

  83. Donoho DL: For most large undetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution.

    Communications on Pure and Applied Mathematics 2006, 59:903-934. OpenURL

  84. Zavlanos MM, Julius AA, Boyd SP, Pappas GJ: Inferring stable genetic networks from steady-state data.

    Automatica 2011, 47:1113-1122. Publisher Full Text OpenURL

  85. Szederkényi G, Hangos KM, Tuza Z: Finding Weakly Reversible Realizations of Chemical Reaction Networks Using Optimization.

    MATCH Communications in Mathematical and in Computer Chemistry 2012, 67:193-212. OpenURL

  86. Kim H, Bond R: Multicore software technologies: a survey.

    IEEE Signal Processing Magazine 2009, 26:80-89. OpenURL

  87. Mileyko Y, Joh RI, Weitz JS: Small-scale copy number variation and large-scale changes in gene expression.

    Proceedings of the National Academy of Sciences of the United States of America 2008, 105:16659-16664. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  88. Alon U: An Introduction to Systems Biology: Design Principles of Biological Circuits. Chapman & Hall/CRC Mathematical & Computational Biology; 2007. OpenURL

  89. Ljung L: Perspectives on system identification.

    Annual Reviews in Control 2010, 34:1-12. Publisher Full Text OpenURL

  90. Conradi C, Flockerzi D, Raisch J, Stelling J: Subnetwork analysis reveals dynamic features of complex (bio)chemical networks.

    Proceedings of the National Academy of Sciences of the United States of America 2007, 104:19175-19180. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  91. Müller S, Hofbauer J, Endler L, Flamm C, Widder S, Schuster P: A generalized model of the repressilator.

    Journal of Mathematical Biology 2006, 53:905-937. PubMed Abstract | Publisher Full Text OpenURL

  92. Dilao R, Muraro D: A software tool to model genetic regulatory networks. Applications to the modeling of threshold phenomena and of spatial patterning in drosophila.

    PLoS ONE 2010, 5:e10743.

    (pp. 1-10)

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  93. Bansal M, di Bernardo D: Inference of gene networks from temporal gene expression profiles.

    IET Systems Biology 2007, 1:306-312. PubMed Abstract | Publisher Full Text OpenURL

  94. Bang-Jensen J, Gutin G: Digraphs: Theory, Algorithms and Applications. Springer; 2001. OpenURL