Email updates

Keep up to date with the latest news and content from BMC Bioinformatics and BioMed Central.

Open Access Research article

Analysis of feedback loops and robustness in network evolution based on Boolean models

Yung-Keun Kwon and Kwang-Hyun Cho*

Author Affiliations

Department of Bio and Brain Engineering and KI for the BioCentury, Korea Advanced Institute of Science and Technology, 335 Gwahangno, Yuseong-gu, Daejeon, 305-701, Republic of Korea

For all author emails, please log on.

BMC Bioinformatics 2007, 8:430  doi:10.1186/1471-2105-8-430

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2105/8/430


Received:30 April 2007
Accepted:7 November 2007
Published:7 November 2007

© 2007 Kwon and Cho; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Many biological networks such as protein-protein interaction networks, signaling networks, and metabolic networks have topological characteristics of a scale-free degree distribution. Preferential attachment has been considered as the most plausible evolutionary growth model to explain this topological property. Although various studies have been undertaken to investigate the structural characteristics of a network obtained using this growth model, its dynamical characteristics have received relatively less attention.

Results

In this paper, we focus on the robustness of a network that is acquired during its evolutionary process. Through simulations using Boolean network models, we found that preferential attachment increases the number of coupled feedback loops in the course of network evolution. Whereas, if networks evolve to have more coupled feedback loops rather than following preferential attachment, the resulting networks are more robust than those obtained through preferential attachment, although both of them have similar degree distributions.

Conclusion

The presented analysis demonstrates that coupled feedback loops may play an important role in network evolution to acquire robustness. The result also provides a hint as to why various biological networks have evolved to contain a number of coupled feedback loops.

Background

There is a growing interest in understanding the principle of biological network evolution and many network growth models have been proposed to investigate this issue. For example, the duplication-mutation models suggest that network growth occurs through the duplication of an existing node and mutation of links by deleting an existing link or adding a new link [1,2]. In addition, other models such as random static network models where links are randomly connected [3,4], aging vertex network models where the probability of producing new edges decreases with the age of a network node [5], and small-world network models based on an interpolation between regular ring lattices and randomly connected graphs [6], have been introduced. Meanwhile, there have been various studies on the topological properties of biological networks, and one prominent result is about the scale-free property indicating the power-law distribution in the number of connections (degree) per network node [7]. In this regard, finding a network growth model that can produce a scale-free network has become an issue. Preferential attachment, a way of adding new interactions to a network node in proportion to the connectivity of the node (i.e. the number of links connected to the node), has been considered the most plausible growth model [8], and it has been partially supported by showing that old proteins or genes are likely to have high connectivity in many biological networks [9,13]. According to preferential attachment, the motive of evolution is only connectivity, which is therefore regarded as the most important factor characterizing the biological networks. However, this approach only focuses on the topological characteristics of networks and there have been other studies showing that the connectivity has a limitation in explaining the entire functional or dynamical behavior of biological networks. For example, it has been shown that the connectivity of a network node is not related to its essentiality in transcriptional regulatory networks [14] and a highly connected node is not directly related to the robustness of the network [15]. In addition, the connectivity of a node cannot explain the influence of a metabolite in a phenotypic state in metabolic networks [16]. In these respects, there is a pressing need to investigate other features of network evolution that can better explain the dynamical properties of biological networks. To this end, in this paper we consider a feedback loop, a circular chain of interaction, as another important factor. Feedback loops are important because they are ubiquitously found in most biological networks. Moreover, it is intriguing that feedback loops exist in the form of multiple coupled feedback loops in many biological systems such as budding yeast polarization [17], eukaryotic chemotaxis [18], and Ca2+ spikes [19]. Note that a system with multiple feedback loops is more robust than one with a single feedback loop [20-22]. In this paper, we hypothesize that coupled feedback loops affect dynamical behaviors in the course of network evolution, particularly affecting the robustness of a network. Many cellular systems are known to be considerably robust to environmental changes. For instance, the chemotaxis receptor of Escherichia coli maintains its tumbling frequency despite significant changes in rate constants or ligand concentrations [23]. The development of the correct segment polarity patterns in Drosophila melanogaster embryos is robust to the changes of the initial conditions, reaction parameters, or certain gene products [24].

To verify our hypothesis on the relationship between feedback loops and the robustness of a network, we employ random Boolean network models where the directed links between nodes are randomly chosen and then consider the evolution of biological networks that are represented by a directed graph. For example, the growth of gene regulatory networks in various organisms through the duplication of transcriptional factors or target genes can be described by using directed networks [13]. Then, we define the robustness of a Boolean network model as the probability with which either an initial state mutation or an update rule mutation does not cause the network converge to a new attractor. The 'attractor' has an important meaning in biological network dynamics. In Boolean network models, a state trajectory starts from an initial state and eventually converges to either a fixed-point or a limit-cycle attractor. Hence, these attractors represent the dynamical behaviors of biological networks such as multistability, homeostasis, and oscillations [25-27]. For example, in the regulatory network of inducing phenotype variations in bacteria, some epigenetic traits are represented by multiple fixed-point attractors [28]. This multistability is a common feature of adaptive processes in bacteria. In addition, mitogen-activated protein kinase cascades in animal cells [25,26] and cell cycle regulatory circuits in Xenopus and Saccharomyces cerevisiae [27,29] are known to produce multistable attractors. However, the transcriptional network of mRNAs for Notch signaling molecules shows an oscillation with a 2-h cycle by Hes1 transcription [30] and this corresponds to a limit-cycle attractor. Such Hes1 oscillation is found in various cell types. As illustrated by these examples, attractors represent the essential dynamics of biological networks. Therefore, converging to a different attractor due to mutations in the network can be interpreted as lacking robustness. This concept has been widely used in a number of previous studies employing computational approaches [31,34].

Results and Discussion

Change of robustness and the number of feedback loops during network evolution

To test our hypothesis, we have performed extensive computer simulations using Boolean network models (see Methods). We have examined robustness with respect to the initial state mutations (Fig. 1a), update rule mutations (Fig. 1b), and the number of coupled feedback loops (Fig. 1c) of a network during its evolution. The simulations showed that the networks evolved by preferential attachment (PA) are more robust and produce more coupled feedback loops than random networks. This suggests that the number of coupled feedback loops might be highly correlated to the robustness of a network during evolution. To further investigate this relationship, we have examined the networks evolved by the "Feedback" model which favors a larger number of feedback loops under a selection pressure (α). (In this simulation, three values, 1, 10, and 30, were chosen for α) Compared with the networks evolved using the "PA" model, the networks evolved using the Feedback" model showed very similar results for α = 1 with respect to both robustness and the number of coupled feedback loops. Furthermore, the higher the selection pressure was, the larger the number of feedback loops the evolved networks had, which results in enhanced robustness. This implies that coupled feedback loops are critical in enhancing the robustness of networks during evolution. Feedback loops help maintain the stability of a network and multiple coupled feedback loops strengthen this function. We verified that this result holds irrespective of the update function used for evolution (see additional data file 1).

Additional file 1. The variation of robustness and the number of coupled feedback loops along with network evolution. (a) Change of robustness with respect to initial state mutations with network evolution using the "CONJ" model. (b) Change of robustness with respect to initial state mutations with network evolution using the "DISJ" model. (c) Change of robustness with respect to update rule mutations with network evolution using the "CONJ" model. (d) Change of robustness with respect to update rule mutations with network evolution using the "DISJ" model. (e) Change of the number of coupled feedback loops with network evolution using the "CONJ" model. (f) Change of the number of coupled feedback loops with network evolution using the "DISJ" model. All results were averaged over 1,000 networks.

Format: PDF Size: 47KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

thumbnailFigure 1. The variation of robustness and the number of coupled feedback loops along with network evolution. (a) Change of robustness with respect to initial update mutations during network evolution for the "CONJ-DISJ" model (see Methods). (b) Change of robustness with respect to update rule mutations during network evolution for the "CONJ-DISJ" model. (c) Change of the number of coupled feedback loops during network evolution for the "CONJ-DISJ" model. Here, "PA" refers to the networks that are evolved using the preferential attachment model and "Feedback" refers to the networks that are evolved by favoring the formation of coupled feedback loops with a selection pressure (α) (see Methods for details). In addition, "Random" denotes the randomly generated networks with the same number of nodes and links as those in "PA" and "Feedback". Network size means the number of nodes (|V|) of a network. For each model, the average and the confidence level (95%) of robustness over 1,000 networks are shown on the y-axis. The Boolean networks using the "CONJ" and "DISJ" models also showed similar results (see additional data file 1).

Correlation between robustness and the number of feedback loops

To further investigate the relationship between the number of coupled feedback loops and network robustness, we performed additional simulations. We randomly generated 9,000 Boolean networks with |V| = 10 and |A| = 14, and 15,000 Boolean networks with |V| = 14 and |A| = 20. Then, we investigated the robustness against the number of coupled feedback loops in these networks (Fig. 2, Additional file 2). We found that there is a strong positive correlation between the number of coupled feedback loops and the robustness of a network. However, we observed that the number of attractors decreases as the number of coupled feedback loops increases. In other words, networks with more coupled feedback loops have a smaller number of attractors and thereby become more robust. This result explains the reason why the "Feedback" model produced more robust networks in Fig. 1. It also explains why the networks evolved using "PA" are more robust than the random networks, since if a network is evolved using preferential attachment, then it has more coupled feedback loops than a random network. Preferential attachment adds a new link to a highly connected node with a higher probability, so it is more likely to produce new feedback loops as the highly connected nodes could already pertain to other coupled feedback loops.

thumbnailFigure 2. The correlation between the number of coupled feedback loops and the robustness of the network. (a) Average results from 9,000 networks with 10 nodes and 14 links. (b) Average results from 15,000 networks with 14 nodes and 20 links. The robustness of all the networks was computed based on the "CONJ-DISJ" model. The Boolean networks using the "CONJ" and "DISJ" models also showed similar results (see additional data file 2).

Additional file 2. The correlation between the number of coupled feedback loops and the robustness of a network. (a) Average results from 9,000 networks with 10 nodes and 14 links using the "CONJ" model. (b) Average results from 16,000 networks with 14 nodes and 20 links using the "CONJ" model. (c) Average results from 9,000 networks with 10 nodes and 14 links using the "DISJ" model (d) Average results from 16,000 networks with 14 nodes and 20 links using the "DISJ" model.

Format: PDF Size: 31KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Degree distributions

In the foregoing developments, we found different dynamics between the "PA" and "Feedback" models which cannot be fully explained in terms of connectivity. We checked the degree distributions of networks obtained by "PA", "Feedback (α = 10)", and "Random" (Fig. 3a). The proportion of nodes with a high degree in both "PA" and "Feedback" was relatively larger than that of "Random". However, the degree distribution of "Feedback" was similar to that of "PA". We observed that the scale-free property was also preserved in the networks evolved using "Feedback". In other words, network evolution following the "Feedback" model generates a few but substantial number of highly connected hubs together with most of the other nodes only having a few links. Hence, the different characteristics of robustness between the "PA" and "Feedback" models cannot be properly explained by degree distribution alone. Furthermore, we checked the in-degree and out-degree distributions separately (Fig. 3b and Fig. 3c, respectively, Additional file 3). Compared with the total degree distribution, we found a significant difference between "Feedback" and "PA". The proportion of nodes with a high in-degree or out-degree in "Feedback" was smaller than that of "PA". This implies that the difference between the in-degree and out-degree of the hub nodes in the networks evolved using "Feedback" is smaller than that in the networks evolved using "PA". This may occur because "Feedback" attaches new links to a node in the direction towards forming a feedback loop and this results in balance between the in- and out-degrees, while "PA" introduces new links in a random direction.

thumbnailFigure 3. Degree distributions of the evolved networks. (a) Total degree distributions. (b) In-degree distributions. (c) Out-degree distributions. All distributions were examined over 1,000 different networks that were evolved using the "PA" and "Feedback"(α = 10) models until |V| = 46. In addition, the "Random" networks were examined. The networks evolved by the "Feedback" model with other selection pressure values also showed similar degree distributions (see additional data file 3).

Additional file 3. Degree distributions of the evolved networks. (a) Total degree distribution. (b) In-degree distribution. (c) Out-degree distribution. All distributions were examined over 1,000 different networks that were evolved using "Feedback" models until |V| = 46.

Format: PDF Size: 31KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Coupled feedback loops in the evolution of biological networks

The simulation results have shown that the number of coupled feedback loops is positively correlated with the robustness of networks and, therefore, it might guide the direction of the network evolution. The strong relationship between coupled feedback loops and the robust behavior of a network is partially supported by previous experiments on various biological networks. For example, it was found that three distinct feedback loops responsible for genetic regulation, mRNA attenuation, and enzyme inhibition that regulate tryptophan concentrations in Escherichia coli. The complex regulatory network formed by the feedback loops induces a rapid and stable response, while being robust against uncertainties [22]. Such coupled feedback loop-based mechanisms were also observed in many other regulatory networks including the regulation of arabinose uptake in Escherichia coli [35], the regulation of galactose uptake [36] and the osmotic effect [37] in Saccharomyces cerevisiae, and the regulation of insulin signaling pathways [38]. Another example is the circadian clock consisting of two interlinked transcriptional feedback loops [39,40]. These multiple coupled feedback loops enhance the robustness of the oscillators in producing accurate circadian rhythms. In the Drosophila segment polarity network, it was shown that three feedback loops are necessary and sufficient to ensure the robustness of pattern formation [41]. The bacterial chemotaxis pathways in Escherichia coli and Bacillus subtilis were compared [42] and it was revealed that the core control strategy for signal processing is realized by the same feedback loop in both organisms. Moreover, in Bacillus subtilis, there are two additional feedback loops and these provide an additional layer of robustness that might have been acquired through evolution. Recent studies on network fragility also provide a further insight into the important roles of feedback loops in biological networks. In an uncontrolled tumor growth, feedback introduces fragilities such as the possibility of self-sustaining and cascading failures [43]. A high gain in negative feedback loops leads to steady-state stability, but fragilities might cause potentially inaccurate transient responses since the time-varying perturbations can be amplified [44]. These examples and our own simulation results lead us to infer importance of the role of multiple feedback loops in robust biological dynamics.

As previously mentioned, if a biological network has been evolved to contain many coupled feedback loops for robustness, the old nodes in the network are involved with a relatively larger number of feedback loops compared with the new nodes. For verification, we have examined the signaling network of the hippocampal CA1 neuron of mice [45]. The number of coupled feedback loops involved with the proteins was plotted against the estimated age of the grouped proteins as described in Methods. It was found that older proteins tend to have a larger number of coupled feedback loops (Fig. 4).

thumbnailFigure 4. The correlation between the number of feedback loops and the protein age of the neuronal signaling network. The number of feedback loops are plotted against the age of the proteins. The proteins are grouped into four categories according to their estimated ages: "Newest", "New", "Old", and "Oldest" (see Methods for details). For each protein group, the average and the confidence level (95%) of the NuFBL are shown on the y-axis.

Conclusion

In this paper, we have discovered that coupled feedback loops play an important role in enhancing the robustness of a network during its evolution. Preferential attachment, which has been known to generate scale-free properties, brings about coupled feedback loops and thereby also results in robust networks. However, if networks are evolved using a method that is biased towards having coupled feedback loops, this results in much more robust networks than those evolved using preferential attachment, while preserving almost the same degree distribution. Our study suggests that coupled feedback loops might be a critical factor in determining robust dynamics during network evolution.

Unfortunately, there are few large-scale biological networks with information about feedback loops at present. To obtain a deeper insight into network evolution with regard to the formation of feedback loops, we need to further investigate real large-scale biological networks. In addition, we need to note that there are some biological networks which do not follow preferential attachment models such as protein-protein interaction networks where proteins can have simultaneous interactions with other proteins. Therefore, future study should include the development of new network evolution models reflecting both the structural and the dynamical characteristics of biological networks and the analysis of real large-scale biological networks.

Methods

Boolean network models

A Boolean network is represented by a directed graph G = (V, A) where V is a set of Boolean variables and A is the set of ordered pairs of the variables called directed links. Each vi V has a value of 1 ("on") or 0 ("off") which represents the possible states of the corresponding elements, e.g. in gene networks, the value 1 represents the 'turn-on' status in which a gene is expressed. A directed link (vi, vj) has a positive ("activating") or negative ("inhibiting") relationship from vi to vj. The value of each variable vi at time t + 1 is determined by the values of ki other variables <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M1','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M1">View MathML</a> with a link to vi at time t by the Boolean function <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M2','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M2">View MathML</a>. Hence, we can write the update rule as vi(t + 1) = <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M3','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M3">View MathML</a> where we use either a logical conjunction or disjunction for all signed relationships in fi. For example, if a Boolean variable v has a positive relationship from v1, a negative relationship from v2, and a positive relationship from v3, the conjunction and disjunction update rules are v(t + 1) = v1(t) ∧ <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M4">View MathML</a>(t) ∧ v3(t) and v(t + 1) = v1(t) ∨ <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M4">View MathML</a>(t) ∨ v3(t), respectively. Then, in the case of a conjunction, the value of v at time t + 1 is 1 only if the values of v1, v2, and v3 at time t are 1, 0, and 1, respectively. Whereas in the case of a disjunction, the value of v at time t + 1 is 1 if at least one of the states of the clauses, v1(t), <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M4','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M4">View MathML</a>(t), and v3(t) is 1. In many previous studies, biological networks were successfully described by Boolean models using conjunction or disjunction update functions [46-49]. In this paper, we assume three models: "CONJ", "DISJ", and "CONJ-DISJ". The "CONJ" and "DISJ" models mean that every node in a network has a conjunction or disjunction update function, respectively. However, the conjunction or disjunction update function is randomly selected (with a uniform probability distribution) at each network node in the "CONJ-DISJ" model. All variables are synchronously updated.

In this paper, we only consider a connected Boolean network since a Boolean network composed of disconnected multiple subnetworks can be considered as a composition of such connected subnetworks. Given a Boolean network with N Boolean variables, v1, v2,⋯, vN, we define a state as a vector consisting of values of the Boolean variables: there are 2N states in total. Each state transitions to another state through a set of N Boolean update functions, f1, f2,⋯,fN. We can construct a state transition network that represents the transition of each state. A state trajectory starts from a state and converges to either a fixed-point or a limit-cycle attractor. These attractors can describe the various behaviors of biological systems such as multi-stability, homeostasis, and oscillations. A network is considered robust if the trajectories starting from different initial states converge to the same attractor. More specifically, we define the robustness of a network in two ways. The first definition of robustness is with respect to the initial state mutations. For this, we construct S with a set of pairs of states (s, s') where a Hamming distance of s and s' is one. (The Hamming distance between two states is defined as the number of Boolean variables having different values.) Hence, there are N2N-1 such pairs of states. The robustness of a network is defined as the ratio of the number of pairs of states whose trajectories converge to the same attractor to the total number of pairs of states in S. The initial state mutation corresponds to the abnormal state (or malfunctioning) of a protein or gene caused by mutations. The second definition is with respect to the update rule mutations. This is defined as the probability with which two state trajectories starting from the same state do not converge to different attractors where one of the two trajectories is obtained by the update rule mutation with a probability of 0.2 for the erroneous updating of v. The update rule mutation corresponds to the change of relationships between nodes by removing or adding links. Although the Boolean network is a highly simplified model of a real biological network, it can still capture many essential aspects of real dynamics [31]. Most of all, it allows us to investigate the dynamics of large-scale networks [46].

Definition of feedback loops

Given a network composed of a set of nodes and a set of links between the nodes, a feedback loop is a closed simple cycle where the nodes are not revisited except the starting and ending nodes. For example, v0 v1 v2 → ⋯ → vL-1 vL is a feedback loop of length L(≥ 1) if there are links from vi-1 to vi (i = 1, 2,...,L) with v0 = vN and vj vk for j, k ∈ {0, 1,...,L - 1}. The number of feedback loops in a network denotes the total number of different feedback loops.

Evolution of Boolean networks

In our simulations, a network is evolved as follows: a small network with |V| = 4 and |A| = 5 is randomly generated. Two new nodes, va and vb, and three links are added to the network where one link is a connection from va to vb, another is a connection from an existing node to va, and the other is a connection from vb to an existing node (see additional file 4 for an illustration). This forms a network with |V| = 6 and |A| = 8. By repeating this process, the network complexity can be controlled. In other words, the average number of links per node converges to approximately <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M5">View MathML</a> since |A| = <a onClick="popup('http://www.biomedcentral.com/1471-2105/8/430/mathml/M5','MathML',630,470);return false;" target="_blank" href="http://www.biomedcentral.com/1471-2105/8/430/mathml/M5">View MathML</a>|V| - 1 holds.

Additional file 4. Illustration of the network evolution process. Given a network with four nodes, v1, v2, v3, and v4, it grows by repetitively adding two nodes (va and vb) and three interaction links where one link is from an existing node to a new node (i.e. from v2 to va), another link is from a new node to an existing node (i.e. from vb to v4), and the other link is between the new nodes (i.e. from va to vb).

Format: PDF Size: 33KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

As a network with |V| grows into a new network with |V| + 2 in the above process, N2 number of candidate pairs of links emerge and, therefore, a selection mechanism should be involved. In this paper, two models are considered: "PA" (the traditional preferential attachment model) and "Feedback" (the newly introduced model favoring the formation of coupled feedback loops). The "PA" model represents the traditional preferential attachment mechanism and employs the fitness of a candidate network as follows:

fitness = ka + kb,

where ka and kb are the connectivities of the nodes that are newly linked to va and vb, respectively. The "Feedback" model chooses a pair of new links according to the following fitness:

fitness = nα,

where n is the number feedback loops of the candidate network and α is the selection pressure.

Analysis of the hippocampal CA1 neuronal signaling network

We considered all 545 proteins and their 1,258 interactions in the signaling network of the hippocampal CA1 neuron of mice [45]. In Fig. 4, proteins were grouped according to their estimated ages. To estimate the protein age, we searched the orthologs of the proteins in five completely sequenced eukaryotic genomes, Mus musculus, Drosophila melanogaster, Caenorhabditis elegans, Saccharomyces cerevisiae, and Schizosaccharomyces pombe using the Inparanoid database [50]. We defined four protein groups as follows: the proteins present in all eukaryotes ("Oldest"); the proteins present in Mus musculus, Drosophila melanogaster, and Caenorhabditis elegans but absent from Saccharomyces cerevisiae and Schizosaccharomyces pombe ("Old"); the proteins present in Mus musculus and Drosophila melanogaster but absent from Caenorhabditis elegans, Saccharomyces cerevisiae, and Schizosaccharomyces pombe ("New"); the proteins present in Mus musculus but absent from the other four genomes ("Newest"). As it is difficult to enumerate all possible feedback loops in such a large network, we only considered the feedback loops whose length (i.e. the number of links comprising the feedback loop) is less than or equal to 10.

Authors' contributions

YKK conceived of the study, wrote the program code, and drafted the manuscript. KHC guided the study, coordinated the project, and revised the manuscript. Both authors read and approved the final manuscript.

Acknowledgements

This work was supported by the Korea Science and Engineering Foundation (KOSEF) grant funded by the Korea government (MOST) (M10503010001-07N030100112) and also supported from the Korea Ministry of Science and Technology through the Nuclear Research Grant (M20708000001-07B0800-00110) and the 21C Frontier Microbial Genomics and Application Center Program (Grant MG05-0204-3-0). It was also supported in part from the Korea Ministry of Commerce, Industry & Energy through the Korea Bio-Hub Program (2005-B0000002).

References

  1. Vázquez A, Flammini A, Maritan A, Vespignani A: Modeling of Protein Interaction Networks.

    ComPlexUs 2003, 1:38-44. Publisher Full Text OpenURL

  2. Sole RV, Pastor-Satorras R, Smith E, Kepler TB: A model of large-scale proteome evolution.

    Advances in Complex Systems 2002, 5:43-54. Publisher Full Text OpenURL

  3. Erdös P, Rényi A: On random graphs.

    Publicationes Mathematicae 1959, 6:290-297. OpenURL

  4. Callaway DS, Hopcroft JE, Kleinberg JM, Newman ME, Strogatz SH: Are randomly grown graphs really random?

    Physical Review E 2001, 64:041902. Publisher Full Text OpenURL

  5. Klemm K, Eguiluz VM: Growing scale-free networks with small-world behavior.

    Physical Review E 2002, 65:036123. Publisher Full Text OpenURL

  6. Watts DJ, Strogatz SH: Collective dynamics of 'small-world' networks.

    Nature 1998, 393(6684):440-442. PubMed Abstract | Publisher Full Text OpenURL

  7. Barabasi AL, Oltvai ZN: Network biology: understanding the cell's functional organization.

    Nature Reviews Genetics 2004, 5:101-113. PubMed Abstract | Publisher Full Text OpenURL

  8. Barabasi AL, Albert R: Emergence of scaling in random networks.

    Science 1999, 286(5439):509-512. PubMed Abstract | Publisher Full Text OpenURL

  9. Eisenberg E, Levanon EY: Preferential attachment in the protein network evolution.

    Physical Review Letters 2003, 91:138701. PubMed Abstract | Publisher Full Text OpenURL

  10. Light S, Kraulis P, Elofsson A: Preferential attachment in the evolution of metabolic networks.

    BMC Genomics 2005, 6:159. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  11. Wagner A: How the global structure of protein interaction networks evolves.

    Proceedings Biological Sciences, The Royal Society 2003, 270:457-466. Publisher Full Text OpenURL

  12. Kim PM, Lu LJ, Xia Y, Gerstein MB: Relating three-dimensional structures to protein networks provides evolutionary insights.

    Science 2006, 314(5807):1938-1941. PubMed Abstract | Publisher Full Text OpenURL

  13. Teichmann SA, Babu MM: Gene regulatory network growth by duplication.

    Nature Genetics 2004, 36(5):492-496. PubMed Abstract | Publisher Full Text OpenURL

  14. Yu H, Greenbaum D, Lu HX, Zhu X, Gerstein M: Genomic analysis of essentiality within protein networks.

    Trends in Genetics 2004, 20:227-231. PubMed Abstract | Publisher Full Text OpenURL

  15. Balaji S, Iyer LM, Aravind L, Babu MM: Uncovering a hidden distributed architecture behind scale-free transcriptional regulatory networks.

    Journal of Molecular Biology 2006, 360:204-212. PubMed Abstract | Publisher Full Text OpenURL

  16. Mahadevan R, Palsson BO: Properties of metabolic networks: structure versus function.

    Biophysical Journal 2005, 88:L07-09. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  17. Ozbudak EM, Becskei A, van Oudenaarden A: A system of counteracting feedback loops regulates Cdc42p activity during spontaneous cell polarization.

    Developmental Cell 2005, 9:565-571. PubMed Abstract | Publisher Full Text OpenURL

  18. Weiner OD, Neilsen PO, Prestwich GD, Kirschner MW, Cantley LC, Bourne HR: A PtdInsP(3)- and Rho GTPase-mediated positive feedback loop regulates neutrophil polarity.

    Nature Cell Biology 2002, 4:509-513. PubMed Abstract | Publisher Full Text OpenURL

  19. Keizer J, Li YX, Stojilkovic S, Rinzel J: InsP3-induced Ca2+ excitability of the endoplasmic reticulum.

    Molecular and Cellular Biology 1995, 6:945-951. OpenURL

  20. Kim D, Kwon YK, Cho KH: Coupled positive and negative feedback circuits form an essential building block of cellular signaling pathways.

    BioEssays 2007, 29:85-90. PubMed Abstract | Publisher Full Text OpenURL

  21. King RW, Deshaies RJ, Peters JM, Kirschner MW: How proteolysis drives the cell cycle.

    Science 1996, 274:1652-1659. PubMed Abstract | Publisher Full Text OpenURL

  22. Venkatesh KV, Bhartiya S, Ruhela A: Multiple feedback loops are key to a robust dynamic performance of tryptophan regulation in Escherichia coli.

    FEBS Letters 2004, 563(1–3):234. PubMed Abstract | Publisher Full Text OpenURL

  23. Alon U, Surette MG, Barkai N, Leibler S: Robustness in bacterial chemotaxis.

    Nature 1999, 297:168-171. OpenURL

  24. von Dassow G, Meir E, Munro EM, Odell GM: The segment polarity network is a robust developmental module.

    Nature 2000, 406:188-192. PubMed Abstract | Publisher Full Text OpenURL

  25. Ferrell JE Jr, Machleder EM: The biochemical basis of an all-or-none cell fate switch in Xenopus oocytes.

    Science 1998, 280:895-898. PubMed Abstract | Publisher Full Text OpenURL

  26. Bhalla US, Ram PT, Iyengar R: MAP kinase phosphatase as a locus of fexibility in a mitogen-activated protein kinase signaling network.

    Science 2002, 297:1018-1023. PubMed Abstract | Publisher Full Text OpenURL

  27. Pomerening JR, Sontag ED, Ferrell JE Jr: Building a cell cycle oscillator: hysteresis and bistability in the activation of Cdc2.

    Nature Cell Biology 2003, 5:346-351. PubMed Abstract | Publisher Full Text OpenURL

  28. Smits WK, Kuipers OP, W VJ: Phenotypic variation in bacteria: the role of feedback regulation.

    Nature Reviews Microbiology 2006, 4:259-271. PubMed Abstract | Publisher Full Text OpenURL

  29. Sha W, Moore J, Chen K, Lassaletta AD, Yi CS, Tyson JJ, Sible JC: Hysteresis drives cell-cycle transitions in Xenopus laevis egg extracts.

    Proceedings of the National Academy of Sciences, USA 2003, 100(3):975-980. Publisher Full Text OpenURL

  30. Hirata H, Yoshiura S, Ohtsuka T, Bessho Y, Harada T, Yoshikawa K, Kageyama R: Oscillatory expression of the bHLH factor Hes1 regulated by a negative feedback loop.

    Science 2002, 298:840-843. PubMed Abstract | Publisher Full Text OpenURL

  31. Li F, Long T, Lu Y, Ouyang Q, Tang C: The yeast cell-cycle network is robustly designed.

    Proceedings of the National Academy of Sciences, USA 2004, 101:4781-4786. Publisher Full Text OpenURL

  32. Kitano H: Biological robustness.

    Nature Reviews Genetics 2004, 5(11):826-837. PubMed Abstract | Publisher Full Text OpenURL

  33. Ciliberti S, Martin OC, Wagner A: Robustness can evolve gradually in complex regulatory gene networks with varying topology.

    PLoS Computational Biology 2007, 3(2):e15. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  34. Huang S, Eichler G, Bar-Yam Y, Ingber DE: Cell fates as high-dimensional attractor states of a complex gene regulatory network.

    Physical Review Letters 2005, 94(12):128701. PubMed Abstract | Publisher Full Text OpenURL

  35. Schleif R: Regulation of the L-arabinose operon of Escherichia coli.

    Trends in Genetics 2000, 16(12):559. PubMed Abstract | Publisher Full Text OpenURL

  36. Ideker T, Thorsson V, Ranish JA, Christmas R, Buhler J, Eng JK, Bumgarner R, Goodlett DR, Aebersold R, Hood L: Integrated genomic and proteomic analyses of a systematically perturbed metabolic network.

    Science 2001, 292(5518):929. PubMed Abstract | Publisher Full Text OpenURL

  37. Hohmann S: Osmotic stress signaling and osmoadaptation in yeasts.

    Microbiology and Molecular Biology Reviews 2002, 66(2):300. Publisher Full Text OpenURL

  38. Sedaghat AR, Sherman A, Quon MJ: A mathematical model of metabolic insulin signaling pathways.

    American journal of physiology. Endocrinology and metabolism 2002, 283(5):E1084. PubMed Abstract | Publisher Full Text OpenURL

  39. Cheng P, Yang Y, Liu Y: Interlocked feedback loops contribute to the robustness of the Neurospora circadian clock.

    Proceedings of the National Academy of Sciences, USA 2001, 98(13):7408. Publisher Full Text OpenURL

  40. Cyran SA, Buchsbaum AM, Reddy KL, Lin MC, Glossop NR, Hardin PE, Young MW, Storti RV, Blau J: vrille, Pdp1, and dClock form a second feedback loop in the Drosophila circadian clock.

    Cell 2003, 112(3):329. PubMed Abstract | Publisher Full Text OpenURL

  41. Ingolia NT: Topology and robustness in the Drosophila segment polarity network.

    PLoS Biology 2004, 2(6):e123. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  42. Rao CV, Kirby JR, Arkin AP: Design and diversity in bacterial chemotaxis: a comparative study in Escherichia coli and Bacillus subtilis.

    PLoS Biology 2004, 2(2):e49. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  43. Kitano H: Cancer as a robust system: implications for anticancer therapy.

    Nature Reviews Cancer 2004, 4(3):227-235. PubMed Abstract | Publisher Full Text OpenURL

  44. Csete ME, Doyle JC: Reverse engineering of biological complexity.

    Science 2002, 295(5560):1664-1669. PubMed Abstract | Publisher Full Text OpenURL

  45. Ma'ayan A, Jenkins S, Neves S, Hasseldine A, Grace E, Dubin-Thaler B, Eungdamrong N, Weng G, Ram P, Rice J, Kershenbaum A, Stolovitzky G, Blitzer R, Iyengar R: Formation of regulatory patterns during signal propagation in a Mammalian cellular network.

    Science 2005, 309(5737):1078-1083. PubMed Abstract | Publisher Full Text OpenURL

  46. Kwon YK, Cho KH: Boolean dynamics of biological networks with multiple coupled feedback loops.

    Biophysical Journal 2007, 92:2975-2981. PubMed Abstract | Publisher Full Text OpenURL

  47. Albert R: Boolean Modeling of Genetic Regulatory Networks.

    Lecture Notes in Physics 2004, 650:459-481. OpenURL

  48. Faure A, Naldi A, Chaouiya C, Thieffry D: Dynamical analysis of a generic Boolean model for the control of the mammalian cell cycle.

    Bioinformatics 2006, 22:e124-131. PubMed Abstract | Publisher Full Text OpenURL

  49. Huang S, Ingber EE: Shape-dependent control of cell growth, differentiation, and apoptosis: switching between attractors and in cell regulatory networks.

    Experimental Cell Research 2000, 261:91-103. PubMed Abstract | Publisher Full Text OpenURL

  50. O'Brien KP, Remm M, Sonnhammer EL: Inparanoid: a comprehensive database of eukaryotic orthologs.

    Nucleic Acids Research 2005, 33:D476-480. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL