<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1471-2105-9-43</ui>
   <ji>1471-2105</ji>
   <fm>
      <dochead>Research article</dochead>
      <bibl>
         <title>
            <p>Predicting biological system objectives de novo from internal state measurements</p>
         </title>
         <aug>
            <au id="A1" ce="yes">
               <snm>Gianchandani</snm>
               <mi>P</mi>
               <fnm>Erwin</fnm>
               <insr iid="I1"/>
               <email>erwin@virginia.edu</email>
            </au>
            <au id="A2" ce="yes">
               <snm>Oberhardt</snm>
               <mi>A</mi>
               <fnm>Matthew</fnm>
               <insr iid="I1"/>
               <email>matto@virginia.edu</email>
            </au>
            <au id="A3">
               <snm>Burgard</snm>
               <mi>P</mi>
               <fnm>Anthony</fnm>
               <insr iid="I2"/>
               <email>aburgard@genomatica.com</email>
            </au>
            <au id="A4">
               <snm>Maranas</snm>
               <mi>D</mi>
               <fnm>Costas</fnm>
               <insr iid="I3"/>
               <email>costas@engr.psu.edu</email>
            </au>
            <au id="A5" ca="yes">
               <snm>Papin</snm>
               <mi>A</mi>
               <fnm>Jason</fnm>
               <insr iid="I1"/>
               <email>papin@virginia.edu</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>Department of Biomedical Engineering University of Virginia Box 800759, Health System Charlottesville, VA 22908 USA</p>
            </ins>
            <ins id="I2">
               <p>Genomatica, Inc. San Diego, CA 92121 USA</p>
            </ins>
            <ins id="I3">
               <p>Department of Chemical Engineering The Pennsylvania State University University Park, PA 16802 USA</p>
            </ins>
         </insg>
         <source>BMC Bioinformatics</source>
         <issn>1471-2105</issn>
         <pubdate>2008</pubdate>
         <volume>9</volume>
         <issue>1</issue>
         <fpage>43</fpage>
         <url>http://www.biomedcentral.com/1471-2105/9/43</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="pmpid">18218092</pubid>
               <pubid idtype="doi">10.1186/1471-2105-9-43</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>29</day>
               <month>11</month>
               <year>2007</year>
            </date>
         </rec>
         <acc>
            <date>
               <day>24</day>
               <month>1</month>
               <year>2008</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>24</day>
               <month>1</month>
               <year>2008</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2008</year>
         <collab>Gianchandani et al; licensee BioMed Central Ltd.</collab>
         <note>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <sec>
               <st>
                  <p>Background</p>
               </st>
               <p>Optimization theory has been applied to complex biological systems to interrogate network properties and develop and refine metabolic engineering strategies. For example, methods are emerging to engineer cells to optimally produce byproducts of commercial value, such as bioethanol, as well as molecular compounds for disease therapy. Flux balance analysis (FBA) is an optimization framework that aids in this interrogation by generating predictions of optimal flux distributions in cellular networks. Critical features of FBA are the definition of a biologically relevant objective function (e.g., maximizing the rate of synthesis of biomass, a unit of measurement of cellular growth) and the subsequent application of linear programming (LP) to identify fluxes through a reaction network. Despite the success of FBA, a central remaining challenge is the definition of a network objective with biological meaning.</p>
            </sec>
            <sec>
               <st>
                  <p>Results</p>
               </st>
               <p>We present a novel method called <b>Biological Objective Solution Search (BOSS) </b>for the inference of an objective function of a biological system from its underlying network stoichiometry as well as experimentally-measured state variables. Specifically, <b>BOSS </b>identifies a system objective by defining a putative stoichiometric "objective reaction," adding this reaction to the existing set of stoichiometric constraints arising from known interactions within a network, and maximizing the putative objective reaction via LP, all the while minimizing the difference between the resultant <it>in silico </it>flux distribution and available experimental (e.g., isotopomer) flux data. This new approach allows for discovery of objectives with previously unknown stoichiometry, thus extending the biological relevance from earlier methods. We verify our approach on the well-characterized central metabolic network of <it>Saccharomyces cerevisiae</it>.</p>
            </sec>
            <sec>
               <st>
                  <p>Conclusion</p>
               </st>
               <p>We illustrate how <b>BOSS </b>offers insight into the functional organization of biochemical networks, facilitating the interrogation of cellular design principles and development of cellular engineering applications. Furthermore, we describe how growth is the best-fit objective function for the yeast metabolic network given experimentally-measured fluxes.</p>
            </sec>
         </sec>
      </abs>
   </fm>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>Systems-based approaches coupled with experimental data have facilitated greater understanding of large-scale biological systems <abbrgrp><abbr bid="B1">1</abbr><abbr bid="B2">2</abbr></abbrgrp>. For example, optimization procedures have recently been used to characterize systemic properties in biology, including phenotypic properties like growth rates and effects of gene knockouts <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr><abbr bid="B7">7</abbr></abbrgrp>. One quantitative measure of a biological phenotype is the set of fluxes through all reactions within a biochemical network <abbrgrp><abbr bid="B8">8</abbr></abbrgrp>. Specifically, flux balance analysis (FBA) is a constraints-based approach that calculates steady-state flux distributions <abbrgrp><abbr bid="B9">9</abbr><abbr bid="B10">10</abbr><abbr bid="B11">11</abbr></abbrgrp>.</p>
         <p>FBA has traditionally been based on the premise that prokaryotes such as <it>Escherichia coli </it>have maximized their growth performance as a response to selective pressure <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>. Consequently, a common objective function in FBA of metabolic networks is the maximization of the rate of synthesis of biomass, a unit of measurement of cellular growth. However, as other types of networks and higher-order systems are interrogated, other objectives may be more accurate in predicting phenotypes. For example, other objective functions that have been previously considered in FBA include optimization of energy production or consumption <abbrgrp><abbr bid="B13">13</abbr></abbrgrp> and byproduct synthesis <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>. By inferring objective functions of biological systems, cellular design principles may be studied and systems may be exploited for engineering of metabolic byproducts of commercial or medical value <abbrgrp><abbr bid="B15">15</abbr><abbr bid="B16">16</abbr><abbr bid="B17">17</abbr><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr><abbr bid="B20">20</abbr></abbrgrp>.</p>
         <p><it>In silico </it>frameworks for determining a most-likely objective function have previously been proposed. One such tool, named <b>ObjFind</b>, attempts to identify weightings, termed coefficients of importance (CoIs), on reaction fluxes within a network while minimizing the difference between the resultant flux distribution and known experimental fluxes <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. In the <b>ObjFind </b>framework, a high CoI indicates a reaction that is more likely a component of the cellular objective function, given available experimental fluxes. However, <b>ObjFind </b>is unable to <it>a priori </it>define objectives, since in FBA the objective function is defined as a single reaction within the system (and represented within the stoichiometric matrix) and not a weighting on multiple reactions (i.e., a set of CoIs). For example, if the true objective reaction has not been experimentally characterized and is not included within the network reconstruction, <b>ObjFind </b>is unable to assign the highest CoI to it and instead chooses an alternate (and consequently suboptimal) reaction or set of reactions as constituting the objective function. Two recent efforts have further attempted to identify the most probable objective of a metabolic system from a set of possible objectives, in one case via a Bayesian-based probability ranking <abbrgrp><abbr bid="B21">21</abbr></abbrgrp> and in the other case using an Euclidean metric <abbrgrp><abbr bid="B20">20</abbr></abbrgrp>. However, like <b>ObjFind</b>, each of these methods requires that the stoichiometric network reconstruction include the true objective function as an existing reaction in order to yield meaningful predictions.</p>
         <p>We present a novel framework, <b>Biological Objective Solution Search </b>(<b>BOSS</b>), for identifying objective functions of biological systems based on the stoichiometry of the underlying biochemical network(s) and known experimental flux data. In this framework, the biological objective function is a <it>de novo </it>reaction (column) that is added to the matrix <b>S </b>representing the stoichiometry of the underlying system. Subsequently, the flux through this particular objective reaction is optimized (maximized) as the objective function using the standard FBA approach. Notably, the objective reaction is not confined to be one of a subset of existing reactions, but rather is allowed to take on any form (e.g., an existing reaction, a combination of existing reactions, or a previously uncharacterized reaction) as specified by an optimization procedure. It is, however, confined to be <it>one </it>linear stoichiometric reaction whose coefficients are determined by the framework.</p>
         <p>To illustrate this novelty of <b>BOSS </b>over existing methods (including the three described above), consider the simple system drawn in Figure <figr fid="F1">1(a)</figr>. This system is comprised of three components and five reactions. The objective reaction is denoted as <it>r</it><sub>obj</sub>. Assume that a network reconstruction based on available literature includes all three components and four of the five reactions but excludes the actual system objective, <it>r</it><sub>obj</sub>, governing the resultant flux distribution. As shown in Figure <figr fid="F1">1(b)</figr>, analyzing the network with an approach like <b>ObjFind </b>generates a rank-ordered list of the reactions that best describe the objective function. However, since <it>r</it><sub>obj </sub>is unknown, the calculated objective will be some combination of weightings on <it>r</it><sub>1 </sub>through <it>r</it><sub>4</sub>, and the approach will fundamentally fail to capture the actual objective of the system <it>r</it><sub>obj</sub>. However, as shown in Figure <figr fid="F1">1(c)</figr>, by generating a <it>de novo </it>stoichiometric reaction as its objective function, <b>BOSS </b>would in theory be able to recapitulate the actual system objective.</p>
         <fig id="F1">
            <title>
               <p>Figure 1</p>
            </title>
            <caption>
               <p>The novelty of the BOSS optimization framework</p>
            </caption>
            <text>
               <p><b>The novelty of the BOSS optimization framework</b>. Panel (a) depicts a simple system comprised of three components and five reactions, including an objective reaction <it>r</it><sub>obj </sub>denoted in red. Assuming a stoichiometric network reconstruction of this system (i.e., based on available literature) includes all three components and four of five reactions, excluding the objective reaction, panels (b) and (c) illustrate the objective functions that may be inferred by <b>ObjFind </b>and <b>BOSS</b>, respectively. Specifically, panel (b) shows how <b>ObjFind </b>generates a set of weightings, termed coefficients of importance (CoIs), on the reactions within the network. In this case, with the actual objective not in the stoichiometric reconstruction, <b>ObjFind </b>fails to assign a CoI to <it>r</it><sub>obj</sub>. By contrast, panel (c) shows how <b>BOSS </b>generates a <it>de novo </it>stoichiometric reaction and recapitulates the actual system objective regardless of whether the actual objective is included as part of the stoichiometric reconstruction.</p>
            </text>
            <graphic file="1471-2105-9-43-1"/>
         </fig>
         <p>We applied <b>BOSS </b>to the previously reconstructed <it>S. cerevisiae </it>central metabolic network <abbrgrp><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr></abbrgrp> (see Additional file <supplr sid="S1">1</supplr> for details of the network) to evaluate which objective reaction it infers for that system given a set of isotopomer flux data <abbrgrp><abbr bid="B23">23</abbr><abbr bid="B24">24</abbr></abbrgrp>. We compared the <b>BOSS</b>-derived objective reaction to the hypothesized system objective of precursor biomass synthesis. We considered two cases, one in which the hypothesized objective reaction (i.e., precursor biomass synthesis) was excluded from the system and another in which it was included within the set of known stoichiometric reactions. We further assessed how <b>BOSS </b>handles noise in experimental flux distributions. Finally, we compared our results to a negative control in which flux distributions comprised of randomly generated values were inputted into <b>BOSS</b>. Ultimately, we illustrate how <b>BOSS </b>extends existing objective function identification tools by inferring the objective reaction of a biochemical network <it>de novo </it>from internal state measurements, and how this tool therefore facilitates future study of cellular design principles and cellular engineering approaches.</p>
         <suppl id="S1">
            <title>
               <p>Additional File 1</p>
            </title>
            <text>
               <p><it>Saccharomyces cerevisiae </it>metabolism. A description of the <it>S. cerevisiae </it>central metabolic network from <abbrgrp><abbr bid="B22">22</abbr></abbrgrp>, including reaction and metabolite listing, is provided.</p>
            </text>
            <file name="1471-2105-9-43-S1.pdf">
               <p>Click here for file</p>
            </file>
         </suppl>
      </sec>
      <sec>
         <st>
            <p>Methods</p>
         </st>
         <p>The framework that we present for identifying a putative objective function for a given biological system constitutes a single-level optimization problem. Specifically, <b>BOSS </b>integrates network stoichiometry, physico-chemical constraints such as reaction bounds, and experimental flux data to generate a novel stoichiometric reaction corresponding to the most likely objective function of the system. The framework and implementation strategies are described here.</p>
         <sec>
            <st>
               <p>Flux Balance Analysis (FBA)</p>
            </st>
            <p>A key feature in the application of FBA is the optimization of an objective function subject to fundamental constraints on cellular function <abbrgrp><abbr bid="B9">9</abbr><abbr bid="B11">11</abbr><abbr bid="B25">25</abbr></abbrgrp>. FBA requires a stoichiometric network reconstruction, usually represented as a stoichiometric matrix, <b>S</b>, in which components are delineated as rows, component interactions as columns, and stoichiometric relationships as coefficients (see Figure <figr fid="F1">1</figr> for examples of biochemical networks and the corresponding <b>S </b>matrices). This reconstruction, coupled with reaction fluxes, comprises the principal constraint in FBA, i.e., at steady-state, for each component, the sum of the stoichiometric coefficients multiplied by the corresponding reaction fluxes must equal zero to ensure that mass is balanced within the system.</p>
            <p>Commonly used objective functions (i.e., stoichiometric objectives or "objective reactions") in FBA of metabolic networks include biomass production <abbrgrp><abbr bid="B26">26</abbr><abbr bid="B27">27</abbr></abbrgrp>, energy production or consumption <abbrgrp><abbr bid="B13">13</abbr></abbrgrp>, and byproduct production <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>. The objective function used in FBA is assumed to be linear by a first-order approximation, since this form simplifies computation and reduces the number of parameters to be defined in the objective experimentally. Changes in a linear objective under varying growth conditions have been observed <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>.</p>
            <p>FBA-predicted flux distributions have displayed agreement with experimentally-measured flux data in some cases <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>. Furthermore, FBA has yielded insights into optimal targets for metabolic engineering <abbrgrp><abbr bid="B15">15</abbr></abbrgrp> and adaptive evolution of <it>E. coli </it>strains <abbrgrp><abbr bid="B28">28</abbr></abbrgrp>, among other applications <abbrgrp><abbr bid="B29">29</abbr></abbrgrp>. Additionally, FBA has successfully predicted metabolic phenotypes of cellular systems by hypothesizing biomass production as the objective function <abbrgrp><abbr bid="B7">7</abbr><abbr bid="B9">9</abbr><abbr bid="B10">10</abbr><abbr bid="B12">12</abbr><abbr bid="B19">19</abbr><abbr bid="B27">27</abbr><abbr bid="B30">30</abbr><abbr bid="B31">31</abbr><abbr bid="B32">32</abbr><abbr bid="B33">33</abbr><abbr bid="B34">34</abbr><abbr bid="B35">35</abbr><abbr bid="B36">36</abbr></abbrgrp>. However, other objectives may be equally successful at predicting phenotypes for particular conditions <abbrgrp><abbr bid="B20">20</abbr></abbrgrp>. Furthermore, a metabolic objective may change at different stages of an organism's life cycle <abbrgrp><abbr bid="B37">37</abbr></abbrgrp>. Some studies suggest a greater role for environmental factors in determining cellular objectives than is assumed when FBA is employed with a biomass production objective <abbrgrp><abbr bid="B38">38</abbr></abbrgrp>. Ultimately, as additional network reconstructions are completed and experimental flux data are obtained, there is increasing interest in determining realistic objective functions to explain systemic behavior <abbrgrp><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr><abbr bid="B20">20</abbr><abbr bid="B39">39</abbr></abbrgrp>.</p>
         </sec>
         <sec>
            <st>
               <p>Formulation of the Objective Function-Finding Algorithm BOSS</p>
            </st>
            <p>The <b>BOSS </b>framework initially takes the form of a bi-level optimization problem that minimizes the sum-squared error between experimentally-measured (<it>in vivo</it>) fluxes and framework-computed (<it>in silico</it>) fluxes ("outer problem") (see Figure <figr fid="F2">2(a)</figr>, line 1), subject to the condition that a cellular objective is simultaneously maximized ("inner problem") (lines 2&#8211;5). The inner problem takes the canonical form of a FBA problem, wherein an objective reaction introduced to the network is maximized (line 2) subject to thermodynamic (line 3), mass balance (line 4), and uptake (line 5) constraints. The coefficients of the objective reaction are unknown and part of the solution space.</p>
            <fig id="F2">
               <title>
                  <p>Figure 2</p>
               </title>
               <caption>
                  <p>The novel optimization framework implemented by BOSS</p>
               </caption>
               <text>
                  <p><b>The novel optimization framework implemented by BOSS</b>. Panel (a) illustrates the bi-level optimization problem that forms the basis for <b>BOSS</b>. This problem involves minimizing the sum-squared error between experimentally-measured (<it>in vivo</it>) and framework-computed (<it>in silico</it>) fluxes (line 1) subject to the fundamental flux balance analysis (FBA) problem (lines 2&#8211;5), i.e., the putative objective reaction is maximized (line 2) subject to physico-chemical (line 3) and other constraints (lines 4 and 5). In this framework: (1) <b>N </b>corresponds to the set of metabolites; (2) <b>M </b>to the set of reactions; (3) <b>P </b>to the set of putative objective reactions, usually a new column inserted into the stoichiometric matrix <b>S</b>, <it>S</it><sub><b>i</b>, <it>j</it></sub>, with flux <it>v</it><sub><it>j </it></sub>where <it>j </it>&#8712; <b>P</b>; (4) <b>v</b><sup>framework </sup>to the set of framework-computed fluxes; and (5) <b>v</b><sup>experimental </sup>to the set of experimentally-measured fluxes. Additionally, to normalize the flux data, the "input flux" corresponding to the uptake of the carbon source (e.g., glucose) <inline-formula><m:math name="1471-2105-9-43-i1" xmlns:m="http://www.w3.org/1998/Math/MathML"><m:semantics><m:mrow><m:msubsup><m:mi>v</m:mi><m:mrow><m:mtext>glucose</m:mtext></m:mrow><m:mrow><m:mtext>framework</m:mtext></m:mrow></m:msubsup></m:mrow><m:annotation encoding="MathType-MTEF">
 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGacaGaaiaabeqaaeqabiWaaaGcbaGaemODay3aa0baaSqaaiabbEgaNjabbYgaSjabbwha1jabbogaJjabb+gaVjabbohaZjabbwgaLbqaaiabbAgaMjabbkhaYjabbggaHjabb2gaTjabbwgaLjabbEha3jabb+gaVjabbkhaYjabbUgaRbaaaaa@4365@</m:annotation></m:semantics></m:math></inline-formula> is set to a predetermined value called "uptake." Panel (b) illustrates the optimization problem in panel (a) reformulated as a single-level optimization problem via the duality theorem of linear programming (LP) [3, 40]. This novel framework for predicting objectives of biological systems is comprised of an objective that aims to minimize the sum-squared error between experimentally-measured and framework-computed fluxes (line 1) subject to a set of primal (lines 3 through 5) and dual constraints (lines 7 through 9), as well as two new constraints, one that sets the value of the primal and dual problems equivalent to one another (line 2) and another that normalizes the flux distribution by setting the flux corresponding to the new objective reaction to a specific value (line 6). The notations in panel (a) apply here as well. The decision variables in this optimization are: (1) the stoichiometric coefficients of the objective reaction, <it>S</it><sub><it>i</it>, <it>j </it></sub>where <it>i </it>&#8712; <b>N </b>and <it>j </it>&#8712; <b>P</b>; (2) the framework-computed fluxes <b>v</b><sup>experimental</sup>; (3) the dual variable <it>g </it>associated with the uptake constraint; and (4) the dual variables <b>u </b>indicating shadow prices on the mass balance constraints for each metabolite in the system.</p>
               </text>
               <graphic file="1471-2105-9-43-2"/>
            </fig>
            <p>In order to make this bi-level optimization problem computationally tractable, we reformulated it as a single-level optimization problem via the duality theorem of LP, as previously described <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B40">40</abbr></abbrgrp> (see Figure <figr fid="F2">2(b)</figr>). Specifically, the revised form is comprised of an objective that aims to minimize the sum-squared error between experimentally-measured and framework-computed fluxes (line 1) subject to a set of primal (lines 3 through 5) and dual constraints (lines 7 through 9). The objective in line 1 is equivalent to the outer objective of the bi-level optimization problem (see Figure <figr fid="F2">2(a)</figr>, line 1), and the primal constraints in lines 3 through 5 are equivalent to the constraints in the original bi-level optimization problem (see Figure <figr fid="F2">2(a)</figr>, lines 3 through 5). Two additional constraints are included in the single-level optimization framework. Specifically, the value of the primal and dual problems are set equivalent to one another (line 2), and the flux distribution corresponding to the new objective reaction is normalized to a specific value (line 6). As described in the caption for Figure <figr fid="F2">2</figr>, the decision variables in this optimization are: (1) the stoichiometric coefficients of the objective reaction, <it>S</it><sub><it>i</it>, objective </sub>where <it>i </it>&#8712; <b>N</b>, or the set of metabolites, and "objective" denotes the new objective reaction; (2) the framework-computed fluxes <b>v</b><sup>experimental</sup>; (3) the dual variable <it>g </it>associated with the uptake constraint; and (4) the dual variables <b>u </b>indicating shadow prices on the mass balance constraints for each metabolite in the system.</p>
            <p>Due to the large number of decision variables, large solution space, existence of multiple local optima, and inherent non-convexity of the problem, we instituted a multiple restart approach, wherein the optimization is run multiple times, each time with different randomly-selected starting values for the decision variables (within a specified range) (see Figure <figr fid="F3">3(b)</figr>, item 3). The output of this approach is a series of putative objective reactions, one for each restart. Objective reactions that yield a poor value in the outer optimization (i.e., for which the sum-squared error between experimental and calculated fluxes is relatively high) are removed from the solution set. The remaining putative objective reactions are then clustered into groups based on similarity, and the most populous cluster is chosen as the consensus objective reaction (see Figure <figr fid="F3">3(b)</figr>, item 4, as well as Additional file <supplr sid="S2">2</supplr>). This last step seeks to eliminate solutions to the outer problem that constitute suboptimal local minima. It is assumed that the global minimum to the outer problem (i.e., the best match between <b>BOSS</b>-derived and experimental fluxes, thereby leading to the likely objective reaction) will draw from a larger portion of the initial state space than any local minimum, and thus will gather the greatest proportion of the restarts when solutions are clustered.</p>
            <fig id="F3">
               <title>
                  <p>Figure 3</p>
               </title>
               <caption>
                  <p>The process flow for evaluating BOSS</p>
               </caption>
               <text>
                  <p><b>The process flow for evaluating BOSS</b>. A four-step process for evaluating <b>BOSS </b>is illustrated. Specifically, in panel (a), we show how we (1) generate a stoichiometric matrix reconstruction for a biological system and (2) obtain experimental flux measurements for the reactions within the system. Note that when we tested <b>BOSS </b>on simulated noisy flux data in yeast central metabolism, each experimental flux was varied randomly via a normal distribution, with mean and standard deviation equivalent to the mean and standard deviation of the actual experimental fluxes. In panel (b), we show how (3) the reconstruction and experimental flux data are inputted into <b>BOSS </b>and stoichiometric coefficients for the objective reaction are identified through a multiple-restart strategy that utilizes random initial guesses for the coefficients. Additionally, (4) the resultant objectives with a low sum-squared error between the framework-computed flux data and the experimentally-measured flux data are clustered, and the most populous cluster is chosen as representative of the objective function of the system.</p>
               </text>
               <graphic file="1471-2105-9-43-3"/>
            </fig>
            <suppl id="S2">
               <title>
                  <p>Additional File 2</p>
               </title>
               <text>
                  <p>Clustering in <b>BOSS</b>. The clustering component of the <b>BOSS </b>framework, as implemented in MATLAB, is described.</p>
               </text>
               <file name="1471-2105-9-43-S2.pdf">
                  <p>Click here for file</p>
               </file>
            </suppl>
            <p>This single-level optimization with multiple restarts, followed by clustering and subsequent averaging of the most populous cluster, ultimately yields a stoichiometrically-weighted reaction for which the metabolic network is optimized. This reaction represents a best hypothesis for the network objective function based on available data about the system. Determination of the objective reaction in this manner offers a means to gain insight about network and sub-network objectives and behavior.</p>
         </sec>
         <sec>
            <st>
               <p>Biological System Evaluated: The <it>S. cerevisiae </it>Central Metabolic Network</p>
            </st>
            <p>The previously reconstructed <it>S. cerevisiae </it>central metabolic network <abbrgrp><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr></abbrgrp> was used to assess the <b>BOSS </b>framework (see Additional file <supplr sid="S2">2</supplr>). This network is a subset of the genome-scale <it>S. cerevisiae </it>metabolic reconstruction <abbrgrp><abbr bid="B41">41</abbr><abbr bid="B42">42</abbr></abbrgrp> and comprises the major carbohydrate metabolism pathways of glycolysis, pentose phosphate, and the citrate cycle, the principal energy metabolism pathway of oxidative phosphorylation, and a precursor biomass synthesis reaction. The network is comprised of 60 metabolites participating in 62 reactions, including six exchange reactions, 55 intracellular reactions, and one precursor biomass synthesis reaction.</p>
            <p>A flux distribution for the central metabolic network was previously characterized experimentally <abbrgrp><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr></abbrgrp>. This distribution was obtained by GC-MS tracing of <sup>13</sup>C-labeled isotopomers, and corresponds to yeast cells cultivated in batch culture with glucose as the limiting substrate and at a maximum specific growth rate, <it>&#956;</it><sub>max</sub>, of 0.37 h<sup>-1</sup>. (See <abbrgrp><abbr bid="B23">23</abbr></abbrgrp> for complete experimental details.) The <b>BOSS </b>framework was applied to this data set.</p>
            <p>In addition, the precursor biomass synthesis reaction, which balances the major metabolites from central metabolism that contribute to biomass, was hypothesized to be the "true" objective function of the system for testing the <b>BOSS </b>framework. This hypothesis was based on the underlying premise described previously that organisms have maximized their growth performance through natural selection <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>. The precursor biomass synthesis reaction was previously characterized experimentally <abbrgrp><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr></abbrgrp>. It is important to note that <b>BOSS </b>does not require an assumption of an objective function, and we demonstrate below the success of <b>BOSS </b>at generating a hypothesized objective function <it>de novo</it>.</p>
         </sec>
         <sec>
            <st>
               <p>Implementation Details</p>
            </st>
            <p>The general implementation scheme for <b>BOSS </b>is illustrated in Figure <figr fid="F3">3</figr>. Specifically, we inputted the stoichiometric network reconstruction and isotopomer flux data for the <it>S. cerevisiae </it>central metabolic network into <b>BOSS </b>(see Figure <figr fid="F3">3(a)</figr>) and assessed the objective reaction that it derived (see Figure <figr fid="F3">3(b)</figr>). We evaluated two conditions, one in which the hypothesized objective function of precursor biomass synthesis was included in the network reconstruction inputted into <b>BOSS </b>and another in which it was excluded. In the second case, <b>BOSS </b>yielded a zero-vector for the objective reaction, suggesting that the true objective was already a part of the network reconstruction. Therefore, we altered <b>BOSS </b>slightly to identify which of the reactions was the likely objective: we removed, one by one, each reaction flux from the set of experimental flux data (<b>v</b><sup>experimental </sup>in Figure <figr fid="F2">2</figr>), and identified in each case the sum-squared error between the <b>BOSS</b>-derived objective reaction and the reaction corresponding to the removed flux. The reaction that exhibited the smallest sum-squared error through this method was identified as the objective function. This approach was utilized to ensure that, if the actual system objective is already in the stoichiometric network reconstruction, the outer optimization problem of <b>BOSS </b>does not force flux to go through that reaction and rather allows the flux corresponding to the new objective function column to be maximized as part of <b>BOSS</b>.</p>
            <p>We considered one additional <it>in silico </it>experiment to evaluate how well our framework handles the kind of variability that is characteristic of actual flux measurements. Specifically, we assessed how a varying amount of noise introduced to the set of experimental flux data affects the objective function derived by <b>BOSS</b>. (See Additional file <supplr sid="S3">3</supplr> as well for a discussion of how <b>BOSS </b>handles a paucity of flux data, as applied to a prototypic system.) To perform this test, additional steps were performed during data preparation (see Figure <figr fid="F3">3(a)</figr>, item 2). First, each experimental flux for the <it>S. cerevisiae </it>metabolic network was varied randomly via a normal distribution, with standard deviation equal to a set percent of the initial value of the flux. Different percent variances, ranging from five percent to 25 percent in increments of five percent, were considered. Fluxes with an initial value of zero were varied with a standard deviation equal to that of the smallest nonzero flux in the system. <b>BOSS </b>was fed these varied fluxes as "experimental" fluxes. To avoid biasing results toward one particular variant of the "experimental" fluxes, we repeated multiple times this process of randomly varying the experimental flux distribution. In other words, for any given percent variance, we tested multiple noisy flux data sets (n = 20). Consequently, when considering the results of any <b>BOSS </b>run on noisy flux data, we evaluated the coefficients of the objective reaction for each noisy flux data set independently.</p>
            <suppl id="S3">
               <title>
                  <p>Additional File 3</p>
               </title>
               <text>
                  <p>Evaluating data integration in <b>BOSS</b>. <b>BOSS </b>is applied to a prototypic system designed to illustrate the ability of the framework to infer an objective function by synthesizing information from multiple experimental conditions.</p>
               </text>
               <file name="1471-2105-9-43-S3.pdf">
                  <p>Click here for file</p>
               </file>
            </suppl>
            <sec>
               <st>
                  <p>Assessing the Results of BOSS</p>
               </st>
               <p>To assess the accuracy and efficacy of our <b>BOSS</b>-derived results, we considered two statistical measures. First, we computed the sum-squared error between the coefficients of the <b>BOSS</b>-derived objective reaction and the coefficients of the hypothesized objective reaction (in this case, precursor biomass synthesis), normalized to the magnitude of the hypothesized objective reaction column vector. This term is abbreviated SSE<sub><b>S </b></sub>throughout the manuscript. Second, we computed the sum-squared error between the reaction fluxes outputted by <b>BOSS </b>and the experimental fluxes inputted to the framework and specified as constraints. This term, which is equivalent to the function being minimized in the <b>BOSS </b>outer optimization problem, is abbreviated SSE<sub><b>v </b></sub>throughout the manuscript. Ideally, smaller values of SSE<sub><b>v </b></sub>should correspond to smaller values of SSE<sub><b>S</b></sub>, as smaller values of SSE<sub><b>S </b></sub>imply more accurate objective reactions.</p>
            </sec>
            <sec>
               <st>
                  <p>Technical Implementation</p>
               </st>
               <p>Simulations of <b>BOSS </b>were run with GAMS v.22.5 on Microsoft Windows XP Professional and Linux (Centos5) machines. The MINOS5 NLP (non-linear programming) solver was utilized. Results were analyzed using code written in MATLAB v.7.5 (part of the MathWorks R2007b release package), with clustering functionality provided by the MATLAB Statistics Toolbox (as detailed in Additional file <supplr sid="S2">2</supplr>).</p>
            </sec>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Results and Discussion</p>
         </st>
         <p>The <it>S. cerevisiae </it>central metabolic network was used as an experimental system to evaluate the ability of <b>BOSS </b>to identify objective functions of biological systems. Additionally, the network was used to evaluate how well the framework handles noise in flux distributions, which is a characteristic of actual experimental measurements. These results were contrasted with randomly-generated flux data for the <it>S. cerevisiae </it>central metabolic network as a further validation of the <b>BOSS </b>framework. We summarize the results here.</p>
         <sec>
            <st>
               <p>Validation of Objective Function Identification</p>
            </st>
            <p>In inferring the objective function for the <it>S. cerevisiae </it>metabolic network with <b>BOSS</b>, two conditions were evaluated. In the first one, the hypothesized objective reaction (i.e., precursor biomass synthesis) was excluded from the stoichiometric network reconstruction. <b>BOSS </b>identified coefficients approximately equal to that of the precursor biomass synthesis reaction (see Figure <figr fid="F4">4(a)</figr>). The sum-squared error between the <b>BOSS</b>-computed objective reaction and the experimentally-derived precursor biomass synthesis reaction, normalized to the magnitude of the precursor biomass synthesis reaction (SSE<sub><b>S</b></sub>), was 8.242 &#215; 10<sup>-29</sup>. The magnitude of this SSE<sub><b>S </b></sub>suggests that <b>BOSS </b>derives an objective reaction equivalent to the precursor biomass synthesis reaction, well within the limits of numerical tolerance.</p>
            <fig id="F4">
               <title>
                  <p>Figure 4</p>
               </title>
               <caption>
                  <p>Validating BOSS on the <it>S. cerevisiae </it>central metabolic network</p>
               </caption>
               <text>
                  <p><b>Validating BOSS on the <it>S. cerevisiae </it>central metabolic network</b>. The results of <b>BOSS </b>(blue line and dots) when applied to the <it>S. cerevisiae </it>central metabolic network are illustrated and contrasted by the hypothesized objective reaction (i.e., precursor biomass synthesis) (open black circles). Panel (a) illustrates the results when the hypothesized objective reaction of precursor biomass synthesis is excluded from the network inputted into <b>BOSS</b>. Panel (b) depicts the results when the network is inputted into <b>BOSS </b>with the hypothesized objective reaction. Note that the entire experimental flux distribution was provided as input to <b>BOSS </b>in both cases. When the precursor biomass synthesis objective reaction was excluded from the network inputted into <b>BOSS</b>, the sum-squared error between the <b>BOSS</b>-derived objective reaction and the expected precursor biomass synthesis objective reaction, normalized to the magnitude of the precursor biomass synthesis objective reaction (SSE<sub><b>S</b></sub>), was 8.242 &#215; 10<sup>-29 </sup>(panel (a)). By contrast, when the precursor biomass synthesis objective reaction was included in the set of stoichiometric reactions inputted into <b>BOSS</b>, the SSE<sub><b>S </b></sub>for the <b>BOSS </b>solution was approximately 655.0 (panel (b)). Panel (c) depicts a plot of the sum-squared error between the <b>BOSS</b>-derived and the corresponding reaction when the flux for each of the 62 reactions in the system was excluded from the pool of experimental fluxes one by one. The smallest SSE<sub><b>S </b></sub>values were 42.20 and 4.210 &#215; 10<sup>-4 </sup>and corresponded to the ATP maintenance and biomass production reactions, respectively. Consequently, as shown in panel (d), <b>BOSS </b>was able to recapitulate the hypothesized objective reaction of precursor biomass synthesis with a SSE<sub><b>S </b></sub>= 4.210 &#215; 10<sup>-4 </sup>when the reaction was included in the network stoichiometry but its experimental flux was removed from the available flux data.</p>
               </text>
               <graphic file="1471-2105-9-43-4"/>
            </fig>
            <p>We also implemented <b>BOSS </b>on the complete <it>S. cerevisiae </it>central metabolic network, i.e., without removing the precursor biomass synthesis reaction. When the precursor biomass synthesis reaction was thus included in the set of stoichiometric reactions, <b>BOSS </b>yielded a zero-vector for the objective reaction (SSE<sub><b>S </b></sub>= 655.0), suggesting that the actual system objective was already a part of the stoichiometric network reconstruction (see Figure <figr fid="F4">4(b)</figr>). Subsequently, we individually removed each of the reaction fluxes from the pool of experimental fluxes defined in the outer optimization problem of <b>BOSS </b>(i.e., <b>v</b><sup>experimental </sup>in Line 1 of Figure <figr fid="F2">2(a)</figr>) and observed the resultant stoichiometric coefficients that <b>BOSS </b>derived for the objective function. SSE<sub><b>S </b></sub>values between the reaction whose flux was removed from <b>v</b><sup>experimental </sup>and the <b>BOSS</b>-derived objective reaction given removal of that flux were compared for each reaction in the system (see Figure <figr fid="F4">4(c)</figr>). The reaction with the smallest SSE<sub><b>S </b></sub>(between the <b>BOSS</b>-derived objective and the experimentally-characterized reaction whose flux was excluded) was the hypothesized system objective of precursor biomass synthesis (SSE<sub><b>S </b></sub>= 4.210 &#215; 10<sup>-4</sup>). This result further validated the ability of <b>BOSS </b>to identify objective reactions with previously known as well as unknown stoichiometry (see Figures <figr fid="F4">4(c)</figr> and <figr fid="F4">4(d)</figr>). Interestingly, the reaction with the next smallest SSE<sub><b>S </b></sub>(= 42.20) was the ATP maintenance reaction, a reaction that has also been evaluated as an objective of metabolic networks under some conditions <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B21">21</abbr><abbr bid="B43">43</abbr></abbrgrp>. All other reactions in the network had SSE<sub><b>S </b></sub>values that were at least an order of magnitude higher. This key result is also a direct validation of the hypothesis that biomass production is a reasonable objective function for many metabolic networks; with the experimentally-generated flux data, <b>BOSS </b>derived an objective function highly correlated with biomass production although there was no such assumption <it>a priori</it>.</p>
            <p>It is important to note that application of FBA to the <it>S. cerevisiae </it>metabolic network does <it>not </it>yield the experimental flux distribution measured by <abbrgrp><abbr bid="B23">23</abbr></abbrgrp>. Because FBA problems have large convex solution spaces, many different flux distributions yield equally optimal results. Therefore, it is significant that <b>BOSS </b>is able to infer the correct coefficients for the precursor biomass synthesis reaction in spite of this difference. Furthermore, although maximization of biomass synthesis is hypothesized as the objective of a metabolic network, the experimental flux data are calculated based on isotopomer measurements and the underlying system stoichiometry but is not biased toward this objective. Thus, the characterization of biomass as the system objective by <b>BOSS </b>is a novel validation of this theoretical assumption.</p>
         </sec>
         <sec>
            <st>
               <p>Accounting for Limitations in Experimental Measurements: Noisy Flux Data</p>
            </st>
            <p>To account for current limitations in experimental (isotopomer) technologies for measuring reaction fluxes, the <it>S. cerevisiae </it>central metabolic network was evaluated by <b>BOSS </b>when different levels of noise were introduced into the experimental flux data. Different percentages of deviation for the flux data were evaluated to determine how quickly the accuracy of the <b>BOSS</b>-computed objective reaction degrades with noisy data.</p>
            <p>The results for the <it>S. cerevisiae </it>network when varying levels of noise are introduced into the individual flux values are illustrated in Figure <figr fid="F5">5</figr>. For the purposes of this evaluation, based on the results described above, the hypothesized objective reaction of precursor biomass synthesis was included as part of the underlying network stoichiometry inputted into <b>BOSS</b>, and the set of experimental fluxes consisted of all fluxes except for the flux corresponding to this reaction. Figure <figr fid="F5">5(a)</figr> illustrates the normalized sum-squared error between the <b>BOSS</b>-derived objective reaction and the hypothesized objective function of precursor biomass synthesis (SSE<sub><b>S</b></sub>) for different percent variances in experimental flux data, ranging from five percent to 25 percent in increments of five percent. (As described above, for each increment, 20 unique "initial" flux distributions, each with the same level of "noise," were computed, and the results for each of these 20 flux distributions were treated independently of the others. Therefore, the plot in Figure <figr fid="F5">5(a)</figr> illustrates the mean SSE<sub><b>S </b></sub>across these 20 distributions, as well as the associated standard deviation within SSE<sub>S </sub>across these 20 distributions.) Up to about 15 percent variance in the flux data, SSE<sub><b>S </b></sub>&lt; 1000, i.e., <b>BOSS </b>is able to generate reconstructions of the hypothesized objective reaction orders of magnitude more accurately than when random flux data are inputted into <b>BOSS </b>(see "Control Case: Random Flux Data" below). As expected, with increasing noise, the results of <b>BOSS </b>exhibit increasing mean SSE<sub><b>S </b></sub>values and the variability of SSE<sub><b>S </b></sub>across different initial flux sets is higher. These data support the utility of our framework in identifying objective functions for biological systems given the current state of experimental flux measurements.</p>
            <fig id="F5">
               <title>
                  <p>Figure 5</p>
               </title>
               <caption>
                  <p>Evaluating noise in the flux data in the <it>S. cerevisiae </it>central metabolic network for the precursor biomass synthesis objective reaction</p>
               </caption>
               <text>
                  <p><b>Evaluating noise in the flux data in the <it>S. cerevisiae </it>central metabolic network for the precursor biomass synthesis objective reaction</b>. The results of <b>BOSS </b>when noisy flux data are supplied as input to the framework are illustrated in the context of the precursor biomass synthesis objective reaction. Panel (a) illustrates the sum-squared error between the computed objective reaction and the hypothesized objective reaction of precursor biomass synthesis, when normalized to the magnitude of the precursor biomass synthesis reaction. The mean and standard deviation represented by the error bars for SSE<sub><b>S </b></sub>at each of the percent variances are based on the 20 independent runs at each level of noise (i.e., 20 independent flux distributions with equivalent amounts of noise randomly inserted). Panels (b), (c), and (d) illustrate the hypothesized objective reaction (gray bars) and the <b>BOSS</b>-derived objective reaction (blue dots/lines) when the reaction fluxes in the network are varied by 5, 15, and 25 percent of their actual values, respectively. As the variance in the fluxes increases, the performance of <b>BOSS </b>degrades. Note that, as described previously in the context of Figures 4(c) and 4(d), to avoid biasing results, the hypothesized objective reaction of precursor biomass synthesis was included in the network inputted into <b>BOSS</b>, and the pool of experimental fluxes consisted of all fluxes with the exception of the precursor biomass synthesis reaction flux.</p>
               </text>
               <graphic file="1471-2105-9-43-5"/>
            </fig>
            <p>To further highlight <b>BOSS</b>'s performance on noisy flux data, snapshots of the objective reactions that it generated at different flux variances are illustrated. Specifically, Figures <figr fid="F5">5(b), 5(c)</figr>, and <figr fid="F5">5(d)</figr> correspond to the coefficients identified by <b>BOSS </b>(blue error bars) overlaid on the precursor biomass synthesis reaction (gray bars) for flux variances of 5, 15, and 25 percent, respectively. (Note that, for each flux variance, 20 unique "initial" flux distributions were computed. Consequently, the values for the coefficients derived by <b>BOSS </b>correspond to a representative result for one of these 20 initial flux sets.) For smaller flux variances, the pattern of the coefficients identified by <b>BOSS </b>follows that of the hypothesized network objective of precursor biomass synthesis that was used to generate the noisy flux data (see Figure <figr fid="F5">5(b)</figr>). As expected, the more noisy the flux data, the less precise the objective reaction identified by the framework (see Figure <figr fid="F5">5(c)</figr>).</p>
            <p>It is important to note that this analysis involves artificially adding noise to an experimental flux distribution. Although the original experimental fluxes are based on a steady-state metabolic model of yeast central metabolism, it is likely that there is some degree of noise already within the data set as part of the experimental protocol. Consequently, the studies with noise presented here include even higher degrees of noise than the five to 25 percent spectrum evaluated. Nevertheless, the results suggest that <b>BOSS </b>performs well, to an extent, with noisy experimental data.</p>
            <sec>
               <st>
                  <p>Control Case: Random Flux Data</p>
               </st>
               <p>To place these results in context, randomly-generated flux values coupled with the underlying network stoichiometry for the <it>S. cerevisiae </it>central metabolic network were inputted into the <b>BOSS </b>framework as a negative control. These fluxes were generated by specifying a normal distribution statistically similar to the characteristics of the experimental flux distribution. Specifically, the randomly-generated fluxes were centered at a mean of 6.697 mmol/g&#183;h with a standard deviation of 9.521 mmol/g&#183;h, identical to the mean and standard deviation of the experimental fluxes reported in <abbrgrp><abbr bid="B23">23</abbr><abbr bid="B24">24</abbr></abbrgrp>. For this test of random flux data, no reaction was removed from the stoichiometric network reconstruction inputted into <b>BOSS </b>to avoid biasing results in any way toward a particular objective. However, to ensure that flux was driven through the objective reaction, thus minimizing SSE<sub><b>v </b></sub>(see discussion above pertaining to Figures <figr fid="F4">4(b), 4(c)</figr>, and <figr fid="F4">4(d)</figr>), the flux for the precursor biomass synthesis objective reaction was not included in the pool of experimental flux data inputted into <b>BOSS</b>, as described earlier. A total of 100 randomly-generated flux distributions, each with mean and standard deviation consistent with the experimental flux data, were evaluated, and the SSE<sub><b>S </b></sub>between the hypothesized objective reaction of precursor biomass synthesis and the <b>BOSS</b>-derived objective reaction was 2.076 &#215; 10<sup>4</sup>. In addition, the SSE<sub><b>v </b></sub>was 962.9. These results are orders of magnitude higher than when actual experimental flux data, or even noisy experimental data, are specified (see "Validation of Objective Function Identification" above), thus further confirming the utility of <b>BOSS </b>in inferring objective functions of biological systems with internal state measurements.</p>
            </sec>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>We present a novel framework called <b>Biological Objective Solution Search </b>(<b>BOSS</b>) that integrates network stoichiometry and experimental flux data to determine the most likely objective function for a given biological system. We illustrate the utility of <b>BOSS </b>on a model of <it>S. cerevisiae </it>central metabolism with a variety of input conditions, including experimental (isotopomer) flux data, varied experimental flux data meant to mimic noise in experimental measurements, and randomly-generated fluxes. When the underlying network stoichiometry and all reaction fluxes are specified, <b>BOSS </b>identifies an objective reaction with a normalized sum-squared error between the computed objective and the hypothesized objective (i.e., precursor biomass synthesis) (SSE<sub><b>S</b></sub>) of 4.210 &#215; 10<sup>-4</sup>. Additionally, when noise is introduced into the flux data to simulate the types of error observed in experimental flux measurements, <b>BOSS </b>identifies the objective reaction with a SSE<sub><b>S </b></sub>of less than 1000 for up to 15 percent experimental flux noise. Thus, we show how <b>BOSS </b>can integrate network stoichiometry and internal state measurements, including in the case of noisy data, to predict the objective function of a biological system.</p>
         <p>Interestingly, researchers have theorized that, through evolution, metabolic systems have optimized for biomass production <abbrgrp><abbr bid="B12">12</abbr></abbrgrp>. Here we illustrate that our framework derives this hypothesized objective reaction, precursor biomass synthesis, based on the underlying network stoichiometry and a set of experimentally-measured flux data. This observation validates the <b>BOSS </b>framework and it further confirms the precursor biomass synthesis reaction as an objective of yeast central metabolism.</p>
         <p>Current challenges remain in the implementation of the <b>BOSS </b>algorithm. The transformation of a bi-level to a single-level optimization via the strong duality theorem (see "Methods") introduces a high degree of nonlinearity into the problem and non-convexity into the solution space, rendering the <b>BOSS </b>algorithm difficult for nonlinear solvers to tackle. Further, the structure of the inner and outer problems suggests that the solution space for a <b>BOSS </b>problem is not smooth, but rather likely contains discontinuous rifts in the value of the optimization parameter (SSE<sub><b>v</b></sub>) as one moves smoothly through the state space. These factors complicate the ability of <b>BOSS </b>to determine a global optimum with a small number of restarts, resulting in several hours to days of simulation time depending on the system and input conditions. Perhaps stronger nonlinear solvers, more powerful dedicated computers, and more run-time would yield better predictions of objective functions. These challenges will need to be addressed as <b>BOSS </b>is scaled up to genome-scale applications.</p>
         <p>Another hurdle to the meaningful application of <b>BOSS </b>is the paucity of large-scale experimentally-derived flux sets in literature. Isotopomer studies, as well as <sup>13</sup>C-constrained fluxomics studies, tend to use simplified models of central metabolism that lump reactions together and thus fail to define a distinct flux for each reaction in the system <abbrgrp><abbr bid="B44">44</abbr><abbr bid="B45">45</abbr><abbr bid="B46">46</abbr><abbr bid="B47">47</abbr></abbrgrp>. These simplifications have been necessary due to experimental and computational hurdles, but they limit the degree to which experimental flux data can be used by <b>BOSS</b>. As more powerful fluxomics techniques are developed, more complete flux distribution maps will become available for analysis by <b>BOSS </b><abbrgrp><abbr bid="B48">48</abbr></abbrgrp>.</p>
         <p><b>BOSS </b>is distinguished from preexisting objective-searching algorithms in its ability to define an objective reaction absent previous knowledge of the stoichiometric structure of the objective function <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B21">21</abbr></abbrgrp>. This attribute could prove useful in analyzing signaling and transcriptional regulatory networks, as their objectives are likely to be more loosely defined and poorly understood than those of metabolic networks <abbrgrp><abbr bid="B32">32</abbr><abbr bid="B49">49</abbr></abbrgrp>. Likewise, studying objectives of multiple metabolically-interacting species or compartmentalized metabolic processes (e.g., mitochondrial metabolism) offers fruitful challenges that cannot be described as simply biomass production. Such analyses could lead to a greater appreciation of the driving evolutionary forces that govern these cellular processes, and could help explain how the whole-cell objective originates. A framework that predicts objectives of a biological system based on known properties of the system (e.g., the stoichiometry of the system and associated reaction fluxes) thus has the potential to address many critical and timely questions in biology.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>EG and MO conceived of the study and participated in its design and implementation. JP conceived of the study and participated in its design and coordination. AB and CM helped with key analyses of the data. All authors read and approved of the final manuscript.</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>We thank Dr. Kyongbum Lee and Ryan P. Nolan for kindly sharing code with us, as well as Dr. Jong Min Lee, Dr. Kenneth Crowther, Arvind Chavali, Drake Guenther, and Michael Ellis for insightful comments and feedback. Additionally, we thank the National Institutes of Health (NIH) (GM08715/NIH Biotechnology Training Grant to EPG and MAO), the National Science Foundation (CAREER Award to JP), and the Whitaker Foundation for support.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Mathematical models in microbial systems biology</p>
            </title>
            <aug>
               <au>
                  <snm>Stelling</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Curr Opin Microbiol</source>
            <pubdate>2004</pubdate>
            <volume>7</volume>
            <issue>5</issue>
            <fpage>513</fpage>
            <lpage>518</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.mib.2004.08.004</pubid>
                  <pubid idtype="pmpid" link="fulltext">15451507</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Two approaches for metabolic pathway analysis?</p>
            </title>
            <aug>
               <au>
                  <snm>Klamt</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Stelling</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Trends Biotechnol</source>
            <pubdate>2003</pubdate>
            <volume>21</volume>
            <issue>2</issue>
            <fpage>64</fpage>
            <lpage>69</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0167-7799(02)00034-3</pubid>
                  <pubid idtype="pmpid" link="fulltext">12573854</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Optimization-based framework for inferring and testing hypothesized metabolic objective functions</p>
            </title>
            <aug>
               <au>
                  <snm>Burgard</snm>
                  <fnm>AP</fnm>
               </au>
               <au>
                  <snm>Maranas</snm>
                  <fnm>CD</fnm>
               </au>
            </aug>
            <source>Biotechnol Bioeng</source>
            <pubdate>2003</pubdate>
            <volume>82</volume>
            <issue>6</issue>
            <fpage>670</fpage>
            <lpage>677</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1002/bit.10617</pubid>
                  <pubid idtype="pmpid" link="fulltext">12673766</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>Mathematical analysis of enzymic reaction systems using optimization principles</p>
            </title>
            <aug>
               <au>
                  <snm>Heinrich</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Schuster</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Holzhutter</snm>
                  <fnm>HG</fnm>
               </au>
            </aug>
            <source>Eur J Biochem</source>
            <pubdate>1991</pubdate>
            <volume>201</volume>
            <issue>1</issue>
            <fpage>1</fpage>
            <lpage>21</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1111/j.1432-1033.1991.tb16251.x</pubid>
                  <pubid idtype="pmpid" link="fulltext">1915354</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>Optimization Theory in Evolution</p>
            </title>
            <aug>
               <au>
                  <snm>Maynard Smith</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Ann Rev Ecol Syst</source>
            <pubdate>1978</pubdate>
            <volume>9</volume>
            <fpage>31</fpage>
            <lpage>56</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1146/annurev.es.09.110178.000335</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>Multiple knockout analysis of genetic robustness in the yeast metabolic network</p>
            </title>
            <aug>
               <au>
                  <snm>Deutscher</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Meilijson</snm>
                  <fnm>I</fnm>
               </au>
               <au>
                  <snm>Kupiec</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Ruppin</snm>
                  <fnm>E</fnm>
               </au>
            </aug>
            <source>Nat Genet</source>
            <pubdate>2006</pubdate>
            <volume>38</volume>
            <issue>9</issue>
            <fpage>993</fpage>
            <lpage>998</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/ng1856</pubid>
                  <pubid idtype="pmpid" link="fulltext">16941010</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>Dynamic flux balance analysis of diauxic growth in Escherichia coli</p>
            </title>
            <aug>
               <au>
                  <snm>Mahadevan</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Doyle</snm>
                  <fnm>FJ</fnm>
                  <suf>3rd</suf>
               </au>
            </aug>
            <source>Biophys J</source>
            <pubdate>2002</pubdate>
            <volume>83</volume>
            <issue>3</issue>
            <fpage>1331</fpage>
            <lpage>1340</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1302231</pubid>
                  <pubid idtype="pmpid" link="fulltext">12202358</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>Metabolic networks in motion: 13C-based flux analysis</p>
            </title>
            <aug>
               <au>
                  <snm>Sauer</snm>
                  <fnm>U</fnm>
               </au>
            </aug>
            <source>Mol Syst Biol</source>
            <pubdate>2006</pubdate>
            <volume>2</volume>
            <fpage>62</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1682028</pubid>
                  <pubid idtype="pmpid" link="fulltext">17102807</pubid>
                  <pubid idtype="doi">10.1038/msb4100109</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>Flux balance analysis in the era of me-tabolomics</p>
            </title>
            <aug>
               <au>
                  <snm>Lee</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Gianchandani</snm>
                  <fnm>EP</fnm>
               </au>
               <au>
                  <snm>Papin</snm>
                  <fnm>JA</fnm>
               </au>
            </aug>
            <source>Brief Bioinform</source>
            <pubdate>2006</pubdate>
            <volume>7</volume>
            <issue>2</issue>
            <fpage>140</fpage>
            <lpage>150</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1093/bib/bbl007</pubid>
                  <pubid idtype="pmpid" link="fulltext">16772264</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>Advances in flux balance analysis</p>
            </title>
            <aug>
               <au>
                  <snm>Kauffman</snm>
                  <fnm>KJ</fnm>
               </au>
               <au>
                  <snm>Prakash</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
            </aug>
            <source>Curr Opin Biotechnol</source>
            <pubdate>2003</pubdate>
            <volume>14</volume>
            <issue>5</issue>
            <fpage>491</fpage>
            <lpage>496</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.copbio.2003.08.001</pubid>
                  <pubid idtype="pmpid" link="fulltext">14580578</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B11">
            <title>
               <p>Genome-scale models of microbial cells: evaluating the consequences of constraints</p>
            </title>
            <aug>
               <au>
                  <snm>Price</snm>
                  <fnm>ND</fnm>
               </au>
               <au>
                  <snm>Reed</snm>
                  <fnm>JL</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Nat Rev Microbiol</source>
            <pubdate>2004</pubdate>
            <volume>2</volume>
            <issue>11</issue>
            <fpage>886</fpage>
            <lpage>897</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nrmicro1023</pubid>
                  <pubid idtype="pmpid" link="fulltext">15494745</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B12">
            <title>
               <p>Analysis of optimality in natural and perturbed metabolic networks</p>
            </title>
            <aug>
               <au>
                  <snm>Segre</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Vitkup</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Church</snm>
                  <fnm>GM</fnm>
               </au>
            </aug>
            <source>Proc Natl Acad Sci USA</source>
            <pubdate>2002</pubdate>
            <volume>99</volume>
            <issue>23</issue>
            <fpage>15112</fpage>
            <lpage>15117</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">137552</pubid>
                  <pubid idtype="pmpid" link="fulltext">12415116</pubid>
                  <pubid idtype="doi">10.1073/pnas.232349399</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>Flux-balance analysis of mitochondrial energy metabolism: consequences of systemic stoichiometric constraints</p>
            </title>
            <aug>
               <au>
                  <snm>Ramakrishna</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>McCulloch</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Am J Physiol Regul Integr Comp Physiol</source>
            <pubdate>2001</pubdate>
            <volume>280</volume>
            <issue>3</issue>
            <fpage>R695</fpage>
            <lpage>704</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">11171647</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B14">
            <title>
               <p>Stoichiometric interpretation of Escherichia coli glucose catabolism under various oxygenation rates</p>
            </title>
            <aug>
               <au>
                  <snm>Varma</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Boesch</snm>
                  <fnm>BW</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Appl Environ Microbiol</source>
            <pubdate>1993</pubdate>
            <volume>59</volume>
            <issue>8</issue>
            <fpage>2465</fpage>
            <lpage>2473</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">182307</pubid>
                  <pubid idtype="pmpid" link="fulltext">8368835</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B15">
            <title>
               <p>In silico aided metabolic engineering of Saccharomyces cerevisiae for improved bioethanol production</p>
            </title>
            <aug>
               <au>
                  <snm>Bro</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Regenberg</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Forster</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Nielsen</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Metab Eng</source>
            <pubdate>2006</pubdate>
            <volume>8</volume>
            <issue>2</issue>
            <fpage>102</fpage>
            <lpage>111</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.ymben.2005.09.007</pubid>
                  <pubid idtype="pmpid" link="fulltext">16289778</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B16">
            <title>
               <p>Production of the antimalarial drug precursor artemisinic acid in engineered yeast</p>
            </title>
            <aug>
               <au>
                  <snm>Ro</snm>
                  <fnm>DK</fnm>
               </au>
               <au>
                  <snm>Paradise</snm>
                  <fnm>EM</fnm>
               </au>
               <au>
                  <snm>Ouellet</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Fisher</snm>
                  <fnm>KJ</fnm>
               </au>
               <au>
                  <snm>Newman</snm>
                  <fnm>KL</fnm>
               </au>
               <au>
                  <snm>Ndungu</snm>
                  <fnm>JM</fnm>
               </au>
               <au>
                  <snm>Ho</snm>
                  <fnm>KA</fnm>
               </au>
               <au>
                  <snm>Eachus</snm>
                  <fnm>RA</fnm>
               </au>
               <au>
                  <snm>Ham</snm>
                  <fnm>TS</fnm>
               </au>
               <au>
                  <snm>Kirby</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Chang</snm>
                  <fnm>MC</fnm>
               </au>
               <au>
                  <snm>Withers</snm>
                  <fnm>ST</fnm>
               </au>
               <au>
                  <snm>Shiba</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Sarpong</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Keasling</snm>
                  <fnm>JD</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2006</pubdate>
            <volume>440</volume>
            <issue>7086</issue>
            <fpage>940</fpage>
            <lpage>943</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature04640</pubid>
                  <pubid idtype="pmpid" link="fulltext">16612385</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>Flux balance analysis of mycolic acid pathway: targets for anti-tubercular drugs</p>
            </title>
            <aug>
               <au>
                  <snm>Raman</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Rajagopalan</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Chandra</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>PLoS Comput Biol</source>
            <pubdate>2005</pubdate>
            <volume>1</volume>
            <issue>5</issue>
            <fpage>e46</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1246807</pubid>
                  <pubid idtype="pmpid" link="fulltext">16261191</pubid>
                  <pubid idtype="doi">10.1371/journal.pcbi.0010046</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Toward a science of metabolic engineering</p>
            </title>
            <aug>
               <au>
                  <snm>Bailey</snm>
                  <fnm>JE</fnm>
               </au>
            </aug>
            <source>Science</source>
            <pubdate>1991</pubdate>
            <volume>252</volume>
            <issue>5013</issue>
            <fpage>1668</fpage>
            <lpage>1675</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1126/science.2047876</pubid>
                  <pubid idtype="pmpid" link="fulltext">2047876</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B19">
            <title>
               <p>Use of genome-scale microbial models for metabolic engineering</p>
            </title>
            <aug>
               <au>
                  <snm>Patil</snm>
                  <fnm>KR</fnm>
               </au>
               <au>
                  <snm>Akesson</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Nielsen</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Curr Opin Biotechnol</source>
            <pubdate>2004</pubdate>
            <volume>15</volume>
            <issue>1</issue>
            <fpage>64</fpage>
            <lpage>69</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.copbio.2003.11.003</pubid>
                  <pubid idtype="pmpid" link="fulltext">15102469</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B20">
            <title>
               <p>Systematic evaluation of objective functions for predicting intracellular fluxes in Escherichia coli</p>
            </title>
            <aug>
               <au>
                  <snm>Schuetz</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Kuepfer</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Sauer</snm>
                  <fnm>U</fnm>
               </au>
            </aug>
            <source>Mol Syst Biol</source>
            <pubdate>2007</pubdate>
            <volume>3</volume>
            <fpage>119</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1949037</pubid>
                  <pubid idtype="pmpid" link="fulltext">17625511</pubid>
                  <pubid idtype="doi">10.1038/msb4100162</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Bayesian-based selection of metabolic objective functions</p>
            </title>
            <aug>
               <au>
                  <snm>Knorr</snm>
                  <fnm>AL</fnm>
               </au>
               <au>
                  <snm>Jain</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Srivastava</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>Bioinformatics</source>
            <pubdate>2006</pubdate>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">17150997</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B22">
            <title>
               <p>Metabolic engineering under uncertainty &#8211; II: analysis of yeast metabolism</p>
            </title>
            <aug>
               <au>
                  <snm>Wang</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Hatzimanikatis</snm>
                  <fnm>V</fnm>
               </au>
            </aug>
            <source>Metab Eng</source>
            <pubdate>2006</pubdate>
            <volume>8</volume>
            <issue>2</issue>
            <fpage>142</fpage>
            <lpage>159</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.ymben.2005.11.002</pubid>
                  <pubid idtype="pmpid" link="fulltext">16413809</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B23">
            <title>
               <p>Network identification and flux quantification in the central metabolism of Saccharomyces cerevisiae under different conditions of glucose repression</p>
            </title>
            <aug>
               <au>
                  <snm>Gombert</snm>
                  <fnm>AK</fnm>
               </au>
               <au>
                  <snm>Moreira dos Santos</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Christensen</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Nielsen</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>J Bacteriol</source>
            <pubdate>2001</pubdate>
            <volume>183</volume>
            <issue>4</issue>
            <fpage>1441</fpage>
            <lpage>1451</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">95019</pubid>
                  <pubid idtype="pmpid" link="fulltext">11157958</pubid>
                  <pubid idtype="doi">10.1128/JB.183.4.1441-1451.2001</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B24">
            <title>
               <p>Identification of in vivo enzyme activities in the cometabolism of glucose and acetate by Saccharomyces cerevisiae by using 13C-labeled substrates</p>
            </title>
            <aug>
               <au>
                  <snm>dos Santos</snm>
                  <fnm>MM</fnm>
               </au>
               <au>
                  <snm>Gombert</snm>
                  <fnm>AK</fnm>
               </au>
               <au>
                  <snm>Christensen</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Olsson</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Nielsen</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Eukaryot Cell</source>
            <pubdate>2003</pubdate>
            <volume>2</volume>
            <issue>3</issue>
            <fpage>599</fpage>
            <lpage>608</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">161459</pubid>
                  <pubid idtype="pmpid" link="fulltext">12796305</pubid>
                  <pubid idtype="doi">10.1128/EC.2.3.599-608.2003</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B25">
            <title>
               <p>The JAK-STAT signaling network in the human B-cell: an extreme signaling pathway analysis</p>
            </title>
            <aug>
               <au>
                  <snm>Papin</snm>
                  <fnm>JA</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Biophys J</source>
            <pubdate>2004</pubdate>
            <volume>87</volume>
            <issue>1</issue>
            <fpage>37</fpage>
            <lpage>46</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1304358</pubid>
                  <pubid idtype="pmpid" link="fulltext">15240442</pubid>
                  <pubid idtype="doi">10.1529/biophysj.103.029884</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B26">
            <title>
               <p>Stoichiometric flux balance models quantitatively predict growth and metabolic by-product secretion in wild-type Escherichia coli W3110</p>
            </title>
            <aug>
               <au>
                  <snm>Varma</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Appl Environ Microbiol</source>
            <pubdate>1994</pubdate>
            <volume>60</volume>
            <issue>10</issue>
            <fpage>3724</fpage>
            <lpage>3731</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">201879</pubid>
                  <pubid idtype="pmpid" link="fulltext">7986045</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B27">
            <title>
               <p>The Escherichia coli MG1655 in silico metabolic genotype: its definition, characteristics, and capabilities</p>
            </title>
            <aug>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Proc Natl Acad Sci USA</source>
            <pubdate>2000</pubdate>
            <volume>97</volume>
            <issue>10</issue>
            <fpage>5528</fpage>
            <lpage>5533</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">25862</pubid>
                  <pubid idtype="pmpid" link="fulltext">10805808</pubid>
                  <pubid idtype="doi">10.1073/pnas.97.10.5528</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B28">
            <title>
               <p>In silico design and adaptive evolution of Escherichia coli for production of lactic acid</p>
            </title>
            <aug>
               <au>
                  <snm>Fong</snm>
                  <fnm>SS</fnm>
               </au>
               <au>
                  <snm>Burgard</snm>
                  <fnm>AP</fnm>
               </au>
               <au>
                  <snm>Herring</snm>
                  <fnm>CD</fnm>
               </au>
               <au>
                  <snm>Knight</snm>
                  <fnm>EM</fnm>
               </au>
               <au>
                  <snm>Blattner</snm>
                  <fnm>FR</fnm>
               </au>
               <au>
                  <snm>Maranas</snm>
                  <fnm>CD</fnm>
               </au>
               <au>
                  <snm>Pals-son</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Biotechnol Bioeng</source>
            <pubdate>2005</pubdate>
            <volume>91</volume>
            <issue>5</issue>
            <fpage>643</fpage>
            <lpage>648</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1002/bit.20542</pubid>
                  <pubid idtype="pmpid" link="fulltext">15962337</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B29">
            <title>
               <p>Use of constraint-based modeling for the prediction and validation of antimicrobial targets</p>
            </title>
            <aug>
               <au>
                  <snm>Trawick</snm>
                  <fnm>JD</fnm>
               </au>
               <au>
                  <snm>Schilling</snm>
                  <fnm>CH</fnm>
               </au>
            </aug>
            <source>Biochem Pharmacol</source>
            <pubdate>2006</pubdate>
            <volume>71</volume>
            <issue>7</issue>
            <fpage>1026</fpage>
            <lpage>1035</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.bcp.2005.10.049</pubid>
                  <pubid idtype="pmpid" link="fulltext">16329998</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B30">
            <title>
               <p>In silico predictions of Escherichia coli metabolic capabilities are consistent with experimental data</p>
            </title>
            <aug>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Ibarra</snm>
                  <fnm>RU</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Nat Biotechnol</source>
            <pubdate>2001</pubdate>
            <volume>19</volume>
            <issue>2</issue>
            <fpage>125</fpage>
            <lpage>130</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/84379</pubid>
                  <pubid idtype="pmpid" link="fulltext">11175725</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B31">
            <title>
               <p>Robustness analysis of the Escherichia coli metabolic network</p>
            </title>
            <aug>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Biotechnol Prog</source>
            <pubdate>2000</pubdate>
            <volume>16</volume>
            <issue>6</issue>
            <fpage>927</fpage>
            <lpage>939</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1021/bp0000712</pubid>
                  <pubid idtype="pmpid" link="fulltext">11101318</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B32">
            <title>
               <p>FluxAnalyzer: exploring structure, pathways, and flux distributions in metabolic networks on interactive flux maps</p>
            </title>
            <aug>
               <au>
                  <snm>Klamt</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Stelling</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Ginkel</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Gilles</snm>
                  <fnm>ED</fnm>
               </au>
            </aug>
            <source>Bioinformatics</source>
            <pubdate>2003</pubdate>
            <volume>19</volume>
            <issue>2</issue>
            <fpage>261</fpage>
            <lpage>269</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1093/bioinformatics/19.2.261</pubid>
                  <pubid idtype="pmpid" link="fulltext">12538248</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B33">
            <title>
               <p>Genome-scale thermodynamic analysis of Escherichia coli metabolism</p>
            </title>
            <aug>
               <au>
                  <snm>Henry</snm>
                  <fnm>CS</fnm>
               </au>
               <au>
                  <snm>Jankowski</snm>
                  <fnm>MD</fnm>
               </au>
               <au>
                  <snm>Broadbelt</snm>
                  <fnm>LJ</fnm>
               </au>
               <au>
                  <snm>Hatzimanikatis</snm>
                  <fnm>V</fnm>
               </au>
            </aug>
            <source>Biophys J</source>
            <pubdate>2006</pubdate>
            <volume>90</volume>
            <issue>4</issue>
            <fpage>1453</fpage>
            <lpage>1461</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1367295</pubid>
                  <pubid idtype="pmpid" link="fulltext">16299075</pubid>
                  <pubid idtype="doi">10.1529/biophysj.105.071720</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B34">
            <title>
               <p>Global organization of metabolic fluxes in the bacterium Escherichia coli</p>
            </title>
            <aug>
               <au>
                  <snm>Almaas</snm>
                  <fnm>E</fnm>
               </au>
               <au>
                  <snm>Kovacs</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Vicsek</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Oltvai</snm>
                  <fnm>ZN</fnm>
               </au>
               <au>
                  <snm>Barabasi</snm>
                  <fnm>AL</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2004</pubdate>
            <volume>427</volume>
            <issue>6977</issue>
            <fpage>839</fpage>
            <lpage>843</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature02289</pubid>
                  <pubid idtype="pmpid" link="fulltext">14985762</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B35">
            <title>
               <p>Flux analysis of underdetermined metabolic networks: The quest for the missing constraints</p>
            </title>
            <aug>
               <au>
                  <snm>Bonarius</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Schmid</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Tramper</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>TRENDS BIOTECHNOL</source>
            <pubdate>1997</pubdate>
            <volume>15</volume>
            <issue>8</issue>
            <fpage>308</fpage>
            <lpage>314</lpage>
            <xrefbib>
               <pubid idtype="doi">10.1016/S0167-7799(97)01067-6</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B36">
            <title>
               <p>Large-scale 13C-flux analysis reveals mechanistic principles of metabolic network robustness to null mutations in yeast</p>
            </title>
            <aug>
               <au>
                  <snm>Blank</snm>
                  <fnm>LM</fnm>
               </au>
               <au>
                  <snm>Kuepfer</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Sauer</snm>
                  <fnm>U</fnm>
               </au>
            </aug>
            <source>Genome Biol</source>
            <pubdate>2005</pubdate>
            <volume>6</volume>
            <issue>6</issue>
            <fpage>R49</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1175969</pubid>
                  <pubid idtype="pmpid" link="fulltext">15960801</pubid>
                  <pubid idtype="doi">10.1186/gb-2005-6-6-r49</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B37">
            <title>
               <p>Parasite immune escape: new views into host-parasite interactions</p>
            </title>
            <aug>
               <au>
                  <snm>Gupta</snm>
                  <fnm>S</fnm>
               </au>
            </aug>
            <source>Curr Opin Microbiol</source>
            <pubdate>2005</pubdate>
            <volume>8</volume>
            <issue>4</issue>
            <fpage>428</fpage>
            <lpage>433</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.mib.2005.06.011</pubid>
                  <pubid idtype="pmpid" link="fulltext">15993644</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B38">
            <title>
               <p>Game-theoretical approaches to studying the evolution of biochemical systems</p>
            </title>
            <aug>
               <au>
                  <snm>Pfeiffer</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Schuster</snm>
                  <fnm>S</fnm>
               </au>
            </aug>
            <source>Trends Biochem Sci</source>
            <pubdate>2005</pubdate>
            <volume>30</volume>
            <issue>1</issue>
            <fpage>20</fpage>
            <lpage>25</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.tibs.2004.11.006</pubid>
                  <pubid idtype="pmpid" link="fulltext">15653322</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B39">
            <title>
               <p>Metabolic network structure determines key aspects of functionality and regulation</p>
            </title>
            <aug>
               <au>
                  <snm>Stelling</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Klamt</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Bettenbrock</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Schuster</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Gilles</snm>
                  <fnm>ED</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2002</pubdate>
            <volume>420</volume>
            <issue>6912</issue>
            <fpage>190</fpage>
            <lpage>193</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature01166</pubid>
                  <pubid idtype="pmpid" link="fulltext">12432396</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B40">
            <title>
               <p>Mathematical Optimization and Economic Theory</p>
            </title>
            <aug>
               <au>
                  <snm>Intriligator</snm>
                  <fnm>MD</fnm>
               </au>
            </aug>
            <publisher>Philadelphia: Society for Industrial and Applied Mathematics</publisher>
            <edition>1</edition>
            <pubdate>2002</pubdate>
         </bibl>
         <bibl id="B41">
            <title>
               <p>Integrated analysis of regulatory and metabolic networks reveals novel regulatory mechanisms in Saccharomyces cerevisiae</p>
            </title>
            <aug>
               <au>
                  <snm>Herrgard</snm>
                  <fnm>MJ</fnm>
               </au>
               <au>
                  <snm>Lee</snm>
                  <fnm>BS</fnm>
               </au>
               <au>
                  <snm>Portnoy</snm>
                  <fnm>V</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Genome Res</source>
            <pubdate>2006</pubdate>
            <volume>16</volume>
            <issue>5</issue>
            <fpage>627</fpage>
            <lpage>635</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1457053</pubid>
                  <pubid idtype="pmpid" link="fulltext">16606697</pubid>
                  <pubid idtype="doi">10.1101/gr.4083206</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B42">
            <title>
               <p>Reconstruction and validation of Saccharomyces cerevisiae iND750, a fully compartmentalized genome-scale metabolic model</p>
            </title>
            <aug>
               <au>
                  <snm>Duarte</snm>
                  <fnm>NC</fnm>
               </au>
               <au>
                  <snm>Herrgard</snm>
                  <fnm>MJ</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Genome Res</source>
            <pubdate>2004</pubdate>
            <volume>14</volume>
            <issue>7</issue>
            <fpage>1298</fpage>
            <lpage>1309</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">442145</pubid>
                  <pubid idtype="pmpid" link="fulltext">15197165</pubid>
                  <pubid idtype="doi">10.1101/gr.2250904</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B43">
            <title>
               <p>Escherichia coli K-12 undergoes adaptive evolution to achieve in silico predicted optimal growth</p>
            </title>
            <aug>
               <au>
                  <snm>Ibarra</snm>
                  <fnm>RU</fnm>
               </au>
               <au>
                  <snm>Edwards</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>BO</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2002</pubdate>
            <volume>420</volume>
            <issue>6912</issue>
            <fpage>186</fpage>
            <lpage>189</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature01149</pubid>
                  <pubid idtype="pmpid" link="fulltext">12432395</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B44">
            <title>
               <p>Metabolic flux responses to pyruvate kinase knockout in Escherichia coli</p>
            </title>
            <aug>
               <au>
                  <snm>Emmerling</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Dauner</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Ponti</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Fiaux</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Hochuli</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Szyperski</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Wuthrich</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Bailey</snm>
                  <fnm>JE</fnm>
               </au>
               <au>
                  <snm>Sauer</snm>
                  <fnm>U</fnm>
               </au>
            </aug>
            <source>J Bacteriol</source>
            <pubdate>2002</pubdate>
            <volume>184</volume>
            <issue>1</issue>
            <fpage>152</fpage>
            <lpage>164</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">134756</pubid>
                  <pubid idtype="pmpid" link="fulltext">11741855</pubid>
                  <pubid idtype="doi">10.1128/JB.184.1.152-164.2002</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B45">
            <title>
               <p>Effect of lpdA gene knockout on the metabolism in Escherichia coli based on enzyme activities, intracellular metabolite concentrations and metabolic flux analysis by 13C-labeling experiments</p>
            </title>
            <aug>
               <au>
                  <snm>Li</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Ho</snm>
                  <fnm>PY</fnm>
               </au>
               <au>
                  <snm>Yao</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Shimizu</snm>
                  <fnm>K</fnm>
               </au>
            </aug>
            <source>J Biotechnol</source>
            <pubdate>2006</pubdate>
            <volume>122</volume>
            <issue>2</issue>
            <fpage>254</fpage>
            <lpage>266</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.jbiotec.2005.09.016</pubid>
                  <pubid idtype="pmpid" link="fulltext">16310273</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B46">
            <title>
               <p>Effect of zwf gene knockout on the metabolism of Escherichia coli grown on glucose or acetate</p>
            </title>
            <aug>
               <au>
                  <snm>Zhao</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Baba</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Mori</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Shimizu</snm>
                  <fnm>K</fnm>
               </au>
            </aug>
            <source>Metab Eng</source>
            <pubdate>2004</pubdate>
            <volume>6</volume>
            <issue>2</issue>
            <fpage>164</fpage>
            <lpage>174</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.ymben.2004.02.004</pubid>
                  <pubid idtype="pmpid" link="fulltext">15113569</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B47">
            <title>
               <p>Determination of metabolic flux changes during fed-batch cultivation from measurements of intracellular amino acids by LC-MS/MS</p>
            </title>
            <aug>
               <au>
                  <snm>Iwatani</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Van Dien</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Shimbo</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Kubota</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Kageyama</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Iwahata</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Miyano</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Hirayama</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Usuda</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Shimizu</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Matsui</snm>
                  <fnm>K</fnm>
               </au>
            </aug>
            <source>J Biotechnol</source>
            <pubdate>2007</pubdate>
            <volume>128</volume>
            <issue>1</issue>
            <fpage>93</fpage>
            <lpage>111</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.jbiotec.2006.09.004</pubid>
                  <pubid idtype="pmpid" link="fulltext">17055605</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B48">
            <title>
               <p>Sensitivity of 13C Isotopomer Based Flux Calculations to Metabolic Network Scope</p>
            </title>
            <aug>
               <au>
                  <snm>Reed</snm>
                  <fnm>JHQ</fnm>
               </au>
               <au>
                  <snm>Palsson</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>In Review</source>
            <pubdate>2007</pubdate>
         </bibl>
         <bibl id="B49">
            <title>
               <p>A methodology for the structural and functional analysis of signaling and regulatory networks</p>
            </title>
            <aug>
               <au>
                  <snm>Klamt</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Saez-Rodriguez</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Lindquist</snm>
                  <fnm>JA</fnm>
               </au>
               <au>
                  <snm>Simeoni</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Gilles</snm>
                  <fnm>ED</fnm>
               </au>
            </aug>
            <source>BMC Bioinformatics</source>
            <pubdate>2006</pubdate>
            <volume>7</volume>
            <fpage>56</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1458363</pubid>
                  <pubid idtype="pmpid" link="fulltext">16464248</pubid>
                  <pubid idtype="doi">10.1186/1471-2105-7-56</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
      </refgrp>
   </bm>
</art>
