Abstract
Background
The complexity and multiscale nature of the mammalian immune response provides an excellent test bed for the potential of mathematical modeling and simulation to facilitate mechanistic understanding. Historically, mathematical models of the immune response focused on subsets of the immune system and/or specific aspects of the response. Mathematical models have been developed for the humoral side of the immune response, or for the cellular side, or for cytokine kinetics, but rarely have they been proposed to encompass the overall system complexity. We propose here a framework for integration of subset models, based on a system biology approach.
Results
A dynamic simulator, the Fullyintegrated Immune Response Model (FIRM), was built in a stepwise fashion by integrating published subset models and adding novel features. The approach used to build the model includes the formulation of the network of interacting species and the subsequent introduction of rate laws to describe each biological process. The resulting model represents a multiorgan structure, comprised of the target organ where the immune response takes place, circulating blood, lymphoid T, and lymphoid B tissue. The cell types accounted for include macrophages, a few Tcell lineages (cytotoxic, regulatory, helper 1, and helper 2), and Bcell activation to plasma cells. Four different cytokines were accounted for: IFNγ, IL4, IL10 and IL12. In addition, generic inflammatory signals are used to represent the kinetics of IL1, IL2, and TGFβ. Cell recruitment, differentiation, replication, apoptosis and migration are described as appropriate for the different cell types. The model is a hybrid structure containing information from several mammalian species. The structure of the network was built to be physiologically and biochemically consistent. Rate laws for all the cellular fate processes, growth factor production rates and halflives, together with antibody production rates and halflives, are provided. The results demonstrate how this framework can be used to integrate mathematical models of the immune response from several published sources and describe qualitative predictions of global immune system response arising from the integrated, hybrid model. In addition, we show how the model can be expanded to include novel biological findings. Case studies were carried out to simulate TB infection, tumor rejection, response to a blood borne pathogen and the consequences of accounting for regulatory Tcells.
Conclusions
The final result of this work is a postulated and increasingly comprehensive representation of the mammalian immune system, based on physiological knowledge and susceptible to further experimental testing and validation. We believe that the integrated nature of FIRM has the potential to simulate a range of responses under a variety of conditions, from modeling of immune responses after tuberculosis (TB) infection to tumor formation in tissues. FIRM also has the flexibility to be expanded to include both complex and novel immunological response features as our knowledge of the immune system advances.
Keywords:
Biological networks; Immune response; Mathematical modeling; Ordinary differential equation systems; Systems biologyBackground
Mathematical models are a natural approach to improve our understanding of complex biological systems, and ultimately enabling us to predict their behavior and control them [1]. In particular, the intricacies and nonlinear nature of the mammalian immune response have attracted considerable attention over the years [2], in no small part due to the role of the immune response in a variety of relevant human conditions. In addition, the existence of a mathematical model allows one to explore the known differences in immunity development between human and nonhuman species [3] by altering or excluding specific pathways, as dictated by experimental findings. The basic components of interest would in principle include: cellular or cytotoxic responses (i.e., the development of cells from the Tlineage that attack antigens directly), humoral responses (i.e. the endogenous production of antibodies from cells of the Blineage that bind to the antigen receptor and hasten its removal) and signaling features (mainly, but not exclusively, through the cytokine network) [4].
In general, the development of quantitative models is often based on the selection of features of interest and their description in mathematical form, followed by their functional integration into a model that can be interrogated and/or used to predict features of interest. Such features can then be compared to experimental data. Similar procedures are followed for immune response models, but due to the system’s complexity, modeling and simulation efforts have focused on specific subsets of the system, such as the cellular responses [57], humoral responses [8,9] and/or cytokine networks [10,11], while sometimes excluding or simplifying other components from the model. As a general consideration, the development of comprehensive models is difficult and has to contend with the integrated network nature of the system, where the addition of one novel component necessarily requires defining the interactions of the new item with the remainder of the network.
Several modeling formalisms have been used in developing models of the immune system. Historically, these have been mostly categorized as differential equation models or agentbased models. Agentbased models or cellular automata models of the immune response have attracted great interest [12] since very early studies [13] and have been refined and proposed over the years in a manner that is responsive to new knowledge [14,15]. Their greatest strength is their flexibility and relative ease of use [16], which makes them suitable to model very complex systems without having to mechanistically specify the known component interactions. Instead, the system is defined in terms of “computer agents”, which are sets of rules by which individual actors (i.e. populations of cells, or even individual cells) are created, interact and are destroyed. The modeling effort then focuses on monitoring the interactions among agents, which gives rise to complex, sometimes emergent behaviors that, depending on the rule base, can provide a striking similarity to the temporal evolution of the system being represented. Such models can then be used to develop answers to complex problems, including therapy optimization [17,18]. As others have pointed out [2], despite their power, challenges remain with agentbased models, including the availability of widely accepted software and of model checking and goodness of fit strategies that resemble those commonly used for differential equation models. Differential equation models have provided tremendous insight in the dynamics of complex immunological networks [19,20] and are still widely used, relatively easier to communicate and more readily shared than agentbased models. Some of these models can achieve remarkable degrees of complexity and realism [21]. In addition, differential equations form the backbone of translational pharmacokineticpharmacodynamic (PKPD) models [22,23], the class of models that describe how drug dose influences response through quantitatively linking the drug dose to exposure (pharmacokinetic [24,25]) and the exposure to response (pharmacodynamic [26]) in a living system. These historically are the models of choice in drug research and development.
The integration of multiscale, realistic models of physiology with pharmacotherapeutic models is a desirable goal that would allow more mechanistic, predictive and overall useful models for drug research and development [27], in addition to enhancing collaborative efforts between biology and modeling. This effort is receiving renewed attention through the area of “systems pharmacology” [28], as explored in two successful interdisciplinary workshops hosted by the National Institutes of Health in 2008 (http://meetings.nigms.nih.gov/?ID=3447 webcite) and 2010 (http://meetings.nigms.nih.gov/?ID=8316 webcite). Issues related to efficient model sharing and model construction are also the purview of the Interagency Modeling and Analysis Group (IMAG) (http://www.imagwiki.nibib.nih.gov webcite). Building these models accurately and efficiently represents a significant challenge. This has prompted the development of sophisticated software to facilitate integration of separate submodels [29] and parallel computation [30].
The recent availability of computational environments to functionally connect submodels without having to write ad hoc computer code is well complemented by the development of approaches to supervised “monolithic” [30] model integration. In our case, a differential equation framework was chosen for the development of an integrated immune response simulator, coupled with a useful framework, found in systems biology, for integrating multiple subset models into a coherent whole. In this framework, connectivity matrices are built to describe the global network structure, followed by introduction of rate laws to seamlessly integrate multiple biological processes [31,32].
The Fullyintegrated Immune Response Modeling (FIRM) simulator is a differential equation based integration of multiple existing models of the immune system [5,8,10]. It accounts for both the humoral and cellular immune response systems and attempts to parsimoniously represent the spatially distributed nature of the system. The goal of this integrated model is to specify antigen exposure over time and calculate predicted antibody levels and cell concentrations following biological perturbations such as immunization or infection. To develop FIRM, we used a pharmacokinetic / pharmacodynamic modeling approach to combine previously published individual models of humoral and cellular response with antigen exposure. FIRM includes both the antigenspecific antibodies and cell populations, and accounts for cytokines and adjuvant components as needed. It is a hybrid construct incorporating structures and parameter values from published models in multiple mammalian species.
This report outlines the stepwise integration of networks describing the cellular dynamics for both T and Bcell responses to bacterial infections and to tumor growth in a target organ. In addition, to illustrate the incorporation of novel mechanisms, we propose and integrate within the framework a new hypothesized model of regulatory Tcell kinetics accounting for immunoevasion.
Methods
Model formulation and content
The process of building an integrated simulator starts with the definition of the underlying physiological structure. This preliminarily defines the existing interrelations among all the variables of interest as a “superset” of cellular and molecular populations and reactions. Second, all the cellular and molecular state variables are identified and the interrelationships (transitions) between them determined. The structure of the networks is thereby specified. Third, the mathematical forms of the equations that describe the fluxes are then formulated and their numerical values determined (from literature or existing data). Usually, the first two steps involve the determination and selection of existing relationships that have a physiological basis. As such, they are somewhat easier than the third step, where such relationships need to be made specific and quantitative. The availability of plausible numerical values is a wellknown rate limiting step in the definition and assembly of kinetic models, and in the rest of this section we will outline the approach we followed to inform FIRM’s parameterization.
Mathematical formalism
All the models we considered for integration obey the general governing equation to describe dynamics of cell and mass balance models:
where x is the vector of state variables (concentrations of various cell types and molecules) and v is the vector of fluxes from one state to the next (i.e. transport processes, reaction rates, cellular fate processes, etc., expressed in concentrations per unit time). S is a matrix that describes the structure of the network and its topology. Every column in S represents a flux and every row represents a state variable. The vector k contains the numerical values of the kinetic and physical constants (often, but not necessarily, expressed in units of inverse time). In general, the vector of fluxes v is a function of the state variables and the kinetic and physical constants characterizing transport and reaction processes.
Three published models of the immune response, each highlighting different features of the system [5,8,10], were identified for inclusion in FIRM. The reconstructed network for the immune response is shown in Figure 1A for the cell populations involved in the system and in Figure 1B for the cytokines relevant to the model. An explanation of the abbreviations is included in the figure legends. Volume heterogeneity in the model is accounted for and described in the next section. In addition, there were fluxes in the reconstructed network that are inactive in the final FIRM model’s computational (executable) implementation. The reasons for inactive fluxes vary, including for example: redundancy, namely their function is accounted for elsewhere in the model; removal or inactivation of a node; lack of data to properly inform the flux. Full details of inactive fluxes, and the reasons for deactivation, can be found in the Supplemental Material (Additional file 1: Table S8). Since some fluxes were inactivated, not all the nodes we initially considered as part of FIRM were active in the final structure: specifically, the function of M_{APC} (macrophages functioning as antigen presenting cells) is incorporated in the dendritic cell population and not explicitly accounted for; and, the function of T_{H2} in the humoral response was not included due to lack of quantitative information regarding this component. Consequently, the relevant cytokine network components are also inactive.
Figure 1. The reconstructed FIRM network. A. The final FIRM formulation includes inactive fluxes and nodes that are included for completeness in this figure. Symbols are as follows: TUMOR, tumor mass; DEBRIS, tumor cell debris; MAPC, antigenpresenting macrophages; MA, activated macrophages; MR, resting macrophages; MI, infected macrophages; PI, intracellular bacteria; PE, extracellular bacteria; IDC, immature dendritic cells; MDC, mature dendritic cells; T, naïve Tcells; TCP, cytotoxic precursor Tcells; TC, cytotoxic Tcells; THP, helper precursor Tcalls TH1, Thelper 1 cells; TH2, Thelper 2 cells; AB, antibody; B, naïve Bcells; BA, activated Bcells; BM, memory Bcells; BP, plasma Bcells; Treg, regulatory Tcells. See the Supplemental Material for the full details. B. The cytokine activity of the FIRM network. Solid green arrows represent production. Dashed green arrows represent upregulation of a flux, and dashed red arrows represent downregulation of a flux. The graph is a superset of Figure 1A, where cytokines are superimposed to the previously defined cell populations. Symbols are as follows: I12, interleukin12; Iγ, interferongamma; I10, interleukin10; I4, interleukin 4; TGFβ, tumor growth factor beta.
Additional file 1. Supplemental Figures and Tables. FIRM Manuscript Supplemental Figures.
Format: DOCX Size: 473KB Download file
The matrix S, the state variables and the fluxes corresponding to the final structure of the FIRM model are found in supplemental Additional file 1: Tables S1, S2 and S3. The mathematical form of all the flux variables are given in Additional file 1: Table S4, and the numerical values and their literature sources are found in Additional file 1: Table S5 and S6.
Spatial distribution features
To account for known features of the spatial distribution of the immune response components in our simulations in a parsimonious manner, the FIRM model has five separate tissue spaces where the cell and cytokine populations can travel: lung (assumed to have a volume of 1000 mL), blood (4500 mL), lymphoid tissues relevant to the cellular (10 mL) and humoral response (150 mL) and the sites of immune recognition (4500 mL). As populations of cells and molecules travel between biological spaces, their concentrations are multiplied by the respective volumes of distribution so as to maintain mass balance. This was particularly important for the population of infected macrophages, which changes dynamically as bacterial infection progresses and turns out to have a timedependent variable volume of distribution whose features needed to be accounted for in the simulation. Additional file 1: Table S7 in the Supplementary Material contains the various tissue space volumes.
It is worth noting that this is a parsimonious representation since, to accurately represent spatially differentiated behaviors, one would have to define biological spaces for each spatially (and functionally) separate component of each organ or tissue that has a distinct pattern or behavior from other parts of the organ or tissue under consideration. These spaces would be defined so as to have different volumes, rate constants for accessibility, etc., to reflect their heterogeneous physical structure and, given the number of parameters required, would require detailed experimental information at the cellular and molecular level. In this sense, FIRM is a parsimonious model and does not reach this level of granularity, although the model structure is amenable to be extended and incorporate such considerations where warranted, required by the purpose of the modeling exercise and supported by the data.
Simulation platform and integration procedure
Mathematica (Wolfram Research, Champaign, IL) was used as the modelbuilding platform. The integrated model was assembled in a stepwise fashion. Specifically, the concentration and flux vectors in the model structure were populated stepbystep with the appropriate features and components, as illustrated in Figure 2. FIRM was built in Mathematica 7.0. The Mathematica workbook that resulted was used to generate all graphs in this paper from FIRM simulations. The simulator is portable to other simulation platforms: a Matlab (The Mathworks, Natick, MA) version of the FIRM simulator was also generated. Additional file 1: Tables S1 to S6 contain a full specification of the FIRM simulator, suitable for implementation in other matrix languages.
Figure 2. FIRM integration formalism. This figure summarizes the plan devised for the development of FIRM. The oval at the top represents the method of building dynamic models that was employed to construct FIRM. At each step, the subset model included can be seen on the left, and the major cell populations covered in each step is outlined on the right. MK refers the MarinoKirschner model (including resting macrophages M_{R}, activated macrophages M_{A}, infected macrophages M_{I}, Thelper 1 cells T_{h1}, Thelper 2 cells T_{h2}, dendritic cells DC and pathogen [10]), DB refers to the DeBoer et al. model (including resting macrophages M_{R}, activated macrophages M_{A}, Thelper 1 cells T_{h1}, cytotoxic Tcells T_{C} and Tumor [5]), and BL refers to the Bell model (which includes naïve Bcells B, activated Bcells B_{A}, memory Bcells B_{M}, plasma Bcells B_{P} and Antigen [8]). “Pathogen” indicates bacterial infection, while “Antigen” refers to viral or other small antigen infection. The partial overlap of the models provides a roadmap to integration, which however needs to take into account the diversity of formulations used in the models to account for essentially the same immune response features.
Results and discussion
(1) Procedure for integrating multiple dynamic models from different sources
As described in the Methods section, the dynamic simulator is expressed as a series of balance equations. Mathematically:
where x is the vector of state variables (cell types and molecule concentrations) and v is the vector of fluxes from one state to the next (i.e., transport processes, reaction rates, cellular fate processes, etc.). S is a matrix that describes the structure of the network and its topology. Every column in S represents a flux and every row represents a state variable. The vector k contains the numerical values of the kinetic and physical constants. The contents of all these mathematical objects are found in Additional file 1: Tables S1 (Stoichiometric matrix), Additional file 1: Table S2 (variable list), Additional file 1: Table S3 (flux list), Additional file 1: Table S4 (rate laws), Additional file 1: Table S5 (kinetic constant values), and Additional file 1: Table S6 (miscellaneous parameter values).
The reconstructed network is shown in Figure 1A. It includes all the major T and Bcell types, the pathogens (antigens), as well as tumor and its debris. The regulatory effects of the major inflammatory growth factors and cytokines are shown in Figure 1B. These graphs highlight the boundaries of FIRM. The processes that we considered for inclusion have been described multiple times (see e.g. figure in [33] for a description) and relate to humoral and adaptive immunity. Briefly, the humoral side of the system describes the activity of Bcells that, when in contact with an antigen/pathogen, secrete antibodies which are essentially a secreted version of their receptor compatible with the antigen). The antibodies bind to the antigens and neutralize them. The link between the humoral and the cellular components of the system is provided by helper Tcells, which activate Bcells. This function is currently not included in the model since it was not a part of the constituent submodels. The cellular side starts with naïve Tcells recognizing antigen epitopes through antigen presentation via dendritic cells and macrophages and subsequently developing a Tcell driven response to the antigen. This process is particularly important when the pathogen is a cell, such as in cancer and bacterial immunity, which are both described in FIRM. Tcells can also differentiate to regulatory Tcells, which essentially mute features of the immune response.
The FIRM simulator was built in a stepbystep fashion, summarized in Figure 2, from both constituent models that have appeared in the literature [5,8,10] and novel mechanisms. A summary of those steps is below.
Immune response to tuberculosis (TB) infection[10]: Cellular response to bacterial challenge. The model integration in FIRM started with a published model for TB infection of the lung (by Marino and Kirschner, hereafter the MK model). This model described the activation of macrophages, their infection, and the antigen presentation by dendritic cells that leads to differentiation of Tcells in lymphoid tissue; these cells then migrate to the lung where they differentiate into T1 and T2 helper cells. The scope of this subset model is described in Figure 3. The MK model also included a rather detailed representation of the cytokine signaling network following infection, which is not shown in Figure 1A for simplicity (but is shown in Figure 1B).
Figure 3. The individual areas of influence of the three original models (MK, DB and BL) in relation to the FIRM network structure. There was overlap in the content of the original models, exemplified here by the overlapping shaded areas of the MK ([10]) and DB ([5]) models (light green). Nodes not encompassed by a shaded area are inactive in the final FIRM structure but have been identified as connections among models and are reported for completeness. See the Supplemental Material (Additional file 1) for full details on inactive fluxes and nodes.
The MK model state variables and fluxes were introduced into the network and used to specify the x and v vectors in the overall massbalance model. This was done in a stepwise fashion and the process was quality controlled at each step. Briefly, to ensure quality control of the implemented model, all fluxes in the network are turned off except one at a time (the one that needs to be examined) and conservation of mass is checked for. This is repeated every time a new population of either cells or molecules is introduced in the model, thus ensuring that no arbitrary gains or losses occurred at any step during model building. A sample QC/QA document is provided in Additional file 1: Figure S10. There were several issues and simplifications associated with mapping the MK model onto the unified network structure at the basis of FIRM. These included changes in basal states (which are calculated analytically as functions of parameter values), accounting of cell population dynamics to obey mass balance (specifically, macrophages and bacteria) and accounting for the variable volume of distribution of the infected macrophages and for the appropriate volume ratios for cell and molecule migration. As a final check, the simulations of this initial model were compared with those available from the original publication (Additional file 1: Figure S9). While the agreement was not exact, this was to be expected given that changes were made to the original model formulation. Details regarding the mapping of the MK model onto the FIRM framework are provided in the Table 1.
Table 1. Overall summary of integration issues
Immune response to tumor formation[5]: Cellular response to tumor challenge. The second subset model identified for inclusion in the integrated model (by DeBoer et al., hereafter the DB model) described the inflammation response to the presence of a tumor. Its components were the growth of tumor mass, the activation of macrophages in response to the tumor cells, the proliferation and differentiation of cytotoxic and T1 helper cells, and the killing of tumor cells creating tumor debris. The original formulation of this subset model had all tracked populations in a single biological space; therefore, the cell populations described in the model had to be mapped to their appropriate organs. The scope of this model can be seen in Figure 3, together with its overlap and points of contact with the MK model. Once again, the state variables and fluxes associated with the content of this subset model were added to the model network.
The inclusion of the DB model marks the first integration in the FIRM system of two separately developed and reported kinetic models (MK and DB). The integration of two kinetic models resulted in some complexities, reflecting in turn: the state of biological knowledge revealed by the models, the assumptions made, the structure of the network, and the detail of the quantitative information. The process of integrating models from various sources and built for different mammalian species requires explicit and sometimes implicit biological and structural assumptions. We summarized those choices as “integration issues” and they are reported in detail in the Table 1. The resolution of integration issues is critical to the construction of an integrated model such as FIRM. For example, the DB model included processes and parameters which tended to be descriptive as opposed to mechanistic, reflecting the knowledge of immunology at the time. Therefore, the issues involved with the addition of the DB model included integrating phenomenological parameters into the FIRM state variable and rate law structure (and sometimes modifying them), selecting a value for kinetic constants that appear in both models, and including new network fluxes, mostly cellular, as necessary to integrate the models to ultimately ensure balance of mass.
Bcell response to antigen[8]: Humoral response to antigen challenge. The third subset model that was included in FIRM (by Bell, hereafter the BL model) details the Bcell and antigen response to the presence of an antigen in the system. Included in the BL model is the exposure of naïve Bcells to antigen, the activation of Bcells that migrate to the lymphoid B via the blood, the differentiation of activated Bcells to plasma and memory Bcells, and the production of antibodies by said Bcells. Lastly, the antibodies work to eliminate the antigen from the blood and the target organ. This model’s components are again shown in Figure 3, which also highlights commonalities with the MK and DB models.
Again, the integration of the BL subset model into the framework of FIRM led to some integration issues. The BL model had a rich level of molecular detail when describing the interaction of Bcell receptors, antibodies, and antigens. These interactions were simplified in the original model through the use of quasiequilibrium assumptions. Given the level of granularity in FIRM, these assumptions could be relaxed and the full details of the underlying molecular processes are described. Therefore, the network structure accommodates antigen and antibody binding (Figure 4). The inclusion of this subset model in the network was a major integration issue with FIRM, since the network had to be substantially expanded to include all of these detailed processes. Integration issues are reported in detail in the Table 1. Briefly, antigenantibody binding reactions (shown in Figure 4) include: a free antibody binding to a free antigen creating a singlebound antibody; a single bound antibody binding to a free antigen creating a doublebound antibody; the removal/clearance of a singlebound antibody; and the removal/clearance of a doublebound antibody.
Figure 4. Scope and details of the BL model in the context of the FIRM network. The model [8] included detailed information on the interactions of antigens, antibodies, and Bcell receptor sites of the humoral response. Symbols are as follows: B, naïve Bcells; BA, activated Bcells; BP, plasma Bcells; BM, memory Bcells. Bivalent antibodies are released by BA and BP in the lymphoid B organs and bind antigens both in blood and lung (target organ) tissues. The antigen binds to naïve and activated Bcells and stimulates the formation of antibody.
The incorporation of the BL model essentially completed the FIRM structure based on published models. Figure 5 shows a simulation of the fully integrated FIRM model at nominal parameter values (Additional file 1: Tables S5 and S6). This is a base case simulation with an initial load of 100,000 infecting bacterial cells in the target organ. The bacteria cells are allowed to migrate into the blood as well, thus triggering a strong antibody response. The Bcell receptor density for the bacteria is assumed to be 10^{3} molecules/mL, in keeping with the BL model.
Figure 5. Cellular and Humoral Response to Antigen Presentation. The cellular (upper panel) and humoral (lower panel) response of the fullyintegrated FIRM simulator with nominal parameter values and an initial load of 100,000 antigen molecules in the target organ, which are allowed to infect macrophages and migrate into the blood. While the cellular response is small and has little to no effect on the infection, the humoral response is strong and effectively eliminates the infection.
It should be mentioned at this point that the constituent models composing FIRM were not necessarily tailored to a particular animal species. The BL model description mentions data being obtained in rabbits, but it also states that the model recapitulates essential features of the mammalian immune response. The DB model is based on data in mice, while the MK model was built to be applicable to humans. This makes FIRM a hybrid model containing features of a few mammalian species. That being said, validation of models against data is a tool of paramount importance in model development. FIRM provides predictions of timing and extent of immune respone, which can be compared against experimental data. While we propose here the FIRM structure and have strived to maintain consistency of units across the models, we make no attempt at validation and later we propose approaches to test this important question.
Addition of T_{reg}and TGFβ: With the integration of the MK, DB, and BL models, we have created a platform with which basic immunological simulations can be performed. The FIRM platform is flexible enough to easily introduce new information and physiological responses. This section demonstrates that principle through addition of regulatory Tcells (T_{reg}). T_{reg} play an important role in the immune system’s response to a tumor. T_{reg} are a rather new discovery in the immunological field, and considered to be of great importance. Therefore, T_{reg} were selected to be the first addition when expanding the FIRM platform beyond the original publications.
There are two sources of T_{reg} in the body: the first source is from the lymphoid T and the second source is a resident population in the target tissue [34]. T_{reg}, much like the T_{CP} and T_{HP}, will also have a constant differentiation from the naïve Tcell population in the lymphoid T that will travel into the blood. T_{reg} account for 5%10% of the Tcells in the blood in a normal state [34]. The differentiation in the lymphoid T was calibrated appropriately to reflect these levels. Once the T_{reg} reach the site of the tumor, they produce TGFβ, a cytokine that has a downregulatory effect on the proliferation of cytotoxic Tcells. Cytotoxic Tcells assist in killing tumor cells, so it stands to reason that tumor cells play a role in the proliferation of T_{reg} in the target tissue. A visual representation of the T_{reg} addition can be seen in Figure 6. T_{reg} exist in the lymphoid B, the blood and the target organ. Naïve Tcells differentiate to T_{reg} in the lymphoid T; they migrate to the blood where they are subject to removal or recruitment to the target organ; they can also proliferate in the target organ. TGFβ is produced and decays in the target organ, where it exerts its effect on Tcell kinetics. The majority of rates and parameters used in the rate laws were assigned values based on approximations. These approximations were picked to be similar to the values of the rates associated with other Tcell lineages and cytokines in FIRM. The exact numerical values of the rates and parameters are still a subject of evaluation and examination of relevant literature and future experimentation.
Figure 6. The T_{reg}kinetic model incorporated in FIRM. The model accounts for T_{reg} presence in the lymphoid T (where they differentiate from naïve Tcells), the blood (where they migrate and are subject to removal or recruitment to the target organ) and the target organ (where they proliferate). The kinetics of TGFβ are similarly accounted for. T_{reg}, regulatory Tcells; TGFβ, tumor growth factor beta; other abbreviations as in Figure 1A and Figure 1B. See text for details.
The basal state: As with all kinetic models, FIRM has a basal (unperturbed) state. In this particular case, the basal state represents the immune system components’ baselines when there is no antigen present. Such a basal state reflects steady state homeostasis and was calculated using the nominal parameters and running the model to stable steady state conditions. Calculated basal state cell populations include: 10^{8} resting macrophages in the target organ, 5 × 10^{7} dendritic cells in the target organ, ~8 × 10^{4} naïve Tcells in the lymphoid T, ~10^{3} T helper precursor cells in the lymphoid T, 3 × 10^{3} T helper precursor t cells in the blood, ~2 × 10^{4} naïve Bcells in the site of recognition, ~10^{3} cytotoxic T precursors in the lymphoid T, 5 × 10^{4} cytotoxic T precursors in the blood, ~3 × 10^{2} molecules of IL12 and ~3 × 10^{2} of TGFBeta in the target organ, 10^{4} T_{reg} in the blood, 2 × 10^{2} in the lymphoid T and 10^{6} in the target organ, and ~2 × 10^{7} free receptor sites on the naïve Bcells in the site of recognition. The T_{reg} in the blood account for about 9.1% of all T cells circulating in the blood [34]. In the basal state, the system is free of antigens, and, therefore, antibodies. This basal state can then be perturbed by exposure to antigen reflecting various stimuli or pathological situations. The response to one or many antigens can be simulated.
The final version of the FIRM simulator has 55 nodes (cells and antibodies), 107 distinct processes and 171 parameters. As defined and with the postulated interactions and parameter values described above, the FIRM simulator is an initial step towards a simulator of the immune response capable of representing a variety of putative challenges. To demonstrate the use of FIRM we present four case studies that illustrate its different features and capabilities.
(2) Use of the simulator – case studies
Based on the full model, changes in network structure and parameter values can be defined to mimic known occurrences in immune response modulation. Within FIRM, completely different situations involving immune system cells, and foreign and endogenous molecules, can be modeled in a few steps. Deactivating one or two fluxes can drastically change the conditions of a simulation. Among many possible simulations, four cases of interest are explored:
1. TB infection;
2. Blood borne pathogen infection;
3. Spontaneous tumor rejection;
4. Influence of T_{reg} on tumor rejection.
The first two case studies represent confirmatory simulations for comparison with the original MK and BL model results.
TB infection
To simulate a pure TB infection, 100,000 extracellular bacteria were introduced into the lung (target organ) and flux v_{87} was deactivated. Flux v_{87} represents the permeation of extracellular bacteria between the target organ and the blood (Figure 1A). Flux v_{87} was thus deactivated to prevent the bacteria from migrating away from the lung. The TB infection is known to stay local in the lung and not permeate into the blood. FIRM was then simulated with its nominal parameters.
As shown by the MK model, a TB infection is thought to be dealt with exclusively by the cellular response with no response from the humoral system. A chronic infection is simulated. The Tcell response that is solicited by the immune system is enough to prevent runaway growth by the bacterial population in the lung. Even though the cellular response prevents runaway growth, the levels of infected macrophages are rather large and stay constant. The results can be seen in Figure 7. As one would expect, the simulation results closely resemble the MK model, which was specifically developed to represent TB [10]. This simulation illustrates that the integrated FIRM can still recapitulate the trends initially found with the MK model.
Figure 7. TB infection simulation. A simulation of an intracellular bacterial infection with an initial condition of 100,000 bacteria in the target organ. See text for details.
Blood borne pathogen
In this simulation, a blood borne pathogen originates in the blood and remains confined within the circulation. For simplicity, the increase in antigen load prior to the induction of an immune response is represented as a spike (pulse) increase. An example of this situation would be a viral infection. The pathogen does not permeate into the tissue to infect, for example, resident macrophages. To simulate a blood borne pathogen in FIRM, fluxes v_{87} and v_{88} were deactivated. These two fluxes model the access of antigen between the target organ and the blood. This simulation used nominal parameter values and an initial condition of 100,000 antigen molecules in the blood. The results of the simulation can be seen in Figure 8.
The humoral (Bcell) response was used by FIRM to eliminate the infection. In fact, in the case study, as expected, the cellular response is virtually nonexistent. The antigens never come in contact with the dendritic cells in the tissue. Therefore, there is little antigen presentation to the Tcells in the lymphoid T to drive differentiation of the naïve Tcells. The graphs in Figure 8 show a fast humoral response flooding the blood vessels with antibodies. The antigens are quickly bound to the antibodies in the blood and are removed from the system as antibodyantigen complexes. This simulation resembles the behavior of the original BL model, confirming the performance of the integrated FIRM against the individual submodels.
Tumor removal
Since no tumorantibody interaction is defined in FIRM at this point (all the individual models, MK, DB or BL, lacked a mechanistic description of antibodymediated cell kill), simulations of tumors will not include migration of tumor antigens (debris in the DB model) into the blood from the target organ. Therefore, the flux v_{88} was deactivated for this case study. Additionally, we changed the halflife of all T helper cells to 0.02 day^{1} from 0.3333 day^{1} (the remaining reaction rates were left at the nominal parameter values). The updated halflife was derived from the DB model, while the previous halflife was derived from the MK model. As a justification, through successive model runs we observed that an elevated halflife for the Tcells prevented them from encouraging proliferation of cytotoxic Tcells and therefore prevented tumor kill. This shows that tumor removal by the immune system may be influenced by the kinetics of these cells and also points to features of the model that greatly influence its predictions.
FIRM was then simulated with one initial tumor cell in the target organ. This simulation scenario (Figure 9) highlights the multiscale temporal characteristics of the FIRM simulator. Initially, the tumor grows at a rapid rate, seemingly unchecked. The growth is quickly suppressed by a macrophage response. The activated macrophages reach a level at which the tumor cells are no longer growing, rather settling around a small population size. After this initial response by the macrophages, the presence of the tumor triggers a cellular response. This Tcell response requires a longer time period in order to proliferate to a population size capable of eliminating tumor cells in the target organ. Once the cytotoxic Tcells reach a critical level, the cellular response is able to eliminate the tumor. Once the tumor has been eradicated, the cell populations move back to their steady state levels. This simulation calls into play the features of the DB model [5], with one important difference. While the DB model contained phenomenological features, these have been mostly replaced in the integrated FIRM with more mechanistic cell populations and fluxes which better reflect physiology. It is reassuring that the outcome of the simulation resembles the original model, but it does so with more mechanistic detail about the cellular populations involved. Generic inflammatory signals are still used to represent the kinetics of IL1 and IL2. It is worthwhile to mention that tumor secretion of TGFβ would be expected to contribute to these processes by promoting immunoevasion: this is discussed in the next case study, where regulatory Tcells are integrated in the simulation.
Figure 9. Tumor removal simulation. A simulation of spontaneous tumor growth and immunemediated tumor elimination. See text for details.
What truly happens in the mammalian immune system following challenge with a single proliferating tumor cell is unknown. However, it has been assumed that the immune system regularly removes tumor cells that may arise spontaneously (the concept of immunosurveillance[35]). If anything, this simulation highlights the role played by the T helper population interaction with the tumor. In our hands, a change in this population’s reported half life to 0.02 day^{1} from 0.3333 day^{1} was sufficient to produce a more realistic output; however, the model structure may also have been incorrectly specified in the original models. Overall, these considerations point to experimental and research areas of focus. In addition, other parameters in the model may have similar strong influences on the model predictions.
Influence of T_{reg} on tumor rejection
Regulatory Tcells are resident in tissues and can also be activated through differentiation in lymph nodes through antigen presentation by dendritic cells, with subsequence migration to the site of action. Several cytokines are now known to be involved in this process. The introduction of T_{reg} and TGFβ into the system has a profound effect, as can be seen in Figure 10. The tumor profiles behave similarly as to the previous scenario until about day 45. The tumor experiences growth and is then rejected. The delay in the rejection of the tumor is due to the hampered proliferation of the Tcell population in the target organ, caused by having added T_{reg} and TGFβ dynamics to the model. It essentially takes the Tcell population over 60 days to reach an effective tumor killing level, while previously that took only 45 days.
Figure 10. Tumor removal with regulatory Tcells. This figure shows a modified version of Figure 7 after T_{reg} and TGFβ have been introduced in the model. from left to right and top to bottom, the time profiles of regulatory Tcells, TGFβ, tumor cells, and cytotoxic Tcells are shown. See text for details.
The T_{reg} addition had a profound effect on how the comprehensive system reacts to the presence of a tumor. As such, it is a good example of how the FIRM simulator can be expanded to include additional, more realistic characteristics of immunological responses. This addition reduces to practice how FIRM could be expanded towards the ultimate goal of building a more comprehensive mathematical representation of immune system features.
Conclusions
Inflammation and immune response are thought to be a common denominator in human disease. A comprehensive simulator of the immune response in human tissues is thus a needed tool for a variety of applications. FIRM was undertaken as an initial step towards meeting this need. The development and use of FIRM showed that: (1) already developed and proven methods from systems biology could be used to facilitate the construction of a platform for the integration of subset models each focusing on a feature of the immune response; (2) these methods can be successfully implemented to generate an integrated simulator; and (3) that FIRM can account for a variety of challenges to the human immune system through its multiscale characteristics. A structure such as FIRM can be used prospectively for iterative model building, as the scope of the simulator grows and as new discoveries are made and integrated in the framework; at the same time, the predictions from FIRM can be compared against experimental data, to improve the model and, consequently, mechanistic understanding of its underlying biology.
As molecular systems biology has developed over the past decade, largescale and even genomescale models have been formulated [36]. These models are formed from reconstructed networks based on biochemical, genetic and genomic data, and thus have been able to compute a variety of phenotypic functions. This process has been particularly successful for metabolic models [37]. Since such models are mostly based on the universal principles of flux or mass balance, this process can be applied to systems analysis of complex dynamic systems, such as the immune response. We were able to build FIRM based on a reconstructed network of the main cellular and molecular components involved in the immune response. The key challenge over the individual component models is that FIRM is built on multiple tissue spaces of different volumes, even varying volumes in some cases. Additionally, the model equations are formulated in terms of total counts of each variable in a given tissue space. This allows for complete and accurate accounting and balancing of all state variables. Concentrations of cellular and molecular species can then be computed by simply dividing the total amount at each time point with the biological volume of the space, thus allowing for direct comparison to experimental measurements.
The reconstructed network was then populated with information from published models that describe subsets of the immune response. These published models contained detailed information about the mathematical form of the flux equations. In addition, numerical values for all the parameters are provided in these subset models that are typically obtained from measurements or the available experimental literature.
The putative reconstructed network allows the mapping of multiple subset models and their ready integration under a unified format. In principle this is a simple process, but in practice it has been implemented as a stepwise procedure that reveals subtle integration challenges as additional subset cellular and regulatory processes are added. One of the major integration problems arises when discrepancies in the numerical values for the same parameter appear in different subset models. For example, in some cases, assumptions about the physiological processes accounted for in a subset model were not needed in the comprehensive network reconstruction and thus had to be relaxed or otherwise modified (just as an example, eliminating “HTL” (TH1) from macrophage activation in the DB model). This was relatively easy to accomplish since the network reconstruction has a manageable amount of biological and biochemical detail.
Integration of three Tcell responses, the full Bcell response and the regulatory action of key growth factors was performed. All these subsets of the immune response form a postulated, coherent whole as described by FIRM, which by its integrated nature is more comprehensive than any of the individual subsets and can be further expanded for additional realism. FIRM is thus capable of simulating both tumor and pathogen challenges to the immune system, either separately, or simultaneously. When FIRM is applied to simulate such challenges, it displays appealing multiscale (time, cellular events, etc.) characteristics. This was demonstrated through case studies representing the formation and eradication of a tumor, and the response to TB infection. The challenges encountered in integrating the FIRM network and its component models are actually representative of the obstacles that can be encountered when attempting to synthesize published mathematical models in a cohesive whole. All biological system models are usually delimited by the boundaries of the system being studied – they are not comprehensive because they cannot be. Their scope is usually limited to the original question they were designed to answer. The biological modeling community is currently entering a new stage: it already moved from the development of individual models to the definition of databases and repositories for these models to be shared; the next evolution is to provide robust tools for ondemand component model integration. This task is addressed in this work. When performing model integration, care must be taken not to reach over the scope of the original component models, especially by trying to incorporate or match aspects that cannot be generalized. This is best decided on a case by case basis. FIRM is a starting point for the modeling community to consider these issues.
Given its current state and the iterative model building enabled by the systems biology approach used in its development, FIRM can and should be expanded to account for additional components of the immune response as new knowledge becomes available. An important area where FIRM could be expanded is the innate response, including natural killer (NK) cells. Models have been recently developed [6] to characterize this response component. It would also be useful to examine the behavior of FIRM in the context of reinfection, through refinement of the memory Bcell models and kinetics. In addition, a mechanism for antibodydependent cellular cytotoxicity (ADCC) would provide an unambiguous link between the DB and the BL model and would enrich the FIRM structure. Perhaps the most important missing feature from FIRM is the activation of the Bcell cascade by the Thelper 2 cells, which is a known, essential mechanism for humoral response initiation. All these remain important areas for further development, whose investigation is made somewhat easier by FIRM’s modular structure.
Since it is possible that a range of parameter values could provide similar unperturbed state values, another area of future investigation would involve sensitivity analysis of the model. To explore this, the model could be expanded to include stochastic behavior so as to account for random variation of the state variables around a physiological set point. Additionally, the model could incorporate expected daily fluctuations, such as e.g. circadian changes, to account for the fact that basal states exhibit a range of behaviors around a baseline. Such analyses might be best performed when the model is used in conjunction with experimental studies, such that development of FIRM (or similar models) can be supported by joint simulations and experimentation.
This work exemplified an approach to constructing largescale integrated simulators of complex dynamic structures such as the immune system. Ours is a hybrid approach bringing together conventional differential equationbased models with methods developed in systems biology over the past decade. The implementation of this approach leads to a postulated representation of the immune system that incorporates the underlying cellular processes and cytokine regulation based on elements of mammalian physiology. The simulator provided by FIRM is well suited to go through an integrated and interactive model building process with experimental validation to reach an increasing state of completion, similar to what as has been accomplished for genomescale models of metabolism [3739].
Competing interests
TH, EP, MZ, KJ, PO, MES and PV are or were employees of Pfizer.
Authors’ contributions
SP, TH, EP, MZ, KJ, PO, MES, BOP and PV designed the research; SP, TH, EP, BOP and PV performed the research and SP, TH, EP, MZ, KJ, PO, MES, BOP and PV wrote the manuscript. All authors read and approved the final manuscript.
Acknowledgments
Initial discussions with Kenneth Luu on model development and the support of Scott Fountain are gratefully acknowledged. This work was partially presented at the American Conference of Pharmacometrics (ACoP) held in San Diego, CA, April 3–6, 2011 and was published in the conference proceedings in abstract form.
References

Anderson ARA, Quaranta V: Integrative mathematical oncology.
Nat Rev Cancer 2008, 8(3):227234. PubMed Abstract  Publisher Full Text

Bauer AL, Beauchemin CAA, Perelson AS: Agentbased modeling of hostpathogen systems: The successes and challenges.
Inform Sci 2009, 179(10):13791389. Publisher Full Text

Mestas J, Hughes CCW: Of Mice and Not Men: Differences between Mouse and Human Immunology.
J Immunol 2004, 172(5):27312738. PubMed Abstract  Publisher Full Text

Perelson AS, Weisbuch G: Immunology for physicists.
Rev Mod Phys 1997, 69(4):12191268. Publisher Full Text

De Boer RJ, et al.: Macrophage T lymphocyte interactions in the antitumor immune response: a mathematical model.
J Immunol 1985, 134(4):27482758. PubMed Abstract  Publisher Full Text

De Pillis LG, Radunskaya AE, Wiseman CL: A validated mathematical model of cellmediated immune response to tumor growth.
Cancer Res 2005, 65(17):79507958. PubMed Abstract  Publisher Full Text

Kirschner D, Panetta JC: Modeling immunotherapy of the tumor–immune interaction.
J Math Biol 1998, 37(3):235252. PubMed Abstract  Publisher Full Text

Bell GI: Mathematical model of clonal selection and antibody production.
J Theor Biol 1970, 29(2):191232. PubMed Abstract  Publisher Full Text

Kolev M: Mathematical modeling of the competition between acquired immunity and cancer.

Marino S, Kirschner DE: The human immune response to Mycobacterium tuberculosis in lung and lymph node.
J Theor Biol 2004, 227(4):463486. PubMed Abstract  Publisher Full Text

Burke MA, et al.: Modeling the Proliferative Response of T Cells to IL2 and IL4.
Cell Immunol 1997, 178(1):4252. PubMed Abstract  Publisher Full Text

Cheng Y, et al.: A discrete computer model of the immune system reveals competitive interactions between the humoral and cellular branch and between crossreacting memory and naïve responses.
Vaccine 2009, 27(6):833845. PubMed Abstract  Publisher Full Text

Celada F, Seiden PE: A computer model of cellular interactions in the immune system.
Immunol Today 1992, 13(2):5662. PubMed Abstract  Publisher Full Text

Castiglione F, et al.: A Network of Cellular Automata for the Simulation of the Immune System.
INTERNATIONAL JOURNAL OF MODERN PHYSICS C 1999, 10:677686. Publisher Full Text

Puzone R, et al.: IMMSIM, a flexible model for in machina experiments on immune system responses.
Futur Gener Comput Syst 2002, 18(7):961972. Publisher Full Text

Kohler B, et al.: A systematic approach to vaccine complexity using an automaton model of the cellular and humoral immune system: I.
Viral characteristics and polarized responses. Vaccine 2000, 19(7–8):862876.

Cappuccio A, Castiglione F, Piccoli B: Determination of the optimal therapeutic protocols in cancer immunotherapy.
Math Biosci 2007, 209(1):113. PubMed Abstract  Publisher Full Text

Castiglione F, Piccoli B: Cancer immunotherapy, mathematical modeling and optimal control.
J Theor Biol 2007, 247(4):723732. PubMed Abstract  Publisher Full Text

Kirschner D, Marino S: Mycobacterium tuberculosis as viewed through a computer.
Trends Microbiol 2005, 13(5):206211. PubMed Abstract  Publisher Full Text

Kirschner DE, et al.: Toward a multiscale model of antigen presentation in immunity.
Immunol Rev 2007, 216(1):93. PubMed Abstract  Publisher Full Text

Kim PS, Lee PP, Levy D: Modeling regulation mechanisms in the immune system.
J Theor Biol 2007, 246(1):3369. PubMed Abstract  Publisher Full Text

Agoram BM, Martin SW, van der Graaf PH: The role of mechanismbased pharmacokineticpharmacodynamic (PKPD) modelling in translational research of biologics.
Drug Discov Today 2007, 12(23–24):10181024. PubMed Abstract  Publisher Full Text

Mager DE, Jusko WJ: Development of Translational PharmacokineticPharmacodynamic Models.
Clin Pharmacol Ther 2008, 83(6):909912. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Melder RJ, et al.: Systemic distribution and tumor localization of adoptively transferred lymphocytes in mice: comparison with physiologically based pharmacokinetic model.
Neoplasia 2002, 4(1):38. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Garg A, Balthasar J: Physiologicallybased pharmacokinetic (PBPK) model to predict IgG tissue kinetics in wildtype and FcRnknockout mice.
J Pharmacokinet Pharmacodyn 2007, 34(5):687709. PubMed Abstract  Publisher Full Text

Mager DE, Wyska E, Jusko WJ: Diversity of MechanismBased Pharmacodynamic Models.
Drug Metab Dispos 2003, 31(5):510518. PubMed Abstract  Publisher Full Text

Vicini P: Multiscale Modeling in Drug Discovery and Development: Future Opportunities and Present Challenges.
Clin Pharmacol Ther 2010, 88(1):126129. PubMed Abstract  Publisher Full Text

Quantitative and Systems Pharmacology in the Postgenomic Era: New Approaches to Discovering Drugs and Understanding Therapeutic Mechanisms. 2011. [An NIH White Paper by the QSP Workshop Group]
http://www.nigms.nih.gov/nr/rdonlyres/8ecb1f7cbe3b431f89e6a43411811ab1/0/systemspharmawpsorger2011.pdf webcite

Webb K, White T: UML as a cell and biochemistry modeling language.
Biosystems 2005, 80(3):283302. PubMed Abstract  Publisher Full Text

Ayyadurai V, Dewey C: CytoSolve: A Scalable Computational Method for Dynamic Integration of Multiple Molecular Pathway Models.
Cell Mol Bioeng 2011, 4(1):2845. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Palsson B: Systems biology: properties of reconstructed networks. Cambridge: Cambridge Univ Pr; 2006.

Jamshidi N, Palsson BØ: Mass Action Stoichiometric Simulation Models: Incorporating Kinetics and Regulation into Stoichiometric Models.
Biophys J 2010, 98(2):175185. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Weinberg RA: The biology of cancer. New York: Garland Science; 2007.

Colombo MP, Piconese S: RegulatoryTcell inhibition versus depletion: the right choice in cancer immunotherapy.
Nat Rev Cancer 2007, 7(11):880887. PubMed Abstract  Publisher Full Text

Park J, et al.: Natural immunosurveillance against spontaneous, autochthonous breast cancers revealed and enhanced by blockade of IL13mediated negative regulation.
Cancer Immunol Immunother 2008, 57(6):907912. PubMed Abstract  Publisher Full Text

Edwards JS, Palsson BO: Systems Properties of the Haemophilus influenzaeRd Metabolic Genotype.
J Biol Chem 1999, 274(25):1741017416. PubMed Abstract  Publisher Full Text

Feist AM, Palsson BO: The growing scope of applications of genomescale metabolic reconstructions using Escherichia coli.
Nat Biotech 2008, 26(6):659667. Publisher Full Text

Duarte NC, et al.: Global reconstruction of the human metabolic network based on genomic and bibliomic data.
Proc Natl Acad Sci 2007, 104(6):17771782. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Gianchandani EP, et al.: Functional States of the GenomeScale Escherichia Coli Transcriptional Regulatory System.
PLoS Comput Biol 2009, 5(6):e1000403. PubMed Abstract  Publisher Full Text  PubMed Central Full Text