Abstract
Background
The aim of this study was to provide a framework for the analysis of visceral obesity and its determinants in women, where complex interrelationships are observed among lifestyle, nutritional and metabolic predictors. Thirtyfour predictors related to lifestyle, adiposity, body fat distribution, blood lipids and adipocyte sizes have been considered as potential correlates of visceral obesity in women. To properly address the difficulties in managing such interactions given our limited sample of 150 women, bootstrapped Bayesian networks were constructed based on novel constraintbased learning methods that appeared recently in the statistical learning community. Statistical significance of edge strengths was evaluated and the less reliable edges were pruned to increase the network robustness. To allow accessible interpretation and integrate biological knowledge into the final network, several undirected edges were afterwards directed with physiological expertise according to relevant literature.
Results
Extensive experiments on synthetic data sampled from a known Bayesian network show that the algorithm, called Recursive Hybrid Parents and Children (RHPC), outperforms stateoftheart algorithms that appeared in the recent literature. Regarding biological plausibility, we found that the inference results obtained with the proposed method were in excellent agreement with biological knowledge. For example, these analyses indicated that visceral adipose tissue accumulation is strongly related to blood lipid alterations independent of overall obesity level.
Conclusions
Bayesian Networks are a useful tool for investigating and summarizing evidence when complex relationships exist among predictors, in particular, as in the case of multifactorial conditions like visceral obesity, when there is a concurrent incidence for several variables, interacting in a complex manner. The source code and the data sets used for the empirical tests are available at http://www710.univlyon1.fr/~aaussem/Software.html.
Background
Introduction
Recently, Bayesian networks (BN) have become a very popular tool for biological network reconstruction [13], for genotypetophenotype relationship studies [4] and for clinical and microarray data aggregation [5,6]. BN are directed acyclic graphs (DAG) that model the probabilistic dependencies underlying the data. These graphical models are highly attractive for their ability to describe complex probabilistic interactions between variables. They offer a coherent and intuitive representation of uncertain domains of knowledge. The graphical part of BN reflects the structure of a problem, while local interactions among neighboring variables are quantified by conditional probability distributions. Learning a BN from data requires identifying both the model structure and the corresponding set of model parameter values. Given a fixed structure, however, it is straightforward to estimate the parameter values. The task can be efficiently solved according to the maximum likelihood (ML) or maximum a posteriori (MAP) criterion under the assumption that the learning data contain no missing values [7,8]. As a result, research on the problem of learning BN from data is focused on methods for identifying the structure that best fits the data. Despite significant recent progress in algorithm development, the computational inference of network structure is currently still very much an open challenge in computational statistics [7,9]. To appreciate the complexity of learning a DAG, we note that the number of DAGs is superexponential in the number of nodes [7].
Broadly speaking, there are two main approaches to BN structure learning. Both approaches have advantages and disadvantages. Scoreandsearch methods search over the space of structures (or the space of equivalence BN classes) employing a scoring function to guide the search. Another approach for learning BN structures, known as the constraintbased (CB) approach, follows more closely the definition of BN as encoders of conditional independence relationships. According to this approach, some judgments are made about the (conditional) dependencies that follow from the data and use them as constraints to construct a partially oriented DAG (PDAG for short) representative of a BN equivalence class. There are many excellent treatments of BN which surveys the learning methods [7,9]. When data sets are small, the relative benefits of the two approaches are still unclear. While none has been proven to be superior, considerable advances have been made in the past years in the design of highly scalable divideandconquer CB methods [1014] in order to improve the network reconstruction accuracy when the number of samples is small.
In this study, we apply one of these CB algorithms, named Recursive Hybrid Parents and Children (RHPC), for representing the statistical dependencies between 34 clinical variables among 150 women with various degrees of obesity. Obesity is recognized as a disease in the U.S. and internationally by governments, health organizations, researchers and medical professionals. It is a complex multifactorial condition that needs to be studied by the means of multidisciplinary approaches involving biological expertise and new statistical and data mining tools. Features affecting obesity are of high current interest. Clinical data, such as patient history, lifestyle parameters and basic or even more elaborate laboratory analytes (e.g., adiposity, body fat distribution, blood lipid profile and adipocyte sizes) form a complex set of interrelated variables that may help better understand the pathophysiology of visceral obesity and provide guidance for its clinical management. Gregori et al. [15] performed a metaanalytic framework for the analysis of obesity and its determinants in children using Bayesian networks. Only seven lifestyle risk factors were considered as being potentially related to obesity in this population. To the best of our knowledge, our study is the first attempt to use BNs in the context of modeling the complex relationships between lifestyle and metabolic correlates of visceral obesity among women.
We use the bootstrapping method to generate more robust network structures as discussed in [6,16]. Statistical significance of edge strengths are evaluated using this approach. If an edge has a confidence above the threshold, it is included in the consensus network. Thus, if dependencies have enough support in the bootstrapping process they are captured and represented in the final consensus network. The confidence estimate assigned to each network edge is represented graphically on the final network. Such network represents a powerful computational tool for identifying putative causal interactions among variables from observational data. The consensus network graphically represents the possibly causal independence relationships that may exist in a very parsimonious manner [17]. In this study, special emphasis was placed on integrating physiological knowledge into the graph structure. Once the consensus PDAG was constructed from data, the remaining undirected edges were then directed according to our causal interpretation and additional latent variables were added to the graph for the sake of clarity, coherence and conciseness. The graphical representation provides a statistical profile of this sample of obese women, and meanwhile helps identifying the most important predictors of visceral obesity. Using the concept of a Markov Blanket we can identify all the variables that shield off the class variable from the influence of the remaining network. Therefore, BNs automatically perform feature selection by identifying the (in)dependency relationships with the class variable. We compare our findings with the results obtained using the same data and more traditional regression models.
Bayesian networks
Formally, a BN is a tuple < , P > where = < U, E > is a directed acyclic graph (DAG) with nodes representing the variables in the domain U, and edges representing direct probabilistic dependencies between them. P denotes the joint probability distribution on U. The BN structure encodes a set of conditional independence assumptions: that each node X_{i }is conditionally independent of all of its nondescendants in given its parents . These independence assumptions, in turn, imply many other conditional independence statements, which can be extracted from the network using a simple graphical criterion called dseparation [8].
We denote by X ⊥_{P }YZ the conditional independence between X and Y given the set of variables Z where P is the underlying probability distribution. Note that an exhaustive search of Z such that X ⊥_{P }YZ is a combinatorial problem and can be intractable for high dimension data sets. We use to denote the assertion that X is dseparated from Y given Z in . We denote by dSep(X, Y), a set that dseparates X from Y. If < , P > is a BN, X ⊥_{P }YZ if . The converse does not necessarily hold. We say that < , P > satisfies the faithfulness condition if the dseparations in identify all and only the conditional independencies in P, i.e., X ⊥_{P }YZ if and only if (iff) . Two graphs are said equivalent iff they encode the same set of conditional independencies via the dseparation criterion. The equivalence class of a DAG is a set of DAGs that are equivalent to . [8] established that two DAGs are equivalent iff they have the same underlying undirected graph and the same set of vstructures (i.e., uncoupled headtohead meetings X → Y ← Z). So we define an essential graph (also called a DAG pattern) for a Markov equivalence class to be the partially directed acyclic graph (PDAG), that has the same links as the DAGs in the equivalence class and has oriented all and only the edges common to all of the DAGs in the equivalence class. The directed links in the essential graph are called the compelled edges [7].
An important concept of BN is the Markov blanket of a variable, which is the set of variables that completely shields off this variable from the others. In other words, a Markov blanket M_{T }of T is any set of variables such that T is conditionally independent of all the remaining variables given M_{T }. A Markov boundary, MB_{T }, of T is any Markov blanket such that none of its proper subsets is a Markov blanket of T. Suppose < , P > satisfies the faithfulness condition. Then, for all X, the set of parents, children of X, and parents of children of X is the unique Markov boundary of X. A proof can be found for instance in [7]. We denote by , the set of parents and children of T in , and by , the set of spouses of T in , i.e., the variables that have common children with T. These sets are unique for all , such that < , P > satisfies the faithfulness condition and so we will drop the superscript .
Bayesian network structure learning
Automatically learning the graph structure of a BN is a challenging topic of pattern recognition that has attracted much attention over the last few years. CB methods systematically check the data for conditional independence relationships and try to construct a partially directed graphical structure (also called a perfect map) that encodes perfectly the set of independencies. Typically, these algorithms run a χ^{2 }independence test when the dataset is discrete and a Fisher's z test when it is continuous in order to decide on dependence or independence, that is, upon the rejection or acceptance of the null hypothesis of conditional independence. Therefore, conditional independencies that are read off from the BN structure are in total agreement with the conditional independencies that are obtained by the statistical tests. Very powerful, correct, scalable and dataefficient CB algorithms have been recently proposed [1012]. They are correct (or sound) in the sense that they return the correct essential graph under the assumptions that the independence tests are reliable and that the learning database is a sample from a distribution P faithful to a DAG . The (ideal) assumption that the independence tests are reliable means that they decide (in)dependence iff the (in)dependence holds in P. In this paper we adopt one of these CB approaches [11,18]. The essential graph is obtained by running an algorithm called Recursive HPC (RHPC), where HPC stands for Hybrid Parents and Children.
Results
Simulation experiments on artificial data
As RHPC relies on HPC to build the whole network structure, we conducted several experiments on synthetic data to assess the comparative performance of HPC, and two algorithm proposals that appeared recently in the literature, namely MMPC [12] and GetPC [10]. The source code (C++) of HPC as well as all data sets used for the empirical tests are available at http://www710.univlyon1.fr/~aaussem/Software.html. The authors' implementation of MMPC and GetPC can be found respectively at http://discover.mc.vanderbilt.edu/discover/public webcite and http://www.ida.liu.se/~jospe webcite. MMPC was deemed one of the best CB algorithms in [12] and GetPC was used recently in [2] for modeling gene networks. We also report the performance of our weak learner InterIAPC for comparison. For GetPC and MMPC, we used the softwares proposed by the respective authors (see footnote). The confidence threshold of the independence test was fixed to α = 0.05 for all algorithms. All the data sets used for the empirical experiments presented in this section were sampled from a biorealistic network that has been previously used as benchmark for BN learning algorithms, namely Insulin (35 nodes and 52 edges). The Insulin network [19] was chosen purposely as it consists of the same number of nodes as our dataset. Four sample sizes have been considered: 200, 500, 1000 and 2000. For each sample size, 100 data sets were sampled. We do not claim that this benchmark resembles our realworld problem, however, it makes it possible to compare the outputs of the algorithms.
All four algorithms were run on the target node having the largest degree (13 neighbors) in the Insulin BN to increase the difficulty of the task. The variables in the output of the algorithms were compared against the true neighbors. To evaluate the accuracy, we combined precision (i.e., the number of true positives in the output divided by the number of nodes in the output) and recall (i.e., the number of true positives divided by 13, the size of the true PC set) as , to measure the Euclidean distance from perfect precision and recall, as proposed in [10]. Figure 1 summarizes the variability of the Euclidean distance over 50 data sets in the form of quadruplets of boxplots, one for each algorithm (i.e., MMPC, GetPC, InterIAPC and HPC). The advantage of HPC against the other three algorithms is clearly noticeable. HPC outperforms the other algorithms in terms of Euclidean distance from perfect precision and recall.
Figure 1. Validation of the learning method on the Insulin benchmark. Empirical experiments on synthetic data sets from the Insulin BN. Each algorithm is run on the node having the largest neighborhood (13 nodes). Four sample sizes were considered: 200, 500, 1000 and 2000. The figure shows the distribution over 100 data sets of the Euclidean distance from perfect precision and recall, in the form of boxplots.
Simulation experiments on the sample of women
The consensus PDAG obtained by running RHPC on the present sample of women is shown in Figure 2. Line thickness corresponds to the relative confidence of the edges. The edges that appeared more than 25% in the networks were included in the aggregate PDAG. The threshold was tuned on the previous Insulin benchmark samples to maximize accuracy. As may be seen, the directionality of the arrows was partially identifiable: 14 edges out of 34 were directed, indicating the presence of several robust uncoupled headtohead meetings (T → Y ← X).
Figure 2. Consensus PDAG of visceral obesity related variables in women returned by RHPC. Consensus PDAG obtained by running RHPC on bootstrapped samples. Labels are selfexplanatory. Line thickness corresponds to the relative edge strength.
Physiological knowledge integration into the model
Several interconnected groups of variables were identified, e.g., beer consumption, wine consumption and spirit consumption; cigarettes per day and low exercise; OM and SC fat cell sizes. In each of these densely connected subgraphs, the variables were highly interdependent and a common cause is likely to explain the observed correlations. Hence, we added some extra nodes and directed some of the links according to physiological knowledge available in the literature. The result is the partially directed acyclic graph (PDAG) that is shown in Figure 3. Dashed nodes and arrows are the latent variables that were added for sake of clarity and coherence. By definition, these latent variables are not observed, nor recorded in our data set. For example, the variable high alcohol intake was added as a common "cause" to beer consumption, wine consumption and spirit consumption; the variable unhealthy lifestyle was added as a common cause to cigarettes per day, high alcohol intake and low exercise; the latent variables fat storage and prevailing hormonal conditions were added as two distinct common causes to SC fat cell size and OM fat cell size.
Figure 3. BN of visceral obesity related variables in women after physiological knowledge integration into the graph. PDAG of Figure 2 oriented according to biological knowledge. Dash nodes and arrows are latent variables that were added based on current literature.
Almost all the undirected edges were oriented based on current literature as follows. Edges directed from the age variable were oriented based on the welldocumented impact of ageing on visceral adipose tissue accumulation, blood pressure and plasma LDLcholesterol levels [20,21]. The edge between age and tea consumption is based on the 2004 Canadian Community Health Survey, which showed a steady increase in tea consumption from 19 to more than 71 years of age [22]. The edge between tea consumption and blood pressure was oriented based on literature showing lower cardiovascular disease risk in tea consumers [23] and a direct effect of black tea consumption on peripheral blood flow and arterial stiffness [24]. The edge between age and the number of live children was attributed to the slight decrease in Canadian birth rates observed between 196166 and 198186 [25], which corresponds approximately to the period in which women of the study had their children. Accordingly, older women of the sample were more likely to have delivered slightly more children. Orientation of the edge between the number of pregnancies and the number of live children is selfexplanatory.
The edge between the number of live children and OM fat cell size was derived from literature supporting that postpregnancy weight retention is an important risk factor for obesity [26]. The finding of a specific association between the number of children and OM fat cell size was novel and warrants further investigation. The edges between OM and SC fat cell sizes and the variables obesity or visceral fat is self explanatory since the excess adipose tissue mass of obese or abdominal obese individuals is constituted of larger fat cells. Associations between fat cell size and obesity have been previously observed [27]. The edges between visceral fat or large OM fat cells and metabolic variables such as LDLcholesterol, triglycerides and blood pressure was oriented based on the 'portal vein hypothesis', which states that visceral fat is a causal agent for metabolic disturbances [28]. However, this hypothesis has not yet been fully proven as operative and has been challenged by a number of investigators. Further studies are required to firmly establish causality. However, the fact that the association between visceral fat and metabolic disturbances is independent from overall obesity is wellaccepted [29,30]. The edges between the various components of body composition (i.e., bone density, lean body mass and obesity) were logical but it was difficult to provide causal direction between these variables. Indeed, many genetic, epigenetic, developmental and environmental factors can contribute to determine body built of a given individual. Moreover, the sizes of all compartments generally evolve in a more or less coordinated manner throughout the individual's existence [31,32]. It was expected that the variable 5yr maximal weight would be a strong correlate of the level of obesity and lean body mass since these variables are the main components of body composition [32] and that most patients reported a stable weight in the five years preceding their inclusion in the study.
The edges around the number of hours of work and the number of meals out per week were oriented based on the demonstration that increased working time was associated with food choice coping strategies [33], which we suggest is reflected by the edges to number of meals out per week, beer, wine and coffee consumption. On the other hand, the number of meals out per week was related to obesity. Accordingly, the frequency of restaurant food consumption was previously found to be positively related to body fatness [34]. Wine consumption was related directly with plasma levels of HDLcholesterol. This edge was oriented based on epidemiological data showing a protective effect of moderate wine consumption on HDLcholesterol levels [35]. Low leisure time physical activity was linked together with smoking habits under a latent causal variable that we termed unhealthy lifestyle. These variables were also linked with coffee and beer consumption, but had no direct link with the level of obesity. We were unable to provide orientation for these edges. Moreover, we were not able to readily explain a small number of edges. For example, the link between age at menarche, which reflects timing of puberty, and dietary supplement use is not intuitive. Further analyses and other samples will be required to clarify this apparent association.
Statistical validation
We noticed from the PDAG that OM fat cell size, visceral fat, blood pressure, tea consuption and age belonged to the triglycerides Markov boundary, though the edge between OM fat cell size and triglycerides was only moderate in strength. The influence of OM fat cell size on triglycerides was mostly mediated by visceral fat. We observed that age and triglycerides were marginally independent according to the dseparation rule. However, they became dependent conditioned on visceral fat. The PDAG was consistent with multivariate linear regression analyzes performed a posteriori on the sample (Table 1). In model 1, plasma triglyceride levels were predicted using computed tomographymeasured visceral adipose tissue area (visceral fat variable) and total body fat mass (which is included in the variable obesity). Visceral fat explained 31.9% of the variance in triglyceride levels whereas overall obesity was not a significant predictor of triglyceride levels. A similar analysis in which plasma triglyceride levels were predicted by OM and SC fat cell size was also performed (Table 1, model 2). OM fat cell size explained 21.2% of the variance in triglyceride levels, whereas SC fat cell size was not a significant predictor of triglyceride levels in the model.
Table 1. Prediction of plasma triglyceride levels
Discussion
The purpose of this paper was to introduce the BN methodology in the context of clinical studies, specifically obesity, and to show its effectiveness, as a component of general data mining/knowledge discovery approaches in epidemiology research. We have evaluated a consensus BN learning approach based on bootstrapping techniques on synthetic data with satisfactory results. Although our approach did not use any prior information, it was successful in uncovering biologically relevant dependencies and conditional independencies. Once the most interesting dependencies are ascertained, traditional statistical methods (e.g. linear or logistic regression, etc.) can be used to rigorously scrutinize the resulting smaller subnetworks.
In this study, special emphasis was put on integrating physiological expertise and statistical data analysis together. It is well beyond the scope and purpose of this paper to delve deeper into the problem of inferring causalities from observational data. However, the usefulness of BN stems partly from their causal interpretation. As we have seen, the graphical representation is useful as it allows tighter collaboration between the modeler and the biologist. The integration of medical knowledge into datadriven models is not only desirable, but it is also far easier and less subjective than constructing the whole BN with a priori knowledge. In this spirit, most edges were directed according to plausible causal inference although interpretation of edges as carriers of information does not necessarily imply causation.
Conclusions
Thirtyfour predictors related to lifestyle, adiposity, body fat distribution, blood lipids and adipocyte sizes have been considered as potential correlates of visceral obesity in women. The analysis was performed with a novel scalable and effective constraintbased bayesian network structure learning algorithm called RHPC.
From a biological point of view, the present study confirms, among other interesting findings, that visceral fat is the predominant predictor of triglyceride levels in obese individuals. It is reassuring that an unsupervised BN analysis uncovered previously established relationships between visceral fat, blood pressure, aging and triglyceride levels. The advantage of BN method is not that it will identify the "true causes", but rather that it will perform initial data exploration to unearth new knowledge in a semiautomated and rapid fashion.
In conclusion, we suggest that BNs are valuable data mining tools for the analysis of clinical data. In addition, BNs can explicitly combine both expert knowledge from the field and information studied from the data. A need for such multistep processes (hypothesis generation step followed by a traditional hypothesis testing step) is essential. Finally, an extension to our existing framework would be to consider Bayesian model averaging as an alternative to a single consensus model selection. This extension is currently underway.
Methods
The Recursive Hybrid Parents and Children algorithm
RHPC is based on the faithfulness assumption. As RHPC calls HPC on each node, we start discussing HPC first. HPC receives a node X and returns its adjacent nodes PC_{X}. Under this faithfulness assumption, X and Y are not adjacent in if and only if ∃ Z ∈ U\{X, Y} such that X ⊥ YZ [7]. As an exhaustive search of Z is intractable for high dimension data sets. HPC perfoms a heuristic search with a severe restriction on the maximum conditioning size in order to significantly increase the reliability of the statistical independence tests. Note that other similar 'Parent and Children' learning procedures were proposed recently in the machine learning literature, namely MMPC [12] and GetPC [10]. They could be used as well. Nonetheless HPC was favored in a recent evaluation using the same conditional independence test, over a range of different networks, sample sizes and number of variables [11].
Formally, HPC can be viewed as an ensemble method for combining many weak PC learners in an attempt to produce a stronger PC learner. The algorithm was designed in order to endow the search procedure with the ability to: 1) handle efficiently data sets with thousands of variables but comparably few instances; 2) deal with datasets which present some deterministic relationships among the variables; 3) be correct under the faithfulness condition; and 4) be able to learn large neighborhoods. HPC is based on three subroutines: DataEfficient Parents and Children Superset (DEPCS), DataEfficient Spouses Superset (DESPS), and Interleaved Incremental Association Parents and Children (InterIAPC), a weak PC learner based on InterIAMB [36] that requires little computation. HPC was shown to be correct in the sample limit under the faithfulness assumption [11,18]. For the sake of conciseness, we only discuss the main HPC routine. The algorithm details are omitted here for brevity: RHPC and its subroutines are thoroughly described in additional file 1 for the sake of conciseness.
Additional file 1. Description of the Recursive Hybrid Parents and Children algorithm. This file contains a detailed discussion of our algorithm called Recursive Hybrid Parents and Children (RHPC). RHPC takes a data set as input and returns a partially oriented DAG (PDAG for short) representative of a bayesian network equivalence class. The latter is obtained by directing the compelled edges of the skeleton. The skeleton is obtained by running an algorithm called Hybrid Parents and Children (HPC) algorithm recursively on every node. RHPC is shown to be sound in the sample limit.
Format: PDF Size: 171KB Download file
This file can be viewed with: Adobe Acrobat Reader
HPC may be thought of as a way to compensate for the large number of false negative nodes, at the output of the weak PC learner with few data cases, by performing extra computations. HPC receives a target node T, a data set and a set of variables U as input and returns an estimation of PC_{T}. It is hybrid in that it combines the benefits of incremental and divideandconquer methods. The procedure starts by extracting a superset PCS_{T }of PC_{T }(line 1) and a superset SPS_{T }of SP_{T }(line 2) with a severe restriction on the maximum conditioning size (Z < = 2) in order to significantly increase the reliability of the tests. A first candidate PC set is then obtained by running the weak PC learner on PCS_{T }∪ SPS_{T }(line 3). The key idea is the decentralized search at lines 48 that includes, in the candidate PC set, all variables in the superset PCS_{T }∪ SPS_{T }that have T in their vicinity. Note that, in theory, X is in the output of InterIAPC(Y) if and only if Y is in the output of InterIAPC(X). However, in practice, this may not always be true, due to the statistical test errors that should appear, especially with few data samples. The decentralized search enables the algorithm to handle large neighborhoods while still being correct under faithfulness condition.
The essential graph is obtained by running HPC on the every node and by directing the compelled edges as shown in RHPC. Note that HPC must have found dSep(X, Y ) (at line 5 of RHPC) and have cached it for later retrieval. Alternatively, HPC can be run recursively on the adjacent nodes of a target variable in order to establish a local graph without having to construct the whole BN first as discussed in [2]. RHPC applies standard techniques at lines 419 to identify the compelled edges. The reader is directed to [7], pp. 538, for further details. The correctness and completeness of the edge orientation in RHPC are demonstrated in [37].
Network aggregation
As discussed in the introduction, our practical goal is to extract a BN structure that encodes the conditional independencies between 34 variables given our sample of 150 women. The most common approach to discovering the structure is to use learning with model selection to provide us with a single model. However, model selection is known to be sensitive to the particular data set, especially with few instances. Had we sampled another data set of the same size from the same distribution, model selection would have learned a different model [16]. So we cannot simply accept our chosen structure as a true representation of the underlying distribution. Averaging over the sampled structures that are generated by a sampling process produces models that are more robust, have greater confidence and place less reliance on a single dataset. Several approaches exist: generating samples of the BN structure from its marginal posterior distribution using Monte Carlo Markov chain (MCMC) [16,3840], using bootstrapping methods for computing a statistical confidence features within a BN [6,16]. In this study, we make use of the bootstrapping method to generate a more robust network structure. The 'reshuffled' dataset is generated from the original dataset (resampling with replacement), the graph is built from this reshuffled set and then the procedure is repeated a sufficient number of times. Confidence in a particular edge is measured as a percentage of the number of times this edge actually appears in the set of reconstructed graphs. If an edge has a confidence above the threshold, it is included in the consensus network. Thus, if dependencies have enough support in the bootstrapping process, they are captured and represented in the final consensus network. When computing confidence estimates, we define a feature as the existence of an edge between two nodes in the PDAG. Thus, the bootstrapped network has a confidence estimate assigned to each network edge. Where directed edges are present in a PDAG, they contribute only to the confidence estimate for the edge in that direction, whereas undirected edges contribute to the confidence estimate for an edge in both directions. If an edge has a confidence above the threshold, it is included in the consensus PDAG, and if edges are found in both directions (e.g. from node X_{i }→ X_{j }and X_{j }← X_{i}), then the edge is undirected. Thus, if directional dependencies have enough support in the bootstrapping process, they will be captured and represented in the final PDAG.
Biological data
The sample of 150 obese women used for these analyzes consists of 34 variables related to lifestyle such as alcohol consumption, smoking habits, leisure time activity and eating patterns. Dual energy xray absorptiometry was used to obtain wholebody measures of body composition (bone density, lean body mass, total body fat mass). Computed tomography was used to assess body fat distribution at the abdominal level. These measures include adipose tissue areas of the abdominal fat compartments located subcutaneously and inside the abdominal cavity (visceral fat). Finally, the variables examined also include average adipocyte sizes measured both in the omental (OM) and subcutaneous (SC) adipose tissue compartments from adipose tissue samples obtained during surgery. Women included in these analyses have been the object of previous publications on other topics [41,42]. All women who participated in the protocols signed an informed consent document. The projects were approved by the ethics committee of Laval University Medical Center.
Authors' contributions
SRM and AA designed and implemented the learning algorithms, SRM and AT performed the tests, AT and SR analyzed the results. AA chose the mathematical framework and supervised the work. AA and AT wrote the manuscript. SR and SRM critically reviewed the manuscript. All authors read and approved the final manuscript.
Acknowledgements
The authors thank the anonymous reviewers for helpful comments and references. The experiments reported here were performed on computers funded by a French Institute for Complex Systems (IXXI) grant. André Tchernof is the recipient of a Fonds de la recherche en santé du Québec Senior investigator scholarship.
References

Grzegorczyk M, Husmeier D, Edwards K, Ghazal P, Millar A: Modelling nonstationary gene regulatory processes with a nonhomogeneous Bayesian network and the allocation sampler.
Bioinformatics 2008, 24(18):20712078. PubMed Abstract  Publisher Full Text

Peña JM, Björkegren J, Tegnér J: Growing Bayesian Network Models of Gene Networks from Seed Genes.

Auliac C, Frouin V, Gidrol X, d'Alché Buc F: Evolutionary approaches for the reverseengineering of gene regulatory networks: A study on a biologically realistic dataset.
BMC Bioinformatics 2008, 9:91. PubMed Abstract  BioMed Central Full Text  PubMed Central Full Text

Rodin A, Boerwinkle E: Mining genetic epidemiology data with Bayesian networks I: Bayesian networks and example application (plasma apoE levels).
Bioinformatics 2005, 21(15):32733278. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Gevaert O, Smet FD, Timmerman D, Moreau Y, Moor BD: Predicting the prognosis of breast cancer by integrating clinical and microarray data with Bayesian networks.
Bioinformatics 2006, 22(14):E184E190. PubMed Abstract  Publisher Full Text

Steele E, Tucker A: Consensus and Metaanalysis regulatory networks for combining multiple microarray gene expression datasets.
Journal of Biomedical Informatics 2008, 41(6):914926. PubMed Abstract  Publisher Full Text

Neapolitan RE: Learning Bayesian Networks. Upper Saddle River, NJ: Pearson Prentice Hall; 2004.

Pearl J: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA, USA: Morgan Kaufmann; 1988.

Darwiche A: Modeling and Reasoning with Bayesian Networks. New York: Cambridge University Press; 2009.

Peña J, Nilsson R, Björkegren J, Tegnér J: Towards Scalable and Data Efficient Learning of Markov Boundaries.
International Journal of Approximate Reasoning 2007, 45(2):211232. Publisher Full Text

Rodrigues de Morais S, Aussem A: A Novel Markov Boundary Based Feature Subset Selection Algorithm.
Neurocomputing 2010, 73:578584. Publisher Full Text

Tsamardinos I, Brown L, Aliferis C: The MaxMin HillClimbing Bayesian Network Structure Learning Algorithm.
Machine Learning 2006, 65:3178. Publisher Full Text

Peña J: Learning gaussian graphical models of gene networks with false discovery rate control.
Proceedings of 6th European Conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics 2008, 165176. Publisher Full Text

Aussem A, Rodrigues de Morais S: A Conservative Feature Subset Selection Algorithm with Missing Data.
Neurocomputing 2010, 73:585590. Publisher Full Text

Gregori D, Berchialla P, Zobec F, Ghidina M: Understanding InterRelationships of Known Risk Factors, Snacking and Obesity in Children: A MetaAnalytic Approach Using Bayesian Networks.

Friedman N, Koller D: Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks.
Machine Learning 2003, 50(12):95125. Publisher Full Text

Pearl J: Causality: Models, Reasoning, and Inference. Cambridge, England: Cambridge University Press; 2000.

Rodrigues de Morais S, Aussem A: A Novel Scalable and Data Efficient Feature Subset Selection Algorithm. In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECMLPKDD'08, of Lecture Notes in Computer Science. Volume 5212. Antwerp, Belgium: SpringerVerlag Berlin Heidelberg; 2008::298312.

Andreassen S, Hovorka R, Benn J, Olesen KG, Carson ER: A modelbased approach to insulin adjustment. In Proc of the Third Conf on AI in Medicine. SpringerVerlag; 1991:239248.

Lemieux S, Prud'homme D, Moorjani S, Tremblay A, Bouchard C, Lupien P, Després J: Do elevated levels of abdominal visceral adipose tissue contribute to agerelated differences in plasma lipoprotein concentrations in men?
Atherosclerosis 2095, 118:155164. Publisher Full Text

Expert Panel on Detection Evaluation and Treatment of High Blood Cholesterol in Adults. Executive summary of the third report of the National Cholesterol Education Program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III)

Garriguet D: Beverage consumption of Canadian adults.
Health Rep 2008, 19:239. PubMed Abstract

Gardner E, Ruxton C, Leeds A: Black tea  helpful or harmful?
A review of the evidence European Journal of Clinical Nutrition 2007, 61:318. Publisher Full Text

Grassia D, Mulder T, Draijer R, Desideri G, Molhuizen H, Ferri C: Black tea consumption dosedependently improves flowmediated dilation in healthy males.
J Hypertens 2009, 27:774781. PubMed Abstract  Publisher Full Text

Statistics Canada. Population and growth components (18512001 Censuses)

Rössner S, Ohlin A: Pregnancy as a risk factor for obesity: lessons from the Stockholm Pregnancy and Weight Development Study.

Spalding K, Arner E, Westermark P, Beranrd S, Buchholz B, Bergmann O, Blomqvist L, Hoffstedt J, Näslund E, Britton T, Concha H, Hassan M, Rydén M, Frisén JPA: Dynamics of fat cell turnover in humans.
Nature 2008, 453:783787. PubMed Abstract  Publisher Full Text

Bergman B, Kim S, Catalano K, Hsu I, Chiu J, Hucking K, Ader M: Why visceral fat is bad: mechanisms of the metabolic syndrome.
Obesity 2006, 14:1619. Publisher Full Text

Després J, Moorjani S, Lupien P, Tremblay A, Nadeau A, Bouchard C: Regional distribution of body fat, plasma lipoproteins, and cardiovascular disease.
Arteriosclerosis 1990, 10:497511. PubMed Abstract

Wajchenberg B: Subcutaneous and visceral adipose tissue: their relation to the metabolic syndrome.
Endocr Rev 2000, 21(6):697738. PubMed Abstract  Publisher Full Text

Veldhuis J, Roemmich J, Richmond E, Rogol A, JC Lovejoy MSM, Mauras N, Bowers C: Endocrine control of body composition in infancy, childhood, and puberty.
Endocr Rev 2005, 26:114146. PubMed Abstract  Publisher Full Text

Wells J: Sexual dimorphism of body composition.
Best Pract Res Clin Endocrinol Metab 2007, 21(3):415430. PubMed Abstract  Publisher Full Text

Devine C, Farrell T, Blake C, Jastran M, Wethington E, Bisogni C: Work conditions and the food choice coping strategies of employed parents.
J Nutr Educ Behav 2009, 41(5):36570. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

McCrory M, Fuss P, Hays N, Vinken A, Greenberg A, Roberts S: Overeating in america: association between restaurant food consumption and body fatness in healthy adult men and women ages 19 to 80.
Obes Res 1999, 7(6):564571. PubMed Abstract

Li J, Mukamal K: An update on alcohol and atherosclerosis.
Curr Opin Lipidol 2004, 15(6):673680. PubMed Abstract  Publisher Full Text

Tsamardinos I, Aliferis C, Statnikov A: Algorithms for Large Scale Markov Blanket Discovery.
Florida Artificial Intelligence Research Society Conference FLAIRS'03 2003, 376381.

Meek C: Causal inference and causal explanation with background knowledge. In Proceedings of Eleventh Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann; 1995:403418.

Heckerman D, Geiger D, Chickering D: Learning Bayesian networks: The combination of knowledge and statistical data.

Madigan D, York J: Bayesian Graphical Models for Discrete Data.
International Statistical Review 1995, 63(2):215232. Publisher Full Text

Ellis B, Wong WH: Learning Causal Bayesian Network Structures From Experimental Data.
Journal of the American Statistical Association 2008, 103:778789. Publisher Full Text

Tchernof A, Bélanger C, Morisset A, Richard C, Mailloux J, Laberge P, Dupont P: Regional differences in adipose tissue metabolism in women: Minor effect of obesity and body fat distribution.
Diabetes 2006, 55(5):13531360. PubMed Abstract  Publisher Full Text

Tchernof A, Desmeules A, Richard C, Laberge P, Daris M, Mailloux J, Rhéaume C, Dupont P: Ovarian hormone status and abdominal visceral adipose tissue metabolism.
J Clin Endocrinol Metab 2004, 89(7):34253430. PubMed Abstract  Publisher Full Text