Open Access Highly Accessed Open Badges Research article

Combining directed acyclic graphs and the change-in-estimate procedure as a novel approach to adjustment-variable selection in epidemiology

David Evans1234*, Basile Chaix13, Thierry Lobbedez45, Christian Verger4 and Antoine Flahault12

Author Affiliations

1 Inserm UMR-S 707, Paris, France

2 EHESP School of Public Health, Rennes-Sorbonne Paris Cité, Paris, France

3 UPMC-Sorbonne Université, Paris, France

4 Registre de Dialyse Péritonéale de Langue Française, Pontoise, France

5 Nephrology Department, CHU Clemenceau, Caën, France

For all author emails, please log on.

BMC Medical Research Methodology 2012, 12:156  doi:10.1186/1471-2288-12-156

Published: 11 October 2012



Directed acyclic graphs (DAGs) are an effective means of presenting expert-knowledge assumptions when selecting adjustment variables in epidemiology, whereas the change-in-estimate procedure is a common statistics-based approach. As DAGs imply specific empirical relationships which can be explored by the change-in-estimate procedure, it should be possible to combine the two approaches. This paper proposes such an approach which aims to produce well-adjusted estimates for a given research question, based on plausible DAGs consistent with the data at hand, combining prior knowledge and standard regression methods.


Based on the relationships laid out in a DAG, researchers can predict how a collapsible estimator (e.g. risk ratio or risk difference) for an effect of interest should change when adjusted on different variable sets. Implied and observed patterns can then be compared to detect inconsistencies and so guide adjustment-variable selection.


The proposed approach involves i. drawing up a set of plausible background-knowledge DAGs; ii. starting with one of these DAGs as a working DAG, identifying a minimal variable set, S, sufficient to control for bias on the effect of interest; iii. estimating a collapsible estimator adjusted on S, then adjusted on S plus each variable not in S in turn (“add-one pattern”) and then adjusted on the variables in S minus each of these variables in turn (“minus-one pattern”); iv. checking the observed add-one and minus-one patterns against the pattern implied by the working DAG and the other prior DAGs; v. reviewing the DAGs, if needed; and vi. presenting the initial and all final DAGs with estimates.


This approach to adjustment-variable selection combines background-knowledge and statistics-based approaches using methods already common in epidemiology and communicates assumptions and uncertainties in a standardized graphical format. It is probably best suited to areas where there is considerable background knowledge about plausible variable relationships. Researchers may use this approach as an additional tool for selecting adjustment variables when analyzing epidemiological data.

Directed acyclic graph; Adjustment-variable selection; Change-in-estimate; Peritoneal dialysis