Open Access Highly Accessed Open Badges Research article

Impact of a computerized system for evidence-based diabetes care on completeness of records: a before–after study

Pavel S Roshanov1, Hertzel C Gerstein23, Dereck L Hunt23, Rolf J Sebaldt2 and R Brian Haynes234*

Author Affiliations

1 Schulich School of Medicine and Dentistry, The University of Western Ontario, 1151 Richmond Street, London, ON, Canada

2 Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, ON, Canada

3 Hamilton Health Sciences, 1200 Main Street West, Hamilton, ON, Canada

4 Health Information Research Unit, Department of Clinical Epidemiology and Biostatistics, McMaster University, 125 Communications Research Laboratory, 1280 Main Street West, Hamilton, ON, L8S4K1, Canada

For all author emails, please log on.

BMC Medical Informatics and Decision Making 2012, 12:63  doi:10.1186/1472-6947-12-63

Published: 7 July 2012



Physicians practicing in ambulatory care are adopting electronic health record (EHR) systems. Governments promote this adoption with financial incentives, some hinged on improvements in care. These systems can improve care but most demonstrations of successful systems come from a few highly computerized academic environments. Those findings may not be generalizable to typical ambulatory settings, where evidence of success is largely anecdotal, with little or no use of rigorous methods. The purpose of our pilot study was to evaluate the impact of a diabetes specific chronic disease management system (CDMS) on recording of information pertinent to guideline-concordant diabetes care and to plan for larger, more conclusive studies.


Using a before–after study design we analyzed the medical record of approximately 10 patients from each of 3 diabetes specialists (total = 31) who were seen both before and after the implementation of a CDMS. We used a checklist of key clinical data to compare the completeness of information recorded in the CDMS record to both the clinical note sent to the primary care physician based on that same encounter and the clinical note sent to the primary care physician based on the visit that occurred prior to the implementation of the CDMS, accounting for provider effects with Generalized Estimating Equations.


The CDMS record outperformed by a substantial margin dictated notes created for the same encounter. Only 10.1% (95% CI, 7.7% to 12.3%) of the clinically important data were missing from the CDMS chart compared to 25.8% (95% CI, 20.5% to 31.1%) from the clinical note prepared at the time (p < 0.001) and 26.3% (95% CI, 19.5% to 33.0%) from the clinical note prepared before the CDMS was implemented (p < 0.001). There was no significant difference between dictated notes created for the CDMS-assisted encounter and those created for usual care encounters (absolute mean difference, 0.8%; 95% CI, −8.5% to 6.8%).


The CDMS chart captured information important for the management of diabetes more often than dictated notes created with or without its use but we were unable to detect a difference in completeness between notes dictated in CDMS-associated and usual-care encounters. Our sample of patients and providers was small, and completeness of records may not reflect quality of care.