Email updates

Keep up to date with the latest news and content from BMC Medical Informatics and Decision Making and BioMed Central.

Open Access Technical advance

in silico Surveillance: evaluating outbreak detection with simulation models

Bryan Lewis1*, Stephen Eubank2, Allyson M Abrams3 and Ken Kleinman3

Author Affiliations

1 Social & Decision Informatics Laboratory, Virginia Tech Research Center, 900 N. Glebe Road, Arlington, VA, 22203, USA

2 Network Dynamics and Simulation Science Laboratory, Virginia Bioinformatics Institute (0477), Virginia Tech, Blacksburg, VA, 24061, USA

3 Department of Population Medicine, Harvard School of Medicine, 133 Brookline Ave, Boston, MA, 22201, USA

For all author emails, please log on.

BMC Medical Informatics and Decision Making 2013, 13:12  doi:10.1186/1472-6947-13-12

Published: 23 January 2013

Abstract

Background

Detecting outbreaks is a crucial task for public health officials, yet gaps remain in the systematic evaluation of outbreak detection protocols. The authors’ objectives were to design, implement, and test a flexible methodology for generating detailed synthetic surveillance data that provides realistic geographical and temporal clustering of cases and use to evaluate outbreak detection protocols.

Methods

A detailed representation of the Boston area was constructed, based on data about individuals, locations, and activity patterns. Influenza-like illness (ILI) transmission was simulated, producing 100 years of in silico ILI data. Six different surveillance systems were designed and developed using gathered cases from the simulated disease data. Performance was measured by inserting test outbreaks into the surveillance streams and analyzing the likelihood and timeliness of detection.

Results

Detection of outbreaks varied from 21% to 95%. Increased coverage did not linearly improve detection probability for all surveillance systems. Relaxing the decision threshold for signaling outbreaks greatly increased false-positives, improved outbreak detection slightly, and led to earlier outbreak detection.

Conclusions

Geographical distribution can be more important than coverage level. Detailed simulations of infectious disease transmission can be configured to represent nearly any conceivable scenario. They are a powerful tool for evaluating the performance of surveillance systems and methods used for outbreak detection.

Keywords:
Surveillance; Simulation; Outbreak detection; Evaluation; Agent-based model; Influenza-like illness