Open Access Open Badges Research article

Impact of methodological "shortcuts" in conducting public health surveys: Results from a vaccination coverage survey

Elizabeth T Luman1*, Mariana Sablan2, Shannon Stokley1, Mary M McCauley1 and Kate M Shaw1

Author Affiliations

1 National Center for Immunization and Respiratory Diseases, US Centers for Disease Control and Prevention, 1600 Clifton Rd, Atlanta GA 30333, USA

2 Department of Health, Division of Public Health, PO Box 500409 CK, Saipan MP 96950v, Commonwealth of the Northern Mariana Islands

For all author emails, please log on.

BMC Public Health 2008, 8:99  doi:10.1186/1471-2458-8-99

Published: 27 March 2008



Lack of methodological rigor can cause survey error, leading to biased results and suboptimal public health response. This study focused on the potential impact of 3 methodological "shortcuts" pertaining to field surveys: relying on a single source for critical data, failing to repeatedly visit households to improve response rates, and excluding remote areas.


In a vaccination coverage survey of young children conducted in the Commonwealth of the Northern Mariana Islands in July 2005, 3 sources of vaccination information were used, multiple follow-up visits were made, and all inhabited areas were included in the sampling frame. Results are calculated with and without these strategies.


Most children had at least 2 sources of data; vaccination coverage estimated from any single source was substantially lower than from all sources combined. Eligibility was ascertained for 79% of households after the initial visit and for 94% of households after follow-up visits; vaccination coverage rates were similar with and without follow-up. Coverage among children on remote islands differed substantially from that of their counterparts on the main island indicating a programmatic need for locality-specific information; excluding remote islands from the survey would have had little effect on overall estimates due to small populations and divergent results.


Strategies to reduce sources of survey error should be maximized in public health surveys. The impact of the 3 strategies illustrated here will vary depending on the primary outcomes of interest and local situations. Survey limitations such as potential for error should be well-documented, and the likely direction and magnitude of bias should be considered.