Email updates

Keep up to date with the latest news and content from BMC Pediatrics and BioMed Central.

Open Access Highly Accessed Research article

Identification and characteristics of vaccine refusers

Feifei Wei1*, John P Mullooly2, Mike Goodman3, Maribet C McCarty1, Ann M Hanson1, Bradley Crane2 and James D Nordin1

Author Affiliations

1 HealthPartners Research Foundation, Minneapolis, MN, USA

2 Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA

3 Xcenda, Woodlands Parkway, Palm Harbor, FL, USA

For all author emails, please log on.

BMC Pediatrics 2009, 9:18  doi:10.1186/1471-2431-9-18


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2431/9/18


Received:12 August 2008
Accepted:5 March 2009
Published:5 March 2009

© 2009 Wei et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

This study evaluated the utility of immunization registries in identifying vaccine refusals among children. Among refusers, we studied their socioeconomic characteristics and health care utilization patterns.

Methods

Medical records were reviewed to validate refusal status in the immunization registries of two health plans. Racial, education, and income characteristics of children claiming refusal were collected based on the census tract of each child. Health care utilization was identified using both electronic medical record and insurance claims. Within the immunization registries of two HMOs in the study, some providers use refusal and medical contraindication interchangeably, and some providers tend to always use "ever refusal." Therefore, we combined medical contraindication and refusal together and treated them all as "refusal" in this study.

Results

The immunization registry, compared to chart review, had negative predictive values of 85–92% and 90–97% for 2- and 6-year olds, and positive predictive values of only 52–74% and 59–62% to identify vaccine refusals. Refusers were more likely to reside in well-educated, higher income areas than non-refusers. Refusers had not opted out of health care system and continued, although less frequently for the age 2 and under group, to use services.

Conclusion

Without enhancements to immunization registries, identifying children with immunization refusal would be time consuming. Since communities where refusers live are well educated, interventions should target these communities to communicate vaccine adverse events and consequences of vaccine preventable diseases.

Background

The decision to voluntarily forgo immunization exposes both the children whose parents refused vaccination and others in the community to the risks of vaccine-preventable disease.[1]

Mandatory vaccination for school entry, as required in all states, is one effective way the United States has chosen to control vaccine preventable diseases. Although this policy exists in all states, exemptions are still allowed. The reasons for parents to refuse to have their children vaccinated ranged from religious beliefs to, increasingly, a fear of adverse reactions to certain vaccinations. A recent study showed that the most common reason stated for refusal (190 [69%] of 277) was concern that the vaccines might cause harm.[2] Parents who refused to vaccinate their children were significantly more likely than parents of vaccinated children to report low perceived vaccine safety and efficacy, a low level of trust in the government, and low perceived susceptibility to and severity of vaccine-preventable diseases. Parents who refused specific or all vaccinations for their children were significantly less likely to report confidence in medical, public health, and government sources for vaccine information and were more likely to report confidence in alternative medicine professionals than parents of vaccinated children.

Health plans have the rare ability to document parental vaccine refusal for a large number of children of all ages. This study took advantage of two health plans' ability to track immunization status, enrollment, and medical encounters to examine immunization refusals.

The purpose of this study was to understand methods for identifying refusers and, among those refusers, to describe their social characteristics and health care utilization patterns. To accomplish the first aim we sought to evaluate the utility of HMO immunization registries in identifying vaccine refusals. The knowledge of HMO immunization registry completeness and the accuracy of social and medical care correlates of vaccine refusals will aid in the development of interventions to improve immunization compliance and long-term follow-up of refusers. Specifically, the study objectives were firstly to assess levels of agreement between automated immunization registries and medical chart abstractions of vaccine refusals. Secondly, the study describes differences in social and economic characteristics (at the census tract level) between children in the age group of 2 to 6 years old who were not vaccinated because of parental refusal and children who were vaccinated. Thirdly, we described patterns of health care utilization (well-child, outpatient, prescriptions, ER and hospital visits) for children with a refusal of vaccination from birth to ages two and six.

Methods

The study protocol was approved by the institutional review boards at the two participating sites and the Centers for Disease Control and Prevention.

Study population

The study population was composed of children aged 0 through 6 years old enrolled in two large health plans participating in the CDC-sponsored Vaccine Safety Datalink (VSD) Project. Children who were enrolled in HealthPartners (HP) from 1997–2001 or Kaiser Permanente Northwest (NWK) from 1998–2001 were included in the study. These two HMOs were chosen because of geographic location and nationwide affiliation. One located on the west coast, and the other in the Midwest. One is part of a national HMO, and the other is a regional HMO.

HP documented immunization refusal beginning in 1997 as either "medical contraindication" or "parent/patient refusal." NWK documented immunization refusal in its vaccination database beginning in 1998 as either "Medical Contraindication to Immunizations" or "Patient/Parent Refusal of Immunizations." Medical contraindication indicated in the registry could be, for example, that the child had a minor fever at time of visit, and the parent chose not to let the child get vaccinated at that time. In addition, some providers use refusal and medical contraindication interchangeably, and some providers tend to always use "ever refusal." Therefore, we combine medical contraindication and refusal together and treat them all as "refusal" in this study.

Eligibility Criteria

The study used the VSD 2002 annual database. Children born between 1994 and 2001 for HP and children born between 1993 and 2001 for NWK were eligible for the study. Henceforth, the two HMOs will be referred to as HMO A and HMO B due to an IRB requirement that prohibits identifying the specific data that came from each HMO.

Clinics at both HMOs maintain vaccination histories in an immunization registry module of electronic medical records for all patients seen at clinics. Existing patients who visit clinics have had their historical immunization data verified and recorded. As new patients come into the system, immunization histories are entered directly into electronic medical record system by the provider. A copy is made of the outside record and scanned into the system to allow for quality assurance. The refusal information is entered in the immunization registry at the point of service. The VSD 2002 annual database used in this study included immunization data from both the immunization registry and the billing system.

Study inclusion criteria are shown in Table 1. The "Age 2 and under" group and "age 6" group were chosen based on the inherent nature of immunization schedule. There is an intense series of immunizations between birth and the age of 18 months, where a number of vaccinations must be given within the short time span of a few months. After these initial vaccinations, no vaccinations are routinely recommended between ages 2 and 4. After age 4, recommended immunizations could be taken within a 2-year time span between the ages of 4 and 6. Due to the requirement of the School Immunization Laws, a health care provider of a 6-year old likely has the child's most up-to-date immunization status. Therefore, this study had a continuous enrollment criteria for the "Age 2 and under" group, but only a point-enrollment requirement at age 6 for the "age 6" group. Since some refusals may be due to a temporary medical condition (such as a headache), the child may receive a vaccination at a later visit. Therefore, some of ever-refuse children, did achieve up-to-date immunization status at the evaluation age specified in Table 1.

Table 1. "Age 2 and under" and "Age 6" eligibility and up-to-date status criteria

Children age 15 months and older on December 31, 2001 who were continuously enrolled (allowing 32 days gaps) in the health plan from birth to 15 months of age were included in the "age 2 and under" group. Children of age equal or greater than 4 months and less than 15 months old at 12/31/2001 who were continuously enrolled in the health plan from birth to December 31, 2001 were also included in the "age 2 and under" study population. Children of age equal or more than 6 years old who enrolled in the health plan at time of age 6 were included in the "age 6" group. Children in the "Age 2 and under" group were included to study health care utilization in the first 24 months, and children in the "Age 6 and under" group were included to compare health care utilization in the first 6 years between ever-refusers versus never-refusers.

Chart review

Chart reviews were performed on a random sample to validate immunization status and refusal from immunization information to collect information on date and type of vaccination given, and the reason not given, if a vaccination was mentioned but not given during the visit. The sample selection mechanism is shown in Table 2. "Age 2 and under" group was chart reviewed from birth to age 2 or 12/31/2001, whichever occurred first. "Age 6" group was chart reviewed from birth to age 6 1/2 or 12/31/2001, whichever occurred first. The chart review scheme was shown in Table 2. If there were sufficient subjects eligible, we reviewed a 30% random sample in cells involving refusers. If there were not enough eligible subjects in cells involving refusers, we chart reviewed all available charts. For the non-refusers, we over sampled those who were not up-to-date within the restrictions of the budget at each participating site (Table 2).

Table 2. Study population

Chart abstraction was completed by trained reviewers with years of experience in record abstraction. Training consisted of approximately 4 hours of classroom review of study objectives, vaccination information, and review of 2 sample charts. Abstractors then completed test charts to assure uniformity of review by all abstractors.

Electronic Data collection

VSD data files were queried for study subjects who met study inclusion criteria. These data included information on enrollment, refusal status, vaccinations received, and dates of vaccine receipt. VSD data files were also used to identify outpatient, emergency department and urgent care visits, and hospitalizations.

Variable definition

A child was classified as a refuser if he/she had a record of a vaccine refusal either in the medical chart or in the immunization registry. A child's immunization up-to-date status was determined based on his immunization data gathered from immunization registry and supplemented by the medical record according to criteria in Table 1.

In order to avoid alienating patients by collecting potentially sensitive information,[3] the participating HMOs as well as most providers throughout country, do not routinely collect demographic variables of children or their parents. The study, therefore, identified the census block group in which each participant lived by geocoding his/her residential address as of December, 2001. [4-24] The census block group was defined as a child's "community." For each child, the study collected census information on race (white/non-white), proportion of individuals older than 25 years of age, educational status, and household income. In accordance with the census definition, a child was below poverty level if his/her total household income was less than the poverty threshold specified for the applicable family size, age of householder, and number of related children under 18.[25]

We identified four conditions that were likely to occur frequently and lead to higher medical care utilization: otitis media and other ear disorders (ICD-9 diagnosis codes = 381, 382, 388); respiratory, including Asthma (493, 786, 466); skin, including Dermatitis (691, 692); seizure (345, 780.3) diagnoses.[26]

Outpatient visits included both regular and urgent care visits: well child visit (ICD-9 diagnosis codes of V20 and V70), illness visit (000–799), and injury visit (800–999). Well child visits were defined as outpatient visits with ICD-9 diagnosis codes of V20 and V70. Only non-birth hospital stays were counted toward inpatient visits. Drug prescriptions studied were antibiotics, asthma, and seizure medications, which were commonly prescribed to infants and children.

Analysis

The study collected refusal information found in the medical record and in the HMO immunization registry of our chart review sample. If the child had any type of refusal (either parent refusal or medical contraindication) during the study period for any vaccine they were marked as having a refusal.

Univariate statistical comparisons were made with chi-square test for categorical variables and t-tests for continuous variables. The study used logistic regressions, Poisson regression models and general linear models to estimate adjusted odds ratios as follows: we compared ever/never use of well-child care, outpatient, emergency room and inpatient care, and select prescriptions between refusers and non-refusers (both up-to date and not up-to-date for immunization), employing logistic regressions that controlled for HMO site, patient's gender, immunization up-to-date status, high use medical conditions, Medicaid status in 2001, and the child's community race/SES variables. Differences in quantitative community characteristics and rates of health care utilization were assessed using Poisson regression models and general linear models with or without log transformations that adjusted for the same set of variables.

Results and discussion

There are total of 14,257 children from HMO A and 24,889 children aged 2 years old or younger from HMO B, and 5,121 children from HMO A and 13,159 children aged 6 from HMO B who were eligible for the study. A total 830 children aged 2 years old and under and 409 children aged 6 were selected for chart review.

Negative predictive values of electronic data compared to chart review on immunization refusal status were 92% and 90% for 2 years old and under and 6-year olds for HMO A, and 85% and 97% for HMO B, respectively. Positive predictive values were only 52% and 62% for HMO A and 74% and 59% for HMO B, using a definition of ever refusal (any refusal for any vaccination) (Table 3). Only between 52% and 74% of refusals documented in the immunization registry were confirmed by text in the electronic medical record. Due to poor positive predictive values, this study cannot provide a population estimate of the proportion of children with immunization refusal in the study population. Closer review of the 21 cases from the 6-year old sample with a refusal in both chart review and HMO immunization registry revealed multiple mismatches with respect to date of refusal and vaccine refused.

Table 3. Agreement between chart review and HMO immunization registry on ever refusal status

Since the agreement between HMO immunization registry and chart reviews on immunization refusal status was poor the following analyses were restricted to the chart review sample only (n = 1,249, Table 2).

Table 4 shows socio-economic characteristics of refuser and non-refuser communities, adjusting for up-to-date immunization status, HMO site, gender, Medicaid status, and select high use medical conditions. Compared to communities where non-refusers lived, refusers' communities had higher average household incomes for both age 2 and under (P-value = 0.04) and age 6 (P-value = 0.03) chart review samples. In the age 6 chart review sample, there were fewer households below the poverty income level (P-value = 0.04) and fewer adults without college degree (P-value = 0.01) among refusers' communities.

Table 4. Demographic characteristics of children communities of the chart review sample

Only one of 236 (0.4%) refusers in the age 2 and under group had never been seen in an outpatient setting. Four (1.7%) refusers in the age 2 and under group and eight (8.7%) refusers in the age 6 group had no well-child visit. Since enrollment criteria for the age 6 group required only that a child was enrolled at a participating HMO at age 6, a child in the age 6 group may have been seen at an outpatient clinic or had a well-child visit when he/she was not enrolled at a participating HMO.

Table 5 shows adjusted odds ratios of ever taking antibiotics, asthma, or seizure medications, being admitted to a hospital, or visiting an emergency room between refusers and non-refusers. Covariates included were up-to date immunization status, HMO site, gender, Medicaid status, and select high use medical conditions. The majority of age-6 group children took antibiotics, asthma, or seizure medications. Compared with non-refusers, a higher percentage of refusers took antibiotics, asthma, or seizure medications in the age 6 group (93.48% versus 77.90%, P-value = 0.0003).

Table 5. Adjusteda odds ratios of health care utilization of children in the chart review sample

Table 5 also compared length of hospitalization, frequency of antibiotics, asthma, or seizure prescriptions, outpatients, well-child and emergency room visits between refusers and non-refusers, controlling for up-to date immunization status, HMO site, gender, Medicaid status, and select high use medical conditions. Although in the age 6 group, refusers and non-refusers were similar, refusers in the age 2 and under group had fewer hospital days per person (P-value = 0.0006), were less frequently seen in outpatient settings (P-value = 0.02) or emergency rooms (P-value = 0.047) than non-refusers.

Conclusion

Our results indicate that there is poor agreement between refusal status in charts and immunization registries. Policies aimed at educating refusers would be well-served by improvement in immunization registries. Immunization registries possibly may be improved by adding a pull-down field that requires providers to specify a reason for refusal (for example, minor physical illness, major physical illness, allergy, parental refusal, etc). The alternative, tracking children through medical records would be both expensive and time consuming for busy pediatric clinics.

Refusers are more likely to come from well-educated and higher income areas than non- refusers. It should be stressed that this paper makes inference about the socio-economic make-up of the communities, not the specific children themselves. Refusers were found not to have opted out of the health care system and continue, although less frequently for the age 2 and under group, to use services in the health plans. Refusers in the age 2 and under group had fewer hospital days per person, and had fewer outpatient and emergency room visits than non-refusers. The trend toward higher levels of antibiotic use in older refusal children is consistent with higher rates of illness observed in previous epidemiological studies.[27,28]

A previous study found that the consequences of not being immunized can be serious. One retrospective study investigated a cohort of 3 to 18 year old Colorado school children from 1987–1998[1] to see if individuals and communities experienced adverse events from personal exemption to immunization. The study found that children with personal (non-medical) exemptions to vaccines were 22 times more likely to be infected with measles and 5.9 times more likely to be infected with pertussis. They also found that unvaccinated children in day care, who already have an increased susceptibility to disease, are up to 60 times more likely to acquire the disease than their vaccinated peers. It found that refusers seem to be able to transmit disease to vaccinated individuals when the two groups are mixed in a school or during an outbreak. Similarly, another study that looked comprehensively at the health consequences of religious and philosophical exemption from immunization laws[29] in a cohort of 5–19 year olds nation-wide from 1985–1992 found that refusers were 35 times more likely than vaccinated individuals to contract measles from 1985–1992 in the United States. A third study analyzed the relationship between state-level rates of nonmedical exemptions at school entry and pertussis incidence data for individuals aged 18 years or younger.[30] They found that an increased pertussis incidence was associated with an easier granting of exemptions (incidence rate ratio = 1.53; 95% confidence interval, 1.10–2.14) and the availability of personal belief exemptions (incidence rate ratio = 1.48; 95% confidence interval, 1.03–2.13). The decision to refuse immunization must carefully balance individual rights and social responsibility. If a large enough number people decide to forgo immunizations it runs the risk of seeing a resurgence of vaccine preventable diseases, especially measles.[1,2] Numerous reports confirm the probability of outbreaks starting in unvaccinated individuals and then spreading to children whose vaccination may have failed.[1]

Because of the important public health implications involved, it is important to understand characteristics of children who refused to be immunized. Our results show that refusers had not opted out of health care system but continued to participate in it. There are opportunities at regular clinic visits to provide information to refusers to influence vaccine attitudes. Our findings suggest that interventions may be implemented at clinics to improve immunization compliance and long-term follow-up with this subgroup of children. Since parents of refusers are from well educated communities, interventions should target these communities to communicate the most up-to-date research on vaccine adverse events and the consequences of vaccine preventable diseases.[31] While the parents may not permit all routine immunizations, some may be given. Progress may be made if the parents are given a wide amount of information about vaccinations including: which diseases are not affected by herd immunity, more information about the diseases, another viewpoint about vaccine side effects, and information that all vaccines routinely given to children, except some influenza vaccines, are thimerosol free. [32-36]

Our study has several limitations. Use of geocoding to assign the race, education, and household income level of the child provides information about the communities in which the child lives, and may result in misclassification of the specific child. However, census-based data on income and education at the block group, tract, and ZIP code level have been widely used as proxies for the SES of individuals in studies of health outcomes and health funds allocation[4-20,22-24]. Census-based SES data at the block group and tract level have also been used to characterize community socioeconomic conditions [17-20]. We have based our interpretation of the results on the characteristics of communities in which children live. Due to the possibility of misclassification, care should be taken when generalizing these results to the child level. Second, due to the small total number of refusers, as well as the fact that some providers use refusal and medical contraindication interchangeably, and that some providers tend to always use "ever refusal," we documented "refusal" as either "contraindication" or "refusal." Vaccine refusals include true vaccine refusals, true contraindications, as well as deferrals for minor illnesses. Combining these three groups is a limitation of this study, but it is unlikely that the data requested could be accurately obtained without undertaking an expensive prospective study that includes direct observation of provider-patient interactions. Third, refusers may be more likely to receive care from alternative providers, such as naturopathic physicians. Since alternative providers are not a part of the HMO system and few health insurance policies pay for these services, we do not have access to data on care provided by alternative providers. Fourth, due to the small total number of refusers in the age 6 group, a continuous enrollment was not required and "per person per day" analysis strategy was adopted.

The present report found that refusers, have slightly lower but similar health care utilization in the short-run except for prescriptions in two year olds. Thus, these families have not opted out of health care completely, and practitioners will have numerous opportunities to counsel these parents in the first two years of their children's lives, which is consistent with AAP policy statement on vaccine refusers.[37]

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

FW Concept and design; acquisition of data; analysis and interpretation of data; drafting of the manuscript; critical revision of the manuscript for important intellectual content; statistical analysis; supervision. JM Concept and design; acquisition of data; analysis and interpretation of data; drafting of the manuscript; critical revision of the manuscript for important intellectual content; statistical analysis; supervision. MG Concept and design; analysis and interpretation of data; critical revision of the manuscript for important intellectual content. MCM Concept and design; analysis and interpretation of data; critical revision of the manuscript for important intellectual content. AMH Concept and design; acquisition of data; analysis and interpretation of data. BC Acquisition of data; analysis and interpretation of data; administrative, technical or logistical support. JDN Concept and design; analysis and interpretation of data; critical revision of the manuscript for important intellectual content. All authors have read and approved the final manuscript.

Acknowledgements

This study was supported by the Centers for Disease Control and Prevention via contract 200-2002-00732 (the Vaccine Safety Datalink Project) with America's Health Insurance Plans.

References

  1. Feikin DR, Lezotte DC, Hamman RF, Salmon DA, Chen RT, Hoffman RE: Individual and community risks of measles and pertussis associated with personal exemptions to immunization.

    Jama 2000, 284(24):3145-3150. PubMed Abstract | Publisher Full Text OpenURL

  2. Salmon DA, Moulton LH, Omer SB, deHart MP, Stokley S, Halsey NA: Factors Associated With Refusal of Childhood Vaccines Among Parents of School-aged Children: A Case-Control Study.

    Arch Pediatr Adolesc Med 2005, 159(5):470-476. PubMed Abstract | Publisher Full Text OpenURL

  3. Baker DW, Cameron KA, Feinglass J, Georgas P, Foster S, Pierce D, Thompson JA, Hasnain-Wynia R: Patients' Attitudes Toward Health Care Providers Collecting Information About Their Race and Ethnicity.

    Journal of General Internal Medicine 2005, 20(10):895-900. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  4. Wise PH, Kotelchuck M, Wilson ML, Mills M: Racial and socioeconomic disparities in childhood mortality in Boston.

    N Engl J Med 1985, 313(6):360-366. PubMed Abstract OpenURL

  5. Devesa SS, Diamond EL: Socioeconomic and Racial Differences in Lung Cancer Incidence.

    Am J Epidemiol 1983, 118(6):818-831. PubMed Abstract | Publisher Full Text OpenURL

  6. Kraus JF, Fife D, Ramstein K, Conroy C, Cox P: The relationship of family income to the incidence, external causes, and outcomes of serious brain injury, San Diego County, California.

    Am J Public Health 1986, 76(11):1345-1347. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  7. Gould JB, Davey B, Stafford RS: Socioeconomic differences in rates of cesarean section.

    N Engl J Med 1989, 321(4):233-239. PubMed Abstract OpenURL

  8. McWhorter WP, Schatzkin AG, Horm JW, Brown CC: Contribution of socioeconomic status to black/white differences in cancer incidence.

    Cancer 1989, 63(5):982-987. PubMed Abstract | Publisher Full Text OpenURL

  9. Krieger N: Social Class and the Black/White Crossover in the Age-Specific Incidence of Breast Cancer: A Study Linking Census-Derived Data to Population-Based Registry Records.

    Am J Epidemiol 1990, 131(5):804-814. PubMed Abstract | Publisher Full Text OpenURL

  10. Mandelblatt J, Andrews H, Kerner J, Zauber A, Burnett W: Determinants of late stage diagnosis of breast and cervical cancer: the impact of age, race, social class, and hospital type.

    Am J Public Health 1991, 81(5):646-649. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Collins JW Jr, David RJ: Differences in neonatal mortality by race, income, and prenatal care.

    Ethn Dis 1992, 2(1):18-26. PubMed Abstract OpenURL

  12. Byrne C, Nedelman J, Luke RG: Race, socioeconomic status, and the development of end-stage renal disease.

    Am J Kidney Dis 1994, 23(1):16-22. PubMed Abstract OpenURL

  13. Chen FM, Breiman RF, Farley M, Plikaytis B, Deaver K, Cetron MS: Geocoding and Linking Data from Population-based Surveillance and the US Census to Evaluate the Impact of Median Household Income on the Epidemiology of Invasive Streptococcus pneumoniae Infections.

    Am J Epidemiol 1998, 148(12):1212-1218. PubMed Abstract | Publisher Full Text OpenURL

  14. Smith GD, Hart C, Watt G, Hole D, Hawthorne V: Individual social class, area-based deprivation, cardiovascular disease risk factors, and mortality: the Renfrew and Paisley Study.

    J Epidemiol Community Health 1998, 52(6):399-405. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Bay KS, Saunders LD, Wilson DR: Socioeconomic risk factors and population-based regional allocation of healthcare funds.

    Health Serv Manage Res 1999, 12(2):79-91. PubMed Abstract OpenURL

  16. Froehlich H, Ackerson LM, Morozumi PA, the Pediatric Tuberculosis Study Group of Kaiser Permanente NC : Targeted Testing of Children for Tuberculosis: Validation of a Risk Assessment Questionnaire.

    Pediatrics 2001, 107(4):e54. PubMed Abstract | Publisher Full Text OpenURL

  17. Heck KE, Schoendorf KC, Chavez GF: The influence of proximity of prenatal services on small-for-gestational-age birth.

    J Community Health 2002, 27(1):15-31. PubMed Abstract | Publisher Full Text OpenURL

  18. Pearl M, Braveman P, Abrams B: The Relationship of Neighborhood Socioeconomic Characteristics to Birthweight Among 5 Ethnic Groups in California.

    Am J Public Health 2001, 91(11):1808-1814. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  19. O'Campo P, Xue X, Wang MC, Caughy M: Neighborhood risk factors for low birthweight in Baltimore: a multilevel analysis.

    Am J Public Health 1997, 87(7):1113-1118. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  20. Elreedy S, Krieger N, Ryan PB, Sparrow D, Weiss ST, Hu H: Relations between Individual and Neighborhood-based Measures of Socioeconomic Position and Bone Lead Concentrations among Community-exposed Men: The Normative Aging Study.

    Am J Epidemiol 1999, 150(2):129-141. PubMed Abstract | Publisher Full Text OpenURL

  21. Karter AJ, Ferrara A, Darbinian JA, Ackerson LM, Selby JV: Self-monitoring of blood glucose: language and financial barriers in a managed care population with diabetes.

    Diabetes Care 2000, 23(4):477-483. PubMed Abstract | Publisher Full Text OpenURL

  22. Karter AJ, Ackerson LM, Darbinian JA, D'Agostino RB Jr, Ferrara A, Liu J, Selby JV: Self-monitoring of blood glucose levels and glycemic control: the Northern California Kaiser Permanente Diabetes registry.

    Am J Med 2001, 111(1):1-9. PubMed Abstract | Publisher Full Text OpenURL

  23. Krieger N, Quesenberry C Jr, Peng T, Horn-Ross P, Stewart S, Brown S, Swallen K, Guillermo T, Suh D, Alvarez-Martinez L, et al.: Social class, race/ethnicity, and incidence of breast, cervix, colon, lung, and prostate cancer among Asian, Black, Hispanic, and White residents of the San Francisco Bay Area, 1988–92 (United States).

    Cancer Causes Control 1999, 10(6):525-537. PubMed Abstract | Publisher Full Text OpenURL

  24. Krieger N, Chen JT, Waterman PD, Soobader M-J, Subramanian SV, Carson R: Geocoding and Monitoring of US Socioeconomic Inequalities in Mortality and Cancer Incidence: Does the Choice of Area-based Measure and Geographic Level Matter? The Public Health Disparities Geocoding Project.

    Am J Epidemiol 2002, 156(5):471-482. PubMed Abstract | Publisher Full Text OpenURL

  25. U.S. Census Bureau. Household Income, Per Capita Income, and Persons Below Poverty: 2000 Census of Population and Housing, Demographic Profile [http://quickfacts.census.gov/qfd/meta/long_101616.htm] webcite

  26. Freid VM, Makuc DM, Rooks RN: Ambulatory health care visits by children: principal diagnosis and place of visit.

    Vital Health Stat 13 1998, (137):1-23. PubMed Abstract OpenURL

  27. Finkelstein JA, Stille C, Nordin J, Davis R, Raebel MA, Roblin D, Go AS, Smith D, Johnson CC, Kleinman K, et al.: Reduction in Antibiotic Use Among US Children, 1996–2000.

    Pediatrics 2003, 112(3):620-627. PubMed Abstract | Publisher Full Text OpenURL

  28. Whitney CG, Farley MM, Hadler J, Harrison LH, Lexau C, Reingold A, Lefkowitz L, Cieslak PR, Cetron M, Zell ER, et al.: Increasing Prevalence of Multidrug-Resistant Streptococcus pneumoniae in the United States.

    N Engl J Med 2000, 343(26):1917-1924. PubMed Abstract | Publisher Full Text OpenURL

  29. Salmon DA, Haber M, Gangarosa EJ, Phillips L, Smith NJ, Chen RT: Health consequences of religious and philosophical exemptions from immunization laws: individual and societal risk of measles.

    Jama 1999, 282(1):47-53. PubMed Abstract | Publisher Full Text OpenURL

  30. Omer SB, Pan WK, Halsey NA, Stokley S, Moulton LH, Navar AM, Pierce M, Salmon DA: Nonmedical exemptions to school immunization requirements: secular trends and association of state policies with pertussis incidence.

    Jama 2006, 296(14):1757-1763. PubMed Abstract | Publisher Full Text OpenURL

  31. Gust D, Brown C, Sheedy K, Hibbs B, Weaver D, Nowak G: Immunization attitudes and beliefs among parents: beyond a dichotomous perspective.

    Am J Health Behav 2005, 29(1):81-92. PubMed Abstract OpenURL

  32. Gust DA, Kennedy A, Wolfe S, Sheedy K, Nguyen C, Campbell S: Developing tailored immunization materials for concerned mothers.

    Health Education Research 2008, 23(3):499-511.

    doi:10.1093/her/cym065

    PubMed Abstract | Publisher Full Text OpenURL

  33. Gust DA, Campbell S, Kennedy A, Shui I, Barker L, Schwartz B: Parental concerns and medical-seeking behavior after immunization.

    Am J Prev Med 2006, 31(1):32-35. PubMed Abstract | Publisher Full Text OpenURL

  34. Gust DA, Kennedy A, Shui I, Smith PJ, Nowak G, Pickering LK: Parent attitudes toward immunizations and healthcare providers the role of information.

    Am J Prev Med 2005, 29(2):105-112. PubMed Abstract | Publisher Full Text OpenURL

  35. Gust DA, Strine TW, Maurice E, Smith P, Yusuf H, Wilkinson M, Battaglia M, Wright R, Schwartz B: Underimmunization Among Children: Effects of Vaccine Safety Concerns on Immunization Status.

    Pediatrics 2004, 114(1):e16-22. PubMed Abstract | Publisher Full Text OpenURL

  36. Gust DA, Woodruff R, Kennedy A, Brown C, Sheedy K, Hibbs B: Parental perceptions surrounding risks and benefits of immunization.

    Seminars in pediatric infectious diseases 2003, 14(3):207. PubMed Abstract | Publisher Full Text OpenURL

  37. Diekema DS, the Committee on B: Responding to Parental Refusals of Immunization of Children.

    Pediatrics 2005, 115(5):1428-1431. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2431/9/18/prepub