Email updates

Keep up to date with the latest news and content from BMC Public Health and BioMed Central.

Open Access Research article

Are healthcare workers’ intentions to vaccinate related to their knowledge, beliefs and attitudes? a systematic review

Raúl Herzog1, Mª José Álvarez-Pasquin12*, Camino Díaz1, José Luis Del Barrio3, José Manuel Estrada4 and Ángel Gil3

Author affiliations

1 Primary Healthcare Service, Madrid Health Service, Santa Hortensia 14, Madrid, Spain

2 Spanish Association of Vaccinology, Madrid, Spain

3 Department of Preventive Medicine, Public Health, Medical Immunology and Microbiology, Rey Juan Carlos University, Avenida de Atenas s/n, Alcorcón, Spain

4 Virtual Library, Lain Entralgo Agency, Gran Vía 27, Madrid, Spain

For all author emails, please log on.

Citation and License

BMC Public Health 2013, 13:154  doi:10.1186/1471-2458-13-154

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2458/13/154


Received:23 March 2012
Accepted:31 January 2013
Published:19 February 2013

© 2013 Herzog et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The Summit of Independent European Vaccination Experts (SIEVE) recommended in 2007 that efforts be made to improve healthcare workers’ knowledge and beliefs about vaccines, and their attitudes towards them, to increase vaccination coverage. The aim of the study was to compile and analyze the areas of disagreement in the existing evidence about the relationship between healthcare workers’ knowledge, beliefs and attitudes about vaccines and their intentions to vaccinate the populations they serve.

Methods

We conducted a systematic search in four electronic databases for studies published in any of seven different languages between February 1998 and June 2009. We included studies conducted in developed countries that used statistical methods to relate or associate the variables included in our research question. Two independent reviewers verified that the studies met the inclusion criteria, assessed the quality of the studies and extracted their relevant characteristics. The data were descriptively analyzed.

Results

Of the 2354 references identified in the initial search, 15 studies met the inclusion criteria. The diversity in the study designs and in the methods used to measure the variables made it impossible to integrate the results, and each study had to be assessed individually. All the studies found an association in the direction postulated by the SIEVE experts: among healthcare workers, higher awareness, beliefs that are more aligned with scientific evidence and more favorable attitudes toward vaccination were associated with greater intentions to vaccinate. All the studies included were cross-sectional; thus, no causal relationship between the variables was established.

Conclusion

The results suggest that interventions aimed at improving healthcare workers’ knowledge, beliefs and attitudes about vaccines should be encouraged, and their impact on vaccination coverage should be assessed.

Keywords:
Immunization; Vaccination; Knowledge; Belief; Attitude; Healthcare worker; Coverage; Intentions

Background

Vaccination against preventable diseases is safe and cost-effective, and it has had an important impact on public health worldwide [1]. Because of universal vaccination, various diseases have been eradicated or substantially reduced in many countries [2]. However, vaccine coverage is still not sufficient to control some diseases, such as the measles, which the World Health Organization pledged in 1997 to eradicate from Western Europe by 2007. Recent years have seen repeated outbreaks in this region [3], including epidemics such as the one that occurred in Germany in 2006 [4].

Studies that investigate why a segment of the population does not accept universal vaccination [5-7] have highlighted reasons such as lack of knowledge, misperceptions and distrust in vaccines [8], combined with a low perceived risk of acquiring the disease because the incidence has declined as a result of vaccination programs [9]. Even HCW (healthcare workers) have low vaccine coverage, as is the case with the influenza vaccine, due to various factors, including knowledge about the disease, knowledge about the vaccine or past beliefs and past attitudes (related to influenza vaccination in previous seasons) [10,11].

Despite the significant impact of the media, health professionals have been identified as the most important source of information on vaccination for the general public. Health professionals are key players in recommending vaccination and encouraging the final decision to be vaccinated [12-17]. Therefore, the willingness of health professionals to recommend immunization is crucial. The Summit of Independent European Vaccination Experts (SIEVE) reported in 2007 [18] that strategies to optimize vaccination coverage in children and adults in Europe should be identified and targeted towards healthcare workers (HCWs). SIEVE emphasized the importance of HCWs’ perceptions about vaccines, their attitudes towards them and the need to improve their knowledge of vaccines and increase access to high-quality information about vaccination.

In this context, we posed the following question: Is there a relationship between HCWs’ knowledge of vaccines, their beliefs and attitudes towards them and their intentions to vaccinate the population they serve? To answer this question, we performed a systematic review of the literature on the subject to compile the existing information and identify the areas of disagreement in the knowledge base.

Methods

First, we performed a pilot study, analyzing the abstracts of the publications we found in our PubMed search that met the inclusion criteria. This process provided an overview of the main features that should be included in the review and allowed us to prepare the protocol for extracting data.

Search strategy

In June 2009, a literature search was conducted in the PubMed, EMBASE, CINAHL and CENTRAL databases for articles published in one of seven different languages. To ensure that our search was thorough, the search in each database was conducted using both free and controlled language. For the free-text search, the terms included the following: (vaccination OR immunization) AND (healthcare worker OR complementary therapies) AND (knowledge OR beliefs OR attitudes OR barriers). The controlled language search included the following exploded MeSH terms: "Immunization", "Occupational Groups", "Beliefs", "Culture" and "Attitude". The only filter applied was the date of publication; studies were included if they were published between February 1998 and the present (i.e., June 2009). Additional file 1 shows the complete search strategy used in Medline. In addition, for further material, the references of the retrieved articles were manually searched, and key authors were contacted and asked to identify published and unpublished studies that met the inclusion criteria.

Additional file 1. Search strategy for Medline.

Format: DOCX Size: 16KB Download fileOpen Data

Article selection

After the preliminary selection of potentially relevant titles, two authors (MJA and RH) independently assessed the study abstracts for inclusion or exclusion based on the established criteria (Additional file 2). Based on the abstracts, a consensus decision was made about reading the full text; the full text was read when there was any doubt. To ensure the fulfillment of the inclusion criteria and the exclusion of studies with data collected before the cut-off point, all the studies published after February 1998 that met the inclusion criteria were initially included and read in their entirety by the investigators. Disagreements in the final selection were resolved by consensus, and in cases of continuing disagreement, through consultation with a third reviewer (CD). The reviewers also recorded and compared their reasons for excluding studies, and a consensus was reached when there were disagreements. To determine the degree of agreement in the selection of abstracts and full papers, the Kappa index of inter-observer agreement was calculated using the tool accessible at the following website: http://faculty.vassar.edu/lowry/kappa.html webcite.

Additional file 2. Inclusion and exclusion criteria. Inclusion and exclusion criteria for the selection of studies in this review [35,36,47-49].

Format: DOCX Size: 15KB Download fileOpen Data

Data extraction and critical appraisal

Each included study was reviewed independently by two investigators (MJA and RH), and the principal characteristics were extracted using a coding method developed in the pilot study. The risk of bias was evaluated using the Newcastle Ottawa scale for case–control studies and an adapted form of the Newcastle Ottawa cohort scale for cross-sectional studies (Additional file 3). Disagreements were resolved by consensus. Results are shown in Table 1.

Additional file 3. Critical appraisal tool for cross-sectional studies. Modified from the Newcastle-Ottawa Quality Assessment Scale for Cohort Studies.

Format: DOC Size: 34KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Table 1. Results of the critical appraisal of the included studies

The results of the included studies are shown in tables. Three tables show the associations found in the cross-sectional studies between the intention to vaccinate and HCWs’ knowledge (Table 2), beliefs (Table 3) and attitudes (Table 4). A fourth table shows the results of the case–control study (Table 5). All studies that aimed to show a possible relationship or an association between the variables were included; there were no restrictions based on the statistical methods used. The adjustments used in the statistical analysis in each study are listed in the last column of the tables, grouped into the following topics: A) Location, B) Demographic characteristics of the patients, C) Practice organization, D) Characteristics of the HCW involved in the study, E) Vaccination-related characteristics, F) HCW experience with morbidity and mortality associated with vaccine-preventable diseases.

Table 2. Associations between HCWs’ knowledge and their intentions to vaccinate in cross-sectional studies

Table 3. Associations between HCWs’ beliefs and their intentions to vaccinate in cross-sectional studies

Table 4. Associations between HCWs’ attitudes and their intentions to vaccinate in cross-sectional studies

Table 5. Associations between HCWs’ beliefs and attitudes and their intentions to vaccinate in case–control studies

To evaluate whether the methodological quality of the included studies influenced the direction or the magnitude of the results, we performed a separate analysis on those that complied with stricter inclusion criteria: 1) using vaccination coverage (measured by vaccination registries) as a measurement of the intention to vaccinate and 2) controlling for the main confounding factors in the statistical analysis. In these studies, it is less likely that the intention to vaccinate was overestimated, compared to the studies that rely on personal evaluation. In addition, the association between the variables is less susceptible to bias caused by confounding factors; thus, the internal validity is greater. Using these filters, we performed a sensitivity analysis. We measured the changes that were observed in the associations when only the studies with greater internal validity were included, compared to the results when we included all the studies that met the initial criteria.

Based on the consensus between two authors (MJA and RH), the different questions posed to the HCW in the studies were grouped by topic. Table 6 shows a summary of the associations found between each topic or factor and HCWs’ intentions to vaccinate. The results of a study were classified as “null association” if the confidence interval included the value representing a null association, if the results were not statistically significant, if confounders were not controlled or if there was insufficient information to interpret the results. To allow for interpretation, some odds ratios had to be inverted to clarify the meaning of the association between the intention to vaccinate and the factors that were evaluated in several studies.

Table 6. Summary of factors related to knowledge, beliefs and attitudes and their associations with HCWs’ intentions to vaccinate

Table 7 shows the main characteristics of the studies that were ultimately included, as well as the Kappa index of agreement.

Table 7. Characteristics of the included studies

Results

Of the 2354 references identified in the initial search, 113 were pre-selected because they aligned with the study objectives. After applying the inclusion criteria to the abstracts, the full-text reports of 43 studies were evaluated. Of these, 15 met the inclusion criteria and were included in the final analysis. A flow chart illustrating the studies that were excluded at each stage in the review process is shown in Figure 1.

thumbnailFigure 1. Flow chart of the reviewing process [39-41,50-74].

The Kappa index was 0.653 for the selection of the full-text studies to be read after applying the inclusion criteria to the abstracts, and it was 0.778 for the final inclusion of the studies. Of the studies ultimately selected, 14 were cross-sectional studies [19-32], and one was a case–control study [33]. We found no other published systematic reviews on this topic.

Three studies analyzed the relationship between the knowledge of HCW and their intentions to vaccinate, eight studied the relationship between beliefs and intentions to vaccinate, and 12 studied the relationship between attitudes and intentions to vaccinate. Seven studies analyzed the relationships between two of these variables and intentions to vaccinate.

The critical appraisal of the included studies is shown in Table 1.

HCWs’ knowledge of vaccines and their intentions to vaccinate

Three cross-sectional studies analyzed the relationship between HCWs’ knowledge and the intention to vaccinate. Their results are shown in Table 2. These studies included 106 to 150 participants, with a mean of 123 participants and a total of 368 participants. Two were performed in New Zealand and one in the USA. The three studies used different methods to measure knowledge, but they all found a significant association between knowledge and the intention to vaccinate, such that the greater the knowledge level, the greater the intention to vaccinate.

Two studies used multivariate analysis to control the influence of confounders and also used record-linked vaccination coverage as a measure of the intention to vaccinate. The results of these two studies are not comparable with the third study, because they used different tools to measure knowledge and intentions to vaccinate, as well as to measure the association. Therefore, subgroup analysis does not allow us to compare the magnitude of the association, but it does show the same direction of the association between the variables, independent of the internal validity of the studies.

HCWs’ beliefs about vaccines and their intentions to vaccinate

Seven cross-sectional studies and one case–control study collected information on HCWs’ beliefs and their relationship with intentions to vaccinate. The sample size in the eight studies ranged between 94 and 694, with a mean of 341 and a total of 2731 HCW. Three studies were performed in the USA, two in Germany, two in Canada and one in Australia. The results of the cross-sectional studies are shown in Table 3, and those from the case–control study are shown in Table 5.

Only the case–control study by Salmon et al. measured the intention to vaccinate using vaccination records and also controlled for confounding factors. It was not possible to compare the results of this study with the others included, because each study asked specific but different questions about beliefs. In spite of these differences, the sensitivity analysis shows that the study with the greatest internal validity found the same direction of association as the other studies: the beliefs most aligned with scientific evidence were associated with greater intentions to vaccinate among HCW.

Of the eight studies, four studied only conventional HCW (pediatricians, family and general practitioners), and two studied complementary or alternative medicine providers (chiropractors, naturopathy students). The difference between the beliefs held by these two groups could not be evaluated by comparing these studies because of the differences in the variables discussed above. However, the remaining two studies did compare the two types of HCW. One of them (Jungbauer-Gans et al.) compared family practitioners and pediatricians with and without training in naturopathy. They found that the physicians trained in naturopathy reported that they prescribed fewer vaccines (considering all the vaccines recommended by the competent authority in Germany (STIKO)) than the physicians without this training (63% vs. 78%, respectively), although the difference was not statistically significant. Likewise, the physicians trained in naturopathy had a significantly lower proportion of patients with up-to-date vaccinations (Beta: -0,121).

The case–control study (Salmon et al.) included different types of primary healthcare professionals. The study found that the conventional HCW made up a greater proportion of the control group (HCW whose patients were all fully vaccinated upon school entry), than the group of cases (those who were responsible for children with non-medical vaccination exemptions) (87.9% vs. 74.1%, respectively; p < 0.05). The doctors of osteopathy made up a greater proportion of the cases than the controls (13% vs. 5.4%, respectively; p < 0.05). However, the study was not designed to analyze the differences according to provider training, and it did not control for confounders.

HCWs’ attitudes towards vaccines and their intentions to vaccinate

We found 11 cross-sectional studies and one case–control study that examined the relationship between HCWs’ attitudes and their intentions to vaccinate. The results of the cross-sectional studies are shown in Table 4, and those from the case–control study are shown in Table 5. The sample size of the 12 studies ranged between 94 and 694 HCW, with a mean of 326 and a total of 3908. Eight studies were performed in the USA, two in Germany, one in Canada and one in Australia.

Seven of the 11 cross-sectional studies controlled for confounders, but only one included vaccination records (Taylor et al.). The case–control study (Salmon et al.) had both characteristics. These two studies were included in the sensitivity analysis. Each study included specific but different questions that explored attitudes, and therefore, the results are not comparable. However, two aspects about attitudes were examined by one of the two studies with greater internal validity and one other study. Thus, for the sensitivity analysis, we compare the results of these studies.

Taylor et al. and Davis et al. (2003) investigated the number of injections that HCW were willing to give in the same medical visit. Taylor et al. studied the record linked percentage of children with up-to-date vaccinations, and Davis et al. studied the self-reported habit of administering a recently-recommended injectable vaccine. Both studies found a positive association between the willingness to give a number of injections simultaneously and compliance with the recommended vaccination schedule, although the association did not remain significant after multiple regression analysis in the study by Taylor et al. The sensitivity analysis should take the lack of statistical significance into account, but this approach does not necessarily invalidate the results of Davis et al. In addition to the methodological differences, there were other basic differences, such as the type of vaccine studied and the associations explored.

Salmon et al. and Milledge et al. studied concerns about the known and unknown side effects of vaccination. Milledge et al. found that concerns about the possible unknown side effects of vaccination made HCW less willing to recommend it (OR: 0.31 (95% CI: 0.15-0 .63); p > 0.05). Salmon et al. found that concerns about the accuracy of the reported severe side effects of vaccination were more strongly associated with cases (i.e., physicians who signed non-medical exemptions from vaccination) than controls (OR: 2.03 (95% CI: 1.05-3.91); p <0.05). In both studies, the concern about side effects was associated with lower adherence to vaccination recommendations, and the study with the highest internal validity had statistically significant results. Therefore, the sensitivity analysis does not change the direction of the association.

Summary of associations

Table 6 shows a summary of the associations found in the studies between specific factors explored as knowledge, beliefs and attitudes, and HCWs’ intention to vaccinate. To measure knowledge, the three included studies evaluated the knowledge in vaccination contraindications. Three topics out of the nine on belief evaluations, showed up in more than two studies: “Vaccine low efficacy and benefit and low susceptibility and severity of the disease” (present in 5 studies), “Vaccine are more risky than beneficial” (3 studies), “Use of alternative medicine theories” (3 studies). Only one topic out of the ten exploring attitudes appeared in more than two studies: “Low confidence in Public Healthcare information or national recommendations”, (3 studies).

Characteristics of studies included

Table 7 shows the characteristics of each of the studies included in the review and the Kappa index of inter-observer agreement on the classification of the study characteristics.

Discussion

This review identifies and summarizes the quantitative evidence about the possible relationship between HCWs’ knowledge, beliefs and attitudes about vaccines and their intentions to vaccinate. The results of the included studies clearly show that these relationships do exist, although unfortunately, the data does not allow us to make conclusions about a causal link, mainly because all but one of the studies are cross-sectional. Only one retrospective case–control study could show a causal link between beliefs, attitudes and intentions to vaccinate, but even this study should be considered as cross-sectional because it evaluated HCWs’ beliefs and attitudes at a given point in time, and these variables may change over time.

Given the range of the inclusion criteria, the included studies differed widely in their evaluations of the variables, methodologies, and statistical analysis techniques. Therefore, the results cannot be integrated to quantify the magnitude of the associations and must be evaluated individually. Even so, it appears that all the studies show associations in the direction postulated by the SIEVE experts, although some associations were statistically significant, and others were not.

Knowledge measurement was only based on questions on vaccination contraindications, which may imply that researchers were especially worried about the importance of this factor in regard to the intention to vaccinate. On the other hand, the variety of topics that were explored such as beliefs and attitudes is wide, as is shown in Table 6, though few were repeated in various studies. This may denote interest of the researchers on showing the importance of this type of factors on the intention to vaccinate. In regard to beliefs, the topics that made reference to efficacy and security of the vaccines, severity of the vaccine preventable disease and use of alternative medicine theories, appeared in various studies and seem to be perceived by the researchers as important factors. The associations found with the intention to vaccinate, show this importance. As for attitudes, only “Low confidence in Public Healthcare information or national recommendations” factor was explored in more than two studies (in 3 out of 12 that measured attitudes). This may reflect that there doesn´t exist a clear investigation line intended to prove the importance of a specific factor. It´s also interesting to highlight that the knowledge, beliefs and attitude themes explored in the HCW in the included studies, do not differ from the barriers towards vaccination explored in the general population [6].

The results of this study must be understood in the context of the limitations of the methodology used. Including observational studies in systematic reviews presents specific challenges, as observational studies have inherent biases (mostly selection and information bias) and vary in their study designs. Taking these concerns into account, we have attempted to be as rigorous as possible in the methodology of this review [34].

We tried to reduce identification bias by performing the literature search in four databases in addition to a manual search, selecting studies in seven languages and making personal contact with authors when necessary. We did not search for unpublished articles or for “grey literature”, and there may be unidentified articles in databases we did not search. Consequently, there may be a risk of publication bias. One limitation was that we chose to include only the studies that started collecting data after the publication of the article by Wakefield et al. This article should not imply that changes occurred in the relationship between knowledge and the intention to vaccinate, and therefore, there may have been studies before this date whose results were equally valid for understanding the current situation. On the other hand, the included studies were those published up to June 2009, so at the time of its publishing our study won´t include the latest evidence. In spite of this, having not found other systematic reviews on this topic, the results may be of interest to investigators, policy makers and healthcare professionals. In addition, we only included data from developed countries. In other words, there may have been relevant studies from developing countries that were not included and also that the results cannot be extrapolated to these countries. HCWs’ perceptions of vaccines and of vaccine-preventable diseases may be different in developing countries because they face different disease burdens, and this is the reason why these studies were not included [35,36].

One difficulty we encountered was classifying and distinguishing the information related to knowledge, beliefs and attitudes, despite the definitions we established, as shown by the low Kappa index for inter-observer agreement. It is also likely that this difficulty in delimiting the variables caused the low Kappa index for the abstract selection, and we believe that an intentional training of the researchers in identifying and classifying the variables during the pilot study would have improved the concordance.

The tools used to determine the risk of bias and the quality of the studies included were based on the Newcastle-Ottawa scales, which are widely used for observational studies [37]. The deficiencies in the methodology and reporting of many of the studies are reflected in the low scores on the quality scales, questioning the reliability of the studies reviewed. With regard to the sample selection, almost all of the studies used an acceptable sampling method, but most failed to report the comparability of the respondents and the non-respondents, which may imply there was a self-selection bias. Many included studies used subjective measures (e.g., self-reporting, unverified intentions or behaviors), which can lead to information bias. Care must be taken in interpreting such information, as there is a tendency for respondents to provide what they believe to be socially acceptable answers [38]. Some studies did not control for confounders, such as demographic factors, meaning that the variability in the intentions to vaccinate may be incorrectly associated with knowledge, beliefs or attitudes. The studies also failed to use validated instruments to measure attitudes, knowledge and beliefs. In addition, there are factors related to immunization that fall in these three areas but were not measured in the included studies, so these studies may offer only a partial viewpoint of the relationship between HCWs’ attitudes, knowledge and beliefs and intentions to vaccinate.

This review fills a gap in the literature, and thus, despite the limitations of our methodology, we believe that the benefits of illuminating this relevant topic overcome the limitations. Qualitative studies, which were not considered in this review, could be the objective of a future review. A gold standard research study is a broad-based population study that controls for confounding factors and biases and uses validated tools to measure knowledge, beliefs, attitudes, and intentions to vaccinate or vaccine coverage. The knowledge, beliefs and attitudes that may determine the intention to vaccinate are those stated at the moment when the intent to vaccinate is measured. The fact that these variables change over time may explain the absence of longitudinal studies that are capable of demonstrating causality. Despite this lack of evidence, various studies have evaluated the impact of interventions on the intent to vaccinate or the practice of vaccination [25,39-44], and others have even assessed their cost-effectiveness [45].

Some years ago, it was stated that the success of vaccination programs depends on strong professional commitment, that it is important to have written clinical guidelines to strengthen, instruct and support professionals at the time of vaccination, and that effective use of information technology would be beneficial [46]. On the last two points, great strides have been made; it may be time, as the SIEVE experts state, to test and implement strategies to incentivize health professionals.

Conclusions

The available information shows that among HCW, greater knowledge about vaccines, beliefs that are aligned with scientific evidence and more favorable attitudes toward vaccines are associated with greater intentions to vaccinate. However, it is not possible to conclude that there is a causal relationship between these variables, because the included studies are observational and must be interpreted as cross-sectional. The fact that knowledge, beliefs and attitudes change over time may explain the absence of longitudinal studies capable of demonstrating causality. We conclude that the existing studies show associations between HCWs’ knowledge, beliefs and attitudes and their intentions to vaccinate the populations they serve. The next step is to test and implement interventions and strategies focused on the knowledge, beliefs and attitudes of HCW to attempt to improve vaccine coverage.

Abbreviations

HCW: Healthcare worker; SIEVE: Summit of Independent European Vaccination Experts.

Competing interests

The authors declare that they have no competing interests.

The Spanish Vaccinology Foundation financed the translation of the article.

Authors’ contributions

RH participated in the study design, the article search, the study selection process, the data extraction and analysis, and the drafting of the manuscript. MJA conceived the study and participated in the study design, the study selection process, the data extraction and analysis, and the drafting of the manuscript. CD assisted with the study selection process and the drafting of the manuscript. JLB assisted with the methodological aspects of the systematic review and the statistical interpretation of the included studies and revised the manuscript. JME performed the search in the electronic databases. AG participated in the design and coordination of the review, revised the manuscript and gave his approval for the manuscript to be published. All authors read and approved the final manuscript.

Acknowledgements

We thank Dr. Jesús Esteban of the Department of Preventive Medicine and Public Health at Rey Juan Carlos University in Madrid for his help and advice, Dr. Paco Rodriguez Salvanés of the Investigation Foundation at La Princesa Hospital of the Public Health System in Madrid for all his responses to our questions and Dr. Lydia Pradera for her help finding the right words in English.

References

  1. Centers for Disease Control and Prevention: Ten great public health achievements- United States 1900–1999.

    MMWR Morb Mortal Wkly Rep 1999, 48:1141-1147. OpenURL

  2. Barquet N, Domingo P, Smallpox: The triumph over the most terrible of the ministers of death.

    Ann Intern Med 1997, 127:635-642. PubMed Abstract | Publisher Full Text OpenURL

  3. Muscat M, Bang H, Glismann S: Measles is still a cause for concern in Europe.

    Euro Surveill 2008, 13:pii=18837. OpenURL

  4. Van Treeck U: Measles outbreak in Germany: over 1000 cases now reported in Nordrhein Westfalen.

    Euro Surveill 2006, 11:pii=2955. OpenURL

  5. Mills EJ, Montori VM, Ross CP, Shea B, Wilson K, Guyatt GH: Systematically reviewing qualitative studies complements survey design: an exploratory study of barriers to pediatric immunisation.

    J Clin Epidemiol 2005, 58:1101-1108. PubMed Abstract | Publisher Full Text OpenURL

  6. Mills E, Jadad A, Ross C, Wilson K: Systematic review of qualitative studies exploring parental beliefs and attitudes toward childhood vaccination identifies common barriers to vaccination.

    J Clin Epidemiol 2005, 58:1081-1088. PubMed Abstract | Publisher Full Text OpenURL

  7. Nowalk MP, Zimmerman RK, Tabbarah M, Raymund M, Jewell IK: Determinants of adult vaccination at inner-city health centers: a descriptive study.

    BMC Fam Pract 2006, 7:2. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  8. Schmitt HJ, Booy R, Weil-Olivier C, Van Damme P, Cohen R, Peltola H: Child vaccination policies in Europe: report from the Summits of independent European vaccination experts.

    Lancet Infect Dis 2003, 3:103-108. PubMed Abstract | Publisher Full Text OpenURL

  9. Bedford H, Elliman D: Concerns about immunization.

    BMJ 2000, 320:240-243. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Llupià A, García-Basteiro AL, Mena G, Ríos J, Puig J, Bayas JM, Trilla A: Vaccination behaviour influences self-report of influenza vaccination status: a cross-sectional study among health care workers.

    PLoS One 2012, 7:e39496. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Prematunge C, Corace K, McCarthy A, Nair RC, Pugsley R, Garber G: Factors influencing pandemic influenza vaccination of healthcare workers-A systematic review.

    Vaccine 2012, 30:4733-4743. PubMed Abstract | Publisher Full Text OpenURL

  12. European Vaccine Manufacturers:

    Survey regarding the Perception of Vaccines and Vaccinations. International Summary Report 2004.

    http://www.webcitation.org/query.php?url=http://www.evm-vaccines.org/pdfs/survey_perceptions.pdf&refdoi=10.1186/1741-7015-5-11 webcite

    OpenURL

  13. Navarro JA, Bernal PJ, Niguez JC: Analysis of factors influencing vaccine uptake:perspective from Spain.

    Vaccine 2001, 20(Suppl 1):13-15. OpenURL

  14. Bovier PA, Chamot E, Bouvier M, Loutan L: Importance of patients' perceptions and general practitioners' recommendations in understanding missed opportunities for immunisations in Swiss adults.

    Vaccine 2001, 19:4760-4767. PubMed Abstract | Publisher Full Text OpenURL

  15. Centers for Disease Control and Prevention: Adult immunization: knowledge, attitudes and practices, DeKalb and Fulton Counties, Georgia, 1988.

    MMWR Morb Mortal Wkly Rep 1988, 37:657-661. PubMed Abstract OpenURL

  16. Gellin BG, Maibach EW, Marcuse EK: Do parents understand immunizations? A national telephone survey.

    Pediatrics 2000, 106:1097-1102. PubMed Abstract | Publisher Full Text OpenURL

  17. Stefanoff P, Mamelund SE, Robinson M, Netterlid E, Tuells J, Bergsaker MA, Heijbel H, Yarwood J, VACSATC working group on standardization of attitudinal studies in Europe: Tracking parental attitudes on vaccination across European countries: The Vaccine Safety, Attitudes, Training and Communication Project (VACSATC).

    Vaccine 2010, 28:5731-5737. PubMed Abstract | Publisher Full Text OpenURL

  18. Schmitt HJ, Booy R, Aston R, Van Damme P, Schumacher RF, Campins M, Rodrigo C, Heikkinen T, Weil-Oliver C, Finn A, Olcen P, Fedson D, Peltola H: How to optimise the coverage rates of infant and adult immunisation in Europe.

    BMC Med 2007, 5:11. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  19. Gonik B, Jones T, Contreras D, Fasano N, Roberts C: The obstetrician-gynecologist’s role in vaccine-preventable diseases and immunization.

    Obstet Gynecol 2000, 96:81-84. PubMed Abstract | Publisher Full Text OpenURL

  20. Schupfner R, Reimer B, Markuzzi A, Von Sonnenburg F: How do pediatricians in Munich perform vaccination?: a healthcare service research study.

    Soz Praventivmed 2002, 47:100-106. PubMed Abstract | Publisher Full Text OpenURL

  21. Taylor JA, Darden PM, Brooks DA, Hendricks JW, Baker AE, Wasserman RC: Practitioner policies and beliefs and practice immunization rates: a study from Pediatric Research in Office Settings and the National Medical Association.

    Pediatrics 2002, 109:294-300. PubMed Abstract | Publisher Full Text OpenURL

  22. Zimmerman RK, Mieczkowski TA, Mainzer HM, Medsger AR, Nowalk MP: Understanding physician agreement with varicella immunization guidelines.

    Prev Med 2002, 35:135-142. PubMed Abstract | Publisher Full Text OpenURL

  23. Davis MM, Ndiaye SM, Freed GL, Clark SJ: One-year uptake of pneumococcal conjugate vaccine: a national survey of family physicians and pediatricians.

    J American Board of Fam Pract 2003, 16:363-371. Publisher Full Text OpenURL

  24. Milledge JT, Cooper CD, Woolfenden S: Barriers to immunization: attitudes of general practitioners to varicella, the disease and its vaccine.

    J Paediatr Child Health 2003, 39:368-371. PubMed Abstract | Publisher Full Text OpenURL

  25. Jungbauer-Gans M, Kriwy P: Influence exercised by physicians on the vaccination rate.

    Gesundheitswesen 2003, 65:464-470. PubMed Abstract | Publisher Full Text OpenURL

  26. Wilson K, Mills E, Boon H, Tomlinson G, Ritvo P: A survey of attitudes towards paediatric vaccinations amongst Canadian naturopathic students.

    Vaccine 2004, 22:329-334. PubMed Abstract | Publisher Full Text OpenURL

  27. Russell ML, Injeyan HS, Verhoef MJ, Eliasziw M: Beliefs and behaviours: understanding chiropractors and immunization.

    Vaccine 2004, 23:372-379. PubMed Abstract | Publisher Full Text OpenURL

  28. Petousis-Harris H, Goodyear-Smith F, Turner N, Soe B: Family practice nurse views on barriers to immunising children.

    Vaccine 2005, 23:2725-2730. PubMed Abstract | Publisher Full Text OpenURL

  29. Clark SJ, Adolphe S, Davis MM, Cowan AE, Kretsinger K: Attitudes of US obstetricians toward a combined tetanus-diphtheria-acellular pertussis vaccine for adults.

    Infect Dis Obstet Gynecol 2006, 2006:87040. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  30. Davis MM, Kretsinger K, Cowan AE, Stokley S, Clark SJ: New combined tetanus-diphtheria-acellular pertussis vaccines for adults: primary care physician attitudes and preferences.

    Hum Vaccin 2007, 3:130-134. PubMed Abstract | Publisher Full Text OpenURL

  31. Gust D, Weber D, Weintraub E, Kennedy A, Soud F, Burns A: Physicians who do and do not recommend children get all vaccinations.

    J Health Commun 2008, 13:573-582. PubMed Abstract | Publisher Full Text OpenURL

  32. Goodyear-Smith F, Grant C, Petoussis-Harris H, Turner N: Immunization champions: characteristics of general practitioners associated with better immunization delivery.

    Hum Vaccin 2009, 5:403-411. PubMed Abstract | Publisher Full Text OpenURL

  33. Salmon DA, Pan WK, Omer SB, Navar AM, Orenstein W, Marcuse EK, Taylor J, deHart MP, Stokley S, Carter T, Halsey NA: Vaccine knowledge and practices of primary care providers of exempt vs. vaccinated children.

    Hum Vaccin 2008, 4:286-291. PubMed Abstract | Publisher Full Text OpenURL

  34. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson D, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology.

    JAMA 2000, 283:2008-2012. PubMed Abstract | Publisher Full Text OpenURL

  35. Gentile A, Bhutta Z, Bravo L, Samy AG, Garcia RD, Hoosen A, Islam T, Karimi A, Salem M, Simasathien S, Sohail A, Watanaveeradej V, Wiedenmayer K, Schmitt HJ: Pediatric disease burden and vaccination recommendations: understanding local differences.

    Int J Infect Dis 2010, 14:649-658. Publisher Full Text OpenURL

  36. Schaetti C, Ali SM, Chaignat CL, Khatib AM, Hutubessy R, Weiss MG: Improving community coverage of oral cholera mass vaccination campaigns: lessons learned in zanzibar.

    PLoS One 2012, 7:e41527. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Stang A: Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses.

    Eur J Epidemiol 2010, 25:603-605. PubMed Abstract | Publisher Full Text OpenURL

  38. Yu IT, Tse SL: Workshop 6-sources of bias in cross-sectional studies; summary on sources of bias for different study designs.

    Hong Kong Med J 2012, 18:226-227. PubMed Abstract | Publisher Full Text OpenURL

  39. Shaw JS, Samuels RC, Larusso EM, Bernstein HH: Impact of an encounter-based prompting system on resident vaccine administration performance and immunization knowledge.

    Pediatrics 2000, 105:978-983. PubMed Abstract | Publisher Full Text OpenURL

  40. Boom JA, Nelson CS, Laufman LE, Kohrt AE, Kozinetz CA: Improvement in provider immunization knowledge and behaviors following a peer education intervention.

    Clin Pediatr (Phila) 2007, 46:706-717. Publisher Full Text OpenURL

  41. Sabnis SS, Pomeranz AJ, Amateau MM: The effect of education, feedback, and provider prompts on the rate of missed vaccine opportunities in a community health center.

    Clin Pediatr (Phila) 2003, 42:147-151. Publisher Full Text OpenURL

  42. Vorsters A, Tack S, Hendrickx G, Vladimirova N, Bonanni P, Pistol A, Metlicar T, Pasquin MJ, Mayer MA, Aronsson B, Heijbel H, Van Damme P: A summer school on vaccinology: responding to identified gaps in pre-service immunisation training of future health care workers.

    Vaccine 2010, 28:2053-2059. PubMed Abstract | Publisher Full Text OpenURL

  43. Levi BH: Addressing parents’ concerns about childhood immunizations: a tutorial for primary care providers.

    Pediatrics 2007, 120:18-26. PubMed Abstract | Publisher Full Text OpenURL

  44. Zimmerman RK, Barker WH, Strikas RA, Ahwesh ER, Mieczkowski TA, Janosky JE, Kanter SL: Developing curricula to promote preventive medicine skills: the teaching immunization for medical education (TIME) project.

    JAMA 1997, 278:705-711. PubMed Abstract | Publisher Full Text OpenURL

  45. Franzini L, Boom J, Nelson C: Cost-effectiveness analysis of a practice based immunization education intervention.

    Ambul Pediatr 2007, 7:167-175. PubMed Abstract | Publisher Full Text OpenURL

  46. Nicoll A, Elliman D, Begg NT: Immunisation: causes of failure and strategies and tactics for success.

    BMJ 1989, 299:808-812. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Rivera JA: Lo que Sócrates le diría a Woody Allen. Madrid: Espasa Calpe; 2008. OpenURL

  48. Wakefield AJ, Murch SH, Anthony A, Linnell J, Casson DM, Malik M, Berelowitz M, Dhillon AP, Thomson MA, Harvey P, Valentine A, Davies SE, Walker-Smith JA: Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children.

    Lancet 1998, 351:637-641. PubMed Abstract | Publisher Full Text OpenURL

  49. World economic and social survey 2006: Diverging Growth and Development. New York: United Nations Publications; 2006. OpenURL

  50. Injeyan HS, Russell ML, Verhoef MJ, Mutasingwa D: Canadian chiropractors' perception of educational preparation to counsel patients on immunization.

    J Manipulative Physiol Ther 2006, 29:643-650. PubMed Abstract | Publisher Full Text OpenURL

  51. Davis MM, Broder KR, Cowan AE, Mijalski C, Katrina K, Stokley S, Clark SJ: Physician attitudes and preferences about combined Tdap vaccines for adolescents.

    Am J Prev Med 2006, 31:176-180. PubMed Abstract | Publisher Full Text OpenURL

  52. Wilson K, Mills EJ, Norman G, Tomlinson G: Changing attitudes towards polio vaccination: a randomized trial of an evidence-based presentation versus a presentation from a polio survivor.

    Vaccine 2005, 23:3010-3015. PubMed Abstract | Publisher Full Text OpenURL

  53. Salmon DA, Moulton LH, Omer SB, Chace LM, Klassen A, Talebian P, Halsey NA: Knowledge, attitudes, and beliefs of school nurses and personnel and associations with nonmedical immunization exemptions.

    Pediatrics 2004, 113:552-559. Publisher Full Text OpenURL

  54. Prislin R, Sawyer MH, Nader PR, Goerlitz M, De Guire M, Ho S: Provider-staff discrepancies in reported immunization knowledge and practices.

    Prev Med 2002, 34:554-561. PubMed Abstract | Publisher Full Text OpenURL

  55. Prislin R, Sawyer MH, De Guire M, Brennan J, Holcomb K, Nader PR: Missed opportunities to immunize: psychosocial and practice correlates.

    Am J Prev Med 2002, 22:165-169. PubMed Abstract | Publisher Full Text OpenURL

  56. Petrovic M, Roberts R, Ramsay M: Second dose of measles, mumps, and rubella vaccine: questionnaire survey of health professionals.

    BMJ 2001, 322:1120. PubMed Abstract | Publisher Full Text OpenURL

  57. Zimmerman RK, Schlesselman JJ, Mieczkowski TA, Medsger AR, Raymund M: Physician concerns about vaccine adverse effects and potential litigation.

    Arch Pediatr Adolesc Med 1998, 152:7-10. PubMed Abstract | Publisher Full Text OpenURL

  58. Mawn B, Pakkala K: Immunization update: a community-based nursing education program.

    J Contin Educ Nurs 2000, 31:101-110. PubMed Abstract OpenURL

  59. Petousis-Harris H, Goodyear-Smith F, Turner N, Soe B: Family physician perspectives on barriers to childhood immunisation.

    Vaccine 2004, 22:2340-2344. PubMed Abstract | Publisher Full Text OpenURL

  60. Dionne M, Boulianne N, Duval B, Lavoie F, Laflamme N, Carsley J: Lack of conviction about vaccination in certain Quebec vaccinators.

    Can J Public Health 2001, 92:100-104. PubMed Abstract OpenURL

  61. Henderson R, Oates K, Macdonald H, Smith WC: General practitioners’ concerns about childhood immunisation and suggestions for improving professional support and vaccine uptake.

    Commun Dis Public Health 2004, 7:260-266. PubMed Abstract OpenURL

  62. Smith SW, Connery P, Knudsen K, Scott KL, Frintner MP, Outlaw G, Weingart S: Immunization practices and beliefs of physicians in suburban Cook County.

    Illinois. J Community Health 1999, 24:1-11. Publisher Full Text OpenURL

  63. Slora EJ, Steffes JM, Harris D, Clegg HW, Norton D, Darden PM, Sullivan SA, Wasserman RC: Improving pediatric practice immunization rates through distance-based quality improvement: a feasibility trial from PROS.

    Clin Pediatr (Phila) 2008, 47:25-36. OpenURL

  64. Cotter S, Ryan F, Hegarty H, McCabe TJ, Keane E: Immunisation: the views of parents and health professionals in Ireland.

    Euro Surveill 2003, 8:145-150. PubMed Abstract OpenURL

  65. Smith A, McCann R, McKinlay I: Second dose of MMR vaccine: health professionals’ level of confidence in the vaccine and attitudes towards the second dose.

    Commun Dis Public Health 2001, 4:273-277. PubMed Abstract OpenURL

  66. Lasserre A, Riviere M, Blanchon T, Alvarez F, Gaillat J, Romain O: Connaissance et application des recommandations vaccinales concernant la coqueluche par la médecine du travail des établissements de santé de Paris.

    Med Mal Infect 2009, 39:325-329. PubMed Abstract | Publisher Full Text OpenURL

  67. Mahony A, Percival P, Condon R: Vaccine know-how. Kimberley immunisation study: community nurses immunisation education, knowledge and practice.

    Collegian 1999, 6:16-22. PubMed Abstract OpenURL

  68. Lehrke P, Nuebling M, Hofmann F, Stoessel U: Attitudes of homoeopathic physicians towards vaccination.

    Vaccine 2001, 19:4859-4864. PubMed Abstract | Publisher Full Text OpenURL

  69. Ehresmann KR, Mills WA, Loewenson PR, Moore KA: Attitudes and practices regarding varicella vaccination among physicians in Minnesota: implications for public health and provider education.

    Am J Public Health 2000, 90:1917-1920. PubMed Abstract | PubMed Central Full Text OpenURL

  70. Koepke CP, Vogel CA, Kohrt AE: Provider characteristics and behaviors as predictors of immunization coverage.

    Am J Prev Med 2001, 21:250-255. PubMed Abstract | Publisher Full Text OpenURL

  71. Newman RD, Taylor JA: Reactions of pediatricians to the recommendation for universal varicella vaccination.

    Arch Pediatr Adolesc Med 1998, 152:792-796. PubMed Abstract | Publisher Full Text OpenURL

  72. Sharkness CM, Goun BD, Davis LA, Sykes LE: Do we practice what we teach about childhood immunization in New Jersey?

    Fam Med 1998, 30:727-732. PubMed Abstract OpenURL

  73. Schaffer SJ, Bruno S: Varicella immunization practices and the factors that influence them.

    Arch Pediatr Adolesc Med 1999, 153:357. PubMed Abstract | Publisher Full Text OpenURL

  74. Zucs AP, Crispin A, Eckl E, Weitkunat R, Schlipköter U: Risk factors for undervaccination against measles in a large sample of preschool children from rural Bavaria.

    Infection 2004, 32:127-133. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2458/13/154/prepub