Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Study protocol

Perceptions and attitudes of clinicians in Spain toward clinical practice guidelines and grading systems: a protocol for a qualitative study and a national survey

Anna Kotzeva16, Ivan Solà2, José Miguel Carrasco3, Petra Díaz del Campo4, Francisco Javier Gracia4, Enrique Calderón56, Idoia de Gaminde7, Maria Dolors Estrada16, Flora Martínez8, Carola Orrego9, Rafael Rotaeche10, Flavia Salcedo3, Paola Velázquez11 and Pablo Alonso-Coello26*

Author Affiliations

1 Catalan Agency for Health Technology Assessment and Research (CAHTA), Roc Boronat 81-95, Barcelona, Spain

2 Iberoamerican Cochrane Centre, Clinical Epidemiology and Public Health Department, Institute of Biomedical Research (IIB Sant Pau). Barcelona, Spain

3 Instituto Aragonés de Ciencias de la Salud, Zaragoza, Spain

4 Agencia Laín Entralgo. Consejería de Sanidad y Consumo de la Comunidad de Madrid, Spain

5 Instituto de Biomedicina de Sevilla. Virgen del Rocío University Hospital, Sevilla, Spain

6 CIBER de Epidemiología y Salud Pública (CIBERESP), Spain

7 Servicio de Docencia y Desarrollo Sanitarios. Departamento de Salud Gobierno de Navarra, Spain

8 Unidad Docente de Medicina Familiar y Comunitaria de Sevilla. Sevilla, Spain

9 Avedis Donabedian Institute, Universidad Autónoma de Barcelona, Barcelona, Spain

10 Centro de Salud de Alza, Donostia-San Sebastián, Spain

11 Consultas Médicas y Psicológicas, Barcelona, Spain

For all author emails, please log on.

BMC Health Services Research 2010, 10:328  doi:10.1186/1472-6963-10-328

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/10/328


Received:11 June 2010
Accepted:3 December 2010
Published:3 December 2010

© 2010 Kotzeva et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Clinical practice guidelines (CPGs) have become a very popular tool for decision making in healthcare. While there is some evidence that CPGs improve outcomes, there are numerous factors that influence their acceptability and use by healthcare providers. While evidence of clinicians' knowledge, perceptions and attitudes toward CPGs is extensive, results are still disperse and not conclusive. Our study will evaluate these issues in a large and representative sample of clinicians in Spain.

Methods/Design

A mixed-method design combining qualitative and quantitative research techniques will evaluate general practitioners (GPs) and hospital-based specialists in Spain with the objective of exploring attitudes and perceptions about CPGs and evidence grading systems. The project will consist of two phases: during the first phase, group discussions will be carried out to gain insight into perceptions and attitudes of the participants, and during the second phase, this information will be completed by means of a survey, reaching a greater number of clinicians. We will explore these issues in GPs and hospital-based practitioners, with or without previous experience in guideline development.

Discussion

Our study will identify and gain insight into the perceived problems and barriers of Spanish practitioners in relation to guideline knowledge and use. The study will also explore beliefs and attitudes of clinicians towards CPGs and evidence grading systems used to rate the quality of the evidence and the strength of recommendations. Our results will provide guidance to healthcare researchers and healthcare decision makers to improve the use of guidelines in Spain and elsewhere.

Background

Clinical practice guidelines (CPGs) are designed to support decision-making processes in patient care and are classically defined as "systematically developed statements to assist practitioners' and patients' decisions about appropriate healthcare for specific circumstances" [1]. While there is some evidence that CPGs improve outcomes when they are appropriately implemented, [2,3] there are numerous factors which influence their acceptability and use by healthcare providers [4].

Some of the major barriers to guideline adherence can be related to practitioner, patient, organisational or guideline factors, [5-7] although practitioners appear to be a key factor. Aspects such as knowledge, perceptions of and attitudes toward CPGs in general, are professional-related. Other factors that affect the success of guideline implementation are content or format related, like clarity and presentation of the recommendations or the existence of a quick reference guide or algorithm [8]. The grading system used to classify the quality of the evidence and the strength of recommendations is an important characteristic of guideline format. However, the growing number of different grading systems employed across different institutions [9] could possibly be a source of confusion, impeding the correct comprehension of recommendations and their application in clinical practice.

The evidence on clinicians' knowledge, perceptions and attitudes toward CPGs is growing. The majority of published studies on this topic used quantitative design (surveys or record audits), investigating the association between barriers or facilitators and CPG use. Alternative approaches used by some investigators were qualitative designs, where concepts are collected in focus groups, interviews or through open-ended questions in questionnaires. Finally, some studies considered a mixed-method design including both qualitative and quantitative techniques.

Survey results were systematically reviewed in two publications, [4,10] concluding that most clinicians were supportive of CPGs, finding them to be useful, educational and likely to improve quality of care. Less frequent findings were that CPGs were impractical, unable to be used for individual patients, limited clinician autonomy, increased the likelihood of litigation or disciplinary action, and were used to cut costs [10].

A recent systematic review and meta-synthesis of qualitative studies of general practitioners' (GPs') attitudes to and experience with the use of CPGs [11] offers a conceptual framework for their interpretation. Six broad themes were identified in the analysis: questioning the guidelines; GPs' experience; preserving the doctor-patient relationship; professional responsibility; practical issues and guideline format. No systematic pattern in the distribution of these themes was found. However, comparative analysis and synthesis suggested that GPs' reasons for not following the CPGs differed according to whether the guidelines encouraged (prescriptive type) or discouraged (proscriptive type) particular interventions or behaviours [11].

Some authors suggest that clinicians find guideline contents too complex and confusing, and perceive difficulties in understanding the CPG development process. More specifically, there is very little research on clinicians' perceptions and understanding of the grading systems used to rate the evidence, quality, and strength of recommendations [12,13]. In our context, a qualitative study about the GRADE system showed important difficulties in understanding it and an important level of disagreement among the participating clinicians, with and without previous experience in CPG development [14]. However, the participants had hardly any experience with the use of this grading system, which requires substantial methodological expertise and practice.

Given this context there is a need for systematically reviewing the evidence on this topic and an assessment of the situation in our context. Additionally, the scarce information about the perceptions and understanding of the grading systems by healthcare professionals in the international literature provide the impetus for an investigation, both qualitative and quantitative, about this important aspect of clinical practice guidelines.

Methods and design

Goal and objectives

The main goal of this study is to explore the perceptions and attitudes of Spanish practitioners (GPs and hospital-based specialists, both with or without previous experience in guideline development) towards clinical practice guidelines and grading systems.

The specific objectives are to:

- Categorize, synthesize, and compare the perceptions of these different groups of healthcare professionals toward CPGs;

- Identify and describe the adoption/non-adoption factors specific to each group;

- Investigate whether different grading systems are better understood, and the influence of the wording of recommendations on understanding, acceptability and use of CPGs;

- Investigate whether different formats of CPGs influence acceptability and use of CPGs;

- Explore and compare the level of knowledge and understanding of different grading systems in these groups.

The design of this two-phase project will include qualitative and quantitative research techniques. During Phase I, with a qualitative design, group discussions will be carried out with the participation of GPs and hospital-based specialists, to explore in depth their perceptions and attitudes towards CPG and grading systems. In a posterior quantitative stage, Phase II, we will complement this information by means of a survey. The study has been approved by the Ethics Board of the Hospital de la Santa Creu i Sant Pau, Barcelona, Spain.

Phase I: Qualitative study

Qualitative research methods provide in-depth knowledge concerning perceptions, beliefs and values of the persons and groups involved and have proved to be extremely useful in the healthcare field [15,16]. These methods provide researchers with the opportunity to explore potential hypotheses on why participants hold the views they do. We thus considered this approach, and more specifically group discussions, as the most appropriate technique to gather information for our study objectives. The added value of group discussions [17,18] is that they permit us to explore dynamic interactions among group members in the light of certain cultural characteristics, concrete values, and references that may underlie individual preferences and shape the general position of the participants. The information gathered from group discussions will be analyzed following the sociological analysis disclosure model [19,20]. In this technique the reading and organization of data does not rely on the fragmentation of texts but on the interpretation of the different discursive positions of the participants and the main explanatory axes of their interventions [21].

1. Group discussions structuring and participants

The basic topics to explore during the group discussions will be pre-selected by a group of experts (medical doctors, psychologists and sociologists with wide experience in CPGs development and implementation). These topics will be based on some of the most relevant and controversial issues around the development and implementation of CPGs in clinical practice, such as confidence, utility, knowledge and understanding of CPGs. Emphasis will be given to the importance of grading systems. Once these areas have been agreed upon, a semi-structured manual will be developed to ensure similarity in the moderation of the sessions.

A total of six groups are expected to be run: three groups of GPs (one group with, and two groups without previous experience in CPG development) and three groups of other hospital-based specialists (same distribution as GPs regarding previous experience). By "previous experience" in CPG development we will consider having participated in a guideline development group. Each group will consist of 8-9 clinicians, as generally recommended, [22] but not less than six. In these cases the sessions will be canceled and rescheduled. Participants will be selected taking into account their structural inter-group representation: medical specialty and years of experience, place of work, age and sex [18]. We will gather a purposefully selected sample, choosing participants according to their representativeness and capacity to provide rich and varied information in relation to the study objectives. On the other hand, the sample size will be considered sufficient when the information obtained has reached saturation, i.e., when information is repeated, redundant and provides no new aspects.

The group discussions will be carried out in four Spanish regions: Andalusia, Aragon, Catalonia and Madrid. We will recruit potential participants by means of a formal letter of invitation, or e-mail, and their travel costs will be reimbursed. Each group discussion will last approximately 60-90 minutes and will be recorded, with the consent of the participants.

2. Moderation of group discussions

All investigators involved in group discussions will receive training in qualitative research methods, and on focus groups technique in particular. In order to achieve optimal standardization of the sessions, the previously developed semi-structured manual will be used. Still, its content might be a subject of constant adjustments depending on the findings that arise during the development of the group discussions [23].

An interviewer and a collaborator will be involved in moderating each group discussion. The role of the interviewer will be to lead the discussion by introducing the subjects of interest and managing the group dynamics so as to maintain focus and cover the programmed issues. We will take great care to avoid sharing opinions on the topic. The role of the collaborator will be to observe group dynamics and annotate any elements of the discussion, such as non-verbal language, responses to the interviewer's interventions, etc.

The interviewer will introduce the study objective indirectly, with the objective of analyzing the group's approach to the subject, and explain the need to record the session. Assurance of confidentiality will be provided to all group members, as well as of the independent nature of the study, explaining clearly to the potential participants that knowledge and quality of clinical practice will not be evaluated. Some basic demographic information will be collected before the beginning of each discussion group. Group sessions will be designed to be flexible and open to possible new topics and issues raised by participants. The two investigators will meet together after finishing the group meetings. This information will be analyzed in conjunction with the data obtained in the group discussions [23].

3. Data organization, validation and analysis

All information generated will be audio-taped and stored digitally, thus representing the 'information corpus'. Audio-tapes will be transcribed literally and completed by the information collected by the interviewers and observers. To guarantee accuracy, transcriptions will be verified by the moderators of each group. For final data validation, the participants will be invited to read and comment on transcription contents [24].

Themes and patterns will then be identified and coded by two independent investigators, keeping in mind the texts as a whole and the contexts in which they have been produced. Each step in the configuration of the potential explicative axes requires new purposeful and iterative reading of texts to legitimate and corroborate the interpretation of findings [25]. Thus, to assure credibility, the data of the first group interviews will be re-assessed in the light of new findings. In the final stage of results interpretation the main explanatory axes will be organized and contrasted with the empirical reference of texts, in order to select the most representative verbatim statements. The investigators will develop a list of the identified concepts. The process and provisional analysis will be triangulated among investigators and, in case of divergence; consensus will be obtained through discussion.

Phase II: Survey

1. Questionnaire design

We will elaborate a single questionnaire divided into three general sections. The first part will collect information on the demographic characteristics and professional profile of participants (such as sex, age, qualifications and work experience). The second and third parts of the questionnaire will evaluate practitioners' knowledge, perceptions of and attitudes toward CPGs and grading systems. The information obtained in the group discussions (phase I) will be used as a starting point in the development of the questionnaire, providing insight into the social and symbolic representation of CPGs in our local circumstances. Previous to its application, the questionnaire will be piloted with a group of practitioners in order to modify or eliminate confusing and contradictory questions.

2. Study sample

We have estimated a sample size of 600 respondents needed to answer one of the specific objectives of the survey (adequate comprehension of grading systems) in the GPs group, with a precision of 4%. To obtain this precision we dichotomized one item of the survey (adequate comprehension: yes/no) assuming maximum variability (50% of affirmative responses). A confidence interval of 95% will be applied to the percentage of affirmative responses.

3. Recruitment of participants

Approximately 1200 clinicians working in Primary Care or Hospital Departments of the four regions participating in the study will be contacted. The questionnaire will be sent via e-mail to all potential participants in the two subgroups of interest (GPs and specialists) with a letter inviting them to collaborate and a link to an electronic version of the questionnaire. Three reminders will be sent to those who have not responded within two weeks. An investigator's contact details will be provided for participants to raise questions or doubts about the questionnaire or the project.

To potentiate practitioners' participation in the survey and to guarantee a high response rate, we will apply the following strategies which have proved to be successful: [26] the questionnaire will be concise and easy to complete (approximate duration 10-15 minutes); we will assure confidentiality of all personal data and will offer the participants the possibility to receive the final results of the survey.

4. Analysis

For qualitative outcomes, between-group comparison will be described by means of contingency tables and inferences with the Chi Square Test or Fisher's Exact Test. Quantitative outcomes will be described using means and their corresponding standard deviations. Inferences will be made using an analysis of variance (ANOVA). If we encounter clearly defined application problems (abnormality and heteroscedasticity) the corresponding non-parametric test will be used. All analyses will be conducted using a bilateral approach. We will use the usual 5% significance level (α = 0.05) and the SPSS statistical package, version 11.5, to run the proposed analyses.

Discussion

Clinicians' knowledge, perceptions and attitudes toward CPGs are important aspects towards the necessary implementation of these tools and subsequent change in clinical practice. To date, these aspects have been systematically reviewed in three main papers [4,10,11]. A number of later studies surveyed clinicians' knowledge about and attitudes towards CPG in general in different clinical settings: among general practitioners (GPs), [27-30] specialists, [28,31-34] and healthcare providers in Intensive Care Units [35-37]. Generally, most findings reported in these studies confirm that higher familiarity with the guidelines is related to more positive attitudes towards them and to more frequent reported use of CPGs.

Guidelines concerning both diagnosis and treatment of common diseases, developed on a national level and adapted locally, presented in summarized format and transmitted directly by the practitioners of the department, have the best chance of being used, as Riou et al. observed in a described setting [32]. On the other hand, the predictive role of characteristics, such as age, personality traits and professional qualifications, in professionals' attitudes towards CPGs is still controversial [31,36-38]. Additionally, several studies have focused on the factors which influence the use and acceptance of a specific guideline in a local context, [39-44] making the generalization of their results difficult.

Carlsen et al. [45] carried out focus groups amongst Norwegian GPs and add two important findings. First, the participants were concerned that guideline recommendations may be more heavily influenced by economic considerations than by clinical aspects. Second, in contrast to earlier findings, changes in recommendations due to evidence-based updates were mostly viewed positively. This latter point should be viewed in light of the Norwegian context, which has a relatively small number of published guidelines. In addition to these findings Boivin et al., using semi-structured focus group interviews, observed that in circumstances where clinicians judge patient participation in decision-making to be important, they perceive tension between the need to respect patients' preferences and the pressure to apply guidelines [46]. The authors conclude that CPGs should include information that supports shared decision-making in addition to their current focus on influencing prescription patterns, costs and health outcomes.

In Spain, to the best of our knowledge, this study will be the first to explore the perceptions, beliefs and attitudes of clinicians (GPs and other specialists, with or without previous experience in guideline development) towards CPGs. In relation to grading systems used to rate the evidence, quality and strength of recommendations, it will be one of the first to explore this issue qualitatively in more detail. Limitations and difficulties which we expect to face during the study originate from the natural complexity of qualitative designs and more specifically, group discussions. The researcher, or moderator, in these types of studies has less control over the data produced [47] than in either quantitative studies or in-depth interviews. The moderator has to allow participants to talk to each other, ask questions and express doubts and opinions, while having very little control over the interaction other than generally keeping participants focused on the topic. By its nature, the group discussion method is open-ended and cannot be entirely predetermined. Additionally, it should not be assumed that the individuals in a group discussion are expressing their own definitive individual view. They are speaking in a specific context, within a specific culture, and thus sometimes it may be difficult for the researcher to clearly identify an individual message. It is to be anticipated that dominant group members influence the statements and opinions of others, as they do in "real" group meetings and other social settings [45]. Nevertheless, there are also important advantages to carrying out group discussions. They allow for gathering a lot of relevant information in a short period of time, offering insight on the existing contradictions and differences in the individual opinions of the participants. This social interaction is produced in a real context and helps getting a broader conceptual perspective of the issues discussed. Another potential disadvantage of corpus analysis is that the findings are not necessarily valid in other settings and cannot be extended to wider populations. However, we will undertake our study in a wide and diverse population of clinicians, assuring wide applicability of our results in Spain and probably elsewhere.

The limitations would be potentially neutralized by completing initial results from group discussions with survey findings. On the other hand, the most apparent limitation of the survey could be a possible low response rate. However, in survey research, no single response rate is considered a standard [48,49]. For some surveys, a response rate of 80 percent is desired; in others, 60 percent is deemed adequate. Mail surveys typically have lower response rates than other types of surveys, and because non-response may introduce error, researchers should take steps designed to promote responses. Some of these steps include personally contacting potential respondents and asking them to participate, sending a reminder to non-respondents, assuring respondents of confidentiality, and making the survey short and easy to complete. In our study, all these measures will be adopted. Finally, caution will be taken when interpreting information about the connection between attitudes and actions. Research indicates that positive attitudes to guidelines do not necessarily mean that doctors follow their recommendations [10,50].

Based on the results from both phases of our study, we expect to deepen our understanding about the perceived difficulties and barriers to the comprehension and application of CPGs and to answer whether different grading systems, recommendation phrasing and guideline format presentation influence these processes. We expect to identify and describe the CPGs' adoption factors specific to each professional group participating and thus inform health professionals and decision makers about the needs and challenges in this field.

Abbreviations

CPGs: Clinical practice guidelines; GPs: general practitioners; GRADE: Grading of Recommendations Assessment, Development and Evaluation; ANOVA: analysis of variance; SPSS: Statistical Package for the Social Sciences.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

PAC and IS conceptualized the study. AK and PAC drafted a first version of the protocol. All authors participated in revising it critically for important intellectual content and have given final approval of the version to be published.

Acknowledgements

Funding

This project has been funded by the Instituto de Salud Carlos III, co-financed by the European Regional Development Fund (PI08 90647). The publication of this document has been funded within the framework of collaboration designed for the Quality Plan of the Spanish National Health System, under the agreement signed by the Carlos III Health Institute and the Aragon Health Science Institute as GuiaSalud secretariat. Pablo Alonso-Coello is funded by a Miguel Servet contract by the Instituto de Salud Carlos III (CP09/00137).

References

  1. Field MJ, Lohr KN, (Eds): Clinical Practice Guidelines: Directions for a New Program. Institute of Medicine, Washington, DC: National Academy Press; 1990.

  2. Bahtsevani C, Udén G, Willman A: Outcomes of evidence-based clinical practice guidelines: a systematic review.

    Int J Technol Assess Healthcare 2004, 20(4):427-33.

    Fall

    OpenURL

  3. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies.

    Health Technol Assess 2004, 8(6):iii-iv.

    1-72

    PubMed Abstract | Publisher Full Text OpenURL

  4. Saillour-Glenisson F, Michel P: [Individual and collective facilitators of and barriers to the use of clinical practice guidelines by physicians: a literature review].

    Rev Epidemiol Sante Publique 2003, 51(1 Pt 1):65-80. PubMed Abstract | Publisher Full Text OpenURL

  5. Stewart RE, Vroegop S, Kamps GB, Werf GTvd, Jong BM-d: Factors influencing adherence to guidelines in general practice.

    Int J Technol Assess Healthcare 2003, 19:546-554. OpenURL

  6. Grol R, Dalhuijsen J, Thomas S, Veld Cit, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study.

    BMJ 1998, 317:858-861. PubMed Abstract | PubMed Central Full Text OpenURL

  7. Siriwardena AN: Clinical Guidelines in Primary-Care - a Survey of General-Practitioners Attitudes and Behavior.

    Br J Gen Pract 1995, 45:643-647. PubMed Abstract | PubMed Central Full Text OpenURL

  8. Hayward RS, Guyatt GH, Moore KA, McKibbon KA, Carter AO: Canadian physicians' attitudes about and preferences regarding clinical practice guidelines.

    CMAJ 1997, 156(12):1715-23. PubMed Abstract | PubMed Central Full Text OpenURL

  9. Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, Guyatt GH, Harbour RT, Haugh MC, Henry D, Hill S, Jaeschke R, Leng G, Liberati A, Magrini N, Mason J, Middleton P, Mrukowicz J, O'Connell D, Oxman AD, Phillips B, Schünemann HJ, Edejer TT, Varonen H, Vist GE, Williams JW Jr, Zaza S, GRADE Working Group: Grading quality of evidence and strength of recommendations.

    BMJ 2004, 328(7454):1490. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Farquhar CM, Kofa EW, Slutsky JR: Clinicians' attitudes to clinical practice guidelines: a systematic review.

    Med J Aust 2002, 177(9):502-6. PubMed Abstract | Publisher Full Text OpenURL

  11. Carlsen B, Glenton C, Pope C: Thou shalt versus thou shalt not: a meta-synthesis of GPs' attitudes to clinical practice guidelines.

    Br J Gen Pract 2007, 57(545):971-8. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  12. Schunemann HJ, Best D, Vist G, Oxman AD, GRADE Working Group: Letters, numbers, symbols and words: how to communicate grades of evidence and recommendations.

    CMAJ 2003, 169(7):677-80. PubMed Abstract | PubMed Central Full Text OpenURL

  13. Akl EA, Maroun N, Guyatt G, Oxman AD, Alonso-Coello P, Vist GE, Devereaux PJ, Montori VM, Schünemann HJ: Symbols were superior to numbers for presenting strength of recommendations to healthcare consumers: a randomized trial.

    J Clin Epidemiol 2007, 60(12):1298-305. PubMed Abstract | Publisher Full Text OpenURL

  14. Calderon C, Rotaeche R, Etxebarria A, Marzo M, Rico R, Barandiaran M: Gaining insight into the Clinical Practice Guideline development processes: qualitative study in a workshop to implement the GRADE proposal in Spain.

    BMC Health Serv Res 2006, 6:138. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  15. Pope C, Mays N: Qualitative Research in Healthcare. London: BMJ Books; 2000.

  16. Murphy E, Dingwall R: Qualitative Methods and Health Policy Research. New York: Aldine de Gruyter; 2003.

  17. Ibáñez J: Más allá de la sociología. El grupo de discusión: Técnica y crítica. Volume XXI. 2a edition. Madrid: Siglo; 1986.

  18. Callejo J: El grupo de discusión: introducción a una práctica de investigación. Barcelona: Ariel; 2001.

  19. Alonso LE: La mirada cualitativa en sociología. Una aproximación interpretativa. Madrid: Editorial Fundamentos; 1998.

  20. Phillips N, Hardy C: Discourse Analysis. Investigating Processes of Social Construction. Thousand Oaks CA: Sage; 2002.

  21. Conde F: El análisis de la información en la investigación cualitativa. In Introducción a la Investigación Cualitativa. Máster de Investigación en Atención Primaria. Edited by Calderón C, Conde F, Fernández de Sanmamed MJ, Monistrol O. Barcelona: semFYC, UAB, Fundació Dr. Robert; 2004. OpenURL

  22. Krueger RA: Is it a Focus Group? Tips on How to Tell.

    J Wound Ostomy Continence Nurs 2006, 33(4):363-366. PubMed Abstract | Publisher Full Text OpenURL

  23. Brown JB: The Use of Focus Groups in Clinical research. In Doing Qualitative Research. Edited by Crabtree BF, Miller WL. Thousand Oaks. CA: Sage; 1999:109-24. OpenURL

  24. Morse JM, Barret M, Mayan M, Olson K, Spiers J: Verification strategies for establishing reliability and validity in qualitative research. [http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/4603/3756] webcite

    IJQM 2002, 1:13-22. OpenURL

  25. Miller WL, Crabtree BF: The dance of Interpretation. In Doing Qualitative Research. Edited by Crabtree BF, Miller WL. Thousand Oaks, CA: Sage; 1999:127-143. OpenURL

  26. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Cooper R: Methods to increase response rates to postal questionnaires.

    Cochrane Database of Systematic Reviews 2007., (2) OpenURL

  27. Bhagat K, Nyazema N: General practitioners and clinical guidelines.

    East Afr Med J 2001, 78(1):30-4. PubMed Abstract OpenURL

  28. Formoso G, Liberati A, Magrini N: Practice guidelines: useful and "participative" method? Survey of Italian physicians by professional setting.

    Arch Intern Med 2001, 161(16):2037-42. PubMed Abstract | Publisher Full Text OpenURL

  29. Scott IA, Buckmaster ND, Harvey KH: Clinical practice guidelines: perspectives of clinicians in Queensland public hospitals.

    Intern Med J 2003, 33(7):273-9. PubMed Abstract | Publisher Full Text OpenURL

  30. Butzlaff M, Kempkens D, Schnee M, Dieterle WE, Böcken J, Rieger MA: German ambulatory care physicians' perspectives on clinical guidelines - a national survey.

    BMC Fam Pract 2006, 7:47. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  31. Bochud M, Cornuz J, Vader JP, Kamm W, Burnand B: Are internists in an non-prescriptive setting favourable to guidelines? A survey in a Department of Internal Medicine in Switzerland.

    Swiss Med Wkly 2002, 132(15-16):201-6. PubMed Abstract OpenURL

  32. Riou E, Veillard D, Jarno P, Coutté MB: [Clinical practice guidelines, what do the internists think?].

    Presse Med 2004, 33(18):1233-7. PubMed Abstract | Publisher Full Text OpenURL

  33. Shea AM, DePuy V, Allen JM, Weinfurt KP: Use and perceptions of clinical practice guidelines by internal medicine physicians.

    Am J Med Qual 2007, 22(3):170-6. PubMed Abstract | Publisher Full Text OpenURL

  34. Saillour-Glénisson F, Domecq S, Pouchadon ML, Jacques B, Sibé M: [Combined quantitative and qualitative methods to identify local facilitators of and barriers to physician's adherence to clinicalpractice guidelines].

    Rev Epidemiol Sante Publique 2008, 56(Suppl 3):S207-19. PubMed Abstract | Publisher Full Text OpenURL

  35. Sinuff T, Eva KW, Meade M, Dodek P, Heyland D, Cook D: Clinical practice guidelines in the intensive care unit: a survey of Canadian clinicians' attitudes.

    Can J Anaesth 2007, 54(9):728-36. PubMed Abstract | Publisher Full Text OpenURL

  36. Quiros D, Lin S, Larson EL: Attitudes toward practice guidelines among intensive care unit personnel: a cross-sectional anonymous survey.

    Heart Lung 2007, 36(4):287-97. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Pogorzelska M, Larson EL: Assessment of attitudes of intensive care unit staff toward clinical practice guidelines.

    Dimens Crit Care Nurs 2008, 27(1):30-8. PubMed Abstract | Publisher Full Text OpenURL

  38. Hasenbein U, Schulze A, Busse R, Wallesch CW: [Physicians' attitudes concerning guidelines. An empirical survey in neurologic clinics].

    Gesundheitswesen 2005, 67(5):332-41. PubMed Abstract | Publisher Full Text OpenURL

  39. Ward MM, Vaughn TE, Uden-Holman T, Doebbeling BN, Clarke WR, Woolson RF: Physician knowledge, attitudes and practices regarding a widely implemented guideline.

    J Eval Clin Pract 2002, 8(2):155-62. PubMed Abstract | Publisher Full Text OpenURL

  40. Heidrich J, Behrens T, Raspe F, Keil U: Knowledge and perception of guidelines and secondary prevention of coronary heart disease among general practitioners and internists. Results from a physician survey in Germany.

    Eur J Cardiovasc Prev Rehabil 2005, 12(6):521-9. PubMed Abstract | Publisher Full Text OpenURL

  41. Graham ID, Brouwers M, Davies C, Tetroe J: Ontario doctors' attitudes toward and use of clinical practice guidelines in oncology.

    J Eval Clin Pract 2007, 13(4):607-15. PubMed Abstract | Publisher Full Text OpenURL

  42. Wiener-Ogilvie S, Pinnock H, Huby G, Sheikh A, Partridge MR, Gillies J: Do practices comply with key recommendations of the British Asthma Guideline? If not, why not?

    Prim Care Respir J 2007, 16(6):369-77. PubMed Abstract | Publisher Full Text OpenURL

  43. Wakkee M, Lugtenberg M, Spuls PI, de Jong EM, Thio HB, Westert GP, Nijsten T: Knowledge, attitudes and use of the guidelines for the treatment of moderate to severe plaque psoriasis among Dutch dermatologists.

    Br J Dermatol 2008, 159(2):426-32. PubMed Abstract | Publisher Full Text OpenURL

  44. Erhardt L, Komajda M, Hobbs FD, Soler-Soler J: Cardiologists' awareness and perceptions of guidelines for chronic heart failure. The ADDress your Heart survey.

    Eur J Heart Fail 2008, 10(10):1020-5. PubMed Abstract | Publisher Full Text OpenURL

  45. Carlsen B, Norheim OF: "What lies beneath it all?"--an interview study of GPs' attitudes to the use of guidelines. [http://www.biomedcentral.com/1472-6963/8/218#B9] webcite

    BMC Health Serv Res 2008, 8:218. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  46. Boivin A, Légaré F, Gagnon MP: Competing norms: Canadian rural family physicians' perceptions of clinical practice guidelines and shared decision-making.

    J Health Serv Res Policy 2008, 13(2):79-84. PubMed Abstract | Publisher Full Text OpenURL

  47. Morgan DL: Focus groups as qualitative research. London: Sage Publicatons; 1988.

  48. Fink A: How to sample in surveys. Thousand Oaks, California: Sage Publicatons; 1995.

  49. Fowler FJ: Survey research methods. 2nd edition. Thousand Oaks, California: Sage Publicatons; 1993.

  50. Adams A, Soumerai S, Lomas J, Ross-Degnan D: Evidence of self-report bias in assessing adherence to guidelines.

    Intern J Qual Healthcare 1999, 11:187-192. Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/10/328/prepub