Skip to main content
  • Research article
  • Open access
  • Published:

The development of a guideline implementability tool (GUIDE-IT): a qualitative study of family physician perspectives

Abstract

Background

The potential of clinical practice guidelines has not been realized due to inconsistent adoption in clinical practice. Optimising intrinsic characteristics of guidelines (e.g., its wording and format) that are associated with uptake (as perceived by their end users) may have potential. Using findings from a realist review on guideline uptake and consultation with experts in guideline development, we designed a conceptual version of a future tool called Guideline Implementability Tool (GUIDE-IT). The tool will aim to involve family physicians in the guideline development process by providing a process to assess draft guideline recommendations. This feedback will then be given back to developers to consider when finalizing the recommendations. As guideline characteristics are best assessed by end-users, the objectives of the current study were to explore how family physicians perceive guideline implementability, and to determine what components should comprise the final GUIDE-IT prototype.

Methods

We conducted a qualitative study with family physicians inToronto, Ontario. Two experienced investigators conducted one-hour interviews with family physicians using a semi-structured interview guide to 1) elicit feedback on perceptions on guideline implementability; 2) to generate a discussion in response to three draft recommendations; and 3) to provide feedback on the conceptual GUIDE-IT. Sessions were audio taped and transcribed verbatim. Data collection and analysis were guided by content analyses.

Results

20 family physicians participated. They perceived guideline uptake according to facilitators and barriers across 6 categories of guideline implementability (format, content, language, usability, development, and the practice environment). Participants’ feedback on 3 draft guideline recommendations were grouped according to guideline perception, cognition, and agreement. When asked to comment on GUIDE-IT, most respondents believed that the tool would be useful, but urged to involve “regular” or community family physicians in the process, and suggested that an online system would be the most efficient way to deliver it.

Conclusions

Our study identified facilitators and barriers of guideline implementability from the perspective of community and academic family physicians that will be used to build our GUIDE-IT prototype. Our findings build on current knowledge by showing that family physicians perceive guideline uptake mostly according to factors that are in the control of guideline developers.

Peer Review reports

Background

Clinical practice guidelines are considered an important knowledge translation tool to inform clinical practice for family physicians, yet their potential has not been realized due to inconsistent adoption in clinical practice [13]. Guidelines can be confusing and difficult to use (and even contradictory), and their implementation and uptake remain variable [4, 5]. The research community classifies inquiry about poor guideline adoption into strategies that focus on the practice or environment (extrinsic approaches) or the guideline itself (intrinsic approaches) to improve uptake. Extrinsic strategies are important since gaps in uptake and use continue to exist even if guidelines are well developed and implementable. However these strategies have had modest impact on quality of care with highly variable costs [6]. We believe that optimising the intrinsic characteristics of guidelines (e.g., wording and format) that are associated with uptake may have greater potential to improve uptake at minimal cost, be easier to implement, and may be broadly applicable.

Implementability refers to a set of characteristics that “predict ease of (and obstacles to) guideline implementation” [7], whereas Implementation refers to that part of the guideline lifecycle in which systems are introduced to influence clinicians' behavior toward guideline adherence [8].There has been much discussion around improving the rigor of guidelines [9], but few tools consider implementation issues during guideline development with the expectation of improving guideline uptake. Existing tools include GLIA [7], which informs developers about potential problems with implementation, but it is time consuming to use and difficult to incorporate into the development process, and not designed to assess the implementability of the whole guideline [10]; AGREE [11] can assess the methodological quality of guidelines but provides only peripheral guidance on implementability; and ADAPTE [12] can be used to adapt existing guidelines into other settings. However, these tools are not based on a broad literature search, and most target methodological and reporting concerns. Currently, there is no resource that takes a comprehensive view of all factors relevant to guideline implementability. Guideline developers need a usable, complementary tool to improve the implementability of guideline recommendations. We developed a conceptual tool with the aid of a general model for planned action (i.e., the knowledge-to action [KTA] framework) [13]. The tool development began with an exhaustive review using Realist Review methodology to better understand the intrinsic characteristics of guidelines that impact on their implementability [14]. Findings of this study are reported in another paper ([15], Kastner M, Hayden L, Makarski J, et al. Understanding the implementability of clinical practice guidelines: A Realist Review. Submitted), but briefly, it identified core implementability dimensions known to influence uptake: Stakeholder involvement, Evidence synthesis, Considered judgment, Feasibility, Message, and Format. The “conceptual” tool, which we call the Guideline Implementability Tool (GUIDE-IT), was designed according to these Realist Review findings in addition to consultation with experts in guideline development. We conceptualized GUIDE-IT as a 3-step process:

  1. 1)

    A strategy to recruit and involve family physicians (i.e., the typical end-users of clinical practice guidelines) in the guideline development process;

  2. 2)

    A process to evaluate the implementability of draft recommendations by family physicians recruited in step 1 using an objective assessment checklist (online or paper-based platform); and

  3. 3)

    Provision of family physician assessments to guideline developers (who will also evaluate recommendations) to take into consideration when finalizing recommendations.

Once we developed the conceptual GUIDE-IT tool, the next steps in the tool development process (according to our KTA framework) were to better understand the barriers to using the knowledge gleaned from our Realist Review and to transform our conceptual tool design into a functional prototype. To do this, we wanted to expand our understanding of guideline implementability from the perspective of family physicians, which represent a large proportion of guideline end-users. As guideline characteristics are best assessed by end-users, we wanted to explore how family physicians perceive this concept in the context of their practice and to determine how they respond to our conceptual GUIDE-IT tool. Thus, the specific objectives of this study were to explore 1) what guideline end-users (family physicians) perceive as important in guidelines, guideline development and uptake (i.e., what they consider facilitators and barriers); 2) to determine how family physicians perceive a set of draft guideline recommendations; and 3) to determine what components should comprise the final GUIDE-IT prototype.

Methods

We conducted a qualitative study of interviews with community and academic family physicians. Our study was planned and executed in accordance with RATS guidelines (http://www.biomedcentral.com/authors/rats). We used a mixed-methods sampling strategy in an attempt to recruit a wider scope of family practice. We purposively recruited family physicians from the St. Michael’s Hospital (SMH) family practice unit in Toronto, Ontario (N = 43). However, we needed to extend our recruitment beyond our research institute family practice unit (which predominantly comprise academic family physicians) to gain a realistic understanding of guideline implementability. To identify a broader spectrum of family practice perspectives (including physicians in academic and community family practice settings), we also randomly selected physicians from the College of Physicians and Surgeons of Ontario (CPSO) database in the greater Toronto area (N = 962). We performed this mixed recruitment strategy simultaneously until we reached data saturation. Sampling was stratified by type of physician (academic or community) in an attempt to maximize the potential for recruiting an equal representation of each. Based on our previous experience conducting qualitative interviews, we anticipated having to interview 10-15 physicians to achieve data saturation. Once providing informed consent, all participants were assigned a unique identification number to ensure the anonymity of their responses. The study was approved by the St. Michael’s Hospital Research Ethics Board.

Interview sessions

Two experienced investigators conducted one-hour interviews with family physicians using a semi-structured interview guide (Additional file 1) with the following 3 objectives that were planned in sequence:

In Objective 1, we wanted to elicit feedback on participants’ perceptions of guidelines, and their views on the facilitators and barriers to using them.

In Objective 1, we wanted to elicit feedback on participants’ perceptions of guidelines, and their views on the facilitators and barriers to using them.

In Objective 2, the aim was to generate a discussion in response to 3 draft recommendations provided by a guideline development group (Additional file 2). Participants were shown the 3 draft recommendations one at a time, and asked to respond to each using the following questions from the interview guide:

  1. 1.

    What do you think the recommendation is saying? Do you understand it? If no, what aspects do you find difficult?

  2. 2.

    What would you do with this recommendation in practice?

  3. 3.

    Would you change this recommendation? Why/why not? How would you change it?

In Objective 3, we wanted to elicit feedback on our conceptual guideline implementability tool (GUIDE-IT), including the generation of ideas and suggestions about optimal features that might enhance guideline uptake. The tool was developed based on the expert input of guideline developers and findings of our realist review investigating characteristics of guidelines that facilitate their uptake [14]. The qualitative interviews in the current study represent guideline end-user perspectives, which will contribute to other stakeholder perspectives in the development of the final prototype. Figure 1 shows the conceptual GUIDE-IT design that was presented to participants during the last part of the interview session.

Figure 1
figure 1

Conceptual design of the guideline implementability tool (GUIDE-IT) that was presented for family physicians during the interviews (Objective 3).

Data collection and analysis

Sessions were audio taped and transcribed verbatim. Data collection and qualitative content analysis were guided by grounded theory methodology [16]. Four investigators independently developed a coding scheme by identifying, and labelling the primary patterns in the content using NVivo [8.0]. For Objectives 1-3, we used the constant comparative method to group codes into categories (where each category was considered as a unit of analysis). For example, codes for the “clarity”, “specificity”, “actionability” and “sensibility” of guidelines were grouped into a category called “Language”. We also interrogated the inter-relationship of categories (axial coding). For example, we had group discussions to determine whether two broad categories, “Content” and “Language” of guidelines, should be combined or represented as two separate categories. After coding the data and reviewing the content related to participants’ feedback on the three draft guideline recommendations (Objective 2), we grouped participant responses according to the theory of information architecture [17, 18]. This theory states that people perceive information before processing it and that format/layout can influence a person’s ability to process information at both the perception and cognition level. We also recognized that beyond cognitive understanding, our informants spoke of a third level, which was assessment. Once they understood the basic message, they assessed whether it was logical, correlated with prior experience, and whether they could see themselves following the recommendation in practice. As such, we conducted axial coding for this level of analysis. To increase our validity, we also performed data triangulation, by seeking input from other researchers and experts in guideline development on our themes, categories and analysis.

Results

Of 1005 family physicians who were invited, 22 agreed to participate (N = 14 from the CPSO; N = 8 from SMH, of whom 5 were also in the CPSO database). Of these, 2 physicians did not attend, so we conducted interviews with a total of 20 family physicians (10 one-on-one and 4 group sessions). Table 1 shows the characteristics of participants. Most were community family physicians (70%) practicing for at least 16 years (60%) and younger than 55 years of age (65%) (Table 1). Results are described below according to our 3 major objectives.

Table 1 Characteristics of family physicians (N = 20)

Objective 1: Perception of the facilitators and barriers to guideline use

Family physicians perceived guideline uptake according to facilitator and barrier factors spread across 6 categories of guideline implementability: Format, Content, Language, Usability, Development, and the Practice environment (Figure 2).

Figure 2
figure 2

Categories of guideline implementabiliy as perceived by family physicians.

Format (Table 2): The majority of family physicians identified a preference for the representation of guidelines as summaries, charts or tables. Suggestions related to the organization of guidelines included a stepwise approach, providing information similar to how it is laid out in lab reports, and according to what patients may ask. In terms of presentation, physicians want a clear layout that makes sense and is “pleasing to the eye”. Some suggested that the provision of a “central resource (a one-stop-shop)” for guidelines would be a good delivery system. Sections identified by participants as important to include in guidelines were a background, purpose, outcomes, a clear recommendation section, and templates to prompt for history. Guidelines described as too big or too long were perceived as the major barriers to uptake.

Table 2 Facilitators and barriers of guideline implementability as perceived by Family Physicians: FORMAT

Content (Table 3): Physicians identified the importance of including information about goals and targets (and whether these are practical and feasible), medication costs and choices, and to provide guidance on atypical situations, exceptions, controversies and uncertainties. Targets that do not fit with practice, do not apply to the patient population, and are difficult to achieve or constantly changing were identified as barriers. Many physicians thought it was important to include evidence and its quality in guidelines, but some believed that only recommendations with good quality of evidence should be included, while recommendations with weak or mid-level evidence should not.

Table 3 Facilitators and barriers of guideline implementability as perceived by Family Physicians: CONTENT

Language (Table 4): Many family physicians perceive guidelines as using language that is too dense or too detailed. They want guidelines to be clear, easy to read and understand; and are specific, actionable and make sense.

Table 4 Facilitators and barriers of guideline implementability as perceived by Family Physicians: LANGUAGE

Usability (Table 5): Most family physicians perceive guidelines as having too much information, and generally too difficult to follow. Guidelines that do not fit with their practice or apply to their patient population, and are inconsistent or conflicting were also major perceived barriers to use. Family physicians want guidelines to be relevant to primary care practice, make a difference for patients and be meaningful. They also want guidelines that are quick to use and easy to remember, but allow for enough flexibility to apply their own judgment to make practice decisions. Having the most up-to-date guideline information or those that are built on previous updates was also considered a facilitator, but only if guidelines are not constantly changing.

Table 5 Facilitators and barriers of guideline implementability as perceived by Family Physicians: USABILIY

Development (Table 6): Our participants believed that guidelines should be developed by a trusted and credible source with input from family physicians. Some believed that the specialists who develop guidelines do not understand the nature of family practice and as such are not the appropriate persons to write them. A few family physicians expressed a lack of trust in guidelines either because they questioned the “solidity of recommendations” or because they were industry sponsored.

Table 6 Facilitators and barriers of guideline implementability as perceived by Family Physicians: DEVELOPMENT

Practice environment (Table 7): Participants wanted guidelines to be accessible and available at the point of care, but many have difficulty finding them or simply do not know that they are available. Almost half of participants indicated that lack of time was a major barrier to implementation of guidelines. Other perceived barriers were too many guidelines and a lack of support to implement them, and that available resources are not taken into consideration when designing guidelines to be able to appropriately implement them.

Table 7 Facilitators and barriers of guideline implementability as perceived by Family Physicians: PRACTICE ENVIRONMENT

Objective 2: Participants’ suggestions for revising draft recommendations

Using the theory of information architecture [17, 18], feedback from family physicians on the 3 draft recommendations were grouped into 3 categories: 1) Perception of the recommendation (i.e., whether physicians believed that they could or wanted to engage with the recommendation in terms of their ability to see, hear, or become aware of something through these senses). 2) Cognition of the recommendation (i.e., whether physicians understood the recommendation in terms of the mental action or process of acquiring knowledge and understanding through thoughts, experience, and the senses); and 3) Agreement on recommendations (i.e., whether participants agreed with the recommendation or the concept of guidelines in general).

Table 8 shows the feedback on the three draft recommendations provided by physicians across these 3 categories (see Additional file 2 for original recommendations). Physicians perceived the recommendations to be disorganized (N = 8), wordy (N = 6) and too long (N = 4). They suggested shortening, and visually separating or organizing the information using lists or point form in tables or a flowchart. Physicians’ understanding of the recommendations was hampered by their lack of understanding of the evidence grading system used to support the recommendations (e.g., the meaning of “Grade A, level 1”) (N = 6), its complexity (N = 4) and lack of specific information to accurately interpret statements (N = 4). To overcome these problems, physicians suggested defining vague terms, acronyms and phrases and using words familiar to physicians; using footnotes to define and specify the evidence grading system supporting recommendations; and creating organized lists, groups, tables and flowcharts to minimize complexity of the information.

Table 8 Family physicians’ perceptions, cognition, and agreement with 3 draft recommendations, and their suggestions for overcoming identified problems

There was low agreement with the 3 draft recommendation statements for several reasons. First, physicians thought that the statements were impractical (N = 11) as they did not consider the necessary resources to perform the recommendations or were incongruent with provider and patient values. To address this problem, physicians suggested individualizing recommendations by considering costs, human resources and provider and patient values in their recommendations. Second, physicians thought that the recommendations lacked clinical sense (N = 6) as there was no clear direction of action or information was missing. Suggestions were to use clear and actionable language such as active voice, the provision of more background information, to include clear targets for patient outcomes, and to include information on the benefits and harms of treatments. Another factor affecting participants’ agreement with statements was the apparent poor evidence supporting them. In such cases, physicians suggested omitting detailed and specific guidance in order to simplify recommendations. Lastly, participants perceived the recommendations to be too aggressive to apply (N = 4), that is the specified clinical targets were either not achievable or suggested interventions were more intense than what they thought their patients would prefer (e.g., being on 3 medications instead of 1 or monitoring twice a day instead of once a day). To address these issues, physicians suggested providing more background information, acknowledging that the statement represents a change from current practice, and to underscore the rationale for such changes. Figures 3A-C show each of the three original draft recommendations and the revised statements according to family physicians suggestions.

Figure 3
figure 3

Three draft recommendations presented to family physicians (Objective 2), depicting their perceptions of problems identified in the original recommendation and their suggestions for revising. A. Draft recommendation 1 presented to family physicians (Objective 2), depicting their perceptions of problems identified in original recommendation and their suggestions for revising. B. Draft recommendation 2 presented to family physicians (Objective 2), depicting their perceptions of problems identified in original recommendation and their suggestions for revising. C. Draft recommendation 3 presented to family physicians (Objective 2), depicting their perceptions of problems identified in original recommendation and their suggestions for revising

Objective 3: Participants’ feedback on the conceptual GUIDE-IT

Three themes emerged from our discussion with participants about the conceptual guideline implememtability tool (GUIDE-IT):

Theme 1: General feedback on GUIDE-IT: Most participants believed that the tool would be useful, and that involving family physicians in the guideline development process would be important and appropriate (N = 12), but believed that these physicians should represent “regular” or community family physicians:

It should go out to family physicians, but ‘regular’ family physicians should be looking at it and you know discussing whether it is useable from their perspective {FG3-P3; FG = Focus Group; P = Participant}.

Theme 2: Strategies to involve family physicians in the guideline development process: Participants suggested several strategies to encourage the involvement of family physicians in the guideline development process. First, they suggested forming a primary care practitioner working group, which should also include patients and those involved in team-based care.

Second, participants believed that their involvement in the process would present a unique opportunity to make developers better understand what they need in the frontlines so that guidelines can become more clear, useful and less burdensome. Specifically, they suggested having a checklist to assess recommendations based on simplicity and clarity, to indicate the 5 most important points to consider, and to be able to look at how guidelines are organized:

“…for them it makes sense but for us it may not. If you were around the table, you could clarify to them what would make sense for you in your practice, and it will be faster and make it more efficient.” {FG4-P1}

However, participants also thought that there could be some downsides to family physician involvement including delays in getting guidelines out and potential barriers to sustainability given the potential costs and resources it may require to continue this process:

People get anxious about not having the latest information or how long it takes to get the guideline out (whether its up to date by the time it gets out), and if this tool will delay it significantly I think there will be resentment from the committee, even the actual guideline developers themselves and from the end users. {I-1; I = Interview}

Some participants thought that family physicians might be “drawn in” to participate purely out of interest, but most believed that some compensation would be needed for their time either in the form of a monetary incentive or through the provision of continuing medical education credits:

Another way could be is to use conferences, focus a 3-hour workshop type session where you could ask people to sign up for this and they get Mainpro-C credits. They would learn the guideline at the same time so there would be an educational component to this. {I-1}

Theme 3: Suggestions for delivering GUIDE-IT: Participants suggested that communication between guideline developers and end-users may also be facilitated through the consideration of different platforms for delivering GUIDE-IT. Some suggested a group-based live forum while most believed that an online system (or a wiki-based system) would be more efficient as this would allow family physicians to contribute to the guideline using a central location from their own computer. They also suggested that an online system would enable assessments on different platforms (e.g., smartphones and other touch screen devices), which would make assessments easier to access, and allow more focus on one idea (compared with a group situation) and thus would also “even out the playing field”.

Discussion

This qualitative study revealed family physician perspectives on facilitators and barriers to guideline use across 6 categories in the context of their own practice. The most frequently described facilitators of uptake addressed guideline format, content, language and usability. In particular, family physicians expressed wanting simple, clear and uncomplicated guidelines that are easy to use or follow, relevant to primary care, and developed by a trusted and credible source. These findings are consistent with others investigating end-user perspectives of guideline implementability in the general context [1925] and across a wide range of specific guideline topics such as cancer control [26]; urinary tract infection [27]; depression [28]; immunization [29]; infection prevention and control [30]; dementia [31]; cholesterol education [32]; and asthma [33]; and for different end users such as physiotherapists [34] and dentists [35]. Our work builds on this knowledge through the creation of a model of guideline implementability, derived exclusively from guideline end-user perspectives (Figure 2). This model represents a more in-depth understanding of the general concept of guideline implementability by showing that physicians perceive facilitators and barriers to guideline uptake almost exclusively according to intrinsic factors (i.e., those that are under the control of guideline developers). This finding strengthens the notion that optimising such factors (as perceived by their end-users) can be, and should be applied in tools addressing guideline implementability. Whether such a tool can have a positive impact, and whether it could be routinely incorporated into guideline development at minimal cost will be the focus of our future work.

Family physicians in our study also had the opportunity to respond to three draft recommendations, which highlighted problems typically encountered with guideline use (i.e., lack of understandability and applicability of recommendations). Most participants perceived draft recommendations as disorganized, wordy and long; had difficulty understanding sections they perceived as confusing or lacked information; and had a general disagreement with recommendations that were “impractical”, had poor evidence base, lacked clinical sense or if they were perceived as too aggressive (i.e., expectations for reaching proposed targets, intervention or monitoring). Family physicians were equally open to offering potential solutions to improve these recommendations, which indicates that involving end-users in their assessment during guideline development is not only feasible but shows potential for end-users to suggest more implementable recommendations. In our study, we were able to show the value of such feedback, as participants not only identified specific problems, they also provided solutions that were practical and operationalized. This level of feedback also suggests that it would be feasible to create objective criteria for assessing and revising draft guideline recommendations across various factors of guideline implementability such as those revealed in our model (Figure 2). For example, if we considered the Wording factor, we could apply objective rules to identify problems with the wording of draft recommendations such as its clarity (i.e., unambiguous), simplicity (minimizing multiple steps, elements or actions) and actionability (i.e., making recommendations specific and using active voice). Through identifying such factors using objective criteria across multiple intrinsic factors (i.e., wording, content, format, evidence, updating), it would be possible to generate domain scores of implementability. This would in principle allow potential problems to be identified across all domains (or in select domains). Furthermore, the same objective criteria that identified the problems in recommendations can also be used to generate solutions, and hence the potential to improve the overall implementibility of the guideline.

Family physicians iterated the importance of their involvement in guideline development to ensure that developers better understand their needs, particularly for frontline practice. However, they suggested that those tasked with assessing the implementability of draft recommendations should comprise mostly of non-academic or “regular” (i.e., community) family physicians with no particular expertise or interest in a specific disease area. Since “regular” physicians are rarely engaged in guideline development, participants thought that their involvement would maximize the objectivity of GUIDE-IT assessments and the potential that recommendations vetted through GUIDE-IT will be more applicable. Such engagement can also identify problems with the applicability and flexibility of guidelines [36, 37], which in turn will foster greater adherence to guidelines and a sense of ownership [27]. Our study participants also thought it was important to balance the potential benefits with barriers such as the potential for delays in completing guidelines resulting from this involvement (i.e., completing assessments), and the increased costs and resources that would be needed to recruit physicians and sustain the process. Furthermore, even though most national guideline development groups and organizations advocate for the involvement of physicians and patients during the development process (e.g., Guideline International Network [GIN], Canadian Task Force on Preventive Health Care [CTFPHC]; Institute of Medicine [IOM]; and the National Institute for Health and Care Excellence [NICE]), most do not provide information about which specific end-users should be involved, how they should be selected or recruited, when they should be involved and how [3841].

Lastly, participants had the opportunity to provide feedback on the conceptual GUIDE-IT tool. They suggested that an individualized online platform would be the most practical forum to deliver GUIDE-IT assessments. They believed that a computerized system would provide more flexible participation and easier access to completing recommendation assessments, including the delivery of GUIDE-IT using diverse platforms such as applications for smartphones and other touch screen devices.

One of the strengths of our study was that we addressed the potential limitations inherent to qualitative studies such as threats to internal validity (i.e., credibility), external validity (i.e., transferability) and reliability (dependability) [42]. We addressed potential threats to credibility by pilot testing the interview questions to ensure that they were well understood, and to use experienced moderators to lead discussions. As with other qualitative studies, our findings are not generalizable beyond the sample of family physicians that participated in our study. However, we used a mixed sampling strategy (random and purposive) in an attempt to identify a wide scope of family practice. Furthermore, we provided detailed information about the family practices and physicians to enhance the transferability of our findings. To limit the potential of biases that may be introduced by investigators with respect to the dependability and confirmability of our work, we standardized procedures, methods, and analysis strategies across all interviews. Furthermore, sessions were planned so that physicians were prompted about their perceptions of the facilitators and barriers to guideline implementability in the context of their own practice before introducing the conceptual design of our GUIDE-IT tool, thereby avoiding any opportunity for contamination. Finally, we believe that our findings are transferable to community and academic family practices in the Toronto general area.

Next steps include applying the findings of this study (in consultation with information technologists and human factors engineers) to transform the conceptual GUIDE-IT design into a functioning prototype. This will involve creating GUIDE-IT as an online system that will be accessible through multiple applications and devices, and the development of a systematic, operationalized, and sustainable approach for selecting and recruiting family physicians for completing GUIDE-IT assessments. For example, we will attempt to optimise strategies for family physician involvement in the use of GUIDE-IT by balancing identified resource and time burdens that may delay guideline production. Once the prototype is finalized, we will test it with guideline developers and all relevant end-users (all physicians who use guidelines) to determine its usability for assessing the implementability of guidelines. Next, we will conduct a randomized trial to determine the impact of GUIDE-IT on improving guideline recommendations and its impact on subsequent guideline use by family physicians.

Conclusions

Our study identified facilitators and barriers from the perspective of guideline end users that will be used to transform our GUIDE-IT tool into a functional prototype. Our findings build on current knowledge of guideline implementability by showing that family physicians perceive guideline uptake mostly according to factors that are in the control of guideline developers. The study also identified numerous intrinsic barriers that could be minimized during guideline development if developers elicit them from potential end users. Finally, it highlights the importance of end user feedback and the willingness of end users to provide feedback in order for developers to produce more implementable products. Characterization of facilitators and barriers can be used to optimize tools and interventions such as GUIDE-IT to overcome barriers and improve guideline uptake.

References

  1. Kendall E, Sunderland N, Muencheberger H, Armstrong K: When guidelines need guideance: considerations and strategies for improving the adoption of chronic disease evidence by general practitioners. J Eval Clin Prac. 2009, 15: 1082-1090. 10.1111/j.1365-2753.2009.01147.x.

    Article  Google Scholar 

  2. Brown LC, Johnson JA, Majumdar SR, et al: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171 (10): 1189-1192. 10.1503/cmaj.1031965.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Grimshaw J, Russell I: Achieving health gain through clinical guidelines I: developing scientifically valid guidelines. Qual Health Care. 1993, 2: 243-248. 10.1136/qshc.2.4.243.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Grimshaw J, Eccles M, Thomas R, et al: Toward evidence-based quality improvement. JGIM. 2006, 21: S14-S20.

    PubMed  PubMed Central  Google Scholar 

  5. Gagliardi AR, Brouwers M, Palda VA, Lemieux-Charles L, Grimshaw JM: An exploration of how guideline developer capacity and guideline implementability influence implementation and adoption: study protocol. Impl Sci. 2009, 4: 36-10.1186/1748-5908-4-36.

    Article  Google Scholar 

  6. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.

    Article  Google Scholar 

  7. Schiffman R, Dixon J, Brandt C, et al: The Guideline Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Info Dec Mak. 2005, 5: 23-10.1186/1472-6947-5-23.

    Article  Google Scholar 

  8. Kashyap N, Dixon J, Michel G, Brandt C, Shiffman RN: Guideline Implementability Appraisal v. 2.0. 2011, Yale Center for Medical Informatics, New Haven, CT, Available at: http://nutmeg.med.yale.edu/glia/doc/GLIA_v2.pdf. Accessed on June 10, 2013

    Google Scholar 

  9. Tricoci P, Allen JM, Kramer JM, Califf RM, Smith SC: Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA. 2009, 301 (8): 831-841. 10.1001/jama.2009.205.

    Article  CAS  PubMed  Google Scholar 

  10. van Dijk LJEW, Willianne LDM N, D’Hooghe TM, et al: The European Society of Human Reproduction and Embryology guideline for the diagnosis and treatment of endometriosis: an electronic guideline implementability appraisal. Implementation Science. 2011, 6: 7-10.1186/1748-5908-6-7.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Brouwers MC, Kho ME, Browman GP, et al: AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010, 182 (18): E839-E842. 10.1503/cmaj.090449.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Fervers B, Brugers JS, Haugh MC, et al: Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care. 2006, 18 (3): 167-176. 10.1093/intqhc/mzi108.

    Article  PubMed  Google Scholar 

  13. Graham ID, Logan J, Harrison MB, et al: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26: 13-24. 10.1002/chp.47.

    Article  PubMed  Google Scholar 

  14. Kastner M, Estey E, Perrier L, et al: Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: protocol for a realist review. Implement Sci. 2011, 6: 69-10.1186/1748-5908-6-69.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kastner M, Makarski J, Hayden L, Durocher L, Chatterjee A, Brouwers M, Bhattacharyya O: Making sense of complex data: a mapping process for analyzing findings of a realist review on guideline implementability. BMC Med Res Method. 2013, 13: 112-10.1186/1471-2288-13-112.

    Article  Google Scholar 

  16. Strauss AL, Corbin JM: Basics of qualitative research: Techniques and procedures for developing grounded theory. 1998, California: Sage Publications Inc.

    Google Scholar 

  17. Oh B, Kang S: Information Design Textbook. 2008, Seoul: Ahn Graphics

    Google Scholar 

  18. Kang S: Framework for information design in the information age. Int J Humanit. 2005, 3 (2): 215-219.

    Google Scholar 

  19. Lugtenberg J, Zegers-van Schaick JM, Westert GP, Burgers JS: Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Impl Sci. 2009, 4: 54-10.1186/1748-5908-4-54.

    Article  Google Scholar 

  20. McKinlay E, McLeod D, Dowell A, Mashall C: Clinical practice guidelines’ development and use in New Zealand: an evolving process. N Z Med J. 2004, 117 (1199): 1-11.

    Google Scholar 

  21. Carlsen B, Norheim OF: “What lies beneath it all?” – an interview study of GPs’ attitudes to the use of guidelines. BMC Health Serv Res. 2008, 8: 218-10.1186/1472-6963-8-218.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999, 282: 1458-1465. 10.1001/jama.282.15.1458.

    Article  CAS  PubMed  Google Scholar 

  23. Mazza D, Russell SJ: Are GPs using clinical practice guidelines?. Aust Fam Physician. 2001, 30 (8): 817-821.

    CAS  PubMed  Google Scholar 

  24. Francke AL, Smit MC, de Veer AJE, Mistiaen P: Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Dec Mak. 2008, 8: 38-10.1186/1472-6947-8-38.

    Article  Google Scholar 

  25. Tierney W: Improving clinical decisions and outcomes with information: a review. Int J Med Inform. 2001, 62 (1): 1-9. 10.1016/S1386-5056(01)00127-7.

    Article  CAS  PubMed  Google Scholar 

  26. Zitzelsberger L, Grunfeld E, Graham ID: Family physicians’ perspectives on practice guidelines related to cancer control. BMC Fam Pract. 2004, 5: 25-10.1186/1471-2296-5-25.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Lugtenberg M, Burgers J, Besters CF, Han D, Westert GP: Perceived barriers to guideline adherence: a survey among general practitioners. BMC Fam Pract. 2011, 12: 98-10.1186/1471-2296-12-98.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Forsner T, Hansson J, Brommels M, Wistedt AA, Forsell Y: Implementing clinical guidelines in psychiatry: a qualitative study of perceived facilitators and barriers. BMC Psychiatry. 2010, 10: 8-10.1186/1471-244X-10-8.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Fontanesi J, Messonnier M, Hill L, Shefer A: A new model of adoption of clinical practice guidelines. J Public Health Manage Pract. 2007, 13 (6): 605-611. 10.1097/01.PHH.0000296137.48929.a1.

    Article  Google Scholar 

  30. Timen A, Hulscher MEJL, Rust L, et al: Barriers to implementing infection prevention and control guidelines during crises: Experiences of health care professionals. Am J Infect Control. 2010, 38: 726-733. 10.1016/j.ajic.2010.03.006.

    Article  PubMed  Google Scholar 

  31. Pimlott NJ, Persaud M, Drummond N, Cohen CA, Silvius JL, Seigel K, Hollingworth GR, Dalziel WB: Family physicians and dementia in Canada: Part 1. Clinical practice guidelines: awareness, attitudes, and opinions. Can Fam Physician. 2009, 55 (5): 506-507. e1-5

    PubMed  PubMed Central  Google Scholar 

  32. Parker DR, Gramling R, Goldman RE, Eaton CB, Ahern D, Cover RT, Borkan J: Physicians' Perceptions of barriers and facilitators regarding adoption of the national cholesterol education program guidelines. Prev Cardiol. 2008, 11 (1): 29-35. 10.1111/j.1520-037X.2007.07200.x.

    Article  PubMed  Google Scholar 

  33. Moffat M, Cleland J, van der Molen T, Price D: Poor communication may impair optimal asthma care: a qualitative study. Fam Pract. 2007, 24: 65-70.

    Article  PubMed  Google Scholar 

  34. Côté AM, Durand MJ, Tousignant M, Poitras S: Physiotherapists and use of low back pain guidelines: a qualitative study of the barriers and facilitators. J Occup Rehabil. 2009, 19 (1): 94-105. 10.1007/s10926-009-9167-2.

    Article  PubMed  Google Scholar 

  35. Spallek H, Song M, Polk DE, Bekhuis T, Frantsve-Hawley J, Aravamudhan K: Barriers to implementing evidence-based clinical guidelines: a survey of early adopters. J Evid Based Dent Pract. 2010, 10 (4): 195-206.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Smith L, Walker A, Gilhooly K: Clinical guidelines on depression: a qualitative study of GPs’ views. J Fam Pract. 2004, 53 (7): 556-561.

    PubMed  Google Scholar 

  37. Wilson EJ, Nasrin D, Banwell C, Broom D, Douglas RM: Realities of practice: engaging parents and GPs in developing clinical practice guidelines. Aust Fam Physician. 2000, 29 (5): 498-503.

    CAS  PubMed  Google Scholar 

  38. Guideline International Network: Patient and public involvement in guidelines. Available at: http://www.g-i-n.net/activities/gin-public/toolkit. Accessed on May 21, 2013

  39. Connor Gorber S, Singh H, Pottie K, Jaramillo A, Tonelli M: Process for guideline development by the reconstituted Canadian task force on preventive health care. CMAJ. 2012, 184 (14): 1575-1581. 10.1503/cmaj.120642.

    Article  PubMed  Google Scholar 

  40. IOM (Institute of Medicine): Clinical Practice Guidelines We can Trust. 2011, Washington, DC: The National Academies Press, Brief report available at: http://www.iom.edu/Reports/2011/Clinical-Practice-Guidelines-We-Can-Trust.aspx. Accessed on May 21, 2013

    Google Scholar 

  41. National Institute for Health and Care Excellence (NICE): How we work. Available at: http://www.nice.org.uk/aboutnice/howwework/how_we_work.jsp. Accessed on May 21, 2013

  42. Shenton AK: Strategies for ensuring trustworthiness in qualitative research projects. Education for Information. 2004, 22: 63-75.

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

We thank the Canadian Cardiovascular Harmonization of National Guidelines Endeavour (C-CHANGE) group for providing the draft recommendations that were tested in this study.

Funding

There was no external funding for this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Monika Kastner.

Additional information

Competing interests

The authors have no competing interests to declare.

Authors’ contributions

All authors participated in the design and development of the protocol. MK and EE conducted the interviews, and MK, LH, AG, and AC analysed the data. MK drafted the manuscript, and all authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: Semi-structured Interview Guide.(DOC 30 KB)

12875_2013_1173_MOESM2_ESM.doc

Additional file 2: Draft guideline recommendations used to elicit feedback from family physician participants during interview sessions*.(DOC 33 KB)

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article

Kastner, M., Estey, E., Hayden, L. et al. The development of a guideline implementability tool (GUIDE-IT): a qualitative study of family physician perspectives. BMC Fam Pract 15, 19 (2014). https://doi.org/10.1186/1471-2296-15-19

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2296-15-19

Keywords