Email updates

Keep up to date with the latest news and content from BMC Medical Education and BioMed Central.

Open Access Research article

A method for developing standardised interactive education for complex clinical guidelines

Janet I Vaughan1*, Heather E Jeffery23, Camille Raynes-Greenow2, Adrienne Gordon3, Jane Hirst4, David A Hill5 and Susan Arbuckle6

Author affiliations

1 Maternal-Fetal Medicine Unit, John Hunter Hospital, Lookout Road, New Lambton, NSW, 2305, Australia

2 Sydney School Public Health, Edward Ford Building, University of Sydney, Sydney, NSW, 2006, Australia

3 RPA Newborn Care, Royal Prince Alfred Hospital, Missenden Road, Camperdown, NSW, 2050, Australia

4 Sydney Medical School, University of Sydney, Royal North Shore Hospital, Reserve Road, St Leonards, NSW, 2065, Australia

5 Sydney Medical School, Edward Ford Building University of Sydney, Sydney, NSW, 2006, Australia

6 Histopathology Department, The Children’s Hospital at Westmead, Cnr Hawkesbury Rd and Hainsworth St, Westmead Sydney, NSW, 2145, Australia

For all author emails, please log on.

Citation and License

BMC Medical Education 2012, 12:108  doi:10.1186/1472-6920-12-108


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6920/12/108


Received:12 November 2011
Accepted:25 October 2012
Published:6 November 2012

© 2012 Vaughan et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Although systematic use of the Perinatal Society of Australia and New Zealand internationally endorsed Clinical Practice Guideline for Perinatal Mortality (PSANZ-CPG) improves health outcomes, implementation is inadequate. Its complexity is a feature known to be associated with non-compliance. Interactive education is effective as a guideline implementation strategy, but lacks an agreed definition. SCORPIO is an educational framework containing interactive and didactic teaching, but has not previously been used to implement guidelines. Our aim was to transform the PSANZ-CPG into an education workshop to develop quality standardised interactive education acceptable to participants for learning skills in collaborative interprofessional care.

Methods

The workshop was developed using the construct of an educational framework (SCORPIO), the PSANZ-CPG, a transformation process and tutor training. After a pilot workshop with key target and stakeholder groups, modifications were made to this and subsequent workshops based on multisource written observations from interprofessional participants, tutors and an independent educator. This participatory action research process was used to monitor acceptability and educational standards. Standardised interactive education was defined as the attainment of content and teaching standards. Quantitative analysis of positive expressed as a percentage of total feedback was used to derive a total quality score.

Results

Eight workshops were held with 181 participants and 15 different tutors. Five versions resulted from the action research methodology. Thematic analysis of multisource observations identified eight recurring education themes or quality domains used for standardisation. The two content domains were curriculum and alignment with the guideline and the six teaching domains; overload, timing, didacticism, relevance, reproducibility and participant engagement. Engagement was the most challenging theme to resolve. Tutors identified all themes for revision whilst participants identified a number of teaching but no content themes. From version 1 to 5, a significant increasing trend in total quality score was obtained; participants: 55%, p=0.0001; educator: 42%, p=0.0004; tutor peers: 57%, p=0.0001.

Conclusions

Complex clinical guidelines can be developed into a workshop acceptable to interprofessional participants. Eight quality domains provide a framework to standardise interactive teaching for complex clinical guidelines. Tutor peer review is important for content validity. This methodology may be useful for other guideline implementation.

Keywords:
Practice guidelines as a topic; Implementation; Information dissemination; Education medical continuing; Interprofessional education; Action research; Perinatal mortality; Stillbirth; Fetal death

Background

The global burden of stillbirth currently estimated at 2.64 million per year has gained recent international attention [1]. The magnitude in Australia has not changed over the past two decades [2] with many of the underlying causes unknown because a significant proportion of stillbirths are not investigated appropriately [3]. To assist clinicians in the investigation and audit of perinatal deaths the Perinatal Society of Australia and New Zealand developed the Clinical Practice Guideline for Perinatal Mortality (PSANZ-CPG) [4]. Its systematic use has been shown to reduce stillbirth classified as unexplained by two-thirds i.e. from 34 to 13% [5]. However, the PSANZ-CPG is a long (154 pages) and complex publication providing recommendations for clinicians working in maternity services including obstetricians, midwives, neonatologists, neonatal nurses, pathologists, paediatricians, general practitioners and social workers/bereavement counsellors [4]. Survey evidence from doctors and midwives shows inadequate implementation of PSANZ-CPG at the hospital level with only 42% of respondents even being aware of them [6]. Franke et al. have performed a systematic meta-review to understand factors which influence the implementation of guidelines. The major guideline characteristic associated with non-compliance is complexity with the challenge for developers being to produce usable and understandable guidelines when they are aimed at different target groups with varying educational levels and backgrounds [7].

Inadequate implementation of clinical guidelines is a well acknowledged problem but research into implementation strategies is limited [8-10]. With only 19% of those aware of the PSANZ- CPG having received training in its use, education was the preferred method stated by 90% of survey respondents for improving uptake [6]. Similarly a US survey of specialist obstetricians recommended implementing education strategies to improve care as only 30% of respondents were very comfortable in their knowledge of causes, prevention and management of stillbirth [11]. A recent systematic review of implementation strategies identified that interactive education was consistently effective at achieving changes in clinical processes but acknowledged the lack of clarity in “the most effective mix in interactive education” [12]. We have experience with a teaching method called SCORPIO (Structured, Clinical, Objective Referenced, Problem-oriented, Integrated and Organised) [13]. It combines a mix of interactive and didactic teaching embedded in a framework based on psychological evidence that maximises adult learning [14]. Its effectiveness in changing clinical behaviour to improve health outcomes in a interprofessional clinical setting has been demonstrated [15] but it has not previously been used as a methodology to implement clinical guidelines.

The first major challenge in developing this workshop was simplification of the complexity of content so implementation retained the capacity to improve the intended health outcomes. Secondly the education needed to be relevant to all of the interprofessional participants. Our aim was to transform the PSANZ-CPG into a SCORPIO based education workshop to develop quality standardised interactive education acceptable for learning skills in collaborative interprofessional care.

Methods

The construct for our Perinatal Loss Workshop included an educational framework, guideline transformation process and tutor training methodology.

Educational framework

SCORPIO is a method for teaching a defined curriculum through a series of stations in which trained tutors interact with participants to learn skills [13]. It is based on a module consisting of a study guide, teaching stations and formative assessment representing the three components required for adult learning [14]. As the original SCORPIO methodology was designed for medical student teaching, this study has used a modified methodology for postgraduate interprofessional learning [15].

Study guide

The study guide, containing the teaching aims and the learning objectives for each teaching station, is distributed to participants a number of days before the workshop activating their prior knowledge and informing them of the organizational structure of the workshop.

Teaching stations

The content is delivered using mixed didactic-interactive teaching and ideally each station incorporates at least one different interactive methodology to encourage sustained participant engagement. Examples include: using models for supervised physical examination, using clinical specimens for anatomical examination, structuring a role play to involve all participants, debating an issue, physically plotting measurements on graphs and discussion based on participant experiences. Groups rotate around all of the stations with a break halfway. Ideally each group has 6 participants, but can function adequately with 5. With 6 stations, 36 participants is the maximum number per workshop, but with rest stations and different station rotation formats a minimum of 15 can be accommodated. Each of the 6 teaching stations is structured to teach a specific skill integrated within the workshop topic. Psychomotor, cognitive or attitudinal skills can all be incorporated in the SCORPIO circuit [13]. Each of 6 content expert tutors teaches their allocated station using either the sequence of “tell, show, do, feed-back” or the hypothetico-deductive reasoning sequence embedded in problem-based learning [16]. Prior to the teaching stations the workshop commences with a 15 to 20 minute didactic lecture to the whole group providing an overview of the curriculum topic and informing them of the context and process for the subsequent teaching stations.

Formative assessment

After completing the teaching stations, a formative assessment with feedback is used as learning enhancement to ensure knowledge and understanding of the topic has been achieved [13]. We used structured short answers with immediate feedback in an interactive group session.

Guideline transformation process

The PSANZ-CPG specifically addresses investigation, audit and psychosocial aspects of bereavement to enhance both the accuracy of information about the causes of perinatal death and the quality of care for parents and families [4]. The core information for transformation to six skill-based topics suitable for teaching using the SCORPIO methodology was extracted from key recommendations summarised in the PSANZ-CPG as sections [4]. Each topic formed the basis of a teaching station with one teaching aim and three learning objectives (HEJ, AG). The content within each teaching station was matched to the relevant PSANZ-CPG section and contextualised using clinical examples and/or scenarios. Focussing on essential skills maximised clinical relevance to interprofessional participants. All the content was integrated to form a curriculum that operates in a highly organised framework.

Tutor training

Tutors were selected on the basis of their prior experience with SCORPIO teaching and/or their status as opinion leaders, including consumer group representation. Tutors were required to comply with the SCOPRIO methodology and respond effectively to feedback. Tutors engaged in a series of meetings for the purpose of being instructed in the SCORPIO methodology and practicing their teaching station to ensure that the whole workshop is coordinated and well-timed.

Standardised interactive education

Standardised interactive education we defined as the development of content and teaching standards. Content standards are the knowledge and skills itemised in the curriculum. Teaching standards are the processes which optimise delivery to participants. The core development group comprised 5 clinicians representative of the PSANZ-CPG target audience [JIV,HEJ,AG, JH, SA]. Using participatory action research through a recurring cycle of planning, acting, observing and reflecting [17,18] the ongoing role of the development group was to modify the Perinatal Loss Workshop construct to develop quality standardised interactive education (Figure 1). Contributions to the action research process were derived empirically and produced progressively different versions of the workshop.

thumbnailFigure 1. Participatory action research cycle.

Pilot workshop

After the initial PSANZ-CPG transformation and tutor training was completed a pilot workshop was held to clarify its relevance and acceptability to opinion leaders and policy makers. Key stakeholders were invited including the PSANZ-CPG authors [4], and representatives from the Commonwealth Department of Health and Aging, Royal Australian and New Zealand College of Obstetrics and Gynaecology (RANZCOG), Australia and New Zealand Stillbirth Alliance (ANZSA), Stillbirth Foundation and other consumer groups. Formal evaluation from these interprofessional, participant comments after this workshop provided collaborative critical observation for reflection by the development group (Figure 1).

Subsequent development workshops

Further workshops were held in response to requests from ANZSA and RANZCOG on an ad hoc basis. These workshops provided the opportunity for an empirical mixed methods approach to evolve with feedback from three sources being: interprofessional participants, tutor peers and an independent educator (DH) (Figure 1). Feedback from each source included formalised written responses to the three criteria of “best aspects”, “worst aspects” and “suggestions for improvement” of the workshop. Responses were collated in a written report and distributed to the development team, who used the information to reflect critically on the Perinatal Loss Workshop construct and direct planning and acting in the action research cycle revision process (Figure 1). For analysis, the “worst aspects” and “suggestions for improvement” were combined together and called “quality improvement observations”. This enabled dichotomous analysis of multisource feedback. To compare the different versions of the Perinatal Loss Workshop, all observations were counted and analysed as dichotomous categorical variables with the proportion of “best aspects” expressed as a percentage of the total feedback (“best aspects” and “quality improvement observations”) to give a “total quality score”. Chi-square statistic for trend in proportions was analysed at a significance of 0.05.

Acceptability

An anonymous participant satisfaction questionnaire used fixed response questions to rate the seven items of presentation technique, content, relevance, understanding, interactivity, tutor support and overall rating. A 5- point Likert-type scale rated the responses from 1 to 5 with 1 = “poor” and 5 = “excellent”. A composite mean score (SD) was calculated to measure acceptability of the workshop.

Ethics approval

This project was exempt from Human Research Ethics Committee review according to the NHMRC National statement on research into humans [19] because the education was part of a clinical quality improvement program to implement national guidelines already endorsed in formal policy documents by all State and Territory health departments.

Results

From April 2008 to November 2010, 181 participants attended eight workshops delivered by 15 different tutors and held across five of the seven States and Territories in Australia. Five different iterative versions (Figure 2) resulted from our action research process.

thumbnailFigure 2. Multisource observation used to develop progressive workshop versions (V1 toV5).

Version 1 (pilot workshop)

The pilot workshop was attended by 32 participants from the key stakeholder groups with representation from obstetrics, neonatology, midwifery, nursing, research, policy, education, support/ counselling and consumers.

Versions 2 to 5

149 interprofessional participants included doctors (59.7%), midwives/nurses (28.2%), counsellors/social workers (10.1%) and researchers (2%). Version 2 is known as IMPROVE (Improving Perinatal Outcomes via Education). Versions 3 to 5 is called the Perinatal Loss Workshop.

Standardised interactive education

Thematic analysis of multisource observations during the action research process identified eight recurring interactive education themes listed in Table 1. Each theme is coded as a quality domain (Table 1). Content standards are represented by two themes (1) Inconsistency within the educational framework (SCORPIO curriculum); (2) Content not aligning with PSANZ-CPG. The final content standards are summarised in Table 2. Teaching standards are represented by six themes listed in Table 1 being (3) Information overload; (4) Unacceptable station timing; (5) Didactic delivery; (6) Inadequate clinical relevance; (7) Poor teaching reproducibility; and (8) Incomplete engagement of participants. The workshop version at which each theme was resolved based on quality improvement observation is indicated in Table 1 and examples are provided to illustrate successful theme modification strategies. None of the themes were resolved after versions 1 or 2. Two teaching themes were resolved by version 3 and another by version 4. It was not until version 5 that both the content themes were resolved. The only partially resolved theme was the teaching theme, (8) Incomplete engagement of participants. The analysis of quality of the content and teaching resulting from the action research cycle is shown in Table 3. There is a significantly reducing trend in number of quality improvement observations and increasing trend of total quality scores from all three sources. By the final version 5, participants had no quality improvement observations whilst the educator and tutors did.

Table 1. Interactive education themes used to standardise content and teaching

Table 2. Final content standard

Table 3. Measurement of improving quality

Participant observation

Participant observations were obtained after each workshop (Figure 2). There was a 55% increase in total quality scores (p <0.0001) from versions one to five (Table 3). Participants only ever made observations on four education themes (Table 1). The final version of the Perinatal Loss Workshop received exclusively positive comments from participants, including the two following statements: “I liked the SCORPIO methodology- short, sharp, varied, interactive = power learning” and “a specialised area seen enough in practice to be necessary knowledge but rare enough so that clinical and communication skills and knowledge need workshop training.

Educator observation

An educator assessment was completed at the pilot and workshops two and five corresponding with versions one, two and four (Figure 2). There was a 42% increase in total quality scores (p=0.0004) from versions one to four (Table 3). All the interactive education themes were identified for modification except (7) Poor teaching reproducibility (Table 1). The final educator report after version four included the statement that “the Perinatal Loss workshop was now professionally run by a well trained team and was conducive to effective learning”.

Tutor peer observation

This process was initiated at the second workshop and repeated at workshops four, six and seven permitting observation of versions two to five (Figure 2). There was a 57% increase in total quality scores (p<0.0001) from versions two to five (Table 3). Tutor peer observation identified all eight interactive education themes (Table 1).

Acceptability

The initial satisfaction questionnaire was completed in versions one to three by 83 (89.2%) participants. Results showed composite mean scores for both versions one and two were similar and indicated good to excellent acceptability with a combined score of 4.35 (SD 0.71) where five indicates an “excellent” rating. Composite mean score for version three was also good to excellent but was significantly better with a combined score of 4.81 (SD 0.43), p<0.0001.

From version four a revised and more detailed questionnaire with ten items was introduced (Additional file 1). A five-point Likert-type scale rated participant satisfaction with updating knowledge, updating clinical skills, updating communication skills, the relevance of the aims and objectives, coverage of the aims and objectives, the learning environment, the learning materials, the opportunity for interaction, the workshop set up and overall rating. It was completed by 79 (89.8%) of participants. The composite mean scores for both version four and five were similar and indicated good to excellent acceptability with a combined score of 4.66 (SD 0.53).

Additional file 1. Final Evaluation.

Format: PDF Size: 39KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Discussion

We have demonstrated that an interprofessional workshop can be developed for complex clinical guidelines. Participants found all versions of the workshop highly acceptable. The final versions which had the most complete coverage of the guideline content and which the interprofessional participants evaluated in the most detail, were universally deemed highly satisfactory to update knowledge, clinical skills and communication skills in an interactive learning environment. Following an action research approach, observations on the quality of the education were collated from participants, tutors and an independent educator and used to reflect and sequentially modify the workshop. Incremental resolution was demonstrated across eight quality domains which emerged during this cyclical collaborative process. These domains are: curriculum, alignment, overload, timing, didacticism, relevance, reproducibility and engagement which together provide a framework to standardise interactive teaching for complex clinical guidelines. They enabled maximal enhancement of the content and teaching pedagogy which is appropriate for the target audience. The improving quality of the workshop was demonstrated by the significantly reducing trend in number of quality improvement observations and increasing trend in percentage of positive observations from all three sources.

Grimshaw and Russell reported that educational strategies involving active professional participation, and that are closely linked to clinical decision making, are more likely to be associated with guideline implementation [20]. Research also indicates that involvement of the targeted professionals to test in practice is recommended before implementation, particularly for interprofessional guidelines [21]. Currently there is limited evidence on how to actually develop an educational strategy that fulfils these criteria. Action research is a method used to successfully blend academic and practitioner knowledge pursuit in healthcare as it is conducive to practitioner participation [22]. We integrated all this evidence to develop our interactive workshop and during the process an innovative approach evolved to standardise interactive education for complex clinical guidelines. In designing an effective education implementation strategy, the Cochrane systematic review on improving health outcomes from professional education meetings, acknowledges limitations in that many studies included have inadequate descriptions of their interventions making characterisation of the relevant factors such as level of interactivity and educational intensity not possible to analyse [23]. We feel that the detailed description of the educational intervention we have given illustrates the complexity and also the futility of attempting to assess individual components of an intervention. Ultimately a successful workshop is determined by a number of factors, as we have identified in our eight quality domains.

A major strength of this study was the multisource feedback which provided the observations for cyclical reflection and planning. Whilst more traditional participant observation is beneficial, it has limitations compared with tutor peer observation, in that our participants only recognised quality improvement issues relating to teaching and failed to acknowledge issues related to content. Tutor observation enables more comprehensive standardisation of interactive education as prior knowledge of the curriculum and the guidelines enable both content and teaching to be reviewed and modified appropriately. This is a critical point as effective transformation of guidelines into an education workshop will be dependent on the accurate representation of the content. Feedback obtained after continuing education workshops is usually only obtained from participants therefore significant inadvertent omissions in guideline content may persist unnoticed. A model of collaborative facilitation to reveal and address “blind spots” in learners’ knowledge has previously been reported in medical professional development using participative action research but this did not involve complex guideline implementation [24].

A further strength of this study was the interprofessional participant involvement. Doctors, midwives/nurses, counsellors/social workers, consumers and researchers all participated and through the action research process contributed collaboratively to the development of an interactive workshop that was consistently deemed relevant. Using this educational approach where different health cadres learn together and interact, we found role delineation can be discussed with the aim that participants left the workshop with a clear concept of the guideline areas relevant to their clinical role, but also with a greater appreciation of the roles of their colleagues and of consumer issues. Implementing complex guidelines requires collaborative care involving all members of the health care team and an understanding of the contributions of each provider is essential [25].

A limitation of this research is the relatively small sample size of each workshop. As each version was modified on the basis of only one or two workshops, it is possible that participants in different versions may have had differing levels of clinical and educational expertise which influenced their observation. Hence it is possible that our demonstrated improvement in quality for each version reflected differences in the participants themselves, rather than the educational method. Whilst this possibility is acknowledged, we believe it was unlikely this represented a significant source of confounding as there was consistent diversity in interprofessional background and experience of the participants. Also the improving quality of participant observations was replicated by the independent educator and the varying tutors involved in different versions.

There is conflicting evidence from the literature as to whether single or multifaceted interventions are more effective for implementing guidelines. This may influence policymakers’ decisions as to how they use this workshop given limited health resources [7,26-28]. Franke et al. concludes that in general, multiple strategies are more effective than single as they target different barriers to change [7]. In an obstetric setting this is supported by the systematic review of Chaillet et al. who would recommend that audit and feedback be implemented in addition to quality interactive education [28]. The Perinatal Loss Workshop quality interactive education is intended for national roll-out with the aim of implementing national guidelines to improve clinical practice. This workshop is fortunate to have the endorsement of the major clinical bodies in Australia responsible for the care of families who suffer perinatal loss (ANZSA, RANZCOG, SIDS and Kids, Australian College of Midwives). However, high-level advocacy from State and Territory Health Departments will be essential for widespread implementation to provide gravitas and resources for evaluation and reinforcing strategies.

Conclusions

This description of the development of the Perinatal Loss Workshop has demonstrated how a complex clinical practice guideline (PSANZ-CPG) can be transformed into standardised interactive education based on the SCORPIO method. This has resulted in a workshop that is highly acceptable to an interprofessional audience throughout Australia. It is hoped that other professional groups can learn from this experience and recognise the importance of multisource participatory action research to optimise educational methods. The ultimate aim of clinical practice guidelines is to improve the care and outcomes that patients and their families experience. Thus it is essential that clinical behaviours and/or patient satisfaction are objectively evaluated following wide-scale implementation of an educational workshop and that the cyclical educational improvement process continues.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

Concept and design (JIV, HEJ); collection of data (JIV, HEJ, JH, AG, SA); analysis and interpretation of data (JIV, HEJ, CRG); drafting of the manuscript (JIV); critical revision of the manuscript for important intellectual content (HEJ, CRG,AG, JH, DH); statistical analysis (JIV); provision of study materials (JIV, HEJ, JH, AG, SA); supervision (JIV; HEJ). All authors have read and approved the final manuscript.

Acknowledgements

We acknowledge the work of the Perinatal Society of Australia and New Zealand (PSANZ) Perinatal Mortality Group in collaboration with the Australian and New Zealand Stillbirth Alliance for producing the PSANZ Clinical Practice Guideline for Perinatal Mortality. We thank the Australia and New Zealand Stillbirth Alliance, Department of Obstetrics and Gynaecology at Royal North Shore Hospital in Sydney, NSW Pregnancy and Newborn Services Network and Royal Australian and New Zealand College of Obstetrics and Gynaecology for funding workshop implementation and providing administrative staff for workshop support. We also thank SIDS and Kids NSW for its dedication to this project and the enormous contribution to the development of the psychosocial and social aspects of the project. We thank the Stillbirth Foundation Australia and Regard Ltd for funding educational equipment. We thank Dorney Productions for audiovisual production used in the implementation of the study. We gratefully acknowledge all tutors who contributed to the implementation of this study.

References

  1. Cousens S, Blencowe H, Stanton C, Chou D, Ahmed S, Steinhardt L, Creanga AA, Tuncalp O, Balsara ZP, Gupta S, Say L, Lawn JE: National, regional, and worldwide estimates of stillbirth rates in 2009 with trends since 1995: a systematic analysis.

    Lancet 2011, 377:1319-1330. PubMed Abstract | Publisher Full Text OpenURL

  2. Australian Bureau of Statistics: Perinatal Deaths, Australia, 2009 (cat. no. 3304.0). Canberra; 2011.

    http://www.abs.gov.au/ausstats/abs@.nsf/Products/CA68D0ABFECFDCF4CA2578920015B9AB?opendocument webcite

    OpenURL

  3. Gordon A, Jeffery HE: Classification and description of stillbirths in New South Wales, 2002–2004.

    Med J Aust 2008, 188:645-648. PubMed Abstract | Publisher Full Text OpenURL

  4. Flenady V, King J, Charles A, Gardener G, Ellwood D, Day K, McCowan L, Kent A, Tudehope D, Richardson R, Conway L, Chan A, Haslam R, Khong Y, Perinatal Society of Australia and New Zealand (PSANZ) Perinatal Mortality Group:

    PSANZ Clinical Practice Guideline for Perinatal Mortality. 2009.

    Version 2.2, 2009. [ http://www.psanz.com.au/special-interest-groups/pnm.aspx webcite]

    OpenURL

  5. Headley E, Gordon A, Jeffery HE: Reclassification of unexplained stillbirths using clinical practice guidelines.

    Aust N Z J Obstet Gynaecol 2009, 49:285-289. PubMed Abstract | Publisher Full Text OpenURL

  6. Flenady V, Mahomed K, Ellwood D, Charles A, Teale G, Chadha Y, Jeffery H, Stacey T, Ibiebele I, Elder M, Khong Y, on behalf of the Australian and New Zealand Stillbirth Alliance: Uptake of the Perinatal Society of Australia and New Zealand perinatal mortality audit guideline.

    Aust N Z J Obstet Gynaecol 2010, 50:138-143. PubMed Abstract | Publisher Full Text OpenURL

  7. Francke AL, Smit MC, de Veer AJE, Mistiaen P: Factors influencing the implementation of clinical guidelines for health care professionals: A systematic meta-review.

    BMC Med Inf Decis Mak 2008, 8:38.

    http://www.biomedcentral.com/1472-6947/8/38 webcite

    BioMed Central Full Text OpenURL

  8. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patient’s care.

    Lancet 2003, 362:1225-1230. PubMed Abstract | Publisher Full Text OpenURL

  9. Davis DA, Taylor-Vaisey A: Translating guidelines into practice: a systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines.

    CMAJ 1997, 157:408-416. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman A, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings.

    BMJ 1998, 317:465-468. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Duke W, Shin M, Correa A, Alverson C: Survey of knowledge attitudes and practice management patterns of Atlanta-Area obstetricians regarding stillbirth.

    Womens Health Issues 2010, 20:366-370. PubMed Abstract | Publisher Full Text OpenURL

  12. Prior M, Guerin M, Grimmer-Somers K: The effectiveness of clinical guideline implementation strategies- a synthesis of systematic review findings.

    J Eval Clin Pract 2008, 14:888-897. PubMed Abstract | Publisher Full Text OpenURL

  13. Hill DA: SCORPIO: a system of medical teaching.

    Med Teach 1992, 14:37-41. PubMed Abstract | Publisher Full Text OpenURL

  14. Norman GR, Schmidt HG: The psychological basis of problem-based learning: a review of the evidence.

    Acad Med 1992, 67:557-565. PubMed Abstract | Publisher Full Text OpenURL

  15. Jeffery HE, Kocova M, Tozija F, Gjorgiev D, Pop-Lazarova M, Foster K, Polverino J, Hill DA: The impact of evidence-based education on a perinatal capacity-building initiative in Macedonia.

    Med Educ 2004, 38:435-447. PubMed Abstract | Publisher Full Text OpenURL

  16. Barrows HS: Problem-based self-directive learning: a stident perspective.

    JAMA 1983, 250:3077-3080. PubMed Abstract | Publisher Full Text OpenURL

  17. Mash B, Meulenberg-Buskens I: ‘Holding it lightly’: the co-operative inquiry group: a method for developing educational materials.

    Med Educ 2001, 35:1108-1114. PubMed Abstract | Publisher Full Text OpenURL

  18. Meyer J: Using qualitative methods in health related action research.

    BMJ 2000, 320:178-181. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  19. National Health and Research Council:

    National Statement on Ethical Conduct in Human Research. Canberra. 2007.

    http://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/e72.pdf webcite

    OpenURL

  20. Grimshaw JM, Russell IT: Achieving health gain through clinical guidelines II: ensuring guidelines change medical practice.

    Qual Health Care 1994, 3:45-52. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  21. The Agree Collaboration: Appraisal of Guidelines for Research & Evaluation (AGREE) Instrument. London; 2001.

    http://www.agreecollaboration.org/pdf/agreeinstrumentfinal.pdf webcite

    PubMed Abstract | Publisher Full Text OpenURL

  22. Cornelissen E, Mitton C, Sheps S: Knowledge translation in the discourse of professional practice.

    Int J Evid Based Healthc 2011, 9:184-188. PubMed Abstract | Publisher Full Text OpenURL

  23. Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes.

    Cochrane Database Syst Rev 2009, 2:CD003030.

    http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD003030.pub2/pdf webcite

    PubMed Abstract | Publisher Full Text OpenURL

  24. Gleeson C: Education beyond competencies: a participative approach to professional development.

    Med Educ 2010, 44:404-411. PubMed Abstract | Publisher Full Text OpenURL

  25. Delva D, Tomalty L, Macrae K, Payne P, Plain E, Rowe W: A new model for collaborative continuing professional development.

    J Interprof Care 2008, 22(Suppl 1):91-100. PubMed Abstract | Publisher Full Text OpenURL

  26. Grimshaw JM, Thomas RE, Maclennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline and implementation strategies.

    Health Technol Assess 2004, 8:1-72.

    http://www.hta.ac.uk/fullmono/mon806.pdf webcite

    PubMed Abstract | Publisher Full Text OpenURL

  27. Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998.

    J Gen Intern Med 2006, 21(Suppl 2):S14-S20. PubMed Abstract | PubMed Central Full Text OpenURL

  28. Chaillet N, Dube E, Dugas M, Audibert F, Tourigny C, Fraser WD, Dumont A: Evidence-based strategies for implementing guidelines in obstetrics: a systematic review.

    Obstet Gynecol 2006, 108:1234-1245. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6920/12/108/prepub