Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Research article

Stakeholder perspectives on implementing accreditation programs: a qualitative study of enabling factors

Reece Hinchcliff1*, David Greenfield1, Johanna I Westbrook2, Marjorie Pawsey1, Virginia Mumford1 and Jeffrey Braithwaite1

Author Affiliations

1 Centre for Clinical Governance Research, Australian Institute of Health Innovation, University of New South Wales, Sydney 2052, Australia

2 Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, University of New South Wales, Sydney 2052, Australia

For all author emails, please log on.

BMC Health Services Research 2013, 13:437  doi:10.1186/1472-6963-13-437

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/13/437


Received:19 March 2013
Accepted:21 October 2013
Published:24 October 2013

© 2013 Hinchcliff et al.; licensee BioMed Central Ltd.

This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Accreditation programs are complex, system-wide quality and safety interventions. Despite their international popularity, evidence of their effectiveness is weak and contradictory. This may be due to variable implementation in different contexts. However, there is limited research that informs implementation strategies. We aimed to advance knowledge in this area by identifying factors that enable effective implementation of accreditation programs across different healthcare settings.

Methods

We conducted 39 focus groups and eight interviews between 2011 and 2012, involving 258 diverse healthcare stakeholders from every Australian State and Territory. Interviews were semi-structured and focused on the aims, implementation and consequences of three prominent accreditation programs in the aged, primary and acute care sectors. Data were thematically analysed to distil and categorise facilitators of effective implementation.

Results

Four factors were identified as critical enablers of effective implementation: the accreditation program is collaborative, valid and uses relevant standards; accreditation is favourably received by health professionals; healthcare organisations are capable of embracing accreditation; and accreditation is appropriately aligned with other regulatory initiatives and supported by relevant incentives.

Conclusions

Strategic implementation of accreditation programs should target the four factors emerging from this study, which may increase the likelihood of accreditation being implemented successfully.

Keywords:
Implementation research; Accreditation; Quality improvement; Quality and safety; Health services research; Knowledge translation; Organisational context; Qualitative research; Interviews; Focus groups

Background

Substandard healthcare is a significant global problem with serious human and financial impacts [1-3]. Accreditation programs are system-wide interventions aiming to improve the quality and safety of healthcare organisations by applying standards and promoting uptake of evidence-based clinical and organisational practices [4-6]. Despite the substantial worldwide financial investments in accreditation [7,8], the evidence-base supporting its effectiveness is weak and contradictory [6,9]. As with other quality and safety interventions [10,11], inconsistent outcomes may result from variable implementation in different settings.

Relatively little research has focused on approaches to accreditation implementation or their effectiveness. A recent review of the accreditation literature identified approximately 3,000 papers referenced in academic databases (e.g. Medline) concerning accreditation, but only 122 were classified as studies employing one or more research methods to collect or analyse data [9]. Merely 12 of these studies, in whole or in part, explicitly examined factors influencing the implementation of accreditation programs [12-23].

One study investigating program uptake and impacts amongst five Canadian healthcare organisations focused on implementation at an organisational level [23]. Distributed staff responsibility for quality and safety was identified as an important implementation facilitator. Health policies and macro-economic forces were also highlighted as critical implementation influences. In addition, health professionals were commonly found to conceptualise accreditation differently (e.g. variously as a regulatory obligation, method to obtain financial incentives, or tool to validate local quality improvement efforts), resulting in organisations enacting programs in diverse ways.

Another study investigated variables contributing to the successful implementation of accreditation programs in low and middle income countries [22]. The need for continual refinement in accreditation agency operations and program delivery was noted. The importance of two system-level factors was highlighted: ongoing and stable financial and policy support from government; and incentives for healthcare organisations to participate in programs.

These examples suggest that factors arising from program, individual, organisational and system-level domains may enable the effective implementation of accreditation programs. We conceptualise effective implementation as constituting processes that best allow accreditation programs to promote improvements to health service quality and patient safety. Yet the limited published research impedes evidence-informed design of implementation strategies. The scarcity of evidence may be due, in part, to the complexity and diversity of programs. For example, programs can involve varied combinations of activities such as: self-assessment by healthcare organisations; external assessment by surveyors on behalf of accreditation agencies; the presentation of an appraisal report to organisations; and actions undertaken by participating organisations to address recommendations [24,25]. Accreditation’s heterogeneity has largely impeded the development of implementation theories that can be generalised across different programs.

Implementation research concerning accreditation has the additional challenge of accounting for the varied and multifaceted contexts in which programs are enacted. Accreditation is practiced in a range of publicly and privately owned healthcare organisations [9]. These organisations are ‘complex adaptive systems’ [26,27] composed of, and continually modified in response to, a multitude of interconnected service delivery practices undertaken by different combinations of professionals for varied consumer groups. Furthermore, health systems respond to external pressures [28], and studies have demonstrated the influence of different macro-level factors on the implementation of complex interventions [29-31]. Due to accreditation’s role as a system-level quality and safety intervention, it is reasonable to assume that similar factors may influence the implementation of accreditation programs.

A key implication of the limited accreditation literature that addresses implementation issues is that factors enabling effective implementation are likely to be varied, arising from individual, program, organisational and system-level domains. Yet no single study has explored a wide range of factors and how they may overlap. We aimed to address this knowledge-gap by critically examining Australian healthcare stakeholders’ views regarding the range of factors influencing the implementation of three Australian accreditation programs.

Methods

Study context

The study forms one part of the ACCREDIT (Accreditation Collaborative for the Conduct of Research, Evaluation and Designated Investigations through Teamwork) Project, led by researchers at the Australian Institute of Health Innovation, University of New South Wales [32]. Protocols regarding current and planned ACCREDIT studies are detailed elsewhere [32-34].

The collaboration includes the leading accreditation agencies from the aged, primary and acute care sectors of the Australian health system: Aged Care Standards and Accreditation Agency (ACSAA); Australian General Practice Accreditation Limited (AGPAL); and The Australian Council on Healthcare Standards (ACHS) [35]. The specific characteristics of each agency’s accreditation program are contextually shaped by the varied sectors where they operate. For example, there is greater reliance on professional rather than peer-surveyors in the ACSAA program compared to ACHS or AGPAL. Nonetheless, these programs share the same set of core accreditation activities described previously in this paper. Therefore, the implementation of each program is likely to be mediated by a similar range of enablers.

Sample and procedure

Management teams in the accreditation agencies provided contact details of representatives from 33 organisations they nominated as key stakeholders with significant knowledge of accreditation processes. While nation-wide representation was not explicitly sought by the research team, the representatives nominated by accreditation agencies came from multiple geographic locations (metropolitan, regional and remote) and jurisdictions (all States and Territories), providing a national perspective. The majority were drawn from acute care settings, a focus of current Australian healthcare reforms [36]. The sample was supplemented with a range of health professionals from accredited public and privately funded healthcare organisations, including medical, nursing and allied health professionals, in addition to administrative staff and managers. As accreditation has been part of the Australian health system for several decades, study participants had detailed, first-hand experience of accreditation programs and processes.

Thirty-nine focus groups and eight individual interviews involving 258 participants were conducted between August 2011 and February 2012. Focus groups involved between three and eight participants. Table 1 provides a breakdown of the data collection activities undertaken with different stakeholder groups in each healthcare sector. The research team’s prior accreditation research experience [5,21,22,24,25,37-39] suggested that thematic saturation [40] (i.e. when no new themes or categories emerge from the data) would be reached with this sample size. Focus groups were preferred for their ability to elicit communication between research participants, which helped generate additional insights from one-on-one interviews [41]. Nonetheless, eight stakeholders nominated interviews as their preferred medium of participation. Interviews and focus groups lasted approximately one hour.

Table 1. Study sample and data collection activities

A semi-structured interview guide was developed and used for the data collection activities. Three broad groups of issues were covered: the aims, implementation and consequences of accreditation programs. These topics were informed by prior reviews of the accreditation literature [6,9] and ongoing discussions with accreditation agency partners. Use of an open-ended guide allowed new concepts to be discussed in the focus groups and interviews. Participants were not explicitly asked to discuss factors enabling the effective implementation of programs. Instead, this information was indirectly elicited by analysing participants’ discussions of the broad issues raised. This strategy prevented the interviewers and focus group conveners from overly steering participant responses and biasing the results. Due to the widespread and long-term nature of Australian healthcare organisations’ enrolment in accreditation programs [5], implementation was conceptualised as an ongoing process rather than a discrete event. Two experienced research team members (RH and DG) collaboratively coordinated and conducted data collection.

Recruitment

Organisations nominated as key stakeholders were recruited via email. The project and roles of participants were explained, and assurances of confidentiality provided, using information and consent forms approved by the University of New South Wales Human Research Ethics Committee [42]. Two stakeholders declined the invitation to participate in the study, producing a response rate of 94%. Health professionals were recruited at 14 educational workshops run by accreditation agencies throughout three Australian States during 2011. A convenience sample of approximately five health professionals from each workshop participated in the study.

Analytical procedures

Two research team members (RH and DG) collaboratively reflected on their data collection experiences and discussed prominent issues raised by participants. Next, thematic analysis [43] of interview and focus group transcriptions was undertaken using textual grouping software, NVivo v.9 [44] to facilitate systematic classification of data [45]. Emergent themes were categorised into explicitly defined, overarching factors that participants perceived to enable program implementation. Analysis was performed at the individual participant level, with key findings generated using the entire dataset, rather than specific stakeholder groups. We aimed to identify factors enabling implementation that were relevant across the three accreditation programs involved in the study, as perceived by the entire range of participants. The analytical focus on developing broadly generalisable conclusions increased the likelihood of the study results being relevant to other accreditation programs operating in Australia and internationally.

The study aim was to uncover participant views and ideas, so there were no size limits placed on segments of coded text [46]. The use of a semi-structured interview guide, where the issues raised with participants were differentially focused upon and phrased to reflect their specific expertise and interests, meant that frequency counts of participant statements was not an appropriate analytical strategy. For consistency, coding was completed by one author (RH) with qualitative data analysis experience [21,47-49]. The sample was found to be sufficiently large to reach thematic saturation regarding the key study foci. The research team also aims to use additional insights drawn from the dataset, regarding accreditation programs and processes, in future studies that are not directly related to the results presented in this paper.

To increase study rigour, results were reported to Australian and international healthcare stakeholders via health services research and quality and safety conference presentations to test and confirm the validity, significance and relevance of the findings. The questions and comments received from conference participants indicated that the results were relevant and likely generalizability across different healthcare settings. The research team also discussed the results with the management teams of each accreditation agency project partner, who expressed similar support for the main study assertions.

Results

Participant responses highlighted nine themes that collapsed into four discrete individual, program, organisational and system-level factors (Table 2). Each of the factors and themes are described in further detail below, with illustrative participant quotes.

Table 2. Key individual, program, organisational and system-level factors and themes perceived to enable implementation of accreditation programs

The program is collaborative, valid and uses relevant standards

Participants valued accreditation agencies and programs which use a collaborative and mentoring ethos. As an accreditation agency manager noted about accreditation, “it’s about a system that’s actually saying, ‘you know, we’re helping you do that.’ Not about saying, ‘This is where you are. When we come back next time, we’ll see if you’ve moved.’” The ethos underlying programs was presented as critical in shaping core accreditation components.

It was commonly suggested that program implementation within healthcare organisation units is best enabled by standards focused on issues directly relevant to the daily activities of frontline health professionals. However, the challenge of developing universal standards that clearly articulate specific organisational requirements was widely acknowledged. A respondent argued, “there’s got to be a shared understanding of what they [standards] mean … it's impossible if the organisation understands the standard to be one thing and the surveyor understands it to mean another.”

External organisational auditing or assessment via accreditation surveys was presented as another program component contributing to effective implementation. Perceived low level inter-rater reliability within programs was seen to disengage frontline health professionals and managers. As a healthcare professional stated, “I agree that auditing is an art and not a science, and this impacts on the validity of the survey process because you are never sure exactly what you’re going to be assessed against, which compromises the validity of the whole process.” Several factors were viewed as capable of promoting inter-surveyor reliability, including transparent interpretation processes and surveyor workforces with appropriate capacity.

Accreditation is favourably received by health professionals

Participants held that health professionals’ comprehension of the utility and value of accreditation modifies their engagement in programs. Professionals were characterised as often harbouring doubts about the ability of accreditation to promote organisational and health system improvements. Such views were linked to broader questions regarding the allocation of time and attention to quality improvement practices, as opposed to patient-centred clinical care, within healthcare organisations. The issue was summed up this way: “clinicians are so busy providing care, they really don't get quality. It’s just a pain … quality is some person from some unit hidden in the bowels of the hospital … asking them to go over a whole heap of information because some people roll up with clipboards.”

Participants opposing accreditation concentrated their critique on whether the real or even intended benefits of programs are worth the costs required for organisations to participate. A respondent expressed these concerns as follows, “there has been no cost benefit analysis of the accreditation system and therefore it is difficult to articulate the social and economic benefits of investment … [Stakeholders] have consistently over the last decade made formal and informal comments … that the cost of accreditation is too high.” Positive and regular accreditation agency feedback to healthcare organisations about their performance, delivered using effective communication strategies, was described as one clear way that support for accreditation amongst health professionals may be increased. There was the need, as one participant succinctly put it, “to translate the language of accreditation to frontline staff and then for them to say, ‘oh, this is about the work we do’, and get them to understand.” When asked to explain what effective communication of accreditation programs and requirements to health professionals may encompass, one respondent used the following terms:

“Engaging with the organisation in terms of we are here to assist and support you. This is a partnership. This is not an audit. This is not a tax investigation where we’re just going to tick boxes or cross boxes. If that partnership can develop, then there’s a real opportunity … to educate and support and strengthen and sew those seeds that the organisation can then continue to grow in the continuing cycle of improvement.”

Healthcare organisations are capable of embracing accreditation

Two interrelated attributes of healthcare organisations were proposed to enable effective implementation of accreditation programs: credible leaders that champion continuous quality improvement (CQI) and the role of accreditation; and organisational cultures which promote collective staff ownership for CQI.

Discussions of effective leadership focused on the importance of modelling positive ideals and championing accreditation-related quality improvement practices. In describing the link between leadership and accreditation, a healthcare professional noted, “[leadership] is what drives quality and safety because it requires people’s motivation. Accreditation is really what drives or gives us direction, but you won't get very far if you don't have that leadership and support.” Another respondent further explained how ineffective leadership of healthcare organisations can impede the implementation of accreditation programs, “I’ve still got leaders who don't think safety and quality should be on the agenda. So, for us, it’s [accreditation] quite difficult. And maybe that is a part of the cultural values of an organisation, but some of it is part of ingrained, you know, ageing leaders that, you know, don’t think that this is useful.”

In addition to individual leadership, a distributed model of CQI leadership was seen as fundamentally related to the presence of organisational cultures based on collective responsibility for quality and safety. A healthcare consumer highlighted how CQI culture was seen to mediate the style of healthcare organisations’ participation in programs, “there’s the group that just tick all the boxes for the purposes of accreditation and then there’s the group that really believe that we will do all this … because we want the improved patient care.”

Accreditation is appropriately aligned with other regulatory initiatives and supported by relevant incentives

Respondents reported that accreditation and other regulatory initiatives, including State or Federal licensing requirements, can be a burden on healthcare organisations. Participants emphasised the importance of accreditation programs and other regulatory initiatives coalescing to target separate, though interlinked, quality and safety priorities in healthcare delivery. A government representative interconnected them in this way: “the basic [licensing] comes first and then the quality assurance processes and mechanisms [accreditation] build on top.” Broad stakeholder agreement regarding the explicit role of accreditation programs, relative to other regulatory initiatives, was viewed as necessary for effective program implementation. One respondent further explained that inappropriate alignment of accreditation and regulation is a key barrier to effective quality and safety governance within their specific healthcare sector:

“The interplay between regulation and the [accreditation] standards … it’s that whole. What’s missing, from my perspective, is that whole community and industry and, you know, government, like, holistic idea of everything that we want to achieve from the system, rather than just the portions … all the different bits that we are trying to separately achieve … We’re still working at cross purposes to some extent. So the issue from my perspective is really … the global consideration of how that fits in.”

Financial incentives offered by governments and insurers to encourage organisational participation in programs were frequently highlighted. Their impact was especially emphasised by participants from the primary care sector who discussed the key role of payments from the Practice Incentives Program (PIP) [50]. One stakeholder explained it in the following terms: “putting a financial incentive on the table gathers the swinging voters … a significant number of practices are participating because there are financial returns.”

Discussion

Systems-level research incorporating nation-wide perspectives is rare. To our knowledge, this is the first national study to examine stakeholders’ views on the implementation of accreditation programs. The key findings of this study are that implementation is more likely to be successful when accreditation programs and their standards are suitable and reliable, positively received by healthcare professionals and organisations, and supported by regulatory initiatives. While prior research [12-23] has identified the importance of these factors individually, this study is the first to demonstrate the importance of concurrent implementation enablers from multiple domains.

The conceptual model presented in Figure 1 provides a heuristic device highlighting how each of the enabling factors and themes identified in this study coalesce to facilitate effective implementation of accreditation programs. Enablers are presented in a four-tiered hierarchy spanning the systems-level, accreditation program characteristics, healthcare organisation characteristics, and the views of health professionals. Accreditation program implementation is positioned at the Figure’s centre, directly or indirectly related to each enabler. Arrows indicate the directionality of inter-enabler relationships.

thumbnailFigure 1. Conceptual model of the relationships between key factors and themes enabling the effective implementation of health service accreditation programs.

The results of this study suggest that systems-level factors (that is, regulatory initiatives and financial incentives) can affect the ethos underlying accreditation programs, which affects their standards and surveying practices. Financial incentives can directly influence the views of individual health professionals regarding the benefits, relative to costs, of accreditation programs. Professionals’ views are interrelated with health service leadership and CQI culture, which are critical organisational characteristics that, along with regulatory initiatives, can influence health service quality and safety practices. The convoluted web of relationships that emerge from the results helps to draw attention to the significant challenge of implementing large-scale change in complex, adaptive healthcare systems [26,27].

Given the findings, what would help those implementing an accreditation program in Australia or internationally to increase their prospects? The findings support prior studies that highlight the influence of organisational features, including leadership and culture, on the implementation of quality and safety interventions [51,52]. Effective implementation of accreditation programs at an organisational level may require ‘change champions’ to support implementation. There may be an important role for distributed leadership [35,52] to help share experiences and institutionalise organisational cultures focused on CQI. Such cultures can foster engagement in programs, rather than pragmatic participation focused on conforming to the minimum program requirements needed to obtain financial incentives.

Participants’ views were consistent with prior research demonstrating that the components of quality and safety interventions can differentially influence their implementation [30]. However, the few evaluations of accreditation’s impacts on healthcare organisations provide limited information regarding the constituent elements of individual programs [9], such as standards and surveying methods.

The results highlight that effective implementation requires health professionals to embrace accreditation as a legitimate quality and safety tool. The literature shows that individual engagement on a mass scale can result in ‘organisational willingness to change’ [53]. Yet we uncovered that professionals’ views of the utility and value of programs were highly varied. This is problematic, as previous research has concluded that effective implementation requires divergent views of complex healthcare interventions to achieve some measure of agreement [54]. Stakeholder perceptions of accreditation were found to be influenced by the ‘framing’ [55] of programs. Effective framing necessitates use of targeted strategies to render information meaningful and engaging to diverse groups [56-58]. It follows that implementation of accreditation programs may be more effective when program aims, requirements and benefits are conceptually unified, yet articulated differently using language and formats that appeal to the cultures and normative practices of different professional groups.

Along with the presence or absence of financial incentives to promote organisational participation in accreditation, confusion regarding accreditation’s aims, compared to other regulatory mechanisms, is likely to mediate how effectively programs are implemented at a health system level. The results imply that policymakers and regulators should ensure that accreditation and other regulatory measures mutually reinforce, rather than overlap, duplicate or conflict with each other.

Our focus on three different accreditation programs operating across the Australian health system produced consistent findings that are likely to be relevant to other programs and countries. Feedback received from conference presentations [59,60] showed their congruence with international healthcare stakeholders’ experiences.

As to limitations, the sample was not randomised. Involved stakeholder groups were purposively selected by partner accreditation agencies, and healthcare professionals that participated in the study were a convenience sample. This sampling strategy may have biased the results. Mitigating this, we reached saturation of themes via a large sample of participants. Also, additional insights may have been obtained by increasing the length of time provided for focus groups. Furthermore, while rigorous methods were used to codify the views of a range of stakeholders, these remain participants’ perceptions rather than actual data on effective implementation. Additionally, while our aim was to generate broadly generalisable conclusions using the entire range of participant views, further insights could have potentially been reached by specifically comparing the views of different stakeholder groups across the three healthcare sectors involved in this study.

Conclusions

Accreditation programs are complex quality and safety interventions, implemented adaptively and dynamically in response to varied contextual stimuli arising from different health system domains. Appreciation of the role and function of enabling factors and themes identified in this study, as well as their interrelationships, is likely to increase the likelihood of accreditation programs being implemented effectively.

Competing interests

All authors declare that they have no competing interests.

Authors’ contributions

JB and JIW conceived of the study. RH, DG and VM obtained the study data. All authors contributed to the interpretation and writing of the findings, and approved the final version to be published.

Acknowledgements

We acknowledge the staff of our industry partners (ACHS, AGPAL, ACSAA) and quality improvement agencies (Australian Commission on Safety and Quality in Health, Clinical Excellence Commission) who have provided project support.

References

  1. Jha AK, Prasopa-Plaizier N, Larizgoitia I, Bates DW: Patient safety research: an overview of the global evidence.

    Qual Saf Health Care 2010, 19:42-47. PubMed Abstract | Publisher Full Text OpenURL

  2. de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA: The incidence and nature of in-hospital adverse events: a systematic review.

    Qual Saf Health Care 2008, 17:216-223. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Wilson RM, Michel P, Olsen S, Gibberd RW, Vincent C, El-Assady R, Rasslan O, Qsous S, Macharia WM, Sahel A, et al.: Patient safety in developing countries: retrospective estimation of scale and nature of harm to patients in hospital.

    BMJ 2012, 344:e832. PubMed Abstract | Publisher Full Text OpenURL

  4. Schmaltz SP, Williams SC, Chassin MR, Loeb JM, Wachter RM: Hospital performance trends on national quality measures and the association with joint commission accreditation.

    J Hosp Med 2011, 6:458-465. OpenURL

  5. Braithwaite J, Westbrook J, Pawsey M, Greenfield D, Naylor J, Iedema R, Runciman B, Redman S, Jorm C, Robinson M, et al.: A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737].

    BMC Health Serv Res 2006, 6:113-123. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  6. Greenfield D, Braithwaite J: Health sector accreditation research: a systematic review.

    Int J Qual Health Care 2008, 20:172-183. PubMed Abstract | Publisher Full Text OpenURL

  7. Appleyard G, John Ramsay and Associates Pty Ltd: Cost analysis of safety and quality accreditation in the Australian health system. Sydney: Australian Commission for Safety and Quality in Health Care; 2008. OpenURL

  8. Doyle G, Grampp C: Accreditation as a quality tool in public sector reform: the fourth stage of convergence. Dublin: University College Dublin; 2008. OpenURL

  9. Hinchcliff R, Greenfield D, Westbrook J, Moldovan M, Pawsey M, Mumford V, Braithwaite J: Narrative synthesis of health service accreditation literature.

    BMJ Qual Saf 2012, 21:979-991. PubMed Abstract | Publisher Full Text OpenURL

  10. Lavis JN: How can we support the use of systematic reviews in policymaking?

    PLoS Med 2009, 6:e1000141. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Panisset U, Koehlmoos T, Alkhatib A, Pantoja T, Singh P, Kengey-Kayondo J, McCutchen B, Miguel GB: Implementation research evidence uptake and use for policy-making.

    Health Res Policy Syst 2012, 10:20. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  12. Bukonda N, Tavrow P, Abdallah H, Hoffner K, Tembo J: Implementing a national hospital accreditation program: the Zambian experience.

    Int J Qual Health Care 2003, 14(suppl 1):7-16. OpenURL

  13. Campbell SM, Chauhan U, Lester H: Primary Medical Care Provider Accreditation (PMCPA): pilot evaluation.

    Br J Gen Pract 2010, 60:295-304. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Cleveland EC, Dahn BT, Lincoln TM, Safer M, Podesta M, Bradley E: Introducing health facility accreditation in Liberia.

    Glob Public Health 2011, 6:271-282. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Gillon M, Buetow S, Wellingham J, Talboys S: A practical approach to quality improvement: the experience of the RNZCGP practice standards validation field trial.

    N Z Med J 2003, 116:U682. PubMed Abstract OpenURL

  16. Moe JL, Pappas G, Murray A: Transformational leadership, transnational culture and political competence in globalizing health care services: a case study of Jordan's King Hussein Cancer Center.

    Global Health 2007, 3:11. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  17. Nandraj S, Khot A, Menon S, Brugha R: A stakeholder approach towards hospital accreditation in India.

    Health Policy Plan 2001, 16(Suppl 2):70-79. PubMed Abstract | Publisher Full Text OpenURL

  18. O'Connor E, Fortune T, Doran J, Boland R: Involving consumers in accreditation: the Irish experience.

    Int J Qual Health Care 2007, 19:296-300. PubMed Abstract | Publisher Full Text OpenURL

  19. Pongpirul K, Sriratanaban J, Asavaroengchai S, Thammatach-Aree J, Laoitthi P: Comparison of health care professionals' and surveyors' opinions on problems and obstacles in implementing quality management system in Thailand: a national survey.

    Int J Qual Health Care 2006, 18:346-351. PubMed Abstract | Publisher Full Text OpenURL

  20. Zeh CE, Inzaule SC, Magero VO, Thomas TK, Laserson KF, Hart CE, Nkengasong JN: Field experience in implementing ISO 15189 in Kisumu, Kenya.

    Am J Clin Pathol 2010, 134:410-418. PubMed Abstract | Publisher Full Text OpenURL

  21. Greenfield D, Hinchcliff R, Westbrook M, Jones D, Low L, Johnston B, Banks M, Pawsey M, Moldovan M, Westbrook J, Braithwaite J: An empirical test of accreditation patient journey surveys: randomised trial.

    Int J Qual Health Care 2012, 24:495-500. PubMed Abstract | Publisher Full Text OpenURL

  22. Braithwaite J, Shaw CD, Moldovan M, Greenfield D, Hinchcliff R, Mumford V, Kristensen MB, Westbrook J, Nicklin W, Fortune T, Whittaker S: Comparison of health service accreditation programs in low- and middle-income countries with those in higher income countries: a cross-sectional study.

    Int J Qual Health Care 2012, 24:568-577. PubMed Abstract | Publisher Full Text OpenURL

  23. Pomey M-P, Lemieux-Charles L, Champagne F, Angus D, Shabah A, Contandriopoulos A-P: Does accreditation stimulate change?A study of the impact of the accreditation process on Canadian healthcare organizations.

    Implement Sci 2010, 5:31. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  24. Braithwaite J, Greenfield DR, Westbrook JI, Pawsey M, Westbrook MT, Gibberd R, Naylor JM, Nathan SA, Robinson M, Runciman W, et al.: Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study.

    Qual Saf Health Care 2010, 19:14-21. PubMed Abstract | Publisher Full Text OpenURL

  25. Greenfield D, Pawsey M, Braithwaite J: Accreditation: a global regulatory mechanism to promote quality and safety. In Continuous quality improvement in health care. 4th edition. Edited by Sollecito W, Johnson J. New York: Jones and Barlett Learning; 2013:513-531. OpenURL

  26. Begun JW, Zimmerman B, Dooley K: Health care organizations as complex adaptive systems. Edited by Mick SM, Wyttenbach M. San Francisco: Jossey-Bass; 2003:253-288. [Advances in Health Care Organization] OpenURL

  27. Braithwaite J, Clay Williams R, Nugus P, Plumb J: Health care as a complex adaptive system. Edited by Hollnagel E, Braithwaite J, Wears R. London: Ashgate; [Resilient health care]

    in press

    OpenURL

  28. Agyepong IA, Kodua A, Adjei S, Adam T: When ‘solutions of yesterday become problems of today’: crisis-ridden decision making in a complex adaptive system (CAS) - the Additional Duty Hours Allowance in Ghana.

    Health Policy Plan 2012, 27(suppl 4):iv20-iv31. PubMed Abstract | Publisher Full Text OpenURL

  29. Urquhart R, Porter GA, Grunfeld E, Sargeant J: Exploring the interpersonal-, organization-, and system-level factors that influence the implementation and use of an innovation-synoptic reporting-in cancer care.

    Implement Sci 2012, 7:12. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  30. Fixsen DL, Naoom SF, Blasé KA, Friedman RM, Wallace F: Implementation research: a synthesis of the literature. Tampa: University of South Florida; 2005. OpenURL

  31. Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, Margolis P: The influence of context on quality improvement success in health care: a systematic review of the literature.

    Milbank Q 2010, 88:500-559. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Braithwaite J, Westbrook J, Johnston B, Clark S, Brandon M, Banks M, Hughes C, Greenfield D, Pawsey M, Corbett A, et al.: Strengthening organizational performance through accreditation research: the ACCREDIT project.

    BMC Res Notes 2011, 4:390. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  33. Greenfield D, Hinchcliff R, Moldovan M, Mumford V, Pawsey M, Westbrook JI, Braithwaite J: A multimethod research investigation of consumer involvement in Australian health service accreditation programmes: the ACCREDIT-SCI study protocol.

    BMJ Open 2012, 2:e002024. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  34. Hinchcliff R, Greenfield D, Moldovan M, Pawsey M, Mumford V, Westbrook JI, Braithwaite J: Evaluation of current Australian health service accreditation processes (ACCREDIT-CAP): protocol for a mixed-method research project.

    BMJ Open 2012, 2:e001726. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Greenfield D, Braithwaite J, Pawsey M, Johnson B, Robinson M: Distributed leadership to mobilise capacity for accreditation research.

    J Health Organ Manag 2009, 23:255-267. PubMed Abstract | Publisher Full Text OpenURL

  36. Australian Commission on Safety and Quality in Health Care (ACSQHC): National Safety and Quality Health Service Standards. Sydney: Commonwealth of Australia; 2011. OpenURL

  37. Greenfield D, Pawsey M, Hinchcliff R, Moldovan M, Braithwaite J: The standard of healthcare accreditation standards: a review of empirical research underpinning their development and impact.

    BMC Health Serv Res 2012, 12:329. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  38. Greenfield D, Pawsey MJB: What motivates health professionals to engage in the accreditation of healthcare organizations?

    Int J Qual Health Care 2011, 23:8-14. PubMed Abstract | Publisher Full Text OpenURL

  39. Greenfield D, Moldovan M, Westbrook M, Jones D, Low L, Johnston B, Clark S, Banks M, Pawsey M, Hinchcliff R, et al.: An empirical test of short notice surveys in two accreditation programs.

    Int J Qual Health Care 2012, 24:65-71. PubMed Abstract | Publisher Full Text OpenURL

  40. Yin R: Case study research: design and methods. 2nd edition. Thousand Oaks: Sage; 2003. OpenURL

  41. Kitzinger J: Qualitative research: introducing focus groups.

    BMJ 1995, 311:299-302. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  42. Human Research Ethics Committee (HREC).

    http://research.unsw.edu.au/human-research-ethics-committee-hrec webcite

    OpenURL

  43. Braun V, Clarke V: Using thematic analysis in psychology.

    Qual Res Psychol 2006, 3:77-101. Publisher Full Text OpenURL

  44. NVivo9.

    http://www.qsrinternational.com/products_nvivo.aspx webcite

    OpenURL

  45. Ragin CC, Becker HS: How the microcomputer is changing our analytical habits. In New technology in sociology. Edited by Blank G, McCartney JL, Brent E. Brunswick: Transaction Publishers; 1989:47-55. OpenURL

  46. Minichiello V, Aroni R, Timewell E, Alexander L: Indepth interview: researching people. Cheshire: Longman; 1990. OpenURL

  47. Hinchcliff R, Poulos R, Ivers RQ, Senserrick T: Understanding novice driver policy agenda-setting.

    Public Health 2011, 125:217-221. PubMed Abstract | Publisher Full Text OpenURL

  48. Hinchcliff R, Chapman S, Ivers R, Senserrick T, Du W: Media framing of graduated licensing policy debates.

    Accid Anal Prev 2010, 42:1283-1287. PubMed Abstract | Publisher Full Text OpenURL

  49. Hinchcliff R, Westbrook J, Greenfield D, Baysari M, Moldovan M, Braithwaite J: Analysis of Australian newspaper coverage of medication errors.

    Int J Qual Health Care 2012, 24:1-8. PubMed Abstract | Publisher Full Text OpenURL

  50. Practice Incentives Program (PIP) http://www.medicareaustralia.gov.au/provider/incentives/pip/index.jsp webcite

  51. Nugus P, Greenfield D, Travaglia J, Westbrook J, Braithwaite J: How and where doctors exercise power: interprofessionalism, collaboration and leadership across a health system.

    Soc Sci Med 2010, 71:898-909. PubMed Abstract | Publisher Full Text OpenURL

  52. Greenfield D: The enactment of dynamic leadership.

    Leadersh Health Serv 2007, 20:159-168. Publisher Full Text OpenURL

  53. Weiner B: A theory of organizational readiness for change.

    Implement Sci 2009, 4:67. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  54. Caldwell S, Mays N: Studying policy implementation using a macro, meso and micro frame analysis: the case of the Collaboration for Leadership in Applied Health Research & Care (CLAHRC) programme nationally and in North West London.

    Health Res Policy Syst 2012, 10:32. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  55. Goffman E: Frame analysis: an essay on the organization of experience. Cambridge: Harvard University Press; 1974. OpenURL

  56. Dickson G, Lindstrom R, Black C, Van der Gucht D: Evidence-informed change management in Canadian healthcare organizations. Ottawa: Canadian Health Services Research Foundation; 2012. OpenURL

  57. Hinchcliff R: Research use in novice driver licensing policy: Identifying barriers and facilitators of research utilisation. Koln: LAP LAMBERT Academic Publishing; 2011. OpenURL

  58. Hinchcliff R, Ivers RQ, Poulos R, Chapman S, Senserrick T: What is the role of researcher media advocacy within the Australian road safety policy process. Adelaide, Australia: Australasian Road Safety Research, Policing and Education Conference; 1998. OpenURL

  59. Hinchcliff R, Greenfield D, Moldovan M, Pawsey M, Mumford V, Westbrook J, Braithwaite J: Mediators of effective implementation. Sydney, Australia: ; 2012. [Australian Institute of Health Innovation Symposium - From systems research to improved health care: The future is in our hands] OpenURL

  60. Hinchcliff R, Greenfield D, Westbrook JI, Braithwaite J: The secret to success: factors that influence the ability of accreditation programs to improve the quality and safety of health services. Geneva, Switzerland; 2012. [ISQua 2012, Twenty-ninth International Safety and Quality Conference: Advancing Quality and Safety for All; Now and in the Future]

    http://www.isqua.org/conference/previous-conferences/geneva-2012 webcite

    OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/13/437/prepub