Email updates

Keep up to date with the latest news and content from BMC Surgery and BioMed Central.

Open Access Research article

Improving quality through process change: a scoping review of process improvement tools in cancer surgery

Alice C Wei12*, David R Urbach12, Katharine S Devitt1, Meagan Wiebe1, Oliver F Bathe3, Robin S McLeod24, Erin D Kennedy24 and Nancy N Baxter25

Author Affiliations

1 Princess Margaret Cancer Centre, University Health Network, Department of Surgery, University of Toronto, Toronto, ON, Canada

2 Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada

3 Department of Surgery and Oncology, University of Calgary, Calgary, AB, Canada

4 Division of General Surgery, Mount Sinai Hospital, Toronto, ON, Canada

5 Division of General Surgery, St. Michael’s Hospital, Toronto, ON, Canada

For all author emails, please log on.

BMC Surgery 2014, 14:45  doi:10.1186/1471-2482-14-45


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2482/14/45


Received:17 July 2013
Accepted:14 July 2014
Published:19 July 2014

© 2014 Wei et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.

Abstract

Background

Surgery is a cornerstone of treatment for malignancy. However, significant variation has been reported in patterns and quality of cancer care for important health outcomes, including perioperative mortality. Surgical process improvement tools (SPITs) have been developed that focus on enhancing the processes of care at the point of care, as a means of quality improvement. This study describes SPITs and develops a conceptual framework by synthesizing the available literature on these novel quality improvement tools.

Methods

A scoping review was conducted based on instruments developed for quality improvement in surgery. The search was executed on electronically indexed sources (MEDLINE, EMBASE, and the Cochrane library) from January 1990 to March 2011. Data were extracted, tabulated and reported thematically using a narrative synthesis approach. These results were used to develop a conceptual framework that describes and classifies SPITs.

Results

232 articles were reviewed for data extraction and analysis. SPITs identified were classified into 3 groups: clinical mapping tools, structure communication tools and error reduction instruments. The dominant instrument reported were clinical mapping tools, including: clinical pathways (113, 48%), fast track (46, 20%) and enhanced recovery after surgery protocols (36, 15%). Outcomes reported included: length of stay (174, 75%), readmission rates (116, 50%), morbidity (116, 50%), mortality (104, 45%), and economic (60, 26%). Many gaps in the literature were recognized.

Conclusion

We have developed a conceptual framework of SPITs and identified gaps in current knowledge. These results will guide the design and development of new quality instruments in surgery.

Keywords:
Surgical procedures; Operative; Quality; Safety; Neoplasms; Scoping review

Background

Surgery is a central modality in the treatment of cancer. The majority of patients with cancer will undergo a surgical procedure during the course of their treatment, for diagnostic, curative and/or palliative indications. For solid tumors, surgery is the cornerstone of curative treatment. As an example, for patients with colorectal cancer, one of the most common causes of cancer in high resource nations, resection is performed in 71-90% of patients. Surgery is the sole modality of treatment in up to 53% of patients [1-6].

Despite the important role of surgery in the care of patients with cancer, the quality of surgical care is not uniform. Significant variation in the patterns of care delivery and the quality of care has been reported, as reflected by clinically important differences in quality outcomes such as perioperative mortality and long-term survival [7-12]. For many procedures, perioperative mortality has a strong inverse relationship with case volume. Better outcomes are reported at high volume surgeons and/or institutions. The strength of the relationship between volume and outcomes is strongest for highly complex procedures such as cardiac surgery, and/or pancreatectomy [8,9]. In Ontario Canada, Simunovic et al. reported a 11.3% perioperative mortality rate in low volume hospitals compared to 3.4% in high volume hospitals [9] for pancreatectomy Similar trends have been demonstrated, to a lower magnitude, in most other cancer procedures including lung, breast and colorectal procedures [8,12-21].

The means by which increased institutional volumes affect outcome are complex and poorly understood. Khuri et al. have argued that procedure volume does not directly affect outcome and is likely a surrogate measure of implicit quality of the systems of care [8,10,13,18,21-30]. As a result, structural interventions are important but are insufficient to realize optimal quality targets. We believe that quality improvement interventions must move beyond strategies that focus solely on structural changes in health care delivery. We propose that gains in quality must include direct interventions at the point of care –interventions that improve the processes of care that are implemented at the time of care delivery.

The goal of this study was to identify and characterize the range of process improvement tools that have been developed in cancer surgery. We used scoping review methodology to synthesize and integrate the current literature. These data were used to develop a conceptual framework of this family of instruments and identify potential gaps in our knowledge about surgical process improvement instruments that warrant further evaluation for primary research and development.

Methods

Theoretical framework

There is currently no conceptual framework that integrates process improvement instruments in surgery into a single model. Within some individual areas (e.g. clinical pathways), conceptual frameworks have been described that model either the format and/or the intent of each individual tool and/or related instruments.

This scoping review was designed to identify surgical process improvement tools (SPITs) that shared the following properties:

1) Affect processes of care (i.e. practices involved in the actual giving and receiving of care)

2) Involve interventions that are delivered at the point of care (i.e. occur at the point in time when care is delivered)

3) Aim to codify, make explicit, standardize and/or operationalize processes of care

4) Incorporate current practices and/or introduce new practices into the content of the instrument

We considered that these criteria would map out a distinct group of quality improvement tools that shared a similar mechanism of action (process change) at a similar point in the health care cycle (point of care).

Approach

We conducted a scoping review using various sources of data, and by consulting with quality improvement experts. A scoping review is appropriate for a topic that has not previously been thoroughly reviewed, or where literature may be sparse [31]. Its purpose is to evaluate the extent and nature of existing literature in areas where either insufficient evidence exists in order to conduct a systematic review or when synthesizing available evidence to begin describing a particular concept or phenomenon, and generate research questions where gaps in knowledge are revealed. This approach has been selected for our research question, as this is the first study (to our knowledge) that aims to integrate the disparate literature on SPITs into a single family of related quality improvement tools.

The methods are similar in rigor to a systematic review, but selection criteria are developed post hoc based on increasing familiarity with the literature, and detailed information is extracted to help readers contextualize the findings. The methods for extracting and describing eligible literature, which is likely to be diverse and include both qualitative and quantitative studies, was guided by Mays, who suggests that “narrative review” of information from various types of studies is appropriate for developing knowledge at an early stage in policy development [31,32]. This involves thematic rather than statistical analysis of information to explore concepts and relationships, and consultation with experts to further contextualize the findings so that they are applicable to stakeholders.

Data collection

Sources

Several indexed, non-indexed and expert sources were consulted. Search strategies were designed specific to the sources, and combined concepts reflecting surgery and tools or communication or quality or safety. Various stakeholders representing physicians (Canadian Association of General Surgeons), institutions (University Health Network hospital administration) and policy level stakeholders (Cancer Care Ontario) were engaged to review the initial selection criteria, in order to identify gaps in the search strategy and to provide additional concepts that informed the search strategy. Searches of indexed sources were executed from January 1990 to March 2011, the period during which concepts of quality improvement in surgery gained traction. These databases included MEDLINE (North American), the Cochrane Library (systematic reviews, trials) and EMBASE (European). In addition, to ensure that all relevant literature is captured, we hand searched the references of eligible studies. It was anticipated that any seminal papers published prior to 1990 would be retrieved from scanning the references of extracted studies.

Selection criteria

Preliminary selection criteria include quantitative (meta-analyses, systemic reviews, surveys, observational studies, randomized trials) or qualitative (reviews/conceptual analyses, interviews, focus groups) studies published in English language peer-reviewed journals from January 1990 to March 2011 and limited to humans, provided that they focused on developing or evaluating SPITs (as defined above), and provided sufficient detail to extract study design and findings. Studies were deemed ineligible if they evaluated processes of care solely for the purposes of performance management, such as studies that report results of quality indicators. Abstracts, addresses, autobiographies, bibliographies, biographies, comments, editorials, letters and newspaper articles, were excluded

Selection methods

Titles and abstracts of the search results and select articles/tools were screened for inclusion based on eligibility criteria. If more than one publication described a single study, only most recent was included. Once the full text articles and tools were retrieved, 2 abstractors independently extracted data. The initial selection criteria were refined based on the information extracted during by the initial scope of the literature. The updated selection criteria were utilized to identify additional eligible items for inclusion in the review.

Data analysis

Data extraction

A data extraction form was developed based on the conceptual framework. Notable qualitative details were identified on the data extraction form. Quality criteria relevant to study design was developed using criterion based approach [33-37] After meeting to compare the data extracted from all selected studies, differences in opinion between the abstractors were resolved through consensus. Extracted data was tabulated and presented thematically.

Data analysis and interpretation

The total number of eligible and included studies was reported, along with reasons for exclusion. Contextual information related to instrument design were examined thematically according to May’s narrative synthesis approach [32]. Qualitative content that was highlighted were reviewed in light of the proposed conceptual framework. Revisions were made to the conceptual framework, as guided by the nature and content of the data extracted, in order to clarify emerging concepts. Tabulated findings were examined to discuss the instrument type, quantity, design, study quality, clinical applications and relevant outcomes.

Results

The aim of this project was to examine the development of SPITs in the area of cancer surgery. But, upon initial scope, we found that studies that focused on SPITs for cancer surgery was very limited. Thus, we modified our search strategy to include all areas of surgery in order to obtain a fuller view of the current literature.

The final search criteria extracted 7192 articles. 5480 remained after duplicates were removed, 4920 articles were excluded based on criteria selected for the abstract review (Figure  1). Abstracts were excluded if: they reported clinical/medical effectiveness without description of a process tool; concluded that a SPIT is needed without description of development, implementation, or evaluation; focused on teaching or training of health professionals or trainees without tool development; focused on instruments to identify patient risk factors, clinical conditions, quality of life, or with regard to preoperative anesthesia alone, dental procedures, or technology/computer tools; if the publication was a letter, editorial, case study with less than 10 patients, or not the most recent version of the research project. The remaining 560 articles were fully reviewed for eligibility. Of these, 212 articles were determined to meet all inclusion criteria and none of the exclusion criteria. Twenty additional articles were identified as relevant to this research project after hand searching the references of the eligible articles. Therefore, a total of 232 articles were reviewed for data extraction and analysis (Additional file 1: Table S1).

thumbnailFigure 1. Scoping review search results.

Additional file 1: Table S1. Summary of articles from scoping review of SPITs.

Format: DOCX Size: 417KB Download fileOpen Data

The quality of these studies was assessed using a criterion approach for the presence of: detailed inclusion and exclusion criteria, description of control group, tool compliance, whether primary outcomes were explicitly described and objective applied, and assessment or discussion of SPIT sustainability. Inclusion and exclusion criteria were only reported in 120 out of 219 articles (55%). When applicable, control groups were described in 88 out of 136 of the articles (65%). Tool compliance was reported in 59 out of 226 articles (26%). Primary outcomes were explicitly described in 192 out of 228 articles (84%) and the outcome criteria were considered objectively applied in 138 out of 223 articles (62%). Sustainability of the SPIT was only mentioned in 6 (3%) articles (Table  1).

Table 1. Quality assessment of SPITs articles

The majority of these studies were designed as either an interventional (115, 49%) or observational (72, 31%) assessment of the SPITs. Only 12 (5%) studies were randomized controlled trials (Table  2). The majority of articles study objectives were to: evaluate (120, 52%), implement (105, 45%), and/or describe (91, 39%) SPITs. Only a few articles compared two or more SPITs (10, 4%) or discussed SPIT development (42, 18%) (Table  2). The majority of these studies were completed at academic centers (158, 68%) and were located in the USA (113, 48%) or Europe (55, 24%).

Table 2. Study design and objectives of SPITs articles

Only 67 (29%) of the studies evaluated SPITs in the setting of cancer surgery. The majority of studies were within the colorectal (53, 23%), abdominal- non-colorectal (29, 12%), orthopedic (29, 12%), vascular (27, 12%), or cardiac surgical setting (27, 12%).

The most common SPITs were clinical pathways (113, 48%), fast-track protocols (46, 20%), and enhanced recovery after surgery (ERAS) protocols (36, 15%). Structured communication tools (17, 7%), checklists (16, 7%), patient care planning/management (14, 6%), preparatory pause (7, 3%) and patient safety (6, 3%) were less frequently reported (Table  3). Outcomes evaluated included: length of stay (174, 75%), readmission rates (116, 50%), morbidity (116, 50%), mortality (104, 44%) and economic impacts (60, 26%).

Table 3. Type of SPITs reported in articles

Data were extracted for statistically significant outcomes. In articles that assessed these outcomes, length of stay (146, 84%) and economic impacts (53, 88%) were frequently reported as decreasing after implementation of the SPIT. When reported, SPIT implementation appeared to have no significant effect on morbidity (69, 59%), mortality (76, 73%) or readmission rates (86, 74%) (Table  4).

Table 4. Impact of SPIT for reported outcomes

Discussion

We report that the literature in the area of SPITs is presently under-investigated with only a handful of high quality studies. Only 232 relevant studies were identified; a mere 67 (29%) studies focused on cancer surgery. At present the quality of literature in this area is low. Nevertheless, this preliminary data suggests that these instruments may be capable of effecting important quality improvements.

An important feature of the studies identified is that patient-centered outcomes, such as mortality and morbidity, were not the primary focus in the majority of the studies; they were reported as secondary outcomes. The vast majority of studies focused on length of stay, cost containment and improved efficiencies of care as primary study endpoints. These data indicate that SPITs can reduce length of stay without negatively affecting patient safety (i.e. morbidity, mortality or readmission rates). Since patient-centered outcomes were only secondary endpoints, most studies were underpowered to fully evaluate these outcomes. Thus future research will be required to clarify whether SPITs has a positive impact on the important patient-centered outcomes such as morbidity, mortality and/or cancer survival.

Our study reveals important gaps in knowledge within this area. Notably, few if any SPITs have been developed for intraoperative processes of care. It is peculiar that there were no SPITs that addressed any of the technical components of a procedure. Another knowledge gap included a paucity of SPITs that addressed the preoperative evaluation or the postoperative surveillance of cancer patients.A conceptual framework of SPITs was developed based on the results of this scoping review. We describe a group of quality improvement tools that change the processes of care, at the point of care. We grouped SPITs into 3 categories of tools: structured communication tools, clinical mapping tools and error reduction tools (Figure  2). These categories describe the major properties of the SPITs and reflect the main mechanism by which they can improve quality of care. Since these tools can have multiple mechanisms of action, they may have properties that overlap into more than one category. Gaps in current knowledge were also incorporated into the framework to direct areas for future research.

thumbnailFigure 2. SPITs conceptual framework.

Structured communication tools include instruments such as: perioperative checklists, preparatory pauses, and team briefings. These instruments focus on operationalizing the steps of team communication and standardizing information exchange in specific settings [38-47]. The most common example in clinical use is the preoperative checklist - is primarily a structured communication tool, but elements of the checklist may involve verification of essential safety steps. Thus through its design and content a checklist also has error checking properties [39,40,48,49].

Clinical mapping tools are multi-disciplinary structured care plans that describe the timing and actions required by providers in order for the patient to meet target goals in a timely manner [50-53]. Clinical pathways are multi-disciplinary care maps that usually have a time dependent inventory of action for a specific episode of care. They have been widely implemented to improve patient efficiencies, reduce length of stay and economic costs through decreased variation in care delivery and early identification of outliers [50-57]. Quality of care has often been a secondary consideration for these instruments [55-60].

Some clinical mapping tools, such as enhanced recovery strategies and fast track protocols, emphasize pharmacologic changes or modification in current practices in order to facilitate early recovery (e.g. modifying perioperative pain control to facilitate early mobilization, early enteral feeding, etc.). Standardization of processes is a by-product rather than a primary goal of enhanced recovery strategies.

Error reduction instruments are developed to reduce the incidence of preventable errors such as wrong site surgery and/or errors in drug administration [44,46,47,61,62]. Often these tools are targeted to eliminate ‘never’ events such as wrong site/wrong patient surgery.

We postulate that SPITs can be described as a unique family of quality improvement interventions. They can be an important method of closing the knowledge-to-action gap between evidence and practice. This family of process improvement tools target process change as a means to improve quality. To date, most have focused on surrogate outcomes such as length of stay, cost, or patient safety, rather than any direct measure of quality of care such as perioperative morbidity, mortality and/or long term survival or appropriateness of care. Thus, the end effect of these tools on quality is not well understood. Further the relationship, relative merits and deficits of each type of SPIT, and areas of mutual overlap are not known. Despite the limited knowledge to date, we believe this family of quality improvement tools is important because they target processes of care and hold the potential to embed evidence-based quality improvement at the point of care. Further information is required about the relationship between this family of quality improvement instruments with each other, and with important quality outcomes.

There are limitations in this scoping review. Our study focused on SPITs instruments used in the immediate perioperative period. This was emphasized in our search strategy that required the term ‘surgery’ as a key element. As a result, it is possible that SPITs used during the early diagnostic and long-term surveillance period may have been missed. For patients with cancer, surgery usually makes up a small part of their cancer therapy. Diagnosis and surveillance activities may not involve the surgeon and therefore SPITs involving these activities may be beyond the scope of this study. Nevertheless, we would have expected that hand searching of articles reference would have at least key articles of note involving diagnosis and/or surveillance related SPITs. No substantial diagnostic or surveillance tools were identified in our scope. As a result, we believe that this area remains an important gap, requiring further research.

Conclusions

SPITs are innovative knowledge instruments that can improve quality of health care by optimizing the processes of care delivery. They can directly influence components of care delivered, standardize and coordinate elements of care, and enhance uptake of best evidence. Importantly we sought to describe a group of tools that work at the point-of-care. In this way, SPITs can change the processes of care directly. This mechanism differs from other knowledge translation strategies such as continuing medical education strategies, which change behavior in more indirect ways. We believe that the limitations in the current knowledge provide opportunities for new research.

At present these instruments are implemented in an isolated fashion, without the benefit of a unified agenda of quality improvement. We suggest that further development and research into SPITs will demonstrate an important role these tools can play in high quality surgical care. The results of this study enrich our understanding of these types of knowledge products and unify them into a family of related tools. We anticipate that the results of this study will guide the design and development of new SPIT instruments for use with patients undergoing cancer surgery.

Abbreviations

SPITs: Surgical process improvement tools; ERAS: Enhanced recovery after surgery.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

ACW, NNB, DRU participated in study conception and design. OFB, RSM, BRT, NNB, EDK, and DRU refined and developed the primary search strategy. ACW, KD, MW were involved in drafting and revising the manuscript. ACW, KD, MW performed data collection and analysis. ACW, DRU, NNB, EDK provided critical revisions to the manuscript. ACW provided supervision of all aspects of the protocol. All authors read and approved the final manuscript.

Acknowledgements

This study is funded by the Canadian Institutes of Health Research, Grant Reference KRS – 103275. Additional funding and/or in kind support will be received from the Division of General Surgery and the Toronto General Hospital Research Institute, University Health Network. We would like to thank Ms. Marina Englesakis for her assistance in developing electronic searches.

Funding

This study is funded by the Canadian Institutes of Health Research, Grant Reference KRS – 103275. Additional funding and/or in kind support will be received from the Division of General Surgery and the Toronto General Hospital Research Institute, University Health Network. The authors have no potential conflicts of interest.

References

  1. Canadian Cancer Society: Canadian Cancer Statistics 2012. Toronto, ON: Canadian Cancer Society; 2012. OpenURL

  2. US Cancer Facts & Figures 2011. Atlanta: American Cancer Society; 2011. OpenURL

  3. Nenshi R, Baxter N, Kennedy E, Schultz SE, Gunraj N, Wilton AS, Urbach DR, Simunovic M: Surgery for colorectal cancer. Toronto: Institute for Clinical Evaluative Sciences; 2008. OpenURL

  4. Avksentyeva M: Colorectal cancer in Russia.

    Eur J Health Econ 2010, 10(Suppl 1):S91-S98. OpenURL

  5. Schurer W, Kanavos P: Colorectal cancer management in the United Kingdom: current practice and challenges.

    Eur J Health Econ 2010, 10(Suppl 1):S85-S90. OpenURL

  6. European Commission: European Guidelines for Quality Assurance in Colorectal Cancer Screening and Diagnosis - First Edition.

    In International Agency for Research on Cancer Edited by Group QA: Agency for Research on Cancer. 2010, 1-452. OpenURL

  7. Dixon E, Bathe OF, McKay A, You I, Dowden S, Sadler D, Burak KW, McKinnon JG, Miller W, Sutherland FR: Population-based review of the outcomes following hepatic resection in a Canadian health region.

    Can J Surg 2009, 52(1):12-17. OpenURL

  8. Birkmeyer JD, Siewers AE, Finlayson EV, Stukel TA, Lucas FL, Batista I, Welch HG, Wennberg DE: Hospital volume and surgical mortality in the United States.

    N Engl J Med 2002, 346(15):1128-1137. OpenURL

  9. Simunovic M, To T, Theriault M, Langer B: Relation between hospital surgical volume and outcome for pancreatic resection for neoplasm in a publicly funded health care system.

    CMAJ 1999, 160(5):643-648. OpenURL

  10. Urbach DR, Baxter NN: Does it matter what a hospital is “high volume” for? Specificity of hospital volume-outcome associations for surgical procedures: analysis of administrative data.

    Qual Saf Health Care 2004, 13(5):379-383. OpenURL

  11. Dimick JB, Finlayson SR, Birkmeyer JD: Regional availability of high-volume hospitals for major surgery.

    Health Aff (Millwood) 2004, Suppl Variation:45-53. OpenURL

  12. Bilimoria KY, Bentrem DJ, Ko CY, Stewart AK, Winchester DP, Talamonti MS: National failure to operate on early stage pancreatic cancer.

    Ann Surg 2007, 246(2):173-180. OpenURL

  13. Gruen RL, Pitt V, Green S, Parkhill A, Campbell D, Jolley D: The effect of provider case volume on cancer mortality: systematic review and meta-analysis.

    CA Cancer J Clin 2009, 59(3):192-211. OpenURL

  14. Birkmeyer JDM, Dimick JBM, Staiger DOP: Operative mortality and procedure volume as predictors of subsequent hospital performance.

    Ann Surg 2006, 243(3):411-417. OpenURL

  15. Urbach DR, Bell CM, Austin PC: Differences in operative mortality between high- and low-volume hospitals in Ontario for 5 major surgical procedures: estimating the number of lives potentially saved through regionalization.

    CMAJ 2003, 168(11):1409-1414. OpenURL

  16. Schrag D, Cramer LD, Bach PB, Cohen AM, Warren JL, Begg CB: Influence of hospital procedure volume on outcomes following surgery for colon cancer.

    JAMA 2000, 284(23):3028-3035. OpenURL

  17. Harmon JW, Tang DG, Gordon TA, Bowman HM, Choti MA, Kaufman HS, Bender JS, Duncan MD, Magnuson TH, Lillemoe KD, Cameron JL: Hospital volume can serve as a surrogate for surgeon volume for achieving excellent outcomes in colorectal resection.

    Ann Surg 1999, 230(3):404-411.

    discussion 411-403

    OpenURL

  18. Birkmeyer JD, Skinner JS, Wennberg DE: Will volume-based referral strategies reduce costs or just save lives?

    Health Aff (Millwood) 2002, 21(5):234-241. OpenURL

  19. Gordon TA, Bowman HM, Bass EB, Lillemoe KD, Yeo CJ, Heitmiller RF, Choti MA, Burleyson GP, Hsieh G, Cameron JL: Complex gastrointestinal surgery: impact of provider experience on clinical and economic outcomes.

    J Am Coll Surg 1999, 189(1):46-56. OpenURL

  20. Schrag D, Panageas KS, Riedel E, Cramer LD, Guillem JG, Bach PB, Begg CB: Hospital and surgeon procedure volume as predictors of outcome following rectal cancer resection.

    Ann Surg 2002, 236(5):583-592. OpenURL

  21. Bentrem DJ, Brennan MF: Outcomes in oncologic surgery: does volume make a difference?

    World J Surg 2005, 29(10):1210-1216. OpenURL

  22. Khuri SF, Hussaini BE, Kumbhani DJ, Healey NA, Henderson WG: Does volume help predict outcome in surgical disease?

    Adv Surg 2005, 39:379-453. OpenURL

  23. Khuri SF, Henderson WG: The case against volume as a measure of quality of surgical care.

    World J Surg 2005, 29(10):1222-1229. OpenURL

  24. Schrag D, Panageas KS, Riedel E, Hsieh L, Bach PB, Guillem JG, Begg CB: Surgeon volume compared to hospital volume as a predictor of outcome following primary colon cancer resection.

    J Surg Oncol 2003, 83(2):68-78.

    discussion 78-69

    OpenURL

  25. Garcea G, Breukink SO, Marlow NE, Maddern GJ, Barraclough B, Collier NA, Dickinson IC, Fawcett J, Graham JC: A systematic review of the impact of volume of hepatic surgery on patient outcome.

    Surgery 2009, 145(5):467-475. OpenURL

  26. Urbach DR, Croxford R, MacCallum NL, Stukel TA: How are volume-outcome associations related to models of health care funding and delivery? A comparison of the United States and Canada.

    World J Surg 2005, 29(10):1230-1233. OpenURL

  27. Afsari A, Zhandoug Z, Young S, Ferguson L, Silapaswan S, Mittal V: Outcome analysis of pancreaticoduodenectomy at a community hospital.

    Am Surg 2002, 68(3):281-284. OpenURL

  28. Sheikh K: Utility of provider volume as an indicator of medical care quality and for policy decisions.

    Am J Med 2001, 111(9):712-715. OpenURL

  29. Goshima KR, Mills JL Sr, Awari K, Pike SL, Hughes JD: Measure what matters: institutional outcome data are superior to the use of surrogate markers to define “center of excellence” for abdominal aortic aneurysm repair.

    Ann Vasc Surg 2008, 22(3):328-334. OpenURL

  30. Eastham JA: Do high-volume hospitals and surgeons provide better care in urologic oncology?

    Urol Oncol 2009, 27(4):417-421. OpenURL

  31. Mays N, Roberts E, Popay J: Synthesising research evidence. In Studying the Organisation and Delivery of Health Services: Research Methods. Edited by Fulop N, Allen P, Clarke A, Black N. London: Routledge; 2001:188-220. OpenURL

  32. Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field.

    J Health Serv Res Pol 2005, 10(suppl_1):6-20. OpenURL

  33. United States Department of Health and Human Services: Systems to rate the strength of scientific evidence.

    In Evidence Report/Technology Assessment Number 47 Edited by Quality AfHRa. 2002, 1-204. OpenURL

  34. Kelley K, Clark B, Brown V, Sitzia J: Good practice in the conduct and reporting of survey research.

    Int J Qual Health Care 2003, 15(3):261-266. OpenURL

  35. Tong A, Sainsbury P, Craig J: Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups.

    Int J Qual Health Care 2007, 19(6):349-357. OpenURL

  36. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials: the CONSORT statement.

    JAMA 1996, 276(8):637-639. OpenURL

  37. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP: The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies.

    Lancet 2007, 370(9596):1453-1457. OpenURL

  38. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC, Merry AF, Moorthy K, Reznik RK, Taylor B, Gawande AA, Safe Surgery Saves Lives Study Group: A surgical safety checklist to reduce morbidity and mortality in a global population.

    N Engl J Med 2009, 360(5):491-499. OpenURL

  39. Lingard L, Espin S, Rubin B, Whyte S, Colmenares M, Baker GR, Doran D, Grober E, Orser B, Bohnen J, Reznik R: Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR.

    Qual Saf Health Care 2005, 14(5):340-346. OpenURL

  40. Hales BM, Pronovost PJ: The checklist–a tool for error management and performance improvement.

    J Crit Care 2006, 21(3):231-235. OpenURL

  41. Verdaasdonk EG, Stassen LP, Widhiasmara PP, Dankelman J: Requirements for the design and implementation of checklists for surgical processes.

    Surg Endosc 2009, 23(4):715-726. OpenURL

  42. Panesar SS, Cleary K, Sheikh A, Donaldson L: The WHO checklist: a global tool to prevent errors in surgery.

    Patient Saf Surg 2009, 3(1):9. OpenURL

  43. Michaels RK, Makary MA, Dahab Y, Frassica FJ, Heitmiller E, Rowen LC, Crotreau R, Brem H, Pronovost PJ: Achieving the National quality forum’s “Never Events”: prevention of wrong site, wrong procedure, and wrong patient operations.

    Ann Surg 2007, 245(4):526-532. OpenURL

  44. Makary MA, Mukherjee A, Sexton JB, Syin D, Goodrich E, Hartmann E, Rowen L, Behrens DC, Marohn M, Pronovost PJ: Operating room briefings and wrong-site surgery.

    J Am Coll Surg 2007, 204(2):236-243. OpenURL

  45. Backster A, Teo A, Swift M, Polk HC Jr, Harken AH: Transforming the surgical “time-out” into a comprehensive “preparatory pause”.

    J Card Surg 2007, 22(5):410-416. OpenURL

  46. Rhodes P, Giles SJ, Cook GA, Grange A, Hayton R, Maxwell MJ, Sheldon TA, Wright J: Assessment of the implementation of a national patient safety alert to reduce wrong site surgery.

    Qual Saf Health Care 2008, 17(6):409-415. OpenURL

  47. Khuri SF: Safety, quality, and the National Surgical Quality Improvement Program.

    Am Surg 2006, 72(11):994-998.

    discussion 1021-1030, 1133-1048

    OpenURL

  48. Lingard L, Regehr G, Orser B, Reznick R, Baker GR, Doran D, Espin S, Bohnen J, Whyte S: Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication.

    Arch Surg 2008, 143(1):12-17.

    discussion 18

    OpenURL

  49. Hales B, Terblanche M, Fowler R, Sibbald W: Development of medical checklists for improved quality of patient care.

    Int J Qual Health Care 2008, 20(1):22-30. OpenURL

  50. Every NR, Hochman J, Becker R, Kopecky S, Cannon CP: Critical pathways: a review: committee on acute cardiac care, council on clinical cardiology, American heart association.

    Circulation 2000, 101(4):461-465. OpenURL

  51. Coffey RJ, Richards JS, Remmert CS, LeRoy SS, Schoville RR, Baldwin PJ: An introduction to critical paths.

    Qual Manag Health Care 2005, 14(1):46-55. OpenURL

  52. DeWoody S, Price J: A systems approach to multidimensional critical paths.

    Nurs Manage 1994, 25(11):47-51. OpenURL

  53. Rotter T, Kugler J, Koch R, Gothe H, Twork S, van Oostrum JM, Steyerberg EW: A systematic review and meta-analysis of the effects of clinical pathways on length of stay, hospital costs and patient outcomes.

    BMC Health Serv Res 2008, 8:265. OpenURL

  54. Müller M, Dedes K, Dindo D, Steiner S, Hahnloser D, Clavien P-A: Impact of clinical pathways in surgery.

    Langenbeck’s Arch Surg 2009, 394(1):31-39. OpenURL

  55. Porter GA, Pisters PWT, Mansyur C, Bisanz A, Reyna K, Stanford P, Lee JE, Evans DB: Cost and utilization impact of a clinical pathway for patients undergoing pancreaticoduodenectomy.

    Ann Surg Oncol 2000, 7(7):484-489. OpenURL

  56. Ronellenfitsch U, Rössner E, Jakob J, Post S, Hohenberger P, Schwarzbach M: Clinical pathways in surgery—should we introduce them into clinical routine? A review article.

    Langenbeck’s Arch Surg 2008, 393(4):449-457. OpenURL

  57. Kennedy E, Grenda T, Sauter P, Rosato E, Chojnacki K, Rosato F Jr, Profeta B, Doria C, Berger A, Yeo C: Implementation of a critical pathway for distal pancreatectomy at an academic institution.

    J Gastrointest Surg 2009, 13(5):938-944. OpenURL

  58. Vanounou T, Pratt W, Fischer JE, Vollmer JCM, Callery MP: Deviation-based cost modeling: a novel model to evaluate the clinical and economic impact of clinical pathways.

    J Am Coll Surg 2007, 204(4):570-579. OpenURL

  59. Lemmens L, van Zelm R, Borel Rinkes I, van Hillegersberg R, Kerkkamp H: Clinical and organizational content of clinical pathways for digestive surgery: a systematic review.

    Dig Surg 2009, 26(2):91-99. OpenURL

  60. Lemmens L, van Zelm R, Vanhaecht K, Kerkkamp H: Systematic review: indicators to evaluate effectiveness of clinical pathways for gastrointestinal surgery.

    J Eval Clin Pract 2008, 14(5):880-887. OpenURL

  61. Garnerin P, Ares M, Huchet A, Clergue F: Verifying patient identity and site of surgery: improving compliance with protocol by audit and feedback.

    Qual Saf Health Care 2008, 17(6):454-458. OpenURL

  62. Clarke JR, Johnston J, Blanco M, Martindell DP: Wrong-site surgery: can we prevent it?

    Adv Surg 2008, 42:13-31. OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2482/14/45/prepub