Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Study protocol

Improving the quality of palliative and terminal care in the hospital by a network of palliative care nurse champions: the study protocol of the PalTeC-H project

Frederika E Witkamp12*, Lia van Zuylen2, Paul J van der Maas1, Helma van Dijk2, Carin CD van der Rijt2 and Agnes van der Heide1

Author Affiliations

1 Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, the Netherlands

2 Department of Medical Oncology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, the Netherlands

For all author emails, please log on.

BMC Health Services Research 2013, 13:115  doi:10.1186/1472-6963-13-115


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/13/115


Received:2 August 2012
Accepted:20 March 2013
Published:25 March 2013

© 2013 Witkamp et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The quality of care of patients dying in the hospital is often judged as insufficient. This article describes the protocol of a study to assess the quality of care of the dying patient and the contribution of an intervention targeted on staff nurses of inpatient wards of a large university hospital in the Netherlands.

Methods/Design

We designed a controlled before and after study. The intervention is the establishment of a network for palliative care nurse champions, aiming to improve the quality of hospital end-of-life care. Assessments are performed among bereaved relatives, nurses and physicians on seven wards before and after introduction of the intervention and on 11 control wards where the intervention is not applied. We focus on care provided during the last three days of life, covered in global ratings of the quality of life in the last three days of life and the quality of dying, and various secondary endpoints of treatment and care affecting quality of life and dying.

Discussion

With this study we aim to improve the understanding of and attention for patients’ needs, and the quality of care in the dying phase in the hospital and measure the impact of a quality improvement intervention targeted at nurses.

Keywords:
Health services research (MeSH); Nurse (MeSH); Quality of health care (MeSH); Study protocol; Terminal care (MeSH)

Background

Providing end-of-life care in a hospital is challenging, because hospital care is typically focused on prolonging life. Several studies have described the unmet needs of patients dying in hospitals, such as poor symptom control and insufficient communication [1-6]. Gaps in end-of-life care have been identified, e.g. the lack of awareness of approaching death, and shortcomings in healthcare professionals’ knowledge of and skills in palliative care [1-8]. To date research on end-of-life care in hospitals has been mainly descriptive, focusing on the characteristics of care, identifying problems and suggesting possibilities for improvement. In a literature review, Al-Qurainy et al. (2009) proposed improvement strategies: integration of palliative care services in the hospital to enhance caregivers’ attention for the transition of treatment goals; increase of palliative care knowledge among healthcare professionals; and improvement of prognostication, advanced care planning and communication [9]. However, experimental studies on quality improvement interventions in end-of-life care in the hospital are scarce, partly due to methodological challenges in health services research in general and in the field of palliative care in particular. Many results of studies on quality improvement interventions are thus affected by concerns about the validity and reliability of data, due to e.g. limitations of the design, selection bias, inaccurate measurements and confounding [7,10-14]. To evaluate the effects of changes in palliative care structures and processes on patient outcomes, innovative experimental research is needed [7,15-21].

In the Netherlands most in-hospital deaths occur on wards that lack specific palliative care expertise. Innovations to improve the quality of end-of-life care in the hospital have to be disseminated to all these wards and to be integrated in the whole hospital care system [9]. This process of quality improvement seems to be comparable to innovations in other fields of hospital health care, such as infection prevention, and tissue and wound care. To address these problems, networks of specialized nurses, such as infection control link nurses have been implemented in many hospitals. Only few studies have evaluated the effects of these link nurses’ networks, but the results were promising [22-26]. Some work has been done on networks of palliative care nurse champions in the UK, and evaluations indicated that champions’ self reported knowledge on palliative care, and confidence in collaborative working had increased [27-30]. In the Netherlands a few hospitals have recently started such a network. The empowerment of hospital nurses in being an ambassador of palliative and end-of-life care and in the dissemination of palliative care knowledge and skills could contribute to the quality of care of patients dying in the hospital [31-33]. This implies the translation of knowledge and skills from palliative care experts via the network of nurse champions to the wards. The translation of knowledge is a complex process, partly because various types of knowledge (e.g. explicit and tacit) are involved, and it has to be received by various persons in various contexts. Therefore such translation requires various teaching skills [34]. Transfer of theoretical knowledge by experts to ward nurses easily conflicts with nurses’ daily practice; nurses may decide that it is irrelevant, or that implementation is impossible [35,36]. A network of ward based nurse champions, as intermediates between palliative care experts and ward nurses, is expected to improve the results of education. Nurse champions are probably more dedicated to palliative care than other nurses and have more insight in the culture and processes on their wards than the experts. It is thus probably easier to adapt the educational programme to prior knowledge, beliefs, attitudes, and educational needs of the champions than of all nurses on all the wards, and the content of the programme will easier be experienced as meaningful when champions can connect it to the context in which they work [34,37].

Education and training of health care professionals will only be successful when it leads to improved practice and decision making [38,39]. In palliative care this means timely identification of patients in need of palliative and end-of life care, timely referral to palliative care experts, collaboration between patients, family and the medical team, the use of guidelines and appropriate working procedures, and knowledge of palliative care and symptom management on the clinical wards [8,40-43]. Being a resource and role model for their colleagues, nurse champions can contribute to improved quality of palliative care, when they have sufficient clinical experience, improved knowledge of palliative care, improved teaching capacities, and acquired authority towards managers and colleagues. [25,28]. Still, rigorous evaluation of the effects of nurse champions on the outcome of care is necessary. In this article we describe the study protocol of the PalTeC-H project: a study on understanding and improving Palliative and Terminal Care in the Hospital by implementing a palliative care network of nurse champions.

Methods

Objectives

Objectives of this study are (1) to explore and understand the impact of the quality of care on the quality of life at the end of life and the quality of dying in a hospital and (2) to investigate the contribution of a quality improvement intervention which consists of the implementation of a network of palliative care nurse champions. We define end-of-life care as care provided during the last three days of life (at most). We hypothesize the implementation of the network to result in more attention for palliative care, in improved and timely recognition of patients’ palliative care needs, in more involvement of palliative care experts and, eventually, in improved quality of life during the last three days of life, improved quality of dying and increased satisfaction of bereaved relatives.

The intervention

The intervention consists of the establishment of a palliative care network of nurse champions which indirectly affects care by three main components: education, knowledge dissemination and support, plus several organizational elements (Table 1). On intervention wards two staff nurses are appointed to be palliative care nurse champions – further referred to as champions. Together they form the palliative care network coordinated by the multidisciplinary consultation team for pain and palliative care. Champions participate in monthly educational meetings of the network and in a targeted education programme of two days annually. The education programme includes palliative care knowledge and skills as well as organizational knowledge and skills, e.g. on planning dissemination of knowledge, in order to teach the champions to be an ambassador of palliative care on the wards and a role model for their colleagues. The educational strategy is based on the principles of constructivist learning and includes multiple approaches [37]. A senior nurse consultant, member of the multidisciplinary consultation team, is assigned to be the network coordinator, supported by the medical oncologist of the team. This network coordinator facilitates the learning process of champions, by organizing meetings and education programmes, and supporting champions individually in their development and in performing activities. The monthly meetings stimulate the incremental grow of knowledge. Working and learning in a network throughout the hospital give champions the opportunity to share knowledge and learn from others’ experiences, and to capture knowledge from outside their own working environment [23,28,34].

Table 1. The intervention

Champions need to identify gaps in knowledge on and quality of palliative care on their ward and to raise health care givers’ awareness on patients’ palliative care needs. They have to organize educational activities, implement protocols on palliative and terminal care, and evaluate these activities at the end of each year.

Assuming that 14 champions each spend eight hours per month on network activities, and that the coordinator spends 24 hours per month, the intervention costs are estimated at € 50.000 per year.

Study population

All wards in a large general university hospital in the Netherlands participate in this study, including a specialized unit for palliative cancer care, but excluding the department of psychiatry and the Intensive Care departments.

We collect data on adult patients who died at one of the 18 participating wards after having been admitted at least 6 hours prior to death.

Design

We designed a controlled before and after study with three phases: 1) pre-intervention phase (16 months); 2) phase in which the intervention is introduced (5 months); and 3) post-intervention phase (16 months). The intervention, i.e. the appointment of two champions joining the network, is introduced in seven wards that regularly admit cancer patients or patients with other chronic and life threatening diseases, such as chronic cardiac diseases and COPD. Although there is not much evidence on the time needed to effectively disseminate expertise and knowledge into clinical practice [31-33], we decided that the introduction phase lasts five months, as a run-up period to generate gradual changes in champions’ behavior [16,38]. In the 11 wards where the intervention is not introduced, the same measurements are performed to control for changes that are not due to the intervention, for example changes in hospital policy (Table 2). These control wards are expected to have a similar number of deaths as the intervention wards.

Table 2. Participating wards

Endpoints

Primary endpoints to reflect the outcomes of care of the dying are global assessments of patients’ quality of life during the last three days of life and patients’ quality of dying on a 0–10 numeric rating scale, comparable to the global ratings in the Quality of Dying and Death questionnaire [44]. The quality of dying has been suggested to encompass seven domains: physical, psychological, social and spiritual experiences, the nature of health care, life closure and death preparation, and the circumstances of death [45]. Secondary endpoints therefore include symptoms, recognition of approaching death, satisfaction of bereaved relatives with health care (e.g. communication, decision making and care) and presence of relatives at the moment of death. Changes in the process of care, such as nursing interventions, treatment goals and the number of referrals to the multidisciplinary consultation team are also secondary endpoints (Table 3).

Table 3. Endpoints

In addition, we assess champion nurses’ knowledge on palliative care before and after the intervention and monitor the developing process of the network.

Data collection

On every participating ward, one or two nurses are assigned to distribute questionnaires to a nurse and a physician involved in each dying patient’s care, within one week after the patient has deceased. Completed questionnaires are sent to the principal investigator (FEW). Three months after a patients’ death a relative is sent a written invitation to complete a questionnaire. In case of non-response this invitation is resent after one month. Data on patient and care characteristics such as diagnosis and do not resuscitate agreements are derived from the patient record, when not available from physicians.

We use three different questionnaires: for physicians (35 items), nurses (55 items) and bereaved relatives (94 items). The questionnaires were developed by a group of experts and criticized by a representative of the hospital patients’ council. Then they were tested on relevance and face validity among members of all targeted groups, and piloted in the first 30 cases. Bereaved relatives are asked to answer questions as patients’ proxy and as unit of care themselves.

Champions’ knowledge and opinions are assessed using the Rotterdam MOVE2PC questionnaire, developed and validated for use among general nurses by our research team (publication in manuscript; FEW, LZ, CR, AH). The network process is investigated by counting the champions’ presence at network meetings and education programmes, assessing their activities on the wards, and assessing the coaching activities of the coordinator.

Data analysis

To address the first objective, i.e. to explore and understand the impact of the quality of care on the quality of life at the end of life and the quality of dying in the hospital, we will analyze primary and secondary endpoints, their interrelatedness, and possible determinants. We will use data from all participating wards during the pre-intervention phase and the intervention-introduction phase (21 months). To address the second objective, i.e. to investigate the influence of the network of nurse champions, we will compare primary and secondary endpoints between the pre- and post-intervention phase (2 x 16 months). Significant changes in the intervention group that are not found in the control group will be interpreted as differences due to the intervention. To measure a difference of one unit on a 0–10 numeric rating scale for global quality of life during the last three days and global quality of dying between the pre-intervention and post-intervention measurement (phase 1 and phase 3), with an assumed standard deviation of 2.5, we need data on 400 patients: 100 patients before as well as after the intervention on both the intervention and the control wards (Lehr’s formula 16/(1/2.5)2 = 100) [46]. Expecting a participation rate of 50% among nurses, physicians and relatives we aim to include 400 cases in the pre-intervention phase and 400 in the post-intervention phase.

Data will be analyzed using descriptive analyses, univariate and multivariate regression analyses, t-tests, ANOVA and Chi square tests.

Ethical considerations

Approval for this study was given by the Medical Ethical Research Committee of the Erasmus MC. The intervention was assigned to seven wards and randomisation of individual patients was not needed. According to the Dutch legislation informed consent was not required because data is gathered after patients’ death and the study involves no more than minimal risk to the participants.

Discussion

Measurement of quality of end-of-life care

The multidimensionality and evolution of care at the end of life have been subject of many studies in the last decades [19,44,47-51]. Quality of life, quality of dying and quality of care are overlapping constructs but can be distinguished [45,52]. Quality of life (at the end of life) involves physical, psychological, social and spiritual experiences, and quality of dying additionally includes the domains of nature of health care, life closure and death preparation, and the circumstances of death [45]. Quality of care at the end of life addresses the extent to which these domains are affected by health care.

We study the quality of care of dying patients and their families, as suggested by Stewart et al. [47]. Stewart’s model suggests that health care structures and processes, such as organization, physical environment, communication and decision making, as well as individual patient factors, e.g. diagnosis, psychological characteristics and religious background, determine the quality of dying. According to this model we study to which extent the structure and process of care and patient factors affect the quality of life during the last days of life and quality of dying in the hospital [45,47].

In consequence of the uncertainty of prognostication, ethical concerns and methodological considerations of prospective measurement in dying patients [53,54], we perform retrospective assessments. We invite relatives to participate 3–4 months after the patient's death and incorporate overlap in items asked to relatives and healthcare providers, to address potential recall bias and differences in the reporting of subjective states, such as pain and anxiety, between patients, relatives and healthcare providers [21,55].

A literature search for instruments investigating different aspects of end-of-life care showed that quality of life instruments do not capture experiences unique to the dying process and focus on physical domains mainly [52,56,57]. In 2008 and 2010, reviews were published on quality of life instruments for use in palliative care [56], quality of dying instruments [58] and instruments for the assessment of care of the dying, [57,59] respectively. It was concluded that the QODD, a measure of Quality of Dying and Death developed by Curtis et al. (2002) is the best tested measure of quality of dying to date, although the developers themselves judged it to be suboptimal [44]. The QODD did not meet our goals precisely, because of e.g. the extent of assessing symptoms at the end of life (two physical symptoms only) and the timeframe of reference (one week to one month before death). In addition, it has not been used as a self-completion questionnaire by relatives [57]. More recently Mayland (2011) published on the ECHO-D questionnaire (Evaluating Care and Health Outcomes – for the Dying), developed to evaluate the impact of the Liverpool Care Pathway for the Dying Patient among bereaved relatives [59]. We specifically aim to investigate preferences and experiences in the last three days of life, the inter-relationship of the different domains of quality of life during the last days of life and quality of dying, and their association with bereaved relatives’ overall satisfaction with the quality of care [21,58,60]. Therefore, we developed three new questionnaires, taking into account the content of previous questionnaires, to include the perspectives of relatives and health care providers.

Evaluation of the intervention

According to the Medical Research Council (MRC) Framework for Development and Evaluation of RCT’s for Complex Interventions to improve health, the intervention with a network of champions is complex [15,61]. Many ingredients contribute to the effects, such as the individual champions’ knowledge and skills and interdisciplinary collaboration, and “it is not easy precisely to define the “active ingredients” of the intervention” [61]. The performance depends on the activities of the champions in the context of their ward, and the “dose” to which professionals and patients are exposed to the intervention may differ among the wards. A principal element of the intervention is the transfer of knowledge. Knowledge transfer is an interpersonal and cognitive process that can promote change strategies and the utilization of this knowledge [31,32]. Coaching the champions to adapt various approaches for the implementation of their newly acquired knowledge is an important tool in our study, in consequence of the need for simultaneous strategies in health care innovations [33]. To date reported effects of champions’ networks are limited to increased knowledge and confidence of the champions themselves [12,22,23,28,29,35,62]. This study will add information on changes in health carers’ behaviour and eventually on the impact on the quality of life at the end of life, the quality of dying and proxies’ satisfaction with care.

Conclusions

This study will improve the understanding of and attention for patients’ needs, and the quality of care in the dying phase in the hospital. To our knowledge no studies have investigated this topic to the same extent, from the perspective of both healthcare providers and relatives, or measured the effects of an intervention with nurse champions on the quality of care at the end of life.

Competing interests

All authors declare that they have no competing interests.

Authors’ contributions

FEW made substantial contributions to conception and design of the study, is primary investigator in this study and is author of the manuscript. LZ made substantial contributions to conception and design of the study, helped to draft the manuscript, and has revised the manuscript critically for important intellectual content. PM made substantial contributions to conception and design of the study; has revised the manuscript critically for important intellectual content. HD participates in data collection and has revised the manuscript critically for important intellectual content. KR made substantial contributions to conception and design of the study; has revised the manuscript critically for important intellectual content. AH made substantial contributions to conception and design of the study; helped to draft the manuscript, and has revised the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

Acknowledgements

We acknowledge the Erasmus MC and the Tom and Josephine Rijckes Foundation for their financial support, and nurses, physicians and representatives of bereaved families and of the hospital patients’ council for their critical advice.

References

  1. Walling AM, Asch SM, Lorenz KA, Roth CP, Barry T, Kahn KL: The quality of care provided to hospitalized patients at the end of life.

    Arch Intern Med 2010, 12:1057-1063. OpenURL

  2. Teno JM, Clarridge BR, Casey V, Welch LC, Wetle T, Shield R: Family perspectives on end-of-life care at the last place of care.

    JAMA 2004, 1:88-93. OpenURL

  3. Klinkenberg M, Willems DL, van der Wal G, Deeg DJ: Symptom burden in the last week of life.

    J Pain Symptom Manage 2004, 1:5-13. OpenURL

  4. Curtis JR: Caring for patients with critical illness and their families: the value of the integrated clinical team.

    Respir Care 2008, 4:480-487. OpenURL

  5. Lynn J, Teno JM, Phillips RS, Wu AW, Desbiens N, Harrold J: Perceptions by family members of the dying experience of older and seriously ill patients. SUPPORT investigators. Study to understand prognoses and preferences for outcomes and risks of treatments.

    Ann Intern Med 1997, 2:97-106. OpenURL

  6. Rocque GB, Cleary JF: Palliative care reduces morbidity and mortality in cancer.

    Nat Rev Clin Oncol 2013, 2:80-89. OpenURL

  7. Morrison RS: Health care system factors affecting end-of-life care.

    J Palliat Med 2005, 8(SUPPL. 1):S79-S87. PubMed Abstract | Publisher Full Text OpenURL

  8. Gilewski T: The art of medicine: teaching oncology fellows about the end of life.

    Crit Rev Oncol Hematol 2001, 2:105-113. OpenURL

  9. Al-Qurainy R, Collis E, Feuer D: Dying in an acute hospital setting: the challenges and solutions.

    Int J Clin Pract 2009, 3:508-515. OpenURL

  10. Simon S, Higginson IJ: Evaluation of hospital palliative care teams: strengths and weaknesses of the before-after study design and strategies to improve it.

    Palliat Med 2009, 1:23-28. OpenURL

  11. A controlled trial to improve care for seriously ill hospitalized patients. The study to understand prognoses and preferences for outcomes and risks of treatments (SUPPORT). The SUPPORT principal investigators

    JAMA 1995, 20:1591-1598. OpenURL

  12. Curtis JR, Nielsen EL, Treece PD, Downey L, Dotolo D, Shannon SE: Effect of a quality-improvement intervention on end-of-life care in the intensive care unit: a randomized trial.

    Am J Respir Crit Care Med 2011, 3:348-355. OpenURL

  13. McCormick AJ, Curtis JR, Stowell-Weiss P, Toms C, Engelberg R: Improving social work in intensive care unit palliative care: results of a quality improvement intervention.

    J Palliat Med 2010, 3:297-304. OpenURL

  14. Cheung W, Aggarwal G, Fugaccia E, Thanakrishnan G, Milliss D, Anderson R: Palliative care teams in the intensive care unit: a randomised, controlled, feasibility study.

    Crit Care Resusc 2010, 1:28-35. OpenURL

  15. Costantini M, Beccaro M: Health services research on end-of-life care.

    Curr Opin Support Palliat Care 2009, 3:190-194. PubMed Abstract | Publisher Full Text OpenURL

  16. Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D: Framework for design and evaluation of complex interventions to improve health.

    BMJ 2000, 7262:694-696. OpenURL

  17. Fowell A, Johnstone R, Finlay IG, Russell D, Russell IT: Design of trials with dying patients: a feasibility study of cluster randomisation versus randomised consent.

    Palliat Med 2006, 8:799-804. OpenURL

  18. Chan R, Webster J: End-of-life care pathways for improving outcomes in caring for the dying.

    Cochrane Database Syst Rev 2010, 1:CD008006. PubMed Abstract | Publisher Full Text OpenURL

  19. Ferrell BR: Overview of the domains of variables relevant to end-of-life care.

    J Palliat Med 2005, 8(Suppl 1):S22-S29. PubMed Abstract | Publisher Full Text OpenURL

  20. Steinhauser KE: Measuring end-of-life care outcomes prospectively.

    J Palliat Med 2005, 8(Suppl 1):S30-S41. PubMed Abstract | Publisher Full Text OpenURL

  21. Teno JM: Measuring end-of-life care outcomes retrospectively.

    J Palliat Med 2005, 8(Suppl 1):S42-S49. PubMed Abstract | Publisher Full Text OpenURL

  22. Ching TY, Seto WH: Evaluating the efficacy of the infection control liaison nurse in the hospital.

    J Adv Nurs 1990, 10:1128-1131. OpenURL

  23. Collins M, Robinson D: Bridging the research-practice gap: the role of the link nurse.

    Nurs Stand 1996, 25:44-46. OpenURL

  24. Cooper T: Delivering an infection control link nurse programme: improving practice.

    Br J Infect Control 2004, 6:24-27. OpenURL

  25. Dawson SJ: The role of the infection control link nurse.

    J Hosp Infect 2003, 4:251-257.

    quiz 320

    OpenURL

  26. Ross KA: A program for infection surveillance utilizing an infection control liaison nurse.

    Am J Infect Control 1982, 1:24-28. OpenURL

  27. Bawn R, Matthews T: Improving palliative care.

    Nurs Times 2002, 12:34-35. OpenURL

  28. Cotterell P, Lynch C, Peters D: Bridging the gap: can a link nurse initiative influence palliative care in an acute hospital?

    Int J Palliat Nurs 2007, 3:102-108. OpenURL

  29. Jack BA, Gambles M, Saltmarsh P, Murphy D, Hutchison T, Ellershaw JE: Enhancing hospital nurses' knowledge of palliative care: a network nurse programme.

    Int J Palliat Nurs 2004, 10:502-506. PubMed Abstract | Publisher Full Text OpenURL

  30. Byron S, Moriarty D, O'Hara A: Macmillan nurse facilitators: establishing a palliative resource nurse network in primary care.

    Int J Palliat Nurs 2007, 9:438-444. OpenURL

  31. Aita M, Richer MC, Heon M: Illuminating the processes of knowledge transfer in nursing.

    Worldviews Evid Based Nurs 2007, 3:146-155. OpenURL

  32. Rycroft-Malone J: Theory and knowledge translation: setting some coordinates.

    Nurs Res 2007, 4:S78-S85. OpenURL

  33. Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care.

    Lancet 2003, 9391:1225-1230. OpenURL

  34. Greenhalgh T, Russell J: Promoting the skills of knowledge translation in an online master of science course in primary health care.

    J Contin Educ Health Prof 2006, 2:100-108. OpenURL

  35. Cooper T: Educational theory into practice: development of an infection control link nurse programme.

    Nurse Educ Pract 2001, 1:35-41. PubMed Abstract | Publisher Full Text OpenURL

  36. Thurston J, Waterworth S: 'Making sense': nurses' experiences of changing practice in caring for dying patients in New Zealand.

    Int J Palliat Nurs 2012, 10:500-507. OpenURL

  37. Daley BJ:

    Using concept maps with adult students in higher education. 2004.

    Available at: http://cmc.ihmc.us/papers/cmc2004-059.pdf webcite. Accessed 02/07, 2013

    OpenURL

  38. Boet S, Sharma S, Goldman J, Reeves S: Review article: medical education research: an overview of methods.

    Can J Anaesth 2012, 2:159-170. OpenURL

  39. Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R: Do short courses in evidence based medicine improve knowledge and skills? validation of Berlin questionnaire and before and after study of courses in evidence based medicine.

    BMJ 2002, 7376:1338-1341. OpenURL

  40. Cherny NI: Stigma associated with "palliative care".

    Cancer 2009, 9:1808-1812. OpenURL

  41. Ferrell BR: Late referrals to palliative care.

    J Clin Oncol 2005, 12:2588-2589. OpenURL

  42. Johnson CE, Girgis A, Paul CL, Currow DC: Cancer specialists' palliative care referral practices and perceptions: results of a national survey.

    Palliat Med 2008, 1:51-57. OpenURL

  43. Morita T, Akechi T, Ikenaga M, Kizawa Y, Kohara H, Mukaiyama T: Late referrals to specialized palliative care service in Japan.

    J Clin Oncol 2005, 12:2637-2644. OpenURL

  44. Curtis JR, Patrick DL, Engelberg RA, Norris K, Asp C, Byock I: A measure of the quality of dying and death. Initial validation using after-death interviews with family members.

    J Pain Symptom Manage 2002, 1:17-31. OpenURL

  45. Hales S, Zimmermann C, Rodin G: The quality of dying and death.

    Arch Intern Med 2008, 9:912-918. OpenURL

  46. Lehr R: Sixteen S-squared over D-squared: a relation for crude sample size estimates.

    Stat Med 1992, 8:1099-1102. OpenURL

  47. Stewart AL, Teno J, Patrick DL, Lynn J: The concept of quality of life of dying persons in the context of health care.

    J Pain Symptom Manage 1999, 2:93-108. OpenURL

  48. Emanuel EJ, Emanuel LL: The promise of a good death.

    Lancet 1998, 351:SII21-SII29. PubMed Abstract OpenURL

  49. Singer PA, Martin DK, Kelner M: Quality end-of-life care: patients' perspectives.

    JAMA 1999, 2:163-168. OpenURL

  50. Steinhauser KE, Christakis NA, Clipp EC, McNeilly M, McIntyre L, Tulsky JA: Factors considered important at the end of life by patients, family, physicians, and other care providers.

    JAMA 2000, 19:2476-2482. OpenURL

  51. Engelberg RA, Patrick DL, Curtis JR: Correspondence between patients' preferences and surrogates' understandings for dying and death.

    J Pain Symptom Manage 2005, 6:498-509. OpenURL

  52. Steinhauser KE, Clipp EC, Tulsky JA: Evolution in measuring the quality of dying.

    J Palliat Med 2002, 3:407-414. OpenURL

  53. Fowler FJ Jr, Coppola KM, Teno JM: Methodological challenges for measuring quality of care at the end of life.

    J Pain Symptom Manage 1999, 2:114-119. OpenURL

  54. Steinhauser KE, Bosworth HB, Clipp EC, McNeilly M, Christakis NA, Parker J: Initial assessment of a new instrument to measure quality of life at the end of life.

    J Palliat Med 2002, 6:829-841. OpenURL

  55. Mularski R, Curtis JR, Osborne M, Engelberg RA, Ganzini L: Agreement among family members in their assessment of the quality of dying and death.

    J Pain Symptom Manage 2004, 4:306-315. OpenURL

  56. Albers G, Echteld MA, de Vet HC, Onwuteaka-Philipsen BD, van der Linden MH, Deliens L: Content and spiritual items of quality-of-life instruments appropriate for use in palliative care: a review.

    J Pain Symptom Manage 2010, 2:290-300. OpenURL

  57. Mayland CR, Williams EMI, Ellershaw JE: How well do current instruments using bereaved relatives' views evaluate care, for dying patients?

    Palliat Med 2008, 2:133-144. OpenURL

  58. Hales S, Zimmermann C, Rodin G: Review: the quality of dying and death: a systematic review of measures.

    Palliat Med 2010, 2:127-144. OpenURL

  59. Mayland CR, Williams EM, Ellershaw JE: Assessing quality of care for the dying: the development and initial validation of a postal self-completion questionnaire for bereaved relatives.

    Palliat Med 2012, 7:897-901. OpenURL

  60. Watts T: End-of-life care pathways as tools to promote and support a good death: a critical commentary.

    Eur J Cancer Care (Engl) 2012, 1:20-30. OpenURL

  61. Medical Research Council: A framework for development and evaluation of RTC'S for complex interventions to improve health. MRC London; 2000. OpenURL

  62. Roberts C, Casey D: An infection control link nurse network in the care home setting.

    Br J Nurs 2004, 3:166-170. OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/13/115/prepub