Email updates

Keep up to date with the latest news and content from BMC Medical Informatics and Decision Making and BioMed Central.

Open Access Research article

A Decision Aid for COPD patients considering inhaled steroid therapy: development and before and after pilot testing

Elie A Akl12*, Brydon JB Grant12345, Gordon H Guyatt67, Victor M Montori8 and Holger J Schünemann9

Author Affiliations

1 Department of Medicine, University at Buffalo, Buffalo, NY, USA

2 Department of Social & Preventive Medicine, University at Buffalo, Buffalo, NY, USA

3 Department of Medicine, VAMC, Buffalo, NY, USA

4 Department of Biostatistics, University at Buffalo, Buffalo, NY, USA

5 Department of Physiology and Biophysics, University at Buffalo, Buffalo, NY, USA

6 Department of Medicine, McMaster University, Hamilton, Ontario, Canada

7 Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada

8 Knowledge and Encounter Research Unit, Mayo Clinic College of Medicine, Rochester, Minnesota, USA

9 INFORMA, Dept. of Epidemiology, Italian National Cancer Institute Regina Elena, Rome, Italy

For all author emails, please log on.

BMC Medical Informatics and Decision Making 2007, 7:12  doi:10.1186/1472-6947-7-12

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6947/7/12


Received:9 February 2007
Accepted:15 May 2007
Published:15 May 2007

© 2007 Akl et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Decision aids (DA) are tools designed to help patients make specific and deliberative choices among disease management options. DAs can improve the quality of decision-making and reduce decisional conflict. An area not covered by a DA is the decision of a patient with chronic obstructive pulmonary disease (COPD) to use inhaled steroids which requires balancing the benefits and downsides of therapy.

Methods

We developed a DA for COPD patients considering inhaled steroid therapy using the Ottawa Decision Support Framework, the best available evidence for using inhaled steroid in COPD and the expected utility model. The development process involved patients, pulmonologists, DA developers and decision making experts. We pilot tested the DA with 8 COPD patients who completed an evaluation questionnaire, a knowledge scale, and a validated decisional conflict scale.

Results

The DA is a computer-based interactive tool incorporating four different decision making models. In the first part, the DA provides information about COPD as a disease, the different treatment options, and the benefits and downsides of using inhaled steroids. In the second part, it coaches the patient in the decision making process through clarifying values and preferences. Patients evaluated 10 out of 13 items of the DA positively and showed significant improvement on both the knowledge scale (p = 0.008) and the decisional conflict scale (p = 0.008).

Conclusion

We have developed a computer-based interactive DA for COPD patients considering inhaled steroids serving as a model for other DAs in COPD, in particular related to inhaled therapies. Future research should assess the DA effectiveness.

Background

Increasingly, patients want to become actively involved in medical decision-making [1]. Active patient involvement can improve outcomes including quality of life and can possibly reduce health care expenditures [2-4]. However, therapy and screening decisions are complicated for several reasons. First, there is often no single 'best' choice because people vary in the values or personal importance that they place on the benefits and harms of different treatment or screening options. Second, the evidence needed to trade off benefits and downsides (harm, burden and cost) of options may be of low quality. Third, clinicians have little knowledge about the best ways to present evidence and to involve patients in the decision making process. Individual practice circumstances further complicate evidence based decision making.

Because of the existing evidence that active patient involvement can improve outcomes [2-4] and in order to help people make wise choices among options [5,6] investigators and clinicians have developed decision aids (DAs). DAs are decision support tools that provide patients with detailed and specific information on options and outcomes, help them clarify their values, and guide them through the decision making process [7]. DAs are superior to usual care interventions in improving knowledge and realistic expectations of the benefits and harms of options; reducing passivity in decision making; and lowering decisional conflict due to feeling uninformed [7]. Additionally, they assist patients with chronic diseases in feeling better socially supported and potentially improving their behavioral and clinical outcomes [8].

Chronic Obstructive Pulmonary Disease (COPD) is a major cause of chronic morbidity and mortality throughout the world [9]. In the US alone, COPD affected an estimated 11 million adults in 2002, and was the fourth leading cause of death in 2004 [10]. The 2004 US expenditures for health and lost productivity due to COPD were estimated at $37.2 billions [10]. Further increases in COPD prevalence and mortality will occur in the coming decades [11].

Inhaled steroids, one of therapeutic options for COPD, reduce the number of acute exacerbations in COPD patients [12,13] and have a small beneficial effect on their health related quality of life (HRQL), but have a number of side effects including oropharyngeal candidiasis and skin bruising [12]. They also pose the additional burden of using an inhaler. Asking COPD patients to decide about starting inhaled steroids implies a decision making process trying to balance the benefits and harms by including their personal values. Although we did not identify any study about the difficulties with making such a decision, we had noted difficulties in the course of our clinical practice and when speaking to colleagues. In this paper we describe the development and pilot testing of a decision aid for COPD patients considering inhaled steroids therapy that can serve as a model for other decisions aids in COPD.

Methods

Development of the Decision Aid

The development of the COPD DA consisted of five steps:

(1) Structural development: the structure of the DA follows the Ottawa Decision Support Framework (DSF) [14] and is based on the Ottawa Personal Decision Guide (OPDG) [15]. The framework is an evidence-based, practical, mid-range theory for guiding patients making health or social decisions. Mid-range theories are moderately abstract and inclusive theories that address specific phenomena and are composed of concepts and propositions that are measurable [16]. The framework supports decision making through providing information about the disease, its treatment alternatives and the associated outcomes; through clarifying values; and finally through augmenting skills in decision making. The Ottawa Personal Decision Guide (OPDG) is a generic decision aid designed for any health-related and/or social decision. It helps people assess their decision making needs, plan the next steps, and track their progress in decision making. However, it does not include standardized guidance about how to include an interactive computer based interface, which was one of the aims of our project. Furthermore, opposed to the generic features of the OPDG we aimed to include different decision making models in the aid. The latter was another of our specific aims for this decision aid and the intended decision making process.

(2) Information compilation: we derived the information about the outcomes of inhaled steroids treatment in COPD patients from the most recent systematic review of the medical literature about the topic [12], and from several of the original studies included in the review. Beneficial outcomes include a reduction in the rate of exacerbations (RR = 0.70; 95% CI: 0.58 to 0.84: from 0.8 to 0.56 exacerbation per year) [12] and a deceleration in the rate of decline in health status [17]. Harms include increases in the rates of oropharyngeal candidiasis (RR = 2.1; from 0.8% to 1.7% per year), skin bruising (RR = 2.1; from 1.0% to 2.1% per year) and dysphonia (RR = 2.0; from 1.7% to 3.3% per year) as well as the burden of using the drug. We also included a statement about the uncertainty of the effect of inhaled steroids on mortality, cataract and bone fractures [18].

(3) Platform design: two professional web designers experienced health related websites developed the platform of the DA using Macromedia Dreamweaver 2002 software. They developed it as a CD-ROM version and then made it available on the World Wide Web.

(4) Experts' feedback: we consulted pulmonologists, medical decision making experts (Drs. Amiram Gafni and Cathy Charles, McMaster University, Hamilton, Canada) and a DA expert (Dr. Annette O'Connor, University at Ottawa, Canada). We used their in-depth feedback to improve different aspects of the DA. These improvements related to the structure of the decision aid and the integration of different decision making models.

(5) Patients' feedback: we conducted detailed interviews with 7 COPD patients. Each patient reviewed the DA, answered specific questions and provided general comments. After each interview, we made modifications based on the patient feedback. Modifications were mainly related to the use of lay terms, the form of presentation of the statistical presentation, and the amount of information.

Pilot testing of the Decision Aid

Eight additional COPD patients used the DA as if they were to make a real life decision about the use of inhaled steroids. These participants completed 3 instruments: (1) an evaluation questionnaire; (2) a knowledge scale (before and after use); and (3) a validated decisional conflict scale (before and after use) [19]. The evaluation questionnaire addressed 13 features of the DA that participants rated on 5-point Likert scales (1 for lowest value, 3 for neutral value and 5 for highest value). The knowledge scale consisted of 10 questions we developed specifically about the use of inhaled steroids in COPD patients [see Additional file 1]. We kept track of the required time and the need for assistance in using the DA. The State University of New York at Buffalo and the Buffalo Veterans Affairs Medical Center institutional review boards (IRB) approved this study and all participants provided informed consent.

Additional file 1. Inhaled steroids in COPD patients' specific Knowledge scale. Reproduces the Inhaled steroids in COPD patients' specific Knowledge scale

Format: DOC Size: 37KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

Statistical analysis

For the 5 point Likert scale questions, we used a one sample t-test to compare the mean response to 3 (neutral value). For the knowledge and decisional conflict scales, we used a paired t-test to compare the pre and post intervention mean scores. We used SPSS, version 11.0 (SPSS, Inc., Chicago, Illinois) and considered p < 0.01 (two-sided) as statistically significant.

Results

The decision Aid [20]

Structure

The DA is structured in two parts, each part consists of several sections, and each section consists of several pages (Figure 1) [see Additional file 2]. In the first part, the DA provides medical information about: the use of the DA, COPD, treatment alternatives, the benefits of inhaled steroids, and their downsides. In the second part, the DA coaches the patient in the decision making process through: case scenarios of hypothetical COPD patients using their values to make tradeoffs between the benefits and harms of the inhaled steroids, clarification of the patient's own values for each benefit and harm (see "rating values"); and assistance in the final decision making (see "Decision making models").

Additional file 2. The DA Structure. Describes the structure of the Decision Aid.

Format: DOC Size: 46KB Download file

This file can be viewed with: Microsoft Word ViewerOpen Data

thumbnailFigure 1. Screenshot showing the general appearance and structure of the DA.

Rating values

The DA asks the patient to assign the value she attaches to each of the potential outcomes (benefits and harms) of using inhaled steroids. The value rating instrument is a horizontal feeling-thermometer with values ranging from 0 ("death") to 100 ("Full Health") by increments of 1 unit. The patient moves the cursor of the scale to assign her value for a specific outcome. A box adjacent to the scale indicates the exact value being assigned. The scales for the different outcomes are stacked vertically to enable the patient to compare them visually. (Figure 2)

thumbnailFigure 2. Screenshot showing the value rating instrument.

Decision making models

The DA, by providing the medical information and clarifying patient values, allows the patient to choose one of four possible decision making models[21,22] Under the "informed decision making model" the patient opts for integrating herself the medical information with her values to make a decision. Under the "physician as an agent model" the patient opts for the DA to integrate the information and the values and provide a recommendation "to use" or "not to use" inhaled steroids. This recommendation is determined by a decision analysis combining outcomes probabilities and the patient assigned values (the expected utility theory). Under the "shared decision making model" the patient reviews the medical information in the DA and goes through the value clarification process, first, and then and makes the decision together with his health care provider. Finally, under the "paternalistic model" the patient can quit the DA at any time and leave the entire decision to her health care provider. (Figure 3)

thumbnailFigure 3. Screenshot showing how the DA provides the user with different decision making models.

Navigation

The user can access the first page of any section from any page of the DA, and all pages of a particular section from any page of that section. Additional features include hyperlinks to references and definitions of technical words that pop-up in small-size windows. The navigation thus permits access to medical information when needed at any step of the DA.

Pilot testing of the Decision Aid

Table 1 lists the characteristics of the patients who participated in the pilot testing of the DA. Table 2 lists the results of the pilot testing. Participants provided positive feedback regarding the design, pictures, understandability, user friendliness, perceived required time, explanations, and amount of information in the DA. They felt comfortable and satisfied using it. However they had neutral opinion about the clarity of statistical explanations, the explanation of the concept of values, the helpfulness of the DA and the perceived improvement in knowledge. Both the knowledge and the decisional conflict scales improved significantly after review of the DA. The mean needed time to finish reviewing the DA was 32 min and 75% of patients needed assistance in using the appropriate buttons to navigate the DA.

Table 1. Baseline characteristics of pilot testing patients

Table 2. Results of the pilot testing

Discussion

We have developed a DA for COPD patients considering inhaled steroid therapy. The DA is a computer-based interactive tool structured following the Ottawa Decision Support Framework and integrating four decision-making models (the paternalistic model, the informed decision making model, the physician as an agent model and the shared decision making model). In practice, patients could briefly review the DA with the health care provider at the time of the medical encounter and then complete a detailed review on their own. The most efficient way of completing the decision aid is thus one that does not require presence of a health care provider. COPD patients evaluated positively most of the features of the DA, and showed significant improvement on both the knowledge and the decisional conflict scales.

The DA has several strengths. First, it meets 14 of the 23 quality criteria for "content" and 15 of the 19 quality criteria for "development process" recently proposed by the International Patient Decision Aid Standards (IPDAS) Collaboration [23]. Second, we used a rigorous evidence-based approach to gather and summarize the evidence provided in the decision aid. Third, we have integrated into the decision aid several decision making models to respond to different decision making preferences. We know of no other decision support tool that provides this flexibility, which responds to the variability in decision-making style preferences among patients [24]. Fourth, we assessed patient values using a quantitative method. Fifth, the computer-based format offers the advantages of ease of access, convenience, and ease of update.

The decision aid has some limitations. First, we have not evaluated yet the effectiveness of the DA in terms of the impact on the decision processes or decision quality. While the pilot testing in 8 patients provided us with important information, it is insufficient for claiming its widespread use. Second, the computer-based format of the DA might not be ideal for older patients. However, the proportion of COPD patients who are computer literate should be on the rise. Third, the DA does not individualize the risk of developing specific outcomes as in other DAs [25]. We would integrate such function when the necessary statistical prediction models become available.

Other DA developers have also described the challenge of how to communicate risk to patients [24,26]. While the literature suggests that different presentation formats lead to different decisions [27], we do not know which format promotes decisions most consistent with patient values and preferences. An international series of randomized trials (Health Information Project: Presentation Online or HIPPO) are currently underway to try to answer that question [28].

Wilson et al. developed a DA to assist patients with COPD in advance planning for life-threatening exacerbations of their disease [29]. For patients participating in an evaluation study of the decision aid, the burden of treatment (mechanical ventilation in that case) was also an important consideration in making the decision. In addition, about a quarter of patients in that study did not completely comprehend the DA suggesting that this relatively older population might find it challenging to use decision support tools.

This DA may benefit patients with a baseline uncertainty about their choice, similarly to findings in studies of other DAs [30]. Patients who have strong prior preference may still benefit from the medical information the DA provides. The DA will also benefit patients who want to be involved in decision making given patients vary in their preferences for such involvement [31].

Conclusion

We are planning to conduct a pragmatic clinical trial evaluating the impact of the decision aid on decision processes and decision quality [32]. In that trial we intend to compare different formats of the DA (computer based, paper based) in order to identify the most cost effective option [33]. The DA presents an opportunity to study different ways of presenting information and of eliciting values and evaluate their effect on the decision making process comparatively. It can also serve as a template for the development of other DAs related to emerging COPD treatments that involve a benefit risk tradeoff (e.g. protease inhibitors).

Disclaimer

The Decision Aid for making decisions about using inhaled steroids in COPD (DA) is not a substitute for medical advice, examination, diagnosis treatment or judgment of a physician or health care professional. If you have any concerns about your health, talk to a doctor. Also, do not disregard or delay seeking medical advice because of something you read on the DA. The information found on the DA is to be used solely for informational purposes. Additionally, in spite of our best efforts, the information in the DA may become out of date over time. The DA team accepts no liability for the accuracy or completeness or use of, nor any liability to update, the information or materials provided in the DA.

Abbreviations

Decision aid (DA)

Chronic Obstructive Pulmonary Disease (COPD)

Health related quality of life (HRQL)

Ottawa Decision Support Framework (DSF)

International Patient Decision Aid Standards (IPDAS) Collaboration

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

EAA participated in the acquisition of funding, the design of the study, the development of the DA, data collection, data analysis and drafting of the manuscript. BJBG participated in the acquisition of funding, the development of the DA and data collection. GHG and VMM participated in the design of the study and the development of the DA. HJS conceived of the DA and participated in the acquisition of funding, the design of the study, the development of the DA, data analysis and drafting of the manuscript. All authors critically revised the manuscript for important intellectual content and gave the approval of the version to be published.

Acknowledgements

The work was perfomed at the State University of New York at Buffalo and the Buffalo Veterans Affairs Medical Center. We would like to thank Ms. Jenny Luk and Mr. Thomas Kappus for developing the platform of the DA [34]. We would like to thank Drs. Amiram Gafni, Cathy Charles, and Annette O'Connor for their valuable feedback during the development of the decision aid. The Graduate Medical Education office of the State University of New York at Buffalo funded this study through an EBM/QI award. Investigators received salary support from institutional sources. This work was supported (in part) by the Office of Research and Development, Medical Research Service, Department of Veterans Affairs.

References

  1. Deyo RA: A key medical decision maker: the patient.

    BMJ 2001, 323(7311):466-467. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  2. Szabo E, Moody H, Hamilton T, Ang C, Kovithavongs C, Kjellstrand C: Choice of treatment improves quality of life. A study on patients undergoing dialysis.

    Archives of Internal Medicine 1997, 157(12):1352-1356. PubMed Abstract | Publisher Full Text OpenURL

  3. Kaplan SH, Greenfield S, Ware JE Jr.: Assessing the effects of physician-patient interactions on the outcomes of chronic disease.[erratum appears in Med Care 1989 Jul;27(7):679].

    Medical Care 1989, 27(3 Suppl):S110-27. PubMed Abstract | Publisher Full Text OpenURL

  4. Stewart MA: Effective physician-patient communication and health outcomes: a review.[comment].

    CMAJ Canadian Medical Association Journal 1995, 152(9):1423-1433. OpenURL

  5. Levine MN, Gafni A, Markham B, MacFarlane D: A bedside decision instrument to elicit a patient's preference concerning adjuvant chemotherapy for breast cancer.[comment].

    Annals of Internal Medicine 1992, 117(1):53-58. PubMed Abstract OpenURL

  6. O'Connor AM: Consumer/patient decision support in the new millennium: where should our research take us?

    Canadian Journal of Nursing Research 1997, 29(3):7-19. PubMed Abstract OpenURL

  7. O'Connor AM, Stacey D, Entwistle V, Llewellyn-Thomas H, Rovner D, Holmes-Rovner M, Tait V, Tetroe J, Fiset V, Barry M, Jones J: Decision aids for people facing health treatment or screening decisions.

    Cochrane Database of Systematic Reviews 2006., 4 OpenURL

  8. Murray E, Burns J, See Tai S, Lai R, Nazareth I: Interactive Health Communication Applications for people with chronic disease.

    Cochrane Database of Systematic Reviews 2006., 4 OpenURL

  9. World Health Organization: The world health report 2003. Shaping the future. Geneva, Switzerland ; 2003.

  10. 2004 NHLBI Morbidity and Mortality Chartbook Bethesda, Maryland , The National Heart, Lung, and Blood Institute; 2004.

  11. Murray CJ, Lopez AD: Evidence-based health policy--lessons from the Global Burden of Disease Study.[comment].

    Science 1996, 274(5288):740-743. PubMed Abstract | Publisher Full Text OpenURL

  12. Alsaeedi A, Sin DD, McAlister FA: The effects of inhaled corticosteroids in chronic obstructive pulmonary disease: a systematic review of randomized placebo-controlled trials.

    The American Journal of Medicine 2002, 113(1):59-65. PubMed Abstract | Publisher Full Text OpenURL

  13. Stanbrook MB, Juurlink DN: A preliminary meta-analysis of long-term inhaled steroids for stable chronic obstructive pulmonary disease.

    Eur Respir J 2001, 18 Suppl 33:486S. OpenURL

  14. O'Connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, McPherson R, Bunn H, Graham I, Drake E: A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation.[see comment].

    Patient Education & Counseling 1998, 33(3):267-279. Publisher Full Text OpenURL

  15. The Ottawa Personal Decision Guide (OPDG) [http://decisionaid.ohri.ca/docs/OPDG/OPDG.pdf] webcite

  16. Meleis AI: Theoretical Nursing: Development and Progress . 3rd ed edition. Philadelphia , Lippincott; 1997.

  17. Spencer S, Calverley PMA, Sherwood Burge P, Jones PW: Health Status Deterioration in Patients with Chronic Obstructive Pulmonary Disease.

    Am J Respir Crit Care Med 2001, 163(1):122-128. PubMed Abstract | Publisher Full Text OpenURL

  18. Jones A, Fay JK, Burr M, Stone M, Hood K, Roberts G: Inhaled corticosteroid effects on bone metabolism in asthma and mild chronic obstructive pulmonary disease [Systematic Review].

    Cochrane Database of Systematic Reviews 2006., 1 OpenURL

  19. O'Connor AM: Validation of a decisional conflict scale.

    Medical Decision Making 1995, 15(1):25-30. PubMed Abstract | Publisher Full Text OpenURL

  20. Decision Aid for COPD patients considering inhaled steroid therapy [http://www.predictonline.com/copd] webcite

  21. Charles C, Gafni A, Whelan T: Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango).

    Social Science & Medicine 1997, 44(5):681-692. Publisher Full Text OpenURL

  22. Gafni A, Charles C, Whelan T: The physician-patient encounter: the physician as a perfect agent for the patient versus the informed treatment decision-making model.[see comment].

    Social Science & Medicine 1998, 47(3):347-354. Publisher Full Text OpenURL

  23. Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T, The International Patient Decision Aids Standards C: Developing a quality criteria framework for patient decision aids: online international Delphi consensus process.

    2006, 333(7565):417. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  24. Feldman-Stewart D, Brundage MD: Challenges for designing and implementing decision aids.

    Patient Education and Counseling 2004, 54(3):265-273. Publisher Full Text OpenURL

  25. Colombet I, Dart T, Leneveut L, Zunino S, Menard J, Chatellier G, for the EsPe RG: A computer decision aid for medical prevention: a pilot qualitative study of the Personalized Estimate of Risks (EsPeR) system.

    2003, 3(1):13. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Fortin J, Hirota L, Bond B, O'Connor A, Col N: Identifying patient preferences for communicating risk estimates: A descriptive pilot study.

    BMC Medical Informatics and Decision Making 2001, 1(1):2. BioMed Central Full Text OpenURL

  27. Trevena LJ, Davey HM, Barratt A, Phyllis B, Caldwell P: A systematic review on communicating with patients about evidence.

    Journal of Evaluation in Clinical Practice 2006, 12(1):13-23. PubMed Abstract | Publisher Full Text OpenURL

  28. Montori VM, Carling C, Schünemann HJ, Herrin J, Dyrnes JA, Treweek S, Kristoffersen DT, Akl EA, Guyatt GH, Dvereaux PJ, Oxman AD: We need more evidence of effectiveness about ways to communicate risk to patients - a proposal.

    BMJ 2003. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  29. Wilson KG, Aaron SD, Vandemheen KL, Hebert PC, McKim DA, Fiset V, Graham ID, Sevigny E, O'Connor AM: Evaluation of a decision aid for making choices about intubation and mechanical ventilation in chronic obstructive pulmonary disease.

    Patient Education & Counseling 2005, 57(1):88-95. Publisher Full Text OpenURL

  30. Goel V, Sawka CA, Thiel EC, Gort EH, O'Connor AM: Randomized trial of a patient decision aid for choice of surgical treatment for breast cancer.

    Medical Decision Making 2001, 21(1):1-6. PubMed Abstract | Publisher Full Text OpenURL

  31. Brundage MD, Feldman-Stewart D, Cosby R, Gregg R, Dixon P, Yousse Y, Davies D, Mackillop WJ: Phase I study of a decision aid for patients with locally advanced non-small-cell lung cancer.

    Journal of Clinical Oncology 2001, 19(5):1326-1335. PubMed Abstract | Publisher Full Text OpenURL

  32. O'Cathain A, Thomas KJ: Evaluating decision aids--where next?

    Health Expectations 2004, 7(2):98-103. PubMed Abstract | Publisher Full Text OpenURL

  33. Liu J, Wyatt J, Altman D: Decision tools in health care: focus on the problem, not the solution.

    BMC Medical Informatics and Decision Making 2006, 6(1):4. BioMed Central Full Text OpenURL

  34. Thomas Kappus: Cherry Web Design. [http://www.cherryweb.com/] webcite

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6947/7/12/prepub