Email updates

Keep up to date with the latest news and content from BMC Medical Research Methodology and BioMed Central.

Open Access Research article

The impact of disease-related impairments on disability and health-related quality of life: a systematic review

Nadine Weisscher1*, Rob J de Haan2 and Marinus Vermeulen1

Author Affiliations

1 Department of Neurology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands

2 Department of Clinical Epidemiology and Biostatistics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands

For all author emails, please log on.

BMC Medical Research Methodology 2007, 7:24  doi:10.1186/1471-2288-7-24

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2288/7/24


Received:17 January 2007
Accepted:19 June 2007
Published:19 June 2007

© 2007 Weisscher et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

To investigate the interchangeability of measures of disability and health-related quality of life (HRQL) by comparing their associations patterns with disease-related impairment measures in patients with a variety of conditions.

Methods

A systematic literature search of MEDLINE, EMBASE, Web of Science and a hand search of reference lists through January 2006. Studies were included if they reported associations patterns between impairment and disability and between impairment and HRQL. Correlation coefficients were transformed to Fisher's z effect size (ES(z)). Weighted averages were reported as pooled ES(z) with 95% confidence intervals (CI).

Results

The relationship between impairment and disability was stronger (pooled ES(z) = 0.69; 95% CI, 0.66 – 0.72) than between impairment and HRQL (pooled ES(z) = 0.38; 95% CI, 0.36 – 0.41). The physical component score (pooled ES(z) = 0.43; 95% CI, 0.39 – 0.47) and disease-specific HRQL (pooled ES(z) = 0.46; 95% CI, 0.40 – 0.51) were stronger associated with impairments than the mental component score (pooled ES(z) = 0.28; 95% CI, 0.20 – 0.36) and generic HRQL (pooled ES(z) = 0.36; 95% CI, 0.33 – 0.39).

Conclusion

This study shows measures of disability and different HRQL domains were not equally related to impairment. Patient's impairments are better reflected in disability measures, than in HRQL instruments. There are many outcomes of interest and precisely defining them and measuring them will improve assessing the impact of new interventions.

Background

Choosing an outcome measure for use in clinical research is a complex process. If the outcomes are chosen inappropriately, a study may provide unreliable results [1]. Frequently used outcomes measures are mortality rates, number of events (recurrent myocard infarction) or disease activity (lesion load on MRI).

Besides biological measures other levels of clinical measurement can be considered in clinical studies: impairments, disability and health-related quality of life (HRQL). Impairments are the direct organic manifestations of the disease such as consciousness and paresis [2,3]. Disability can be defined as limitations in carrying out activities of daily living, such as self-care, mobility and activities inside or outside the home [2,3]. HRQL refers to a broad spectrum of consequences of disease. Although this concept also includes elements of impairments and disabilities, it has a strong focus on patient's social functioning and perceived health status and well being [4,5]. Hence, impairment measures are closely related to the patient's disorder, whereas the other outcome measures focus on the patient's level of functional health. Each subsequent level of clinical measurement is increasingly less disease-specific and more relevant to the patient.

Recently, patient-relevant outcomes in terms of disability and HRQL have become more important [6]. Although both functional outcomes reflect the consequences of diseases on personal level, they are conceptually different and not synonymous as is often thought by clinical researchers. Consequently, the decision to use one of these measures can have important implications for the interpretation of the study results. The objective of this systematic review is to investigate the interchangeability of measures of disability and HRQL by comparing their association patterns with disease-related impairment measures.

Methods

Data sources

We conducted a systematic literature search of MEDLINE from 1966 through January 2006, EMBASE from 1980 through January 2006 and Web of Science from 1988 through January 2006 to identify studies addressing the relation between outcome measures. A search strategy using Medical Subject Heading, text words and Publication Types Impairment or Body function (Publication date from 2001) or Body structure (Publication date from 2001) and Disability (Evaluation) or Activity or Disabled Persons or Activities of Daily Living and Health-related quality of life combined with Association or Evaluation Studies or Comparative Study or Validation Studies was used. Studies from English, German and French literature were included. The electronic search was supplemented by hand searching the investigators files, and retrieval of references cited in available literature. The search strategy was composed by one of the authors (NW) in consultation with a clinical librarian.

Study selection

A set of explicit criteria, composed by three investigators (NW, RdH, MV), were used for selection of the literature. Articles were included if they focused on methodological or metric aspects of patient-based outcomes (for example, methods of evaluating such measures, psychometric or clinimetric assessment of measures, comparative studies of measures).

Studies were included in which both the association between impairment and disability, and between impairment and HRQL were calculated by means of correlation coefficients or other association measures, regardless of the disease with the exception of psychiatric disorders. Hence, to improve the comparability between the correlation patterns between the different health concepts, only studies were included in which the three types of health outcomes were assessed in the same patient population. The measurement instruments were questionnaires or observation lists. When a multi-scale questionnaire focuses on more than one concept we only included the sub-scale for the health domain in question. In case of double publication we selected the first publication in time. Excluded were studies which valuated HRQL in terms of utilities [7] or composite scores of conceptual different measures.

Data extraction

All data were independently abstracted by two investigators (NW, RdH) through use of a list of the criteria composed by three investigators. After study selection, measures were categorized according the definitions of the WHO International Classification of Impairments, Disabilities, and Handicap version [2] and the revised International Classification of Functioning [3]. Outcome measures were classified into one of the following categories: impairment, disability, and HRQL. The latter was further categorized into generic HRQL, disease-specific HRQL, mental component of HRQL and physical component of HRQL. When there was doubt on the classification of the health domain a third reviewer (MV) was consulted.

A first draft synthesizing the data was produced by the first author of this review (NW) and extensively criticized by two other authors. The following information was abstracted: author, year of publication, sample size, disease, type of impairment and disability scales, distinction between generic or disease-specific and mental or physical HRQL, and the associations with impairment. Studies reporting repeated measures only baseline data was abstracted. Disagreements in abstracting were solved by discussion.

Statistical analysis

The correlations coefficients (r) published were converted using Fischer's variance stabilizing z transform (ES(z)) [8].

ES(z) = 1/2 loge [1+r/1-r]

were the asymptotic variance was:

v ES(z) = 1/n-3

Mean ES(z) were calculated for studies reporting multiple correlations between the concepts studied [9]. The ES(z) were combined using a fixed or random effects model, when appropriate. The weight for each study was inversely proportional to the square root of the number of patients included in the study. The methods for obtaining the pooled ES(z) and its 95% confidence interval (CI) are described in detail elsewhere [10]. We labeled the strength of the ES 0.20 as small, 0.50 as medium and 0.80 as large [11]. The pooled ES(z) were converted back to a correlation coefficient [12]:

r = tanh(ES(z))

in which we labeled the strength of the association; absolute values of r, 0.00–0.19 is regarded as very weak, 0.20–0.39 as weak, 0.40–0.59 as moderate, 0.60–0.79 as strong and 0.80–1.00 as very strong correlation [13]. The backward transformed correlation coefficients were also expressed in variance explained (r2). The square of the correlation coefficient tells us what proportion of the variance of one variable can be explained by the linear correlation with the other.

Statistical heterogeneity was measured using the Cochrane Q statistics; p ≤ 0.10 was considered representative of significant statistical heterogeneity. To establish the effect of heterogeneity between studies on meta-analysis conclusions, we performed several subgroup analyses: impairment in relation to generic or disease-specific HRQL and impairment versus the physical or mental aspects of HRQL.

We constructed normal quantile plots to assess whether the ES(z) estimates are (approximately) normal distributed and to search for publication bias [14]. With regard to the presence of publication bias we also used the Spearman's rho rank correlation method [12] to test the relationship between the standardized ES(z) and sample size (p < 0.05 indicates significant publication bias) and a fail-safe number approach. A fail-safe number is the number of non-significant, unpublished, or missing studies that would need to be added to the meta-analysis in order to change the results of the analysis. If this number is relative large to the number of observed studies, the observed results, even with some publication bias, can be treated as a reliable estimate of the true effect [15]. All analyses were performed in Meta-Win, version 2.0.

Results

Study characteristics

Our initial search yielded 434 potentially literature citations (Figure 1). Of these, 125 were excluded based on title (70 were investigating a psychiatric disorder, 44 were review articles, nine articles measured caregiver burden, one article reported data about a composite score and one reported HRQL in terms of utilities). Abstracts from 309 articles were retrieved and additional 188 articles were excluded (134 studies did not measure all three health domains, 49 did not report concrete associations between the health domains, three were investigating a psychiatric disorder, one reported data about a composite score and one reported HRQL in terms of utilities), leaving 121 articles for full review. Of these, 90 were excluded (44 did not report association patterns, 34 articles measured not all three domains, in five articles impairment measures were no scale score, four articles used composite scores, one reported utility based HRQL, one concerned a proxy measure and one a double publication).

thumbnailFigure 1. Summary description of the studies included and excluded in the meta-analysis.

A total of 31 studies, with an average sample size of 401 (range 38 – 6497) persons, were found to conform to our inclusion criteria [16-46] (Table 1). Seven studies reported data on outcome measures in patients with arthritis, six on Multiple Sclerosis, three on Parkinson's disease, two on stroke, two on spinal cord injury, four on a variety of joint diseases (knee, patella, elbow, shoulder), one cervical dystonia, one diabetic neuropathy, one facial nerve paralysis, one AIDS, one chronic dysphonia, one chronic obstructive pulmonary disease, and one on psoriasis.

Table 1. Information on the 31 studies included in the analysis ordered on disease

The studies included a wide range of disease-related impairment measures, as well as a variety of disability measures (Table 1), in which the Functional Independence Measure (FIM) was the most often used. With regard to the HRQL measures, 17 studies used the SF-36 (or SF-20), 12 studies reported both the physical component and mental component scores, in two studies [37,42] the mental health dimension was considered as mental HRQL. Other scales that were considered as a mental component of HRQL were the psychosocial dimension of the Sickness Impact Profile (SIP) [21,22,34], psychological well-being and the General Health Questionnaire (GHQ) [26], the mental dimension of the Multiple Sclerosis HRQL scale (MSQL) [36], the social well-being dimension of the Facial Disability Index (FDI) [28], the Overall Rating of Life satisfaction (ORLS) [20], and the emotional subscale of the Voice Handicap Index (VHI) [43].

Overall the studies included 86 correlations between impairment and disability and 104 correlations between impairment and HRQL. Five studies reported only one single correlation [24,25,28,33,44], for the remaining studies mean ES(z) were calculated for each health domain. Table 2 presents effect sizes of the 31 studies included. Thirteen studies (42%) reported large ES(z) between impairment and disability (≥ 0.81), whereas 81% of the ES(z) related to HRQL was small to moderate (≤ 0.50). The ES(z) between impairment and the different types of HRQL were on average small to moderate, except for disease-specific HRQL; 50% of the studies reported moderate to large ES(z) (0.51 – 0.80).

Table 2. ES(z) of the studies included in the meta-analysis

Data synthesis

Review of the normal quantile plots (Figure 2 and 3) showed that one study [46] substantially deviated from normality. Removal of this study revealed statistical homogeneity of the datasets for the association between impairment and disability (Q statistics, p = 0.34), and between impairment and HRQL (Q statistics, p = 0.15).

thumbnailFigure 2. Normal quantile plot for the ES(z) between impairment and disability. The plot compares two distributions by plotting there quantiles against each other. One of the distributions is the standard normal distribution (X as) while the other is the distribution one wishes to compare it against (here the Y as is defined as ES(z)i/√i). The deviations from linearity indicate deviations in normality. Publication bias will tend to leave strange gaps in the plot or lead to strange curves.

thumbnailFigure 3. Normal quantile plot for the ES(z) between impairment and health-related quality of life. The plot compares two distributions by plotting there quantiles against each other. One of the distributions is the standard normal distribution (X as) while the other is the distribution one wishes to compare it against (here the Y as is defined as ES(z)i/√i). The deviations from linearity indicate deviations in normality. Publication bias will tend to leave strange gaps in the plot or lead to strange curves.

On aggregate level (Figure 4), there was a moderate to large association between impairment and disability (pooled ES(z) = 0.69; 95% CI, 0.66 – 0.72). The aggregated relationship between impairment and HRQL was statistically significant smaller (pooled ES(z) = 0.38; 95% CI, 0.36 – 0.41). Backward transformation in correlation coefficients resulted in a moderate association between impairment and disability (r = 0.60; r2 = 36%) and a weak association between impairment and HRQL (r = 0.36; r2 = 13%).

thumbnailFigure 4. Meta-analysis for the ES(z) between impairment, disability, and health-related quality of life and the subgroup analyses.

Subgroup analyses

Table 2 presents the ES(z) per study used for the subgroup analyses. Figure 4 also depicts the various impairment – HRQL subgroup analyses. No statistical heterogeneity could be demonstrated (range p-values of the Q statistics 0.35 – 0.44), with the exception of the association between impairment and the mental component of HRQL (p = 0.06).

The pooled ES(z) between impairment and generic HRQL measures was 0.36 (95% CI, 0.33 – 0.39; r = 0.35; r2 = 12%) [16-22,24-27,29-32,34,37-42,45]. The pooled ES(z) between impairment and disease-specific HRQL measures was significantly higher (pooled ES(z) = 0.46; 95% CI, 0.40 – 0.51; r = 0.43; r2 = 18%) [23,28,29,33,35,36,40,43,44,46]. Impairment measures were significantly higher related with the physical component of the HRQL measures (pooled ES(z) = 0.43; 95% CI, 0.39 – 0.47; r = 0.41; r2 = 17%) [16,17,19,26,27,31,32,34,36,38-40,45] than with the mental component (pooled ES(z) = 0.28; 95% CI, 0.20 – 0.36 [random effects model]; r = 0.27; r2 = 7%) [16,17,19-22,26-29,31,32,34,36-40,42,43,45].

Publication bias

Review of normal quantile plots showed no clear indications for publication bias in both the analyses for the relationship impairment and disability and for impairment and HRQL (Figure 2 and 3). In addition, publication bias was not evident when the Spearman's rho rank correlation method was used (both p > 0.50). The fail-safe calculation by Rosenthal's method retrieved for both analyses a large number of studies (n = 27077/n = 9755) needed to be added in order to change the results of the meta-analysis.

Discussion

In this study we investigated the impact of impairments on patients' functional health in a spectrum of diseases. The results of the meta-analysis show that impairments explain 36% of the variance of the disability scores and 13% of the variance of HRQL scores. Impairment scales account for 17% of the physical dimension of HRQL, but can explain no more than 7% of the psychological aspects of HRQL [47].

Due to the great variability in disease-related impairment scales and disability and HRQL instruments used in patient groups with a wide range of disorders, we expected heterogeneous data sets. Interestingly, after removal of one study which deviated from normality, homogeneity could be demonstrated in all analyses, except when we investigated the relationship between impairment and the mental component of HRQL. Possibly, this type of HRQL is less clearly defined compared to the other types of functional outcomes.

Treatments, such as new drugs or new surgical or radiological interventions, are aimed at reducing mortality and morbidity. If these treatments reduce impairments, the beneficial effects on functional health will be far more better detectable in the patient's level of disability than in his or her level of HRQL. Moreover, if the outcome is assessed in terms of HRQL, treatment effects will be more visible in the physical component than in the mental components, and will be better reflected in the disease-specific measures than in the generic HRQL measures. Therefore, outcome measures at the level of functioning of patients should be selected carefully when clinical studies are designed. It clearly does matter on which level the functional outcome measurement is chosen.

No doubt, HRQL scales represent an important measure from a patient's point of view, but have serious disadvantages in many clinical efficacy studies. The extent to which patients fulfill social roles and participate in their environment cannot be observed directly and depends not only on their functional ability, but also on personal traits, social circumstances and societal barriers. In particular, HRQL scores, which reflect the patient's perception of the consequences of disease, depend on numerous additional, usually psychosocial, factors other than the disease itself. This explains why the correlation between impairments and HRQL scores is weak, especially when emphasis is laid on subjective psychological scores of these scales. The subjective HRQL scores therefore are often beyond the influence of the physician. In the primary assessment of new drugs or new surgical procedures, there are many outcomes of interest and precisely defining them and measuring them will improve assessing the impact of new interventions. In contrast, disability (mobility, self-care) seem to be a more appropriate primary end point for assessing the functional health status of patients. The ability to perform basic and complex activities of daily life is, as we showed, not only better related to the disease process itself, but is also observable and predictive of dependence [48], and forms an essential aspect of the patient's HRQL [49], an aspect which is amenable for treatment.

A shortcoming of this meta-analysis might be that there are probably more studies than the 31 we found. Our search strategy was based on the ICIDH and ICF terms and few researchers distinguish between the terms impairment, disability and HRQL. If they distinguished between these terms correlations between impairment and disability or between impairment and HRQL were given rarely for all three domains together. Another point of discussion may be the concern for publication bias. However, the normal quantile plots, Spearman's rank correlation coefficient method and fail-safe calculation method do not give an indication for this type of bias. Finally and unfortunately, we were not able to perform subgroup analysis based on the methodological quality of the studies. This because the psychometric and clinimetric articles analyzed used a hotchpotch of research designs which made it impossible to formulate unequivocal methodological criteria in terms of, for example, appropriateness of the design chosen, sample size consideration, blind assessment of outcome parameters, statistical adjustment for confounders, or loss to follow-up [50].

Conclusion

New drugs or new surgical or radiological treatments are developed from a pathophysiologic perspective and are primarily directed at reducing impairments. Traditionally, biological and impairment measures are preferred. Increasingly, it becomes evident that this type of outcome is not always relevant for patients [21,51]. Our study shows that patient's impairments are clearly better reflected in disability measures, than in HRQL instruments. The relatively low association between impairment and HRQL is found in patients with various disorders, therefore we conclude that to assess the efficacy of a new treatment, disability is an important functional endpoint in clinical studies.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

NW, RdH and MV initiated the project. NW and RdH screened, extracted and analysed the data. All authors participated in the discussion of the results, in the writing of the paper, and read and approved the final manuscript.

Acknowledgements

We would like to thank Koos Zwinderman for his statistical advice.

N. Weisscher is supported by a grant from the Anton Meelmeijer Fonds, a charity supporting innovative research in the Academic Medical Center, Amsterdam, the Netherlands.

References

  1. Frater A, Costain D: Any better? Outcome measures in medical audit.

    BMJ 1992, 304:519-520. PubMed Abstract | PubMed Central Full Text OpenURL

  2. World Health Organization: International Classification of Impairment, Disabilities, and Handicaps.

    Geneva 1980. OpenURL

  3. World Health Organization: International Classification of Functioning, Disability, and Health.

    Geneva, Switzerland 2001. OpenURL

  4. de Haan R, Aaronson N, Limburg M, Hewer RL, van Crevel H: Measuring quality of life in stroke.

    Stroke 1993, 24:320-327. PubMed Abstract OpenURL

  5. Aaronson NK: Quality of life: what is it? How should it be measured?

    Oncology (Williston Park) 1988, 2:69-76, 64. PubMed Abstract OpenURL

  6. Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials.

    Health Technol Assess 1998, 2:i-74. PubMed Abstract | Publisher Full Text OpenURL

  7. Sackett DL, Torrance GW: The utility of different health states as perceived by the general public.

    J Chronic Dis 1978, 31:70. Publisher Full Text OpenURL

  8. Fisher R: Statistical Methods for Research Workers. Edinburgh: Oliver & Boyd; 1925. OpenURL

  9. Rosenthal R: Parametric Measures of Effect Size. In The Handbook of Research Synthesis. Edited by Cooper H, Hedges LV. New York: Russel Sage Foundation; 1994:231-44. OpenURL

  10. Shadish W, Haddock C: Combining Estimates of Effect Size. In The Handbook of Research Synthesis. Edited by Cooper H, Hedges LV. New York: Russell Sage Foundation; 1994:261-82. OpenURL

  11. Cohen J: Statisical power analysis for the behavioural science. New York: Academic Press; 1977. OpenURL

  12. Sokal R, Rohlf F: Biometry. 3rd edition. San Francisco: Freeman; 1995. OpenURL

  13. Swinscow TDV: Correlation and regression. Statistics at Square One. ninth edition. University of Southampton: BMJ Publishing Group; 1997. OpenURL

  14. Wang MC, Bushman BJ: Using the Normal Quantile Plot to Explore Meta-Analytic Data Sets.

    Psychol Med 1998, 3:46-54. OpenURL

  15. Rosenthal R: The "file drawer problem" and tolerance for null results.

    Psychol Bull 1979, 86:638-641. Publisher Full Text OpenURL

  16. Angst F, Pap G, Mannion AF, Herren DB, Aeschlimann A, Schwyzer HK, Simmen BR: Comprehensive assessment of clinical outcome and quality of life after total shoulder arthroplasty: usefulness and validity of subjective outcome measures.

    Arthritis Rheum 2004, 51:819-828. PubMed Abstract | Publisher Full Text OpenURL

  17. Angst F, John M, Pap G, Mannion AF, Herren DB, Flury M, Aeschlimann A, Schwyzer HK, Simmen BR: Comprehensive assessment of clinical outcome and quality of life after total elbow arthroplasty.

    Arthritis Rheum 2005, 53:73-82. PubMed Abstract | Publisher Full Text OpenURL

  18. Beaton DE, Richards RR: Measuring Function of the Shoulder. A Cross-Sectional Comparison of Five Questionnaires.

    J Bone Joint Surg Am 1996, 78:882-890. PubMed Abstract | Publisher Full Text OpenURL

  19. Birrell FN, Hassell AB, Jones PW, Dawes PT: Why not use OSRA? A comparison of Overall Status in Rheumatoid Arthritis (RA) with ACR core set and other indices of disease activity in RA.

    J Rheumatol 1998, 25:1709-1715. PubMed Abstract OpenURL

  20. Cleary PD, Fowler FJ Jr, Weissman J, Massagli MP, Wilson I, Seage GR, Gatsonis C, Epstein A: Health-related quality of life in persons with acquired immune deficiency syndrome.

    Med Care 1993, 31:569-580. PubMed Abstract | Publisher Full Text OpenURL

  21. de Haan R, Horn J, Limburg M, van der Meulen J, Bossuyt P: A comparison of five stroke scales with measures of disability, handicap, and quality of life.

    Stroke 1993, 24:1178-1181. PubMed Abstract OpenURL

  22. Deyo RA, Inui TS, Leininger JD, Overman SS: Measuring functional outcomes in chronic disease: a comparison of traditional scales and a self-administered health status questionnaire in patients with rheumatoid arthritis.

    Med Care 1983, 21:180-192. PubMed Abstract | Publisher Full Text OpenURL

  23. Franchignoni F, Martignoni E, Ferriero G, Pasetti C: Balance and fear of falling in Parkinson's disease.

    Parkinsonism Relat Disord 2005, 11:427-433. PubMed Abstract | Publisher Full Text OpenURL

  24. Fuhrer MJ, Rintala DH, Hart KA, Clearman R, Young ME: Relationship of life satisfaction to impairment, disability, and handicap among persons with spinal cord injury living in the community.

    Arch Phys Med Rehabil 1992, 73:552-557. PubMed Abstract OpenURL

  25. Gottlieb A, Golander H, Bar-Tal Y, Gottlieb D: The influence of social support and perceived control on handicap and quality of life after stroke.

    Aging (Milano) 2001, 13:11-15. PubMed Abstract OpenURL

  26. Hobart J, Freeman J, Thompson A: Kurtzke scales revisited: the application of psychometric methods to clinical intuition.

    Brain 2000, 123:1027-1040. PubMed Abstract | Publisher Full Text OpenURL

  27. Hu J, Meek P: Health-related quality of life in individuals with chronic obstructive pulmonary disease.

    Heart Lung 2005, 34:415-422. PubMed Abstract | Publisher Full Text OpenURL

  28. Kahn JB, Gliklich RE, Boyev KP, Stewart MG, Metson RB, McKenna MJ: Validation of a patient-graded instrument for facial nerve paralysis: The FaCE Scale.

    Laryngoscope 2001, 111:387-398. PubMed Abstract | Publisher Full Text OpenURL

  29. Kvien TK, Kaasa S, Smedstad LM: Performance of the Norwegian SF-36 Health Survey in Patients with Rheumatoid Arthritis. II. A Comparison of the SF-36 with Disease-Specific Measures.

    Journal of Clinical Epidemiology 1998, 51:1077-1086. PubMed Abstract | Publisher Full Text OpenURL

  30. Lindeboom R, Brans JW, Aramideh M, Speelman HD, de Haan RJ: Treatment of cervical dystonia: a comparison of measures for outcome assessment.

    Mov Disord 1998, 13:706-712. PubMed Abstract | Publisher Full Text OpenURL

  31. MacDermid JC: Outcome evaluation in patients with elbow pathology: issues in instrument development and evaluation.

    J Hand Ther 2001, 14:105-114. PubMed Abstract OpenURL

  32. Marx RG, Jones EC, Allen AA, Altchek DW, O'Brien SJ, Rodeo SA, Williams RJ, Warren RF, Wickiewicz TL: Reliability, validity, and responsiveness of four knee outcome scales for athletic patients.

    J Bone Joint Surg Am 2001, 83-A:1459-1469. PubMed Abstract | Publisher Full Text OpenURL

  33. May LA, Warren S: Measuring quality of life of persons with spinal cord injury: external and structural validity.

    Spinal Cord 2002, 40:341-350. PubMed Abstract | Publisher Full Text OpenURL

  34. Miller DM, Rudick RA, Cutter G, Baier M, Fischer JS: Clinical Significance of the Multiple Sclerosis Functional Composite: Relationship to Patient-Reported Quality of Life.

    Arch Neurol 2000, 57:1319-1324. PubMed Abstract | Publisher Full Text OpenURL

  35. Paxton EW, Fithian DC, Stone ML, Silva P: The Reliability and Validity of Knee-Specific and General Health Instruments in Assessing Acute Patellar Dislocation Outcomes.

    Am J Sports Med 2003, 31:487-492. PubMed Abstract | Publisher Full Text OpenURL

  36. Rasova K, Brandejsky P, Havrdova E, Zalisova M, Rexova P: Spiroergometric and spirometric parameters in patients with multiple sclerosis: are there any links between these parameters and fatigue, depression, neurological impairment, disability, handicap and quality of life in multiple sclerosis?

    Mult Scler 2005, 11:213-221. PubMed Abstract | Publisher Full Text OpenURL

  37. Rothwell PM, McDowell Z, Wong CK, Dorman PJ: Doctors and patients don't agree: cross sectional study of patients' and doctors' perceptions and assessments of disability in multiple sclerosis.

    BMJ 1997, 314:1580. PubMed Abstract | Publisher Full Text OpenURL

  38. Rubenstein LM, Voelker MD, Chrischilles EA, Glenn DC, Wallace RB, Rodnitzky RL: The usefulness of the Functional Status Questionnaire and Medical Outcomes Study Short Form in Parkinson's disease research.

    Qual Life Res 1998, 7:279-290. PubMed Abstract | Publisher Full Text OpenURL

  39. Salaffi F, Carotti M, Grassi W: Health-related quality of life in patients with hip or knee osteoarthritis: comparison of generic and disease-specific instruments.

    Clinical Rheumatology 2005, 24:29-37. PubMed Abstract | Publisher Full Text OpenURL

  40. Schrag A, Selai C, Jahanshahi M, Quinn NP: The EQ-5D – a generic quality of life measure – is a useful instrument to measure quality of life in patients with Parkinson's disease.

    J Neurol Neurosurg Psychiatry 2000, 69:67-73. PubMed Abstract | Publisher Full Text OpenURL

  41. Schwartz CE, Vollmer T, Lee H: Reliability and validity of two self-report measures of impairment and disability for MS.

    Neurology 1999, 52:63. PubMed Abstract | Publisher Full Text OpenURL

  42. Sharrack B, Hughes RAC, Soudain S, Dunn G: The psychometric properties of clinical rating scales used in multiple sclerosis.

    Brain 1999, 122:141-159. PubMed Abstract | Publisher Full Text OpenURL

  43. Speyer R, Wieneke GH, Dejonckere PH: Self-assessment of voice therapy for chronic dysphonia.

    Clinical Otolaryngology and Allied Sciences 2004, 29:66-74. Publisher Full Text OpenURL

  44. Vinik EJ, Hayes RP, Oglesby A, Bastyr E, Barlow P, Ford-Molvik SL, Vinik AI: The Development and Validation of the Norfolk QOL-DN, a New Measure of Patients' Perception of the Effects of Diabetes and Diabetic Neuropathy.

    Diabetes Technology & Therapeutics 2005, 7:497-508. PubMed Abstract | Publisher Full Text OpenURL

  45. Wolfe F, Kong SX, Watson DJ: Gastrointestinal symptoms and health related quality of life in patients with arthritis.

    J Rheumatol 2000, 27:1373-1378. PubMed Abstract OpenURL

  46. Zachariae R, Zachariae H, Blomqvist K, Davidsson S, Molin L, Mork C, Sigurgeirsson B: Quality of life in 6497 Nordic patients with psoriasis.

    British Journal of Dermatology 2002, 146:1006-1016. PubMed Abstract | Publisher Full Text OpenURL

  47. Abrahamson JH, Abrahamson ZH: Measures of strength. In Abrahamson JH, Abrahamson ZH. Making sense of data. A self-instruction manual on the interpretation of epidemiologic data. 3rd edition. Oxford: Oxford University Press; 2001:234-238. OpenURL

  48. de Haan R, Limburg M, Meulen van der J, Bos van den GAM: Use of health care services after stroke.

    Quality in Health Care 1993, 2:222-7. PubMed Abstract OpenURL

  49. Fries JF, Singh G: The hierarchy of patient outcomes. In Quality of life and pharmacoeconomics in clinical trials. Edited by Spilker B. Philadelphia: Lippincott-Raven Publishers, USA; 1996:33-40. OpenURL

  50. Wortman PM: Judging Research Quality. In The Handbook of Research Synthesis. Edited by Cooper H, Hedges LV. New York: Russel Sage Foundation; 1994:97-109. OpenURL

  51. Molenaar DS, Vermeulen M, de Visser M, de Haan R: Impact of neurologic signs and symptoms on functional status in peripheral neuropathies.

    Neurology 1999, 52:151-156. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2288/7/24/prepub