Email updates

Keep up to date with the latest news and content from BMC Psychiatry and BioMed Central.

Open Access Highly Accessed Research article

A new clinical rating scale for work absence and productivity: validation in patients with major depressive disorder

Raymond W Lam*, Erin E Michalak and Lakshmi N Yatham

Author Affiliations

Department of Psychiatry; University of BC; Mood Disorders Centre, UBC Hospital, Vancouver, Canada

For all author emails, please log on.

BMC Psychiatry 2009, 9:78  doi:10.1186/1471-244X-9-78

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-244X/9/78


Received:2 September 2009
Accepted:3 December 2009
Published:3 December 2009

© 2009 Lam et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The prevalence of major depressive disorder (MDD) is highest in working age people and depression causes significant impairment in occupational functioning. Work productivity and work absence should be incorporated into clinical assessments but currently available scales may not be optimized for clinical use. This study seeks to validate the Lam Employment Absence and Productivity Scale (LEAPS), a 10-item self-report questionnaire that takes 3-5 minutes to complete.

Methods

The study sample consisted of consecutive patients attending a Mood Disorders outpatient clinic who were in full- or part-time paid work. All patients met DSM-IV criteria for MDD and completed during their intake assessment the LEAPS, the self-rated version of the Quick Inventory for Depressive Symptomatology (QIDS-SR), the Sheehan Disability Scale (SDS) and the Health and Work Performance Questionnaire (HPQ). Standard psychometric analyses for validation were conducted.

Results

A total of 234 patients with MDD completed the assessments. The LEAPS displayed excellent internal consistency as assessed by Cronbach's alpha of 0.89. External validity was assessed by comparing the LEAPS to the other clinical and work functioning scales. The LEAPS total score was significantly correlated with the SDS work disability score (r = 0.63, p < 0.01) and the Global Work Performance rating from the HPQ (r = -0.79, p < 0.01). The LEAPS total score also increased with greater depression severity.

Conclusion

The LEAPS displays good internal and external validity in a population of patients with MDD attending an outpatient clinic, which suggests that it may be a clinically useful tool to assess and monitor work functioning and productivity in depressed patients.

Background

Mental illnesses in general, and major depressive disorder (MDD) in particular, are among the most common, disabling and costly of medical conditions. The total economic burden (both direct and indirect costs) of depression were estimated at over C$6 billion in Canada [1], US$83 billion in the United States [2], and €118 billion in Europe [3].

The prevalence of MDD in the general population is highest in those of typical working age (15-64 years) [4] and, given the nature of the physical and cognitive symptoms of depression, it is not surprising that the major portion of the economic burden of MDD arises from impairment in occupational functioning. Numerous studies have documented that clinical depression is associated with high rates of absenteeism, or time away from work. For example, depressed workers in the United States reported 1.5-3.2 more short-term work-disability days per month, compared to people who were not depressed [5], while a Canadian study found that approximately 2.5% of employees in 3 large companies had at least 1 depression-related short-term disability leave [6]. Similarly, in the European ESEMeD study, depressed workers had 3-4 times more work-loss days per month than those without depression [7].

While the economic costs of depression-related absenteeism are significant, they are dwarfed by those attributed to presenteeism, in which depressed workers stay at work but have reduced productivity as a result of their condition. In a community survey in Canada, 29% of people with a history of MDD in the past year reported reduced activities at work, compared to only 10% of people with no history of depression [8]. Almost half of people with chronic depression reported reduced productivity at work [9] and the costs of productivity losses associated with MDD have been estimated in the United States (in 2002) at over US$31 billion [10].

Given the magnitude of occupational impairment in MDD, it is important to include assessment of work functioning within the clinical evaluation and management of the condition. There are many validated scales used to measure work performance and productivity, including generic productivity scales (e.g., Work Limitations Questionnaire [11], Stanford Presenteeism Scale [12]) that are useful for comparisons with other disease conditions. However, there are few work performance scales designed specifically for use in a depressed population. A rationale for using disease-specific measures includes the potential for such scales to provide more specific information that might otherwise be missed or to be more sensitive to change than generic counterparts [13]. For example, a depression-specific scale for work functioning may prove useful as a clinical tool for monitoring progress during treatment and/or as an outcome measure in clinical trials for MDD. This study seeks to validate a new clinical rating scale for work functioning and productivity in patients with MDD.

Methods

Scale Development

The Lam Employment Absence and Productivity Scale (LEAPS) was designed to assess work functioning and impairment in a clinically depressed population. The items were constructed and selected based on a review of the literature on depressive symptoms and interference with work functioning, and on the common work-related problems experienced by people with depression.

The LEAPS (Additional file 1) is a self-rated questionnaire consisting of 10 items: the first item asks the respondent to list their occupation and the next two items ask about the number of work hours scheduled in the past two weeks and the number of work hours missed. These items assess absenteeism, which can be expressed as a proportion (%) of work hours scheduled. Finally, there are 7 items rated on a 5-point Likert scale with the following response format: 'None of the time (0%)', 'Some of the time (25%)', 'Half the time (50%)', 'Most of the time (75%)', 'All the time (100%)', scored as 0-4, respectively. The LEAPS total score therefore ranges from 0 to 28. A "productivity subscale" sums the scores from the 3 items assessing work functioning and productivity (doing less work, doing poor quality work, and making more mistakes).

Additional file 1. The LEAPS. The self-rated questionnaire consisting of 10 items that was used in the study.

Format: PDF Size: 13KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Subjects and Procedures

The validation sample consisted of consecutive patients with MDD attending a Mood Disorders clinic at a university teaching hospital. Patients were referred from primary care physicians and from community psychiatrists. Clinical assessments were conducted by board-certified psychiatrists. Diagnoses were assigned according to DSM-IV criteria based on clinical interviews supplemented by a symptom check list and all available medical information. Inclusion criteria for this study included a DSM-IV diagnosis of MDD; patients with bipolar disorder were excluded. Patients also had to be working, defined as paid work (employed or self-employed), either part-time or full-time. Patients on short-term or long-term work disability were excluded. This study was approved by the Clinical Research Ethics Board of the University of British Columbia.

Patients completed several questionnaires at initial assessment, including the Quick Inventory of Depressive Symptomatology, Self-Rated (QIDS-SR), a validated and widely used self-rated scale to assess severity and type of depressive symptoms [14]. In addition, subjects completed the Health and Work Performance Questionnaire (HPQ, [15]) and the Sheehan Disability Scale (SDS, [16]). The HPQ was developed for the World Health Organization as a depression-specific, self-rated questionnaire that assesses illness-related work absence (as number of hours/week), work productivity, Global Work Performance, and job-related accidents. The HPQ has been validated against objective measures of absence and performance in a number of blue-collar and white-collar occupations [17,18] and can be considered the "gold standard" productivity assessment. The SDS is a generic self-report inventory that assesses the degree to which symptoms have disrupted the person's work, social life, and family life. A single question assesses work/school impairment, formatted as 'The symptoms have disrupted your work/school work:' and rated on a 0-10 point scale ranging from 'Not at all (0)' through 'Mildly (1-3)', 'Moderately (4-6)' and 'Markedly (7-9)' to 'Extremely (10)'. There are two additional items which inquire about the number of days lost in the past month owing to absence or reduced productivity.

Statistical Procedures

All results are reported as means ± standard deviations (SD). Construct validation of a scale for work functioning is complex because there are no definitive measures for the underlying construct. Hence, we conducted a series of scale validation procedures. Internal consistency (the degree to which the items of a scale measure the same construct) of the 7 LEAPS items was measured using Cronbach's alpha. To assess the structure of the LEAPS, a factor analysis was conducted using Principal Components Analysis with varimax rotation. Convergent validity is the degree of correlation between a new scale and previously validated measures of the same construct. This was assessed using two-tailed Pearson correlations between the LEAPS total score and scores on other scales measuring work productivity. In addition, work functioning would be expected to be more impaired as the depressive symptomatology worsens. Therefore, the LEAPS should discriminate between severity categories (e.g., minimally depressed versus more severely depressed) of depression. This was evaluated by examining mean scores on the LEAPS across the range of severity categories of the QIDS-SR, using one-way ANOVA. If the overall F was significant, post hoc pairwise comparisons between severity categories were examined using Tukey's HSD to control for multiple comparisons. All statistical analyses were conducted using SPSS, V.16 [19].

Results

Subject Demographic Variables

Table 1 shows the demographic and clinical information for the 234 subjects studied. The profile is typical of a mood disorders cohort attending a specialty clinic. The mean score on the QIDS-SR was 13.8 ± 5.9, indicating a moderate severity of depression. The subjects missed an average of 10 hours of work in the past 2 weeks owing to their symptoms, which represented 16% of the time they were scheduled to work.

Table 1. Demographic and clinical features of the validation sample (N = 234).

Internal Consistency

The Cronbach's alpha for the 7 Likert-scored items on the LEAPS was 0.89, indicating that the LEAPS items showed high internal consistency.

Factor Analysis

Table 2 shows the results of the factor analysis with varimax rotation conducted on the 7 Likert-scored items of the LEAPS. Two factors were identified on the Principal Components Analysis that accounted for 75% of the variance in the LEAPS total score. The first factor included the 3 items relating to work productivity, which accounted for 60% of the variance. The second factor comprised the 4 items relating to troublesome symptoms, which accounted for an additional 15% of the variance.

Table 2. Factor loadings of the 7 items on the LEAPS (Principal Components Analysis, using varimax rotation).

Convergent Validity

Table 3 shows the Pearson correlation matrix for the LEAPS total score and the productivity subscale score with other work functioning and productivity measures. There were significant correlations between the scores with all the other measures, including a high correlation with the "gold standard" HPQ Global Work Performance rating. Only a moderate correlation was found with the SDS Work score, likely explained by the fact the SDS score is comprised of a single item. The LEAPS total score and work productivity subscale score also explained more of the variance with '% hours of work missed' than either the SDS Work score (r = 0.24) or the HPQ Global Work Performance score (r = -0.37).

Table 3. Pearson correlations of LEAPS scores with other work functioning and productivity measures.

Discrimination Between Depression Severity Categories

Table 4 shows the mean scores on the LEAPS for each of the severity categories of the QIDS-SR depressive symptom scale. There were significant differences in the LEAPS total scores overall (one-way ANOVA: F = 47.4, df = 4,229, p < 0.01). Post hoc Tukey's HSD tests showed significant differences (p < 0.05) between each pairwise comparison, except between the Severe and Very Severe categories. Similar results were seen with the LEAPS productivity subscale scores.

Table 4. Mean scores on the LEAPS total and Productivity Subscale versus depression severity (based on QIDS-SR score).

Figure 1 shows the degree of clinical impairment (defined as percentage of the sample scoring 2 or higher on the item, indicating 50% or more of the time) in the individual productivity items associated with depression severity categories (as defined by the QIDS-SR scores).

thumbnailFigure 1. Significant impairment in work productivity items (from the LEAPS) versus depression severity (based on QIDS-SR score).

Discussion

The results from this validation study suggest that the psychometric properties of the LEAPS are very good. The LEAPS demonstrated a high internal consistency as measured by Cronbach's alpha. The factor analysis of the LEAPS showed that it is comprised of two factors, termed Work Productivity and Troublesome Symptoms, which account for a large proportion of the variance in total scores.

The validity of the LEAPS was further supported by the significant correlations with other validated measures of work functioning and productivity, including the SDS and the HPQ. Only a moderate correlation (explaining 40% of the variance) between the LEAPS and the SDS was observed, which is to be expected given that the SDS Work score is comprised of only a single item, compared to the higher correlation (explaining over 60% of the variance) found with the HPQ. The LEAPS score also showed higher correlations with the '% of work hours missed' over a 2-week period than the SDS Work score and the HPQ Global Work Performance rating.

The LEAPS scores also increase significantly with increasing overall severity of depressive symptoms and can discriminate between various depression severity categories, such as between 'None to minimal' and more severely depressed categories. The results from the individual productivity items on the LEAPS indicate that significant work impairment is found in patients with MDD. More than 75% of patients with higher severity of depressive symptoms described problems "much of the time" or "all the time" with the quantity and quality of work. In addition to productivity loss, the LEAPS data show that depressed patients were absent from work for 16% of their scheduled work hours (over 1.5 typical working days) in the previous two weeks. This is of similar magnitude to findings from other studies of work absence [5,7] and illustrates the substantial impact of depression on absenteeism.

Although the LEAPS performs well in this population, the limitations of this study need to be acknowledged. Further studies are needed to validate the LEAPS against external and objective measures of work performance, such as employer work absence data and objective measures of productivity. However, other studies have shown that self-rated work productivity measures are significantly correlated with objective metrics [20,21] and with administrative work records [15]. In addition, further studies are required to investigate the performance of the LEAPS in non-clinical samples of workers and in other clinical populations in specialist and primary care settings.

Clinical treatment studies in MDD now focus on symptom remission because of the evidence for poor outcomes predicted by the presence of residual depressive symptoms [22]. However, functional improvement, including that of work functioning, is more relevant to patients and restoration of occupational functioning is important to society [23]. The concept of measurement-based care for depression [24], in which outcomes are assessed using validated scales and which is increasingly recommended by clinical guidelines for the management of MDD [25], should encompass work functioning as well as symptom severity.

Many of the validated scales that assess work functioning are "generic" in that they are designed to evaluate productivity across a wide range of non-specific medical conditions. Alternatively, a disease-specific scale can provide important information for a defined clinical population. There are few depression-specific productivity scales available. The HPQ is the "gold standard" scale for assessment of work performance in patients with depression, but at 37 items and 8 pages in length, the respondent burden may be too high for routine clinical use. In contrast, the LEAPS is short (10 items on a single page) and simple and takes only 3-5 minutes to complete. Its brevity suggests that it will be an efficient tool for use in clinical settings. For example, the LEAPS can be used alongside symptom scales to monitor treatment progress, to ensure that work functioning improves in parallel with clinical symptoms. Additionally, scores on individual items (e.g., making mistakes) can be used to inform discussions with depressed workers regarding whether to stay at work or take time off while being treated for MDD.

The productivity impairment measured by the LEAPS increases, as expected, with increasing severity of depression. Although this is a cross-sectional observation, it suggests that the scale may also be useful as an outcome measure for occupational functioning in clinical trials of MDD. Further studies are underway to investigate the utility of the LEAPS to assess change in work functioning with treatment of MDD.

Conclusion

The LEAPS is a short and simple self-rated scale of work absence and productivity that has been designed for use in a clinically depressed population. It displays good internal and external validity compared to other validated, self-rated scales of work performance and productivity. Further studies will be needed to determine whether the LEAPS can be used in other populations or as an outcome measure for clinical trials, and whether it will prove useful as a clinical tool to assess and monitor occupational functioning in patients with MDD.

Competing interests

RWL has received honoraria for consulting/speaking from: Advanced Neuromodulation Systems Inc., AstraZeneca, Biovail, Canadian Network for Mood and Anxiety Treatments, Eli Lilly, Janssen, Litebook Company Ltd., Lundbeck, Lundbeck Institute, Servier, Takeda, and Wyeth. He has received research grants from: Advanced Neuromodulation Systems Inc., AstraZeneca, BrainCells Inc., Canadian Institutes of Health Research, Canadian Psychiatric Research Foundation, Litebook Company Ltd., Lundbeck, Mathematics of Information Technology and Advanced Computing Systems, Michael Smith Foundation for Health Research, Servier, and UBC Institute of Mental Health/Coast Capital Savings. He holds a copyright on the LEAPS.

EEM declares that she has no competing interests.

LNY has received honoraria for consulting/speaking from: AstraZeneca, Bristol Myers Squibb, Canadian Network for Mood and Anxiety Treatments, GlaxoSmithKline, Janssen, Pfizer, Ranbaxy, and Scherring Plough. He has received research grants from: AstraZeneca, Bristol Myers Squibb, Canadian Institutes of Health Research, Janssen, Michael Smith Foundation for Health Research, Servier, and Stanley Foundation.

Authors' contributions

RWL conceived the study, designed the scale, contributed to data acquisition, conducted the statistical analysis, interpreted the data, wrote the initial draft of the manuscript, and funded the study through internal research funds. EEM contributed to study design and data acquisition, interpreted the data, and revised drafts of the manuscript. LNY contributed to study design and data acquisition, interpreted the data, and revised drafts of the manuscript. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to acknowledge their appreciation to the patients attending the Mood Disorders Centre, UBC Hospital, for their participation in this study. Erin Michalak is supported by a Michael Smith Scholar Award from the Michael Smith Foundation for Health Research and a New Investigator Award from the Canadian Institutes for Health Research.

References

  1. Stephens T, Joubert N: The economic burden of mental health problems in Canada.

    Chronic Dis Can 2001, 22:18-23. PubMed Abstract OpenURL

  2. Greenberg PE, Kessler RC, Birnbaum HG, Leong SA, Lowe SW, Berglund PA, Corey-Lisle PK: The economic burden of depression in the United States: how did it change between 1990 and 2000?

    J Clin Psychiatry 2003, 64:1465-1475. PubMed Abstract | Publisher Full Text OpenURL

  3. Sobocki P, Jonsson B, Angst J, Rehnberg C: Cost of depression in Europe.

    J Ment Health Policy Econ 2006, 9:87-98. PubMed Abstract | Publisher Full Text OpenURL

  4. Patten SB, Wang JL, Williams JV, Currie S, Beck CA, Maxwell CJ, el Guebaly N: Descriptive epidemiology of major depression in Canada.

    Can J Psychiatry 2006, 51:84-90. PubMed Abstract OpenURL

  5. Kessler RC, Barber C, Birnbaum HG, Frank RG, Greenberg PE, Rose RM, Simon GE, Wang P: Depression in the workplace: effects on short-term disability.

    Health Aff (Millwood) 1999, 18:163-171. PubMed Abstract | Publisher Full Text OpenURL

  6. Dewa CS, Goering P, Lin E, Paterson M: Depression-related short-term disability in an employed population.

    J Occup Environ Med 2002, 44:628-633. PubMed Abstract | Publisher Full Text OpenURL

  7. Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, de Girolamo G, Graaf R, Demyttenaere K, Gasquet I, Haro JM, Katz SJ, Kessler RC, Kovess V, Lepine JP, Ormel J, Polidori G, Russo LJ, Vilagut G, Almansa J, Arbabzadeh-Bouchez S, Autonell J, Bernal M, Buist-Bouwman MA, Codony M, Domingo-Salvany A, Ferrer M, Joo SS, Martinez-Alonso M, Matschinger H, Mazzi F, Morgan Z, Morosini P, Palacin C, Romera B, Taub N, Vollebergh WA: Disability and quality of life impact of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project.

    Acta Psychiatr Scand Suppl 2004, (420):38-46. PubMed Abstract OpenURL

  8. Gilmour H, Patten SB: Depression and work impairment.

    Health Rep 2007, 18:9-22. PubMed Abstract OpenURL

  9. Druss BG, Schlesinger M, Allen HM Jr: Depressive symptoms, satisfaction with health care, and 2-year work outcomes in an employed population.

    Am J Psychiatry 2001, 158:731-734. PubMed Abstract | Publisher Full Text OpenURL

  10. Stewart WF, Ricci JA, Chee E, Hahn SR, Morganstein D: Cost of lost productive work time among US workers with depression.

    JAMA 2003, 289:3135-3144. PubMed Abstract | Publisher Full Text OpenURL

  11. Lerner D, Amick BC III, Rogers WH, Malspeis S, Bungay K, Cynn D: The Work Limitations Questionnaire.

    Med Care 2001, 39:72-85. PubMed Abstract | Publisher Full Text OpenURL

  12. Koopman C, Pelletier KR, Murray JF, Sharda CE, Berger ML, Turpin RS, Hackleman P, Gibson P, Holmes DM, Bendel T: Stanford presenteeism scale: health status and employee productivity.

    J Occup Environ Med 2002, 44:14-20. PubMed Abstract | Publisher Full Text OpenURL

  13. Michalak EE, Murray G, Young AH, Lam RW: Burden of bipolar depression: impact of disorder and medications on quality of life.

    CNS Drugs 2008, 22:389-406. PubMed Abstract | Publisher Full Text OpenURL

  14. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, Markowitz JC, Ninan PT, Kornstein S, Manber R, Thase ME, Kocsis JH, Keller MB: The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression.

    Biol Psychiatry 2003, 54:573-583. PubMed Abstract | Publisher Full Text OpenURL

  15. Kessler RC, Barber C, Beck A, Berglund P, Cleary PD, McKenas D, Pronk N, Simon G, Stang P, Ustun TB, Wang P: The World Health Organization Health and Work Performance Questionnaire (HPQ).

    J Occup Environ Med 2003, 45:156-174. PubMed Abstract | Publisher Full Text OpenURL

  16. Leon AC, Olfson M, Portera L, Farber L, Sheehan DV: Assessing psychiatric impairment in primary care with the Sheehan Disability Scale.

    Int J Psychiatry Med 1997, 27:93-105. PubMed Abstract | Publisher Full Text OpenURL

  17. Kessler RC, Ames M, Hymel PA, Loeppke R, McKenas DK, Richling DE, Stang PE, Ustun TB: Using the World Health Organization Health and Work Performance Questionnaire (HPQ) to evaluate the indirect workplace costs of illness.

    J Occup Environ Med 2004, 46:S23-S37. PubMed Abstract | Publisher Full Text OpenURL

  18. Wang PS, Simon GE, Avorn J, Azocar F, Ludman EJ, McCulloch J, Petukhova MZ, Kessler RC: Telephone screening, outreach, and care management for depressed workers and impact on clinical and work productivity outcomes: a randomized controlled trial.

    JAMA 2007, 298:1401-1411. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  19. SPSS Inc: SPSS for Windows, v.16.0. Chicago, SPSS Inc; 2008.

  20. Meerding WJ, IJzelenberg W, Koopmanschap MA, Severens JL, Burdorf A: Health problems lead to considerable productivity loss at work among workers with high physical load jobs.

    J Clin Epidemiol 2005, 58:517-523. PubMed Abstract | Publisher Full Text OpenURL

  21. Lerner D, Amick BC III, Lee JC, Rooney T, Rogers WH, Chang H, Berndt ER: Relationship of employee-reported work limitations to work productivity.

    Med Care 2003, 41:649-659. PubMed Abstract | Publisher Full Text OpenURL

  22. Fava GA, Ruini C, Belaise C: The concept of recovery in major depression.

    Psychol Med 2007, 37:307-317. PubMed Abstract | Publisher Full Text OpenURL

  23. Bilsker D, Wiseman S, Gilbert M: Managing depression-related occupational disability: A pragmatic approach.

    Can J Psychiatry 2006, 51:76-83. PubMed Abstract OpenURL

  24. Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, Norquist G, Howland RH, Lebowitz B, McGrath PJ, Shores-Wilson K, Biggs MM, Balasubramani GK, Fava M: Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice.

    Am J Psychiatry 2006, 163:28-40. PubMed Abstract | Publisher Full Text OpenURL

  25. Lam RW, Kennedy SH, Grigoriadis S, McIntyre RS, Milev R, Ramasubbu R, Parikh SV, Patten SB, Ravindran AV: Canadian Network for Mood and Anxiety Treatments (CANMAT) clinical guidelines for the management of major depressive disorder in adults. III. Pharmacotherapy.

    J Affect Disord 2009, 117(Suppl 1):S26-S43. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-244X/9/78/prepub