Email updates

Keep up to date with the latest news and content from BMC Psychiatry and BioMed Central.

Open Access Highly Accessed Research article

Reliability, validity and psychometric properties of the Greek translation of the zung depression rating scale

Konstantinos N Fountoulakis1*, Apostolos lacovides1, Stavros Samolis1, Soula Kleanthous1, Stergios G Kaprinis1, George St Kaprinis1 and Per Bech2

Author Affiliations

1 3rd Department of Psychiatry, Aristotle University of Thessaloniki, Greece

2 Frederiksborg General Hospital, Department of Psychiatry, Hillerod, Denmark

For all author emails, please log on.

BMC Psychiatry 2001, 1:6  doi:10.1186/1471-244X-1-6

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-244X/1/6


Received:9 September 2001
Accepted:29 October 2001
Published:29 October 2001

© 2001 Fountoulakis et al; licensee BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.

Abstract

Introduction

The current study aimed to assess the reliability, validity and psychometric properties of the Greek translation of the Zung Depression Rating Scale (ZDRS).

Methods

The study sample included 40 depressed patients 29.65 ± 9.38 years old and 120 normal comparison subjects 27.23 ± 10.62 years old. In 20 of them (12 patients and 8 comparison subjects) the instrument was re-applied 1–2 days later. Translation and Back Translation was made. Clinical Diagnosis was reached by consensus of two examiners with the use of the SCAN v.2.0 and the IPDE. Statistical Analysis included ANOVA, the Pearson Product Moment Correlation Coefficient, Principal Components Analysis and Discriminant Function Analysis and the calculation of Cronbach's alpha (α)

Results

Both Sensitivity and specificity exceed 90.00 at 44/45, Chronbach's alpha for the total scale was equal to 0.09, suggesting that the scale covers a broad spectrum of symptoms. Factor analysis revealed five factors (anxiety-depression, thought content, gastrenterological symptoms, irritability and social-interpersonal functioning). The test-retest reliability was satisfactory (Pearson's R between 0.92).

Conclusion

The ZDRS-Greek translation is both reliable and valid and is suitable for clinical and research use with satisfactory properties. Its properties are similar to those reported in the international literature, although the literature is limited. However one should always have in mind the limitations inherent in the use of self-report scales.

Background

The Zung Depression Rating Scale (ZDRS) [1] is a self-reporting instrument and was originally developed in order to assess depression symptoms without the bias of an administrator affecting the results. The items in the ZDRS scale may also help patients begin to discuss previously nebulous symptoms, especially those patients who present with physical symptoms of depression such as headache or insomnia.

The ZDRS is a well-known and world-widely used self-rating scale for the measurement of depression. Along with the Beck Depression Inventory [2] and the CES-D[3,4] these are the most popular self-administered instruments for the assessment of depression. They are supposed to be used as screening tools rather and not substitutes for an in-depth interview [5]. They can also be an efficient tool for screening patients for depression [6] and have been used successfully for many years in the primary care setting. Higher scores on this scale are indicative of more severe depression [7]

ZDRS consists of 20 items that cover affective, psychological, and somatic symptoms. The patient specifies the frequency with which the symptom is experienced (that is: a little = 1, some = 2, a good part of the time = 3, or most of the time = 4) [8].

Except from the use of the raw ZDRS score, another way to rate is the SDS index, which is obtained by dividing the ZDRS raw score with 80, which is the maximum score. Minimum score is 20. It is expected that most people with depression score above 50 (SDS index 0.62). A subject with ZDRS score below 50 is considered normal, with a score of 50–59 (SDS 0.62–0.74) is considered to suffer from mild depression, with score 60–69 (SDS 0.75–0.86) depression is considered moderate to marked, while with a score of 70 or above depression is considered to be severe.

The aim of the current study was to assess the reliability, validity and psychometric properties of the Greek translation of the Zung Depression Rating Scale

Material and methods

Material

Forty patients (25 males and 15 females) aged 29.65 ± 9.38 years (range 18–55) suffering from Major Depressive disorder according to DSM-IV [9] and depression according to ICD-10 criteria [10], and 120 normal comparison subjects (71 males and 49 females aged 27.23 ± 10.62 years (range 18–51) entered the study. In 20 of them (12 patients and 8 normal comparison subjects) the instrument was re-applied 1–2 days later.

Patients and normal comparison subjects were free of any medication for at least two weeks and were physically healthy with normal clinical and laboratory findings (Electroencephalogram, blood and biochemical testing, thyroid function, test for pregnancy, 12 and folic acid).

Patients came from the inpatient and outpatient unit of the 3rd Department of Psychiatry, Aristotle University of Thessaloniki, General Hospital AHEPA, Thessaloniki, Greece. They were consecutive cases and were chosen because they fulfilled the above criteria.

The normal comparison group was composed of members of the hospital staff and relatives of patients. A clinical interview confirmed that they did not suffer from any mental disorder and their prior history was free from mental and thyroid disorder.

All patients and normal comparison subjects provided written informed consent before participating in the study.

Note: the study sample was identical with that used for the CES-D standardization study[4]

Method

Translation and back translation was made by two of the authors, one of whom did not knew the original English text. The final translation was fixed by consensus.

Clinical diagnosis was reached by consensus of two examiners. The Schedules for Clinical Assessment in Neuropsychiatry (SCAN) version 2.0 [11,12] and the International Personality Disorders Examination (IPDE) [13-15] were used. Both were applied by one of the authors (KNF) who has official training in a World Health Organization Training and Reference Centre. The IPDE did not contribute to the clinical diagnosis of depression, but was used in the frame of a global and comprehensive assessment of the patients. The second examiner performed an unstructured interview.

Procedure

The identification of potential cases and normal comparison subjects was done first and subjects were referred for detailed evaluation. The use of structured interviews and the final consensus decision of the two examiners determined which subjects would be included in the study. Testing with the ZDRS followed.

Statistical analysis

Analysis of Variance (ANOVA) [16] was used to search for differences between groups. The Pearson Product Moment Correlation Coefficient R was calculated to assess the test-retest reliability. Principal Components Analysis (Varimax Normalized Rotation) was performed, and factor coefficients and scores were calculated. Finally, Discriminant Function Analysis was performed as well.

Item Analysis [17] was performed, and the value of Cronbach's alpha (α) for ZDRS and its factor subscales was calculated. Receiver Operator Characteristic Curves (ROC curves) and histogram of frequencies were created as well.

Results

The calculation of sensitivity (Sn) and specificity (Sp) at various cut-off levels showed that both variables exceed 90.00 at 44/45 (SDS 0.55/0.56), with 111 normal comparison subjects and 36 patients correctly classified. Nine 9 normal comparison subjects and 4 patients were classified into a wrong diagnostic group (table 1). Receiver Operation Curve Analysis (figure 1) confirmed these results.

thumbnailFigure 1. ROC analysis Curve-the score level 44/45 has the largest distance from the dichotomous

Table 1. Sensitivity and Specificity of ZDRS at various cut-off levels. The optimum is at level 44/45

Chronbach's alpha for the total scale was equal to 0.09, and this is a very low value, suggesting that the scale covers a broad spectrum of symptoms and represents a global assessment of depression.

The histogram of ZDRS scores in normal comparison subjects reveals that they do not follow the normal distribution in this population, but manifest a skewness towards lower values (figure 2).

thumbnailFigure 2. Histogram of ZDRS scores in Control subjects

The factor analysis of cases (varimax normalized rotation) revealed five factors (table 2). The first one explained 15% of total variance, included items No 1, 2, 4, 9 and 10 and largely reflects a factor of anxiety-depression. The second one explained 16% of total variance, included items No 11, 12, 14, 16, 17, 18 and 20 and largely reflects a cognitive (thought content) factor. The third factor explained 11% of total variance, included items No 5, 7 and 8 and reflects gastrenterological symptoms. The fourth explained 10% of total variance, included items No 11, 12 and 15 and represents an aspect of symptomatology similar with factor 2, with the addition of irritability. The last factor explained 13% of total variance, included items No 3, 6, 10 and 19 and reflects social and interpersonal functioning. Factor loadings and coefficients are shown in table 2. All five factors explained 64% of total ZDRS variance.

Table 2. Factor loadings and coefficients after Factor Analysis (Varimax normalized rotation) of normal comparison subjects and patients data

Chronbach's alpha for the individual factors (subscales that include the items that load in each one) was fair, with values from 0.23 to 0.45. Only factor 2 had high internal consistency with alpha equal to 0.86.

Depressed patients did not differ from normal comparison subjects in age. On the contrary they differed in every ZDRS individual item score and total score (p < 0.001 – table 3). It is very interesting that the two groups differed in the scores of factors 1, 3 and 5 (p < 0.001), that is in the essence of anxiety, depression, gastrenterological symptoms, and social and interpersonal functioning, but not in the score of factors 2 and 4, that is thought content and irritability.

Table 3. Greek translation of the ZDRS and comparison between normal comparison subjects and patients

The test-retest reliability proved to be satisfactory. Individual items had good Pearson correlation coefficients with lower for item No 6 (R = 0.51) and higher for item No 7 (R = 0.89). The coefficient for the total ZDRS score was excellent and equal to 0.92.

Discriminant function analysis results are shown in table 4. Two separate analyses were performed, with the forward stepwise method, one with individual ZDRS items and a second with factor scores. The first one performed excellently while the second one was fair. The results of the first one suggest that when the D-C equation, that is:

Table 4. Discriminant Function Analysis Results.

2.65*(itl) - 0.45*(it2) + 2.03*(it3) + 1.14*(it4) - 0.97*(it6) + 1.56*(it7) + 0.82*(it8) + 1.18*(it9) + 1.13*(it10) + 1.02*(it11) - 2.37*(it12) - 1.46*(it15) + 0.91*(itl6) + 0.97*(itl7) takes values above 15.52, then the subject is a depressed patient. This method correctly classified all normal comparison subjects and 90% of patients.

Discussion

Self-administered scales heavily depend on the co-operation and reading ability of the patient. On the other hand they save time for the clinician. More, translations are difficult to access because of publication in various languages or national journals [18-21].

The current study reports observations on the reliability, the validity and psychometric properties of the Greek translation of the Zung Depression Rating Scale. The results suggest that this translation is well suited for use in the Greek population with high sensitivity and specificity at the cut-off level 44/45 and high test-retest reliability.

The reliability and validity of the Zung Depression Rating Scale has been examined in only a limited number of studies and not many translations of this scale have been published. In the original study [1] this scale was found be able to differentiate between depressed patients and normal comparison subjects. Later studies showed the relationship of the scale with the clinician's assessment of severity, the Beck Depression Inventory, the D dimension of the MMPI and an unstable relationship with the Hamilton Depression Rating Scale [22-26].

The highest published cut-point for the ZDRS was 60/61 [27] and with an unusually low sensitivity for detecting major depression. Other studies generally accept the level 49/50 and report 97% sensitivity and 63% specificity.

In another study, 69 randomly selected medical outpatients were clinically evaluated for depressive illness. ZDRS identified 30% of those depressed while missing those whose depression was presented under the guise of somatic illness [28].

While there are data supporting the content and construct validity of the ZDRS, the evidence regarding its reliability is not conclusive. For the purpose of exploring the psychometric properties of the ZDRS, two studies were done using subjects from two markedly different socio-cultural settings: 213 male and female drug addicts in New York City and 206 male and female undergraduates in Nigeria. Findings included high coefficient alphas and large average item-correlations (total minus item) in both studies. It was concluded that the ZDRS rates well in terms of internal consistency reliability and construct validity [29].

Using both the English version and an Igbo translation of ZDRS in 132 first-time attenders to a hospital-based general outpatient clinic a prevalence rate of 25% for depressive symptoms was obtained. Fourteen percent scored within the range for "mild depression", while 11% obtained scores within the range for "moderate depression" [30].

Review studies on various self-administered instruments suggest that there is no significant difference between various self-administered depressive scales in terms of performance. Overall sensitivity is around 84% and specificity around 72% [31]. These instruments are of particular value in primary care settings because it is clear that primary care providers fail to diagnose and treat as many as 35% to 50% of patients with depressive disorders [32,33]. Depression is one of the most common psychiatric diagnoses in primary care populations [34]; major depressive disorders can be diagnosed in 6% to 9% of such patients. Obstacles to the appropriate recognition of depression include inadequate provider knowledge of diagnostic criteria; competing comorbid conditions and priorities among primary care patients; time limitations in busy office settings; concern about the implications of labeling; poor reimbursement mechanisms; and uncertainty about the value, accuracy, and efficiency of screening mechanisms for identifying patients with depression. Given that 50% to 60% of persons seeking help for depression are treated exclusively in the primary care setting, accurate detection in this setting is important [35] and self – administered instruments may help to ameliolate some of them. Many studies have assessed the effect of feedback of scale scores on physician practice patterns [36-45] and have shown improved recognition of depression with such feedback.

On the other hand, it should be noted that the diagnosis of depression is itself based on symptoms. A patient cannot truly be asymptomatic and have major depressive disorder. Thus, these screening questionnaires are actually being evaluated for their ability to detect unrecognized, rather than strictly asymptomatic, depressive symptoms and disease.

The Canadian Task Force on the Periodic Health Examination found fair evidence to exclude the use of depression detection tests from the periodic health examination of asymptomatic people [46]. The American Academy of Family Physicians advises physicians to remain alert for depressive symptoms in adolescents and adults [47]; this policy is under review. The American Medical Association recommends that all adolescents be asked annually about behaviors or emotions that indicate recurrent or severe depression [48].

Conclusion

The Greek translation of the ZDRS scale is both reliable and valid and is suitable for clinical and research use with satisfactory properties. However one should always have in mind the limitations inherent in the use of self-reporting scales.

The very low internal consistency of the scale, reported by the current study suggests that the ZDRS is not a unidimensional scale. It is also evident that its development was not based on the contemporary definition of depression but rather on that of the sixties. Thus, although sensitivity and specificity were proved to be high, the interpretation of its results should be made with caution.

Competing interests

None declared

References

  1. Zung WWK: A Self-Rating Depression Scale.

    Arch Gen Psychiatry 1965, 12:63-70. PubMed Abstract OpenURL

  2. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An Inventory for Measuring Depression.

    Arch Gen Psychiatry 1961, 4:53-63. OpenURL

  3. Radloff LS: The CES-D scale: A self report depression scale for research in the general population.

    Applied Psychological Measurement 1977, 1:385-401. OpenURL

  4. Fountoulakis KN, lacovides A, Kleanthous S, Samolis S, Kaprinis SG, Sitzoglou K, Kaprinis GS, Per Bech: Reliability, Validity and Psychometric Properties of the Greek Translation of the Center for Epidemiological Studies-Depression (CES-D) Scale.

    BMC Psychiatry 2001, 1(1):3. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  5. Zung WW, Richards CB, Short MJ: Self-rating depression scale in an outpatient clinic. Further validation of the SDS.

    Arch Gen Psychiatry 1965, 13(6):508-515. OpenURL

  6. Carrell BJ: Validity of the Zung self-rating scale.

    Br J Psychiatry 1978, 133:379-380. PubMed Abstract OpenURL

  7. Marder SR: Psychiatric rating scales. In: Kaplan HI, Sadock BJ, eds. Comprehensive Textbook of Psychiatry/VI 6th ed.

    Baltimore, Md: Williams & Wilkins; 1995, 1:619-635. OpenURL

  8. Carroll BJ, Fielding JM, Blashki TG: Depression rating scales: a critical review.

    Arch Gen Psychiatry 1973, 28:361-366. PubMed Abstract OpenURL

  9. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, 41 Edition, DSM-IV.

    American Psychiatric Press, Washington DC 1994. OpenURL

  10. World Health Organisation: The ICD-10 Classification of Mental and Behavioural Disorders.

    Diagnostic Criteria for Research. Geneva, 1993, 81-87. OpenURL

  11. Wing JK, Babor T, Brugha T, et al.: SCAN: Schedules for Clinical Assessment in Neuropsychiatry.

    Archives of General Psychiatry, 1990, 47:589-593. OpenURL

  12. World Health Organisation: Schedules for Clinical Assessment in Neuropsychiatry – SCAN version 2.0) Greek Version: Mavreas V.

    Research University Institute for Mental Health, Athens 1995. OpenURL

  13. Loranger AW, Sartorious N, Andreoli A, et al.: The World Health Organisation/Alcohol, Drug Abuse and Mental Health Administration International Pilot Study of Personality Disorders.

    Archives of General Psychiatry, 1994, 51:215-224. OpenURL

  14. World Health Organisation: International Personality Disorders Examination,.

    Geneva, 1995. OpenURL

  15. World Health Organisation: International Personality Disorders Examination, Greek Edition.

    (Translation: Fountoulakis KN, lacovides A, Kaprinis G, lerodiakonou Ch) 3rd Department of Psychiatry, Aristotle University of Thessaloniki Greece (unpublished) OpenURL

  16. Altman DG: Practical Statistics for Medical Research.

    Chapman and Hall, London 1991. OpenURL

  17. Anastasi A: Psychological Testing 6th edition.

    Macmillan Publishing Company, New York, 1988, 202-234. OpenURL

  18. Lopez VC, de Esteban Chamorro T: [Validity of Zung's Self-Rating Depression Scale].

    Arch Neurobiol (Madr) 1975, 38(3):225-46.

    Article in Spanish

    OpenURL

  19. Xu MY: [Using the SDS (self-rating depression scale) for observations on depression].

    1987, 22(4):156-159.

    Article in Chinese

  20. Chen XS: [Masked depression among patients diagnosed as neurosis in general hospitals].

    1986, 66(1):32-33.

    Article in Chinese

  21. Jegede RO: Psychometric characteristics of Yoruba versions of Zung's self-rating depression scale and self-rating anxiety scale.

    Afr J Med Med Sci 1979, 8(3-4):133-137. OpenURL

  22. Zung WWK: Factors Influencing the Self-Rating Depression Scale.

    Arch Gen Psychiatry, 1967, 16:543-547. OpenURL

  23. Brown GL, Zung WWK: Depression Scales.

    Compr Psychiatry, 1972, 13:361-367. OpenURL

  24. Davies B, Burrows G, Paynton C: A Comparative Study of Four Depression Rating Scales.

    Austr NZ J Pzychiatry, 1975, 9:21-24. OpenURL

  25. Carroll BJ, Fielding JM, Blashki MB: Depression Rating Scales: A Critical Review.

    Arch Gen Psychiatry, 1973, 28:361-366. OpenURL

  26. Biggs JT, Wylie LT, Ziegler VE: Validity of the Zung Self-rating Depression Scale.

    Br J Psychiatry 1978, 132:381-385. PubMed Abstract OpenURL

  27. Raft D, Spencer RF, Toomey T, Brogan D: Depression in medical outpatients: use of the Zung scale.

    Dis Nerv Syst 1977, 38:999-1004. PubMed Abstract OpenURL

  28. Raft D, Spencer RF, Toomey T, Brogan D: Depression in medical outpatients: use of the Zung scale.

    Dis Nerv Syst 1977, 8(12):999-1004. OpenURL

  29. Jegede RO: Psychometric properties of the Self-Rating Depression Scale (SDS).

    J Psychol 1976, 93(1st Half):27-30. OpenURL

  30. Ihezue UH, Kumaraswamy N: Prevalence of depressive symptoms among patients attending a general outpatient clinic.

    Acta Psychiatr Scand 1986, 73(4):395-398. OpenURL

  31. Mulrow CynthiaD MD MSc, Williams JohnW Jr MD MHS, Gerety MeghanB MD, Ramirez Gilbert DrPH, Montiel OscarM MD, Kerber Caroline MD: Case-Finding Instruments for Depression in Primary Care Settings.

    Annals of Internal Medicine, 1995, 123:913-921. OpenURL

  32. Simon GE, VonKorff M: Recognition, management, and outcomes of depression in primary care.

    Arch Fam Med 1995, 4:99-105. PubMed Abstract | Publisher Full Text OpenURL

  33. Gerber PD, Barrett J, Barrett J, Manheimer E, Whiting R, Smith R: Recognition of depression by internists in primary care: a comparison of internist and gold standard psychiatric assessments.

    J Gen Intern Med 1989, 4:7-13. PubMed Abstract OpenURL

  34. Katon W, Roy-Byrne PP: Antidepressants in the medically ill: diagnosis and treatment in primary care.

    Clin Chem 1988, 34:829-836. PubMed Abstract OpenURL

  35. Schurman RA, Krooner PD, Mitchell JB: The hidden mental health network. Treatment of mental illness by nonpsychiatric physicians.

    Arch Gen Psychiatry 1985, 42:89-94. PubMed Abstract OpenURL

  36. Callahan CM, Hendrie HC, Dittus RS, Brater DC, Hui SL, Tierney WM: Improving treatment of late life depression in primary care: a randomized clinical trial.

    J Am Geriatr Soc 1994, 42:840-845. OpenURL

  37. Brody DS, Lerman CE, Wolfson HG, Caputo GC: Improvement in physicians' counseling of patients with mental health problems.

    Arch Intern Med 1990, 150:993-998. PubMed Abstract | Publisher Full Text OpenURL

  38. Magruder-Habib K, Zung WW, Feussner JR: Improving physicians' recognition and treatment of depression in general medical care.

    Med Care 1990, 28:239-250. PubMed Abstract OpenURL

  39. Rand EH, Badger LW, Coggins DR: Toward a resolution of contradictions. Utility of feedback from the GHQ.

    Gen Hosp Psychiatry 1988, 10:189-196. PubMed Abstract OpenURL

  40. Rucker L, Frye EB, Cygan RW: Feasibility and usefulness of depression screening in medical outpatients.

    Arch Intern Med 1986, 146:729-731. PubMed Abstract | Publisher Full Text OpenURL

  41. Hoeper EW, Nycz GR, Kessler LG, Burke JD Jr, Pierce WE: The usefulness of screening for mental illness.

    Lancet 1984, 1:33-35. PubMed Abstract | Publisher Full Text OpenURL

  42. Zung WW, King RE: Identification and treatment of masked depression in a general medical practice.

    J Clin Psychiatry 1983, 44:365-368. PubMed Abstract OpenURL

  43. Zung WW, Magill M, Moore JT, George DT: Recognition and treatment of depression in a family medicine practice.

    J Clin Psychiatry 1983, 44:3-6. PubMed Abstract OpenURL

  44. Johnstone A, Goldberg D: Psychiatric screening in general practice.

    A controlled trial. Lancet 1976, 1:605-608. OpenURL

  45. Magruder-Habib K, Zung WWK, Feussner JR: Improving physicians' recognition and treatment of depression in general medical care: results from randomized clinical trial.

    Med Care 1990, 28:239-250. PubMed Abstract OpenURL

  46. Canadian Task Force on the Periodic Health Examination: Canadian guide to clinical preventive health care. Ottawa:.

    Canada Communication Group, 1994, 450-455. OpenURL

  47. American Academy of Family Physicians: Age charts for periodic health examination.

    Kansas City, MO: American Academy of Family Physicians, 1994. (Reprint no.510.) OpenURL

  48. American Medical Association: Guidelines for adolescent preventive services (GAPS): recommendations and rationale.

    Chicago: American Medical Association, 1994, 131-139. OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-244X/1/6/prepub