Skip to main content

The revision and factor analytic evaluation of the German version of the depression literacy scale (D-Lit-R German)

Abstract

Background

Depression is a common mental health disorder and the second leading cause of disability worldwide. In people with depression, low depression literacy, which could be characterized by a poor recognition of depressive symptoms and less knowledge about the availability of treatment options, can hinder adequate therapy for depression. Nevertheless, questionnaires measuring depression literacy in Germany are rare. Consequently, for the present study, the German Depression Literacy Scale (D-Lit) has been revised and evaluated.

Methods

First, a team of clinical psychologists revised the D-Lit German scale. Next, cognitive interviews were conducted with patients with depression to improve the comprehensibility of the scale items. Our revision of the D-Lit-R German scale was then subjected to an anonymous online study. Finally, the data went through an exploratory factor analysis, and sociodemographic subgroup analyses were performed.

Results

N = 524 individuals (age 18–80) completed the D-Lit-R German scale and a questionnaire on their sociodemographic data. Cronbach´s alpha was estimated as α = .72, and McDonald's Omega (categorical) was estimated as ω = .77. The mean Item difficulty was M = .75 (SD = .15). An EFA was performed for a unidimensional model, a 5-factor-model and at last a 3-factor-model. The 5-factorial model showed a good model fit (χ2emp,WLSMV(131) = 92.424, p > .05; CFI = 1, RMSEA = 0, SRMR = .07) but was rejected since the content of the potential 5 factors could not be determined. The 3-factor model showed an arguable model fit. The Chi2 test was significant (χ2emp,WLSMV(168) = 199.912, p < .05), but the CFI and the RMSEA met an acceptable model fit (CFI = .990, RMSEA of .019, 90% CI[.003, .029]). Substantively, the three factors were defined as (1) Distractors and other symptoms, (2) Depressive symptoms, and (3) Pharmacological and psychotherapeutic depression treatment. Furthermore, there were significant differences in sum scores regarding the subgroup's gender, treatment for mental health problems, depression treatment, experience with depression, and different career fields.

Conclusions

The D-Lit-R German scale is a time-efficient scale to assess some aspects of the depression literacy construct that can be easily applied. Since there was no perfect model fit, it is recommended to continue to revise the scale. Further evaluation studies could ask for knowledge of the etiological factors of depression. Future studies could then use this instrument to convey depression literacy. This instrument could assess the growth of knowledge after psychoeducational interventions in different settings.

Trial registration

This trial was preregistered at the platform osf.io (https://osf.io/49xdh).

Registration number: https://doi.org/10.17605/OSF.IO/49XDH

Date of registration: 28 April 2022.

Peer Review reports

Background

With a prevalence rate of 28.9%, depression is now a worldwide mental disorder [1]. This disorder is characterized by the main symptoms of a depressed mood, decreased energy, and lack of interest for at least two weeks. Several other, partly somatic symptoms include sleep disturbances and loss of appetite [2]. In Germany, even though effective treatments for depression already exist and are commonly used, e.g., cognitive behavioral psychotherapy, interpersonal psychotherapy, or antidepressant medication [3], more than half of the people with depression don´t use the available health services [4]. In addition to access barriers, e.g., inability to get an appointment or long waiting times, individual barriers also play an essential role in explaining this [5]. One barrier can be the fear of being stigmatized. Another barrier can be dysfunctional cognitions, e.g., believing that treatment will not be helpful or wanting to deal with the problem on their own. Tomczyk et al. (2018) found that informal help-seeking was negatively associated with depression literacy, meaning that people with high depression literacy were less likely to seek informal help and vice versa [6]. In the literature, depression literacy or depression knowledge is defined as a sub-construct of mental health literacy (MHL) [7]. Depression literacy includes knowledge about depressive symptoms, depression-relevant support services, and competence in applying this knowledge. MHL, in general, refers to the knowledge of how to identify a specific mental disorder, how to access health information, what the risk and etiological factors are, and what self-help and treatment options are available [8]. MHL also comprises attitudes that promote appropriate treatment. Greater MHL is shown to predict the readiness to take up treatment [9, 10]. In Contrast, lower depression literacy is associated with poor recognition of depressive symptoms and less knowledge of the availability of treatment options [11]. Sociodemographic factors such as age, gender, and general education can also influence MHL. Studies show that MHL is lower in older adults, in people with lower education, and in men compared to women [12,13,14].

Regarding depression literacy, Makowski et al. (2021) conducted a national telephone study and found that 55% of the participants recognized depression as the health problem depicted in a case vignette [15]. Although this seems to be a moderate level of depression literacy, it is of great importance to increase depression literacy in society, in view of the growing number of people with depression worldwide [16]. More services should be offered to particularly vulnerable groups to improve the course of depressive disorders and reduce barriers to access. This could be achieved, for example, through a psychoeducational intervention in General practices, as most patients with depression first consult their GP and are also treated by them [17,18,19]. Instruments used to assess MHL are mainly case vignettes that ask for disease-specific declarative knowledge [20]. Those vignettes focus on the knowledge of terminology, risk factors, diagnosis, and prognosis, which are captured by recognition tests [8]. In addition, there are also several standardized knowledge questionnaires on MHL [20]. Wei et al. (2018) identified a total of 69 knowledge questionnaires in a review of available MHL measurement instruments from 401 studies, most notably the Mental Health Literacy Scale (MHLS) [21, 22]. However, questionnaires measuring specific disease-related knowledge about depression in Germany are insufficient. One example is a knowledge questionnaire by Görnitz et al. (1998), which has not yet been evaluated [23]. Since there is a lack of evaluated questionnaires in the field of depression knowledge, Freitag et al. (2018) translated the depression literacy scale (D-Lit) by Griffiths et al. (2004) [24] into German and conducted an evaluation study [7]. The original scale consists of 22 items, and the translated German scale had the same properties as the original scale and reached an internal consistency of Cronbach's alpha = 0.747, which can be regarded as satisfactory [25]. However, the authors state that there may have been problems with the content or language of some items in terms of comprehension.

Furthermore, it should be noted that the sample used in the study consisted of individuals with depressive symptoms. Therefore, the authors recommend evaluating the scale on a subclinical sample. Consequently, the present study aimed to optimize the D-Lit German scale as a measure of depression knowledge and to test its psychometric properties and factor structure. Furthermore, it aimed to investigate the differences in depression literacy regarding subgroups based on psychosocial variables (e.g., Gender, Age) to select those with a greater need for interventions that increase depression literacy. Overall, this study was conducted to develop a validated instrument that can be used in another subsequent study to assess depression knowledge in patients with depression. In this planned study, a psychoeducation program for patients with depression [26] will be tested in general practices. Since one of the variables of interest will be depression literacy, it was also aimed to optimize the compatibility of the D-Lit German scale as a measuring instrument for such an intervention.

Methods

Study design

This study was preregistered at the platform osf.io (Registration link: https://osf.io/49xdh, registration number: https://doi.org/https://doi.org/10.17605/OSF.IO/49XDH). The study consisted of two parts. The first part included the revision of the scale. Part two comprised the online survey to investigate psychometric properties, analyze the scale's factor structure, and compare differences in the sum score depending on sociodemographic subgroups. Before data collection, the study was assessed and approved by the ethics committee of the Technical University of Munich (TUM). All methods were carried out in accordance with relevant guidelines and regulations. All participants confirmed their informed consent before taking part in the study.

Adaptation and revision

First, the existing D-Lit German scale [7] was revised by an expert team of two clinical psychologists to improve the comprehensibility of the scale items as recommended by Freitag et al. (2018) [7]. Four items were found to be misleading or not in accordance with the current S3 guidelines for depression. These items were replaced by four new items, thematizing other aspects of depression and depression treatment. This first draft of the revised D-Lit-R German scale [27] was developed for the present study, has not been published before, and is available in the online supplements. The scale then underwent a pretest with cognitive interviews with the technique of “thinking aloud” [28] to identify possible comprehension and response problems. In accordance with the recommendation of Prüfer & Rexroth (2005) [28], we aimed to recruit at least 5 participants for the interviews. Due to difficulties in the recruitment, the final number of participants was N = 5, consisting of patients with depression (two women and three men; Ages: 24, 28, 43, 49, and 66) staying at the private ward of the Clinic for Psychiatry and Psychotherapy of the University Hospital Rechts der Isar of the Technical University in Munich (TUM). The Interviews were conducted by one of the first authors of the present study (DJ) in April 2022. They were audio recorded and transcribed. After transcription, the audio records were deleted. Participants gave informed consent before taking part in the interviews.

The registered problems in the transcripts were rated following the Question Rating System of Faulbaum et al. (2009) [29]. Then, the altered items were again discussed and reviewed by the clinical psychologists and the study team.

Online survey

In a subsequent online survey, a convenient sample of participants answered the modified D-Lit-R German scale [27] and a sociodemographic questionnaire. All interested individuals (18–80 years) who did not meet exclusion criteria were eligible to participate and thus included. The exclusion criteria comprised cognitive impairment, language barriers, an academic degree in psychology, or another expertise in psychology or psychiatry. Interested persons were only invited to participate in the study if they did not meet any exclusion criteria. Expertise in psychology or psychiatry was further assessed by asking questions about their profession in the sociodemographic questionnaire at the beginning of the online survey. The survey was conducted via the internet platform www.sosci-survey.de. The period for participation was 6 weeks (May–June 2022). The time required to complete the survey was suggested to be 5–10 min. Subjects were asked to give their informed consent at the beginning of the survey by clicking a button since data collection was anonymous. Participation was voluntary and unpaid. By closing the survey web page, participants could end the survey at any time if they no longer wished to participate.

Sample size and recruitment

Schönbrodt and Perugini (2013) recommend a minimum sample size of N = 250 since stable estimates of correlations with manifest variables can only be expected with this sample size [30]. For stable estimates regarding the correlations of latent variables, a sample size of 490 persons is recommended [31]. Therefore, a target sample size of N = 490 individuals was aimed for.

Recruitment was conducted via analog and digital advertisement through flyers at universities, clinics, other educational institutions, and institutions of daily life (e.g., supermarkets) in Munich, Germany, and Innsbruck, Austria.

Measurement tools

Sociodemographic questionnaire

The questionnaire included items with questions on the following domains: Age, gender, experience with treatment for mental health problems, experience with depression (self, acquaintance), current treatment for depression, level of education, and career field. We further assessed how the participants found out about the study.

D-Lit-R German scale [27]

A revised version of the German translation of the Depression Literacy Scale (D-Lit German) by Freitag et al. (2018) [7] was used to assess depression literacy. The original version was constructed by Griffiths et al. (2004) [24]. In total, the revised D-Lit-R German scale [27] that we developed for this study contains 22 items with a three-part response format ("true," "false," "I don't know"). One point is given for each correct answer; no point is awarded for questions answered incorrectly or with "I don't know.". A higher sum score indicates a greater depression knowledge [7]. Freitag et al. (2018) [7] report a Cronbach’s α of 0.747 for the D-Lit German scale. Four items of the D-Lit German scale were replaced by reformulated items (see Table 1). However, the revised scale still had the same response format as the D-Lit German scale and was evaluated and interpreted in the same way. The authors of both the original and the translated version of the D-Lit scale, Kathleen Griffiths and Simone Freitag, have kindly given their permission to use their versions for the further development of the scale.

Table 1 Modified/ Replaced Items and their original version

Statistical analysis

Statistical analyses were performed using SPSS statistical software version 27 (IBM SPSS Statistics) and R (version 4.2.0 R Core Team, 2022) and the packages Jmv (Version 2.3.4;), Lavaan (Version 0.6–12; Rosseel, 2012), MBESS (Version 4.9.1; Kelley, 2017), nfactors (Version 2.4.1; Raiche, 2010), psy (Version 1.2; Falissard & Falissard, 2022), psych (Version 2.2.5; Revelle, 2022), and RE- daS (Version 0.9.4; Maier, 2022). The significance level was set at α = 0.05 for two-sided significance tests. For multiple tests, the significance level was corrected according to Bonferroni. Multiple imputations (chained equation) [32] of missing values of the dependent variable (D-Lit-R German data) were not performed since the small number of three data points (0.03%) did not follow a systematic pattern and were classified as MCAR values (missing completely at random) [33, 34].

Descriptive item statistics (means, standard deviations, selectivity, item skewness) were calculated, and distributional analyses (scale skewness and scale kurtosis) were performed. The scale's reliability was assessed using Cronbach´s alpha and McDonald's Omega (categorical). To check the suitability of the present data for the factor analysis, we examined Bartlett's test for sphericity [35] with the Kaiser–Meyer–Olkin coefficient (KMO) [36] and the correlations of the anti-image matrices (MSA coefficients). This was followed by a factor analytic examination of the D-Lit-R German scale with determination of the number of factors to be extracted using parallel analysis [37] and MAP test [21, 38]. Because of the categorical response format and the fact that the factors would correlate, a WLSMV (Weighted Least Squares Mean Variance – adjusted; rotation: oblimin) factor analysis was calculated [39, 40]. Measurement models were evaluated using the following fit indices: global model fit (Chi2 test), RMSEA (Root Mean Square Error of Approximation), CFI (Comparative Fit Index), and SRMR (Standardized Root Mean Square Residual) [41]. We want to point out that we used these fit indices to compare models with varying numbers of factors. In this, we tried to find a trade-off between model fit and model interpretability. Finally, subgroup analyses were performed using t-tests (Welch tests for missing prerequisites), nonparametric tests (Mann–Whitney U test), and the univariate analyses of variance complemented by Dunnett T3 post hoc tests.

Results

Adaptation and revision

In sum, 10 original D-Lit German scale items were replaced by reformulated items and modified. Table 1 shows the modified items and their original versions. There were several reasons for the modification or replacement of the items. Items 1, 3, and 12 were slightly modified to improve the comprehensibility. Item 18, which initially had to be answered with “correct”, is a question on the treatment of depression that is not in line with the current recommendations of the S3- guidelines. Therefore, we replaced it with a more accurate item regarding depression treatment based on the guidelines' recommendations. Items 13, 16, and 19 were found to be misleading and display implausible comparisons. These items were replaced by new items, which were chosen in accordance with the content of the psychoeducational program of the subsequent study, for which the revised scale is thought to be one of the measuring tools. The same reasoning was crucial for the replacement of item 15. The original item 15 was found to be too easy based on the feedback in the cognitive interviews. Since the original item possibly aimed to decrease stigma, we chose to replace it with an item about the causes of depression that could also have a destigmatizing effect.

Descriptive statistics

630 subjects participated in the study. Before data analysis, 103 data entries were excluded since only the link had been clicked on and no data had been entered. Additionally, 3 subjects were excluded from the analysis because they met an exclusion criterion. Table 2 shows the descriptive statistics of the sociodemographic characteristics of the final sample (N = 524). Most participants stated that they became aware of the study through their university or college (53.2%), and some have been approached by friends, family, or acquaintances (28.6%). Other participants were asked to participate through the Institute of General Practice and Health Services Research (10.9%) and some through social media (6.9%). Regarding the gender of the participants, the sample included 370 (70.6%) women and 142 (27.1%) men, 7 (1.3%) participants choosing the option “diverse” and 5 (1%) participants selecting the response option "I do not wish to provide information". The sample's age ranged from 18 to 79 years (M = 32.38; SD = 14.69).

Table 2 Sociodemographic characteristics of the final sample (N = 524)

Online survey

Data from N = 524 subjects could be included in the statistical analysis; the mean sum score was M = 16.52 (SD = 3.40), the selectivity of the items ranged between rit = -0.02—0.50, with 15 of the 22 items (68.2%) having a selectivity < 0.30, which can be considered as a moderate degree [39, 42]. Since Cronbach´s alpha was α = 0.72 and McDonald's Omega (categorical) was ω = 0.77, the scale's reliability was found to be acceptable. Table 3 shows the descriptive statistics.

Table 3 Descriptive statistics of the German D-Lit-R scale

The mean completion time of the online survey was M = 4.36 (SD = 1.95) minutes. Since participants could have looked up some of the answers online, a spearman correlation analysis of the completion time and the sum score was conducted. A significant, negative correlation of r = -0.153, p < 0.001 showed that a longer completion time was associated with a smaller sum score.

Factor analysis

Based on the Kaiser–Meyer–Olkin coefficient (KMO = 0.77), the data was considered suitable for the factor analysis. In addition, the anti-image matrices of the inter-item correlations had high MSA coefficients (0.51—0.86). The Bartlett's test of sphericity showed that all correlations were significantly different from zero (χ2 = 1584.35; p < 0.001; df = 231). Horn's (1965) parallel analysis suggested extracting 5 factors for which eigenvalues are reported above the 95% percentile [37]. However, because the MAP test extracted only one factor for the minimum mean squared partial correlation (0.01) and since it was assumed that the scale measured the construct depression knowledge, an EFA (algorithm: WLSMV, rotation: oblimin) was first performed for a unidimensional model.

Unidimensional model

Table 4 shows the factor loadings (λ) and commonalities (h2). The unidimensional structure accounted for 28.5% of the total variance.

Table 4 Item parameters for a unidimensional model

A total of 19 loadings were significant at a significance level of p < 0.001 and two loadings (λ2, λ16) at a significance level of p < 0.05. The chi2 test calculated for the general model fit was significant (χ2emp,WLSMV(35) = 173.252, p < 0.001), the model is therefore rejected. Similarly, the fit indices of the single-factor model (CFI = 0.930, RMSEA = 0.087, SRMR = 0.146) failed to meet the cut-off values defined by Hu and Bentler (1999) [41]. Due to the rather poor model fit, the single-factor- congeneric model was rejected based on the fit indices and the chi2 test.

5-factor-model

Based on the parallel analysis, an EFA was calculated for a multidimensional τ-congeneric model. The 5-factorial structure explained 52.61% of the total variance. The chi2 test was not significant (χ2emp,WLSMV(131) = 92.424, p > 0.05). The fit indices also indicated a good model fit (CFI = 1, RMSEA = 0, SRMR = 0.07). Although the 5-factorial model seemed to explain the data statistically best, the content of the factors could not be sufficiently depicted, respectively.

3-factor-model

As a result, the model was discarded in favor of a 3-factor model based on theoretical post-hoc considerations regarding the content of the factors. The explained total variance of the 3-factorial model was 42.62%. The proportion of correct answers varied between the factors. The global hypothesis test was significant, χ2emp,WLSMV(168) = 199.912, p < 0.05. The CFI is 0.990, arguing for acceptance of the model, followed in the output, by the RMSEA of 0.019, 90% CI[0.003, 0.029], which meets an acceptable model fit. The SRMR of 0.093 failed to meet the common cut-offs by Hu and Bentler (1999) [41]. Six items had higher loadings on factor 1, nine items on factor 2, and six on factor 3 (Table 5). Item 15 had the lowest loading (λ15 = 0.04), which did not become significant on any of the factors. This item did not seem to belong to any factor, so it should be removed from the scale in the long term. However, the remaining 21 loadings were significant on at least one factor. Other modified items (1, 3, 12, 13, 16, 18, 19) had factor loadings and communalities of λ = 0.18—0.75 and h2 = 0.10—0.71. The three highest loadings were on item 8 (λ8 = 0.89), item 10 (λ10 = 0.85) and item 22 (λ22 = 0.80). Item 3 had a double loading on the first (λ3 = 0.18) and second factors (λ3 = 0.19).

Table 5 Factor loadings on a 3-factor model

3-factor-model after removing Item 15

After removing Item 15, which did not have a significant loading on any factor, the analysis was conducted again for the 3-factor model, resulting in a better model fit with χ2emp,WLSMV(150) = 156.062, p > 0.05, CFI = 0.998, RMSEA = 0.009, SRMR = 0.088. The explained total variance of the 3-factor model without item 15 increased to 44.78% and the items still loaded on the same factors as before. The individual factor loadings can be found in the online supplements.

Content identification of the potential factors

Factor 1: distractors and other symptoms

Factor 1 is composed of items that are predominantly not associated with the construct depression and mainly address symptoms of other mental illnesses. Items 1, 3, 5, 6, 10 and 14 therefore discriminate incorrect from correct knowledge about depressive symptoms.

Factor 2: depressive symptoms

This factor represents items that primarily ask about depressive symptoms (2, 4, 7, 8, 9, 11, 13, 16, 19). Item 16 had the lowest communality and more likely corresponds to the treatment of depression.

Factor 3: pharmacological and psychotherapeutic depression treatment

This factor contains items regarding the pharmacological or psychotherapeutic treatment of depression (12, 17, 18, 20, 21, 22). Item 15 did not seem to be connected to any factor.

Sociodemographic subgroup analyses

There was no significant influence of age on the number of correct answers. Due to the very small number of cases in the gender groups ‘divers’ and ‘no information’, only the gender groups of women and men were compared. There were statistically significant differences between the two gender categories (tWelch(237,45) = 4.37, p < 0.001, d = 0.45), with females averagely scoring 1.5 more correct responses than males. Differences in the sum score depending on the level of education were analyzed by a t-test for the two most predominant groups of education, Abitur and secondary school. The results of the Welch test showed no statistically significant differences between the groups. Using the Mann–Whitney U-test, a significantly higher sum score was found for people who had already sought treatment for mental health problems compared to people without treatment experience (U = 21,494, Z = -6.771, p < 0.001, r = 0.30). Also, using the Mann–Whitney U-test, a significant difference was found between the group that had been in depression treatment before and the group without previous depression treatment, with higher scores in the first group (U = 14,494, Z = -5.71, p < 0.001, r = 0.25). Additionally, another Welch test revealed statistically significant differences between the group that had already been affected by depression themselves or had someone close to them who was affected and the group without any experience depression (tWelch(175,81) = 6.54, p < 0.001, d = 0.74). Individuals who had experience of depression, scored on average 2.4 more correct responses than those without experience. Significant mean differences were also found between the different career fields (technical, social, economic, health sciences, humanities, natural sciences, law, other field of activity, not specified) using a one-factor ANOVA with post-hoc tests (Dunnett-T3) (F(8, 515) = 132.28, p < 0.001, η2 = 0.174, 95% CI[0.108, 0.221] and are depicted in Table 6.

Table 6 Differences between the sum scores in Dunnet-T3 Post-hoc Test regarding the career field of subjects

Discussion

In the present study, we revised and examined the German Depression Literacy Scale [7] regarding its factoranalytic and psychometric values. As recommended by Freitag et al. (2018) [7], we conducted the revised German Depression Literacy Scale [27] in a convenient sample.

The parallel analysis within the EFA revealed a 5-factorial structure of the D-Lit-R German scale, contrary to the assumption that depression knowledge could be a unidimensional construct as it had been extracted by the MAP test. After examining the unidimensional model and reviewing the fit indices, the assumption of a single-factorial structure was rejected. Although the 5-factor model fitted the data better than the unifactorial model, we could not make sense of the content of a 5-factor model. We chose the 3-factor model because it is a good trade-off between interpretability and model fit. Freitag et al. (2018) postulated that the original German version contained items regarding depressive symptoms and knowledge of other psychological symptoms [7]. These two categories were also reflected by the results of the present study. Jorm (2012) defines mental health literacy as a composition of many factors:1. knowing how to prevent mental disorders, 2. recognizing when a disorder is developing, 3. knowing what help-seeking options and treatments are available, 4. knowing which effective self-help strategies for milder problems exist, and 5. having first aid skills to support others who are developing a mental disorder or are in a mental health crisis [43]. Two of these domains could be identified in the 3-factorial model in the present study. One factor (factor 2) contained items testing knowledge about depression symptoms. The other factor (factor 1) also entailed items that tested symptom knowledge but related to symptoms of other mental disorders. As mentioned above, the third factor asked for items related to treatment knowledge. Treatment knowledge (factor 3) and symptom knowledge (factors 1 and 2) are only two of the essential components of depression knowledge [7, 43]. The other constructs subsumed under depression knowledge, such as prevention knowledge, help-seeking knowledge, and informal support options [43], were not represented in the modified D- Lit-R German scale.

These findings complement the literature on studies that translated and validated the original D-Lit scale into other languages. The factors extracted by the factor analysis we conducted are similar to the results of Jeong et al. (2017) [44], which also retained 3 factors for their revised 21-item Korean version of the D-Lit scale: 1) misperceptions about depression and its treatment; 2) knowledge about depression; and 3) knowledge about the treatment of depression. Other studies have detected either a 5-factor model [45] with factor domains similar to what we suggested or a 1-factor model, covering depression literacy as a one-dimensional construct [46, 47].

In the present study, we aimed to adapt and revise the scale to increase the comprehensibility and correct items that were not aligned with the S3 guidelines. Furthermore, we tried to match the items of the scale to the topics that will be presented in a psychoeducation program in a subsequent study, which concerns improving depression care in general practices. Since most translations had been adapted for cultural aspects [44,45,46, 48], the different versions might, in fact, represent different domains of depression literacy. To create a scale that represents all of the domains of depression literacy based on the MHL definition by Jorm (2012), further studies should adapt the D-Lit scale according to his definition.

For our final version of the D-Lit-R German scale, we recommend excluding Item 15 since it shows a low selectivity, and excluding it increased the explained total variance. Compared to the reliability of the original German version of the D-Lit-German scale (α = 0.75) [7], the reliability of our scale in the present study (α = 0.72; ω = 0.77) was similar. The reliability analysis of the English version revealed a Cronbach's alpha of 0.70 with a test–retest reliability of 0.71 [24] and is slightly below the reliability of the D- Lit-R German scale [27]. A majority of almost 75% of the respondents answered the questions correctly, which is notably higher than the 50% correct response rate detected by Freitag et al. (2018) [7]. Respectively, the percentage of correct answers for symptom knowledge, which excludes incorrect symptoms (factor 1) and identifies correct symptoms (factor 2), was 71% and 91%. This means that the sample has a high level of symptom knowledge. Compared to that, only 38% correctly answered questions regarding the possible third factor, which is depression treatment (pharmacological and psychotherapeutic treatment). This supports findings from previous studies on depression knowledge [7, 49, 50] and implies that the present sample seems to have less knowledge regarding guideline-based treatment.

To our knowledge, the present study is the first attempt to analyze the factor structure of the German D-Lit scale. Having an instrument to measure depression literacy without using case vignettes is important to enable standardized research since most studies use different kinds of case vignettes, which often leads to results that are difficult to compare [51, 52]. Although it was possible for researchers like Makowski et al. (2021) [15] to gain representative results on depression literacy by using case vignettes, this approach requires many resources. By revising the German D-Lit scale, we promote the extensive usage of this short and time-saving scale in German mental health research. Furthermore, we replaced misleading items with items that matched to a cognitive-behavioral depression psychoeducation [26]. Therefore, it could be expected that the scale can also be useful to measure the growth in depression literacy after other interventions to increase depression literacy since most interventions are based on cognitive-behavioral therapy concepts [53]. According to the stage model of Wright et al. (2015), involving patients in the adaptation process of a questionnaire can be classified as a preliminary stage of patient and public involvement (PPI) [54]. By conducting cognitive interviews with patients, we aimed to promote a participatory research approach, which cannot yet be regarded as standard in Germany [55].

Limitations

The study has some limitations, one of which is due to the online nature of the study. Because the study was online, subjects could search for the correct answers while completing the scale to achieve a better test result. Due to this limitation, we calculated a correlation between the processing time and the total score. Processing time correlated negatively with the total score. This could mean that participants who knew less about depression spent more time thinking about the answers and had a longer processing time. However, it might be that those who knew less would have scored even worse if they had not used the processing time for research. In the future, a time limit should be implemented to prevent this possible bias. Despite the achievement of the minimum sample size, the sample was not representative (young average age, high level of education). Since we conducted the scale on a convenient sample, due to the online nature of the study, younger participants might have had easier access to the study. Furthermore, women are shown to participate in online surveys more often than men [56]. This was also the case in our study, which might have led to higher depression knowledge since women have higher depression knowledge and mental health literacy in general [6, 7, 57, 58]. The high proportion of correct answers could also be traced back to the educational level of the sample, which was above average. In addition, 77% of individuals reported having depression experience, and 43% reported having treatment experience. Overall, 21% of the respondents were undergoing treatment for their own depression at the time they participated in the study. This aligns with the results from insurance fund routine data in Germany [4, 59], but could also have been favorable for a higher depression knowledge. To summarize, the results of this study are not representative of the general population, as the people included in the study were predominantly young, highly educated, and female.

Nevertheless, our results can suggest a preliminary factor structure that should be tested again using a representative sample. Further studies should focus on more inclusive strategies to recruit participants and consider implementing the scale in a paper-based format. Instead of focusing on universities or other educational institutions for recruitment, health care centers, e.g., general practices, community health care centers, or clinics, should be considered. Also, to avoid only attracting people who have already experienced depression, the topic of the research project should not be revealed until the end of the survey. Considering the moderate selectivities of the items, the absence of an analysis of the test–retest reliability, and the limitations regarding the study population, the German D-Lit-R scale [27] still has to undergo further development and evaluation.

Conclusion

In the present study, we revised the Geman Depression Literacy scale and evaluated the psychometric values and factor structure of it in a convenient sample. The results indicate that the D-Lit-R German scale measures knowledge of 1) symptoms of depression, 2) symptoms of other psychological disorders that have to be distinguished from depression, and 3) the treatment of depression (pharmacological and psychotherapeutic). The scale conveys satisfactory reliability and can be easily applied since it is very time-saving and standardized. Due to several limitations, such as the limited generalizability resulting from our convenient sample, the scale should be conducted again in a more representative population. Also, further revision is needed to construct a scale that can capture all aspects of depression literacy as defined in the literature and can be used for follow-up measures.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author upon reasonable request.

References

  1. Evaluation IoHMa: Results from the 2019 Global Burden of Diseases study. In.; 2019.

  2. WHO WHO: Systematisches Verzeichnis, Internationale statistische Klassifikation der Krankheiten und verwandter Gesundheitsprobleme,. In., vol. 10: Deutsches Institut für Medizinische Dokumentation und Information (DIMDI) im Auftrag des Bundesministeriums für Gesundheit (BMG) unter Beteiligung der Arbeitsgruppe ICD des Kuratoriums für Fragen der Klassifikation im Gesundheitswesen (KKG). ; 2018.

  3. Bundesärztekammer (BÄK), Kassenärztliche Bundesvereinigung (KBV), Arbeitsgemeinschaft der Wissenschaftlichen MFA: Nationale VersorgungsLeitlinie Unipolare Depression – Langfassung, Version 3.1. In.; 2022.

  4. Mack S, Jacobi F, Gerschler A, Strehle J, Hofler M, Busch MA, Maske UE, Hapke U, Seiffert I, Gaebel W, et al. Self-reported utilization of mental health services in the adult German population–evidence for unmet needs? Results of the DEGS1-Mental Health Module (DEGS1-MH). Int J Methods Psychiatr Res. 2014;23(3):289–303.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Nubel J, Mullender S, Hapke U, Jacobi F. Epidemic of depression? : Development of prevalence and help-seeking behaviour. Nervenarzt. 2019;90(11):1177–86.

    PubMed  Google Scholar 

  6. Tomczyk S, Muehlan H, Freitag S, Stolzenburg S, Schomerus G, Schmidt S. Is knowledge “half the battle”? The role of depression literacy in help-seeking among a non-clinical sample of adults with currently untreated mental health problems. J Affect Disord. 2018;238:289–96.

    Article  PubMed  Google Scholar 

  7. Freitag S, Stolzenburg S, Schomerus G, Schmidt S. Depression Literacy - German Translation and Testing of the Depression Literacy Scale. Psychiatr Prax. 2018;45(8):412–9.

    Article  PubMed  Google Scholar 

  8. Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P. “Mental health literacy”: a survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. MJA. 1997;166(4):182–6.

    PubMed  Google Scholar 

  9. Rüsch N, Evans-Lecko SE, Henderson C, Flach C, Thornicroft G. Knowledge and Attitudes as Predictors of Intentions to Seek Help for and Disclose a Mental Illness. Psychiatr Serv. 2011;62:675–8.

    Article  PubMed  Google Scholar 

  10. Angermeyer MC, Holzinger A, Matschinger H. Mental health literacy and attitude towards people with mental illness: a trend analysis based on population surveys in the eastern part of Germany. Eur Psychiatry. 2009;24(4):225–32.

    Article  PubMed  Google Scholar 

  11. Goldney R, Fisher L, Wilson D. Mental helath literacy: an impediment to optimum tretment of major depression in the community. J Affect Disord. 2001;64:277–84.

    Article  PubMed  Google Scholar 

  12. Rüsch N, Müller M, Ajdacic-Gross V, Rodgers S, Corrigan PW, Rossler W. Shame, perceived knowledge and satisfaction associated with mental health as predictors of attitude patterns towards help-seeking. Epidemiol Psychiatr Sci. 2014;23(2):177–87.

    Article  PubMed  Google Scholar 

  13. Wang J, Adair C, Fick G, Lai D, Evans B, Perry BW, Jorm A, Addington D. Depression literacy in Alberta: findings from a general population sample. La Revue canadienne de psychiatrie. 2007;52(7):442–9.

    Google Scholar 

  14. Sorensen K, Pelikan JM, Rothlin F, Ganahl K, Slonska Z, Doyle G, Fullam J, Kondilis B, Agrafiotis D, Uiters E, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25(6):1053–8.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Makowski AC, Harter M, Schomerus G, von dem Knesebeck O. What Does the Public Know About Varying Depression Severity?-Results of a Population Survey. Int J Public Health. 2021;66:607794.

    Article  PubMed  PubMed Central  Google Scholar 

  16. World Health Organization: Depressive disorder (depression). In.: https://www.who.int/news-room/fact-sheets/detail/depression; 2023.

  17. Kadam U, Croft P, McLeod J, Hutchinson M. A qualitative study of patient´s views on anxiety and depression. Br J Gen Pract. 2001;51:375–80.

    PubMed  PubMed Central  Google Scholar 

  18. Loeb P. Unbefriedigende Behandlung der Depression- nur Sache des Hausarztes? Schweizerische Ärztezeitung. 2010;91(4):117–9.

    Article  Google Scholar 

  19. Trautmann S, Beesdo-Baum K. The treatment of depression in primary care. Dtsch Arztebl Int. 2017;114(43):721–8.

    PubMed  PubMed Central  Google Scholar 

  20. Baumeister A, Mantell PK, Woopen C. Gesundheitskompetenz im Kontext psychischer Erkrankungen: Konzeptanalyse, Forschungsstand, Interventionsansätze. In: Rathmann K, Dadaczynski K, Okan O, Messer M, editors. Gesundheitskompetenz. Berlin, Heidelberg: Springer; 2022. p. 1–11.

    Google Scholar 

  21. O`Connor M, Casey L. The Mental Health Literacy Scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Res. 2015;229(1–2):511–6.

    Article  PubMed  Google Scholar 

  22. Wei Y, McGrath P, Hayden J, Kutcher S. The quality of mental health literacy measurement tools evaluating the stigma of mental illness: a systematic review. Epidemiol Psychiatr Sci. 2018;27(5):433–62.

    Article  PubMed  Google Scholar 

  23. Görnitz A, Pitschel-Walz G, Bäuml J: Wissensfragebogen: Depressive Erkrankungen. In: Psychoedukation Depression Manual zur Leitung von Patienten und Angehörigengruppen. edn. Edited by Pitschel-Walz GB, J. : Urban Fischer; 1998.

  24. Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C. Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatising attitudes to depression: randomised controlled trial. Br J Psychiatry. 2004;185:342–9.

    Article  PubMed  Google Scholar 

  25. Bland JM, Altman DG. Cronbach´s alpha. BMJ. 1997;314(7080):7572.

    Article  Google Scholar 

  26. Pitschel-Walz G, Bäuml J, Kissling W. Psychoedukation bei Depression- Manual zur Leitung von Patienten- und Angehörigengruppen. 2nd ed. München: Elsevier; 2018.

    Google Scholar 

  27. Gökce F, Jais D, Pitschel-Walz G: German Depression Literacy Scale Revised (D-Lit-R German). In.: Institute of General Practice and Health Services Research, TU Munich; 2022.

  28. Prüfer P, Rexroth M: Kognitive Interviews (GESIS-How-to, 15). Mannheim: Zentrum für Umfragen, Methoden und Analysen -ZUMA-; 2005.

  29. Faulbaum F, Prüfer P, Rexroth M. Was ist eine gute Frage? Wiesbaden: VS Verlag für Sozialwissenschaften; 2009.

    Book  Google Scholar 

  30. Schönbrodt FD, Perugini M. At what sample size do correlations stabilize? J Res Pers. 2013;47:609–12.

    Article  Google Scholar 

  31. Kretzschmar A, Gignac G. At what sample size do latent variable correlations stabilize? J Res Pers. 2019;80:17–22.

    Article  Google Scholar 

  32. Rubin D. Multiple Imputation for Nonresponse in Surveys. New York: John WIley & Sons Inc.; 1987.

    Book  Google Scholar 

  33. Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials - a practical guide with flowcharts. BMC Med Res Methodol. 2017;17(162):1–10.

    Google Scholar 

  34. Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393.

  35. Bartlett MS. Tests of significance in factor analysis. The British Journal of Psychology. 1950;3:77–85.

    Google Scholar 

  36. Kaiser HF. An Index of Factorial Simplicity. Psychometrika. 1974;39(1):31–6.

    Article  Google Scholar 

  37. Horn JL. A rationale and test for the number of factors in a factor analysis. Psychometrica. 1965;30(2):179–85.

    Article  Google Scholar 

  38. Velicer WF. Determining the number of components from the matrix of partial correlations. Psychometrika. 1976;41(3):321–7.

    Article  Google Scholar 

  39. Bühner M: Einführung in die Test- und Fragebogenkonstruktion 4edn: Pearson Studium 2021.

  40. DiStefano C, Morgan GB. A Comparison of Diagonal Weighted Least Squares Robust Estimation Techniques for Ordinal Data. Struct Equ Modeling. 2014;21(3):425–38.

    Article  Google Scholar 

  41. Lt Hu. Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55.

    Article  Google Scholar 

  42. Kelava A, Moosbrugger H. Deskriptivstatistische Itemanalyse und Testwertbestimmung. In: Moosbrugger H, Kelava A, editors. Testthheorie und Fragebogenkonstruktion. Berlin: Springer; 2020. p. 143–58 3 edn.

    Chapter  Google Scholar 

  43. Jorm AF. Mental health literacy: empowering the community to take action for better mental health. Am Psychol. 2012;67(3):231–43.

    Article  PubMed  Google Scholar 

  44. Jeong YM, Hughes TL, McCreary L, Johnson TP, Park C, Choi H. Validation of the Korean Parental Depression Literacy Scale. Int J Ment Health Nurs. 2018;27(2):712–26.

    Article  PubMed  Google Scholar 

  45. Tehrani H, Nejatian M, Moshki M, Jafari A. Psychometric properties of Persian version of depression literacy (D-Lit) questionnaire among general population. Int J Ment Health Syst. 2022;16(1):40.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Darraj HA, Mahfouz MS, Al Sanosi RM, Badedi M, Sabai A, Al Refaei A, Mutawm H. Arabic Translation and Psychometric Evaluation of the Depression Literacy Questionnaire among Adolescents. Psychiatry J. 2016;2016:8045262.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Arafat SMY, Shams SF, Rahman Chowdhury MH, Chowdhury EZ, Hoque MB, Abdul Bari M. Adaptation and validation of the Bangla version of the Depression Literacy Questionnaire. J Psychiatry. 2017;20:412. https://doi.org/10.4172/2378-5756-1000412.

    Article  Google Scholar 

  48. Imano T, Yokoyama K, Itoh H, Shoji E, Asano K. Development of the Japanese version of the Depression Literacy Scale. Int J Soc Psychiatry. 2022;68(8):1708–15.

    Article  PubMed  Google Scholar 

  49. Althaus D, Stefanek J, Hasford J, Hegerl U. Knowledge and attitude of the general public regarding symptoms, etiology and possible treatments of depressive illnesses. Nervenarzt. 2002;73(7):659–64.

    Article  PubMed  Google Scholar 

  50. Hess SG, Cox TS, Gonzales LC, Kastelic EA, Mink SP, Rose LE, Swartz KL. A survey of adolescents’ knowledge about depression. Arch Psychiatr Nurs. 2004;18(6):228–34.

    Article  PubMed  Google Scholar 

  51. Furnham A, Hamid A. Mental health literacy in non-western countries: a review of the recent literature. Ment Health Rev J. 2014;19(2):84–98.

    Article  Google Scholar 

  52. Kulwicka K, Gasiorowska A. Depression literacy and misconceptions scale (DepSter): a new two-factorial tool for measuring beliefs about depression. BMC Psychiatry. 2023;23(1):300.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Cuijpers P, Miguel C, Ciharova M, Harrer M, Moir F, Roskvist R, van Straten A, Karyotaki E, Arroll B. Psychological treatment of adult depression in primary care compared with outpatient mental health care: A meta-analysis. J Affect Disord. 2023;339:660–75.

    Article  PubMed  Google Scholar 

  54. Wright MT, Kilian H, Block M, von Unger H, Brandes S, Ziesemer M, Gold C, Rosenbrock R. Participatory quality development: engaging community members in all phases of project planning and implementation. Gesundheitswesen. 2015;77(1):141–2.

    Google Scholar 

  55. Schilling I, Herbon C, Jilani H, Rathjen KI, Gerhardus A. Patient and public involvement in clinical research: An introduction. Z Evid Fortbild Qual Gesundhwes. 2020;155:56–63.

    Article  PubMed  Google Scholar 

  56. Becker R, Moser S, Glauser D. Cash vs. vouchers vs. gifts in web surveys of a mature panel study Main effects in a long-term incentives experiment across three panel waves. Soc Sci Res. 2019;81:221–34.

    Article  PubMed  Google Scholar 

  57. Batterham PJ, Han J, Calear AL, Anderson J, Christensen H. Suicide stigma and suicide literacy in a clinical sample. Suicide and Life-Threatening Behavior. 2019;49(4):1136–47.

    Article  PubMed  Google Scholar 

  58. Sukys S, Cesnaitiene VJ, Ossowsky ZM. Is health education at university associated with students’ health literacy? Evidence from cross-sectional study applying HLS-EU-Q. Biomed Res Int. 2017;2017:1–9.

    Article  Google Scholar 

  59. Wiegand HF, Sievers C, Schillinger M, Godemann F. Major depression treatment in Germany-descriptive analysis of health insurance fund routine data and assessment of guideline-adherence. J Affect Disord. 2016;189:246–53.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors acknowledge and thank all participants of the study. Furthermore, we also acknowledge and thank Prof. Dr. Barbara Juen for supervising this work. Also, we would like to thank Kathleen Griffiths and Simone Freitag for giving her permission to use their versions of the depression literacy scale.

***The POKAL-Group (PrädiktOren und Klinische Ergebnisse bei depressiven ErkrAnkungen in der hausärztLichen Versorgung (POKAL, DFG-GrK 2621)) consists of the following principle investigators: Markus Bühner, Tobias Dreischulte, Peter Falkai, Jochen Gensichen, Peter Henningsen, Caroline Jung-Sievers, Helmut Krcmar, Kirsten Lochbühler, Karoline Lukaschek, Gabriele Pitschel-Walz, Barbara Prommegger, Andrea Schmitt and Antonius Schneider. The following doctoral students are members of the POKAL-Group: Katharina Biersack, Constantin Brand, Vita Brisnik, Christopher Ebert, Julia Eder, Feyza Gökce, Carolin Haas, Lisa Hattenkofer, Lukas Kaupe, Jonas Raub, Philipp Reindl-Spanner, Hannah Schillok, Petra Schönweger, Clara Teusen, Marie Vogel, Victoria von Schrottenberg, Jochen Vukas and Puya Younesi.

Funding

Open Access funding enabled and organized by Projekt DEAL. Open Access funding enabled and organized by Projekt DEAL. The research reported in this publication was supported by the German Research Foundation (DFG-GrK 2621/POKAL-Kolleg).

Author information

Authors and Affiliations

Authors

Consortia

Contributions

FG and DJ contributed equally to this work and thus share the first authorship. FG, GPW and DJ designed the study; DJ acquired and analyzed the data; PS assisted in analyzing the data; PS, GPW and FG assisted in the interpretation of the data. FG drafted the manuscript. FG, GPW, PS, AS and JG were involved in revising it critically and all authors have read and approved the final manuscript.

Corresponding author

Correspondence to Feyza Gökce.

Ethics declarations

Ethics approval and consent to participate

Before data collection, the study was assessed and approved by the ethics committee of the Technical University of Munich (TUM). All methods were carried out in accordance with relevant guidelines and regulations.

Internal reference number of the Ethics Approval: 2022-84_1-S-SR.

Consent for publication

All participants confirmed their informed consent before taking part in the study.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gökce, F., Jais, D., Sterner, P. et al. The revision and factor analytic evaluation of the German version of the depression literacy scale (D-Lit-R German). BMC Psychol 12, 235 (2024). https://doi.org/10.1186/s40359-024-01730-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-024-01730-9

Keywords