Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Quantification of relevance of quality of life assessment for patients with cognitive impairment: the suitability indices

BMC Neurology volume 14, Article number: 78 (2014) Cite this article

Abstract

Background

The extent to which MS patients with cognitive dysfunction can accurately self-report outcomes has been a crucial issue. The aim of this study was to quantify and compare the relevance of the quality of life (QoL) assessment between two populations with a high occurrence of cognitive dysfunction, specifically in individuals with multiple sclerosis (MS) and in individuals suffering from schizophrenia (SCZ).

Methods

Design: A cross-sectional study was performed using the following inclusion criteria: MS and SCZ patients were diagnosed according to the McDonald criteria and DSM-IV criteria, respectively. Data on sociodemographic (age, gender, education level) and clinical (disease severity, disease duration) factors, QoL (disease-specific questionnaires, MusiQoL and SQoL) and cognitive performance (executive, memory, and attention functions) were collected. Non-impaired and impaired populations were defined according to the French norms. Psychometric properties were compared to those reported in reference populations, which were assessed in the respective validation studies. Suitability indices were provided used to quantitatively compare how the structures in the different populations matched with the initial structure of the questionnaires (reference populations).

Results

One hundred and twenty-four MS patients and 113 SCZ patients were enrolled. Factor analysis was performed on the impaired populations and revealed that the questionnaire structure adequately matched the initial structure of the disease-specific QoL questionnaires. All of the suitability indices of construct and external validity in the non-impaired populations ranged from 70 to 100%.

Conclusions

Our study suggested that cognitive dysfunction did not compromise the reliability or validity of the self-reported QoL questionnaires among subjects with cognitive dysfunction, such as MS and SCZ. Thus, this report may clarify the relevance of using self-reported QoL assessments in clinical practice.

Peer Review reports

Background

The assessment of quality of life (QoL) has been considered increasingly important with regard to the evaluation of disease progression, treatment and the management of care provided to patients with chronic illness. The US Food and Drug Administration and the European Medicines Agency have provided detailed recommendations for QoL assessment [1, 2]. Despite the acknowledged need to consider QoL issues, QoL assessment remains under-utilized in clinical practice [3, 4].

QoL is commonly assessed using self-reported questionnaires. The extent to which patients with cognitive dysfunction can accurately self-report their QoL has been a crucial issue that has only been partially examined [5]. Few studies have investigated this issue in specific populations, such as in patients with multiple sclerosis (MS) [6, 7], patients with serious chronic mental illnesses [8, 9], in elderly populations [10, 11], and in patients with traumatic brain injury [12]. These studies have produced conflicting results, where some studies have demonstrated that the cognitively impaired are unable [13, 14] or able [6, 7, 9] to produce valid and reliable QoL measures. However, these studies provided restricted data regarding validity and reliability and did not report whether the structure of the questionnaire described in the impaired populations was well adapted when the QoL measure was used in these individuals. More recent studies have reported strong arguments in support of the conclusion that cognitively impaired patients can reliably and consistently respond to disease-specific questionnaires, where such studies used an interesting approach based on quantification of the relevance of the QoL assessment [15–17]. This quantification relied on suitability indices based on decision rules. These rules defined expected psychometric properties according to the appropriate standards [18, 19] and the properties reported in the reference population in the initial validation publication of the QoL questionnaire. This approach enables the determination of the relevance of QoL measures in different populations independent of the questionnaire used.

In this study, we compared the relevance of the QoL assessment between 2 populations of subjects with cognitive dysfunction to determine if the nature of the disease influenced the individual’s ability to accurately report his or her life experience. Cognitive deficits occur in a large proportion of patients with MS [20, 21] as well as in patients suffering from schizophrenia (SCZ) [22, 23]. In these 2 populations, similar neuroimaging abnormalities were reported [24, 25] and all cognitive domains, such as executive functions, memory, and attention/concentration are affected. The aim of this study was to explore the validity of disease-specific QoL questionnaires in patients with impaired cognitive function and to compare these findings between MS and SCZ patients.

Methods

Study design and participants

This study utilized a cross-sectional design. The inclusion criteria for MS patients included the following: an MS diagnosis according to the McDonald criteria [26], any subtype of MS, no neurological disease (other than MS), and no history of severe mental illness (except depression disorders). The inclusion criteria for SCZ patients included the following: age, diagnosis of SCZ according to the Diagnostic and Statistical Manual of Mental Disorders, 4th ed. (DSM-IV) criteria [27], and no neurological disease. All of the patients were over 18 years old, outpatients, in a stable disease phase (no relapse during the last 3 months), and native French speakers. MS patients were recruited from the neurology department of a public French academic teaching hospital (Marseille, France) and SCZ patients were recruited from two psychiatric hospitals (Marseille and Toulon, France). The French Ethics Committee approved this study (Comité Consultatif de Protection des Personnes dans la Recherche Biomédicale, Marseille, France). Informed consent was obtained from all subjects.

Data collection

The collected data included sociodemographic information, clinical characteristics, QoL and cognitive assessments. The sociodemographic (age, gender, and education level) and clinical (disease duration) data were recorded for each patient. Disease severity was assessed using the Expanded Disability Status Scale (EDSS) [28] and the Positive and Negative Syndrome Scale (PANSS) for MS and SCZ patients [29], respectively.

QoL was assessed using the French versions of disease-specific questionnaires: the MusiQoL for MS patients and SQoL for SCZ patients. The MusiQoL is a well-validated MS-specific questionnaire [30] consisting of 31 items that describes nine dimensions and provides a global index score: activity of daily living (ADL), psychological well-being (PWB), symptoms (SPT), relationships with friends (RFr), relationships with family (RFa), relationships with the health care system (RHCS), sentimental and sexual life (SSL), coping (COP), and rejection (REJ). The SQoL is a self-administered QoL questionnaire designed for people with schizophrenia [31, 32]. It consists of 18 items that describes 8 dimensions (psychological well-being (PsW), self-esteem (SE), family relationships (RFa), relationships with friends (RFr), resilience (RE), physical well-being (PhW), autonomy (AU) and sentimental life (SL)) and provides a total score (index). For the two questionnaires, the dimension and index scores range from 0, which indicates the lowest QoL, to 100, which indicates the highest QoL.

Cognition assessment

For both patient groups, cognitive assessment included executive function, memory, and attention performances. The executive function performance was assessed using both the French versions of the Stroop color-word test [33] and the Trail Making test (TMT) [34]. Memory performance was assessed using the long-short-delay tests of the French version of Grober and Buschke [35] in MS patients, and the long-short-delay subscales of the French version of the Wechsler Memory Scale [36] in SCZ patients. Attention performance was evaluated using the attention/concentration subscale of the French version of the Wechsler Memory Scale [36]. The same trained psychologist administered the tests in a standardized manner and the same instructions were given to the subjects prior to each test. Applying French normative values according to age, gender, and educational level (except for the Wechsler Memory Scale), the patients were divided into the following categories of cognitive function: 1) executive function: non-impaired (normal Stroop test and normal TMT) and impaired (other cases) [37]; 2) memory function: non-impaired (normal short-delay memory and normal long-delay memory) and impaired (other cases) [35, 36]; 3) attention function: non-impaired (normal attention/concentration subscale) and impaired (other cases) [36]. These categorizations enabled the characterization of each patient as a no or low-impaired (no impairment or one impaired function) and highly-impaired global function (2 or 3 impaired functions).

Statistical analysis

Statistical analyses were performed on the 4 populations defined above, i.e., no/low-impaired and highly-impaired groups for the 2 diseases, using the same procedure reported in the initial validation publications (reference populations) for MusiQoL [30] and SQoL [32]. For each group, the psychometric properties were compared to those reported in the reference population as assessed in the validation study of each questionnaire [30, 32]. The structures of the MusiQoL/SQoL were examined in the no/low-impaired and highly-impaired populations using factor analysis to determine how these structures matched with the initial structure of the questionnaire using principal component factor analyses with a varimax rotation [18, 19]. For each population, the proportion of factors identified from the initial factor structure of the MusiQoL/SQoL and the proportion of items projected to their initial dimension were obtained.

The multidimensional structure (construct validity) was verified using the multi-trait/multi-item analysis program [38]. The internal structural validity was assessed by investigating item-dimension correlations. The item internal consistency (IIC) was calculated by correlating each item with its scale, and the item discriminant validity (IDV) was assessed by determining the extent to which the items correlated with the dimension that they were hypothesized to represent compared to the correlations with other dimensions. Floor and ceiling effects were determined to assess the homogeneous repartition of the response distribution. For each dimension, the internal consistency reliability was evaluated using Cronbach’s alpha coefficient [39].

The unidimensionality of each dimension was explored by computing the item goodness-of-fit statistics (INFIT), which was obtained from Rasch analyses [40]. The INFIT values ranged from 0.7 to 1.2 to ensure that all of the scale items measured the same concept.

To explore external validity, Spearman’s correlation coefficients were used to investigate the relationships between the MusiQoL and SF36 dimensions in each group, and the associations between the MusiQoL dimension scores and sociodemographic and clinical features were reported similar to the validation study. For qualitative variables, the mean dimension scores of the MusiQoL were compared across patient groups (e.g., gender, educational level, marital status, and occupational status) using one-way analysis of variance. Quantitative variables (e.g., age, EDSS score, and MS duration) were analyzed using Spearman’s correlation coefficients. Acceptability was assessed by calculating the percentage of missing data per dimension. Data analyses were performed using SPSS 11.0, MAP-R, LISREL and WINSTEP software.

To quantify the manner in which each of the 4 structures matched with the initial structure (2 reference structures), suitability indices were calculated as previously described [15]. Decision rules, which were established by experts in QoL, were used to define satisfactory properties according to appropriate standards [18, 19]. The means of the different proportions were calculated to produce a suitability index of the ‘construct validity’ and a suitability index of the ‘external validity’.

Results

One hundred and twenty-four consecutive MS patients and 113 patients with schizophrenia were enrolled in this study. The sociodemographic and clinical features are listed in Table 1. At the timepoint of performing QoL assessment, 118 (95%) MS patients were taking disease-modifying drugs and 109 (96%) patients with schizophrenia were taking atypical antipsychotics (average dose of chlorpromazine of approximately 570 mg). According to the French normative values and to the definition of global cognitive status, 50 MS patients were categorized as cognitively no/low-impaired and 49 patients were categorized as cognitively highly-impaired. In addition, 40 SCZ patients were categorized as cognitively no/low-impaired and 67 patients were categorized as cognitively highly-impaired.

Table 1 Sample characteristics
Full size table

Construct validity

In the MS sample population, seven of the 9 initial factors were identified in the no/low-impaired group (REJ and SSL dimensions were not clearly identified), and 8 initial factors were found in the highly-impaired group (COP dimension was not detected). Twenty-seven and 29 of the 31 items contributed to the initial dimension in the no/low-impaired and highly-impaired groups, respectively.

The proportion of dimensions with IIC, which was greater than 0.2 compared to the reference population, was higher in the highly-impaired population compared to the no/low-impaired population. The proportion of dimensions with IDV, which was not greater than 0.2 compared to the reference population, was moderately satisfactory in both populations. The correlation for each item with its contributive dimension (IIC) was higher compared to the other dimensions (IDV) for 6 and 7 dimensions in the no/low- and highly-impaired populations, respectively. Cronbach’s alpha coefficients were satisfactory for 6 of the 9 dimensions in the no/low-impaired group. In addition, both populations showed satisfactory INFIT statistics. The floor effects were less than 10% compared to the reference population for 8 and 4 dimensions in the no/low-impaired and highly-impaired groups, respectively. The proportion of dimensions with a ceiling effect exceeding 10% compared to the reference population was higher in the highly-impaired population compared to the no/low-impaired population. The suitability indices of the construct validity were 82% and 78% in the highly-impaired and no/low-impaired populations, respectively.

In the SCZ sample, the 8-factor structure of the SQoL was clearly detected in the no/low and highly-impaired groups. Sixteen of the 18 items contributed to the initial dimension in the no/low-impaired and highly-impaired groups, respectively. The proportion of dimensions with IIC that was greater than 0.2 from the reference population was unsatisfactory in both populations. Moreover, the correlation for each item with its contributive dimension (IIC) was higher compared to the others (IDV) for 5 dimensions in the no/low- and highly-impaired populations. Cronbach’s alpha coefficients were satisfactory for 6 of the 8 dimensions in the no/low-impaired group. Furthermore, the INFIT statistics were satisfactory for both populations. The floor effects were less than 10% compared to the reference population for 6 dimensions in both groups, and the ceiling effects were less than 10% from the reference population for 4 and 5 dimensions in the no/low- and highly-impaired populations, respectively.

The suitability indices of the construct validity were 80% in the highly-impaired population and 74% in the no/low-impaired population (Figure 1). Further details are provided in Table 2 and Table 3.

Figure 1
figure 1

Suitability indices of construct validity according to the disease. LI no/low-impaired (0 or 1 impaired composites: executive, memory, and attention functions); HI highly-impaired (2 or 3 impaired composites). MS multiple sclerosis, SCZ schizophrenia.

Full size image
Table 2 Internal structural validity, reliability, unidimensionality according to the cognitive status
Full size table
Table 3 Suitability indices of construct validity and external validity according to the cognitive status: a global approach
Full size table

External validity

In MS individuals, women generally reported lower scores compared to men excepted in the sentimental and sexual life independent of cognitive status. The suitability index was more satisfactory in the highly-impaired population compared to the no- or low-impaired population. The proportion of dimensions with an effect size of less than 0.2 compared to the reference population for educational level was moderately satisfactory in both populations. In SCZ individuals, the proportion of dimensions with an effect size of less than 0.2 compared to the reference population for gender and occupational status was more satisfactory in both the no/low and highly-impaired groups.

As expected, age and disease duration almost never correlated with the QoL dimensions in the MS and SCZ populations. Findings related to relationships with disease severity and QoL scores were close compared to those of the 2 reference populations.

Taken together, the suitability indices of external validity in the no/low- and highly-impaired populations were 80% and 87% for the MS population and 85% and 88% for the SCZ population, respectively (Figure 2). These results are summarized in Tables 3, 4, and 5.

Figure 2
figure 2

Suitability indices of external validity according to the disease. LI no/low-impaired (0 or 1 impaired composites: executive, memory, and attention functions); HI highly-impaired (2 or 3 impaired composites). MS multiple sclerosis, SCZ schizophrenia.

Full size image
Table 4 Associations between QoL dimension scores and sociodemographic characteristics according to the cognitive status
Full size table
Table 5 Correlations between QoL dimension scores and age and clinical features according to the cognitive status
Full size table

Discussion

Our results provide strong evidence supporting the relevance of self-reported quality of life assessments for patients with cognitive disorders, particularly in patients with severe cognitive dysfunction. It seems that the nature of multiple sclerosis and schizophrenia did not affect this type of assessment.

We examined these two diseases on the basis of the following points: i) the status of chronic illnesses with a high occurrence of reported cognitive deficits, even during the early disease stages [41, 42]; ii) three main composites of cognition were indiscriminately affected [42, 43]; iii) the homogeneous and extensive assessment of cognition, including tests assessing memory, attention, and executive function; iv) the availability of a disease-specific self-reported QoL questionnaire [30, 32]; and v) the surprising similarities related to changes in white matter structure or abnormalities in myelin [24, 25]. Moreover, some studies have suggested that changes in the integrity of white matter can result in impaired cognitive function in MS [44] and SCZ [45] patients.

These findings may support for the use of QoL assessment for clinicians who are still perplexed when interpreting the meaning of QoL scores for an individual with cognitive impairment. This present study suggests that cognitively impaired patients, as defined by a global cognitive dysfunction, can reliably and consistently respond to a specific QoL self-reported questionnaire. This assumption is underlined by the suitability indices found in the highly-impaired groups, i.e., 2 or 3 altered functions altered, in both MS and SCZ patients. These indices may be considered satisfactory compared to their respective reference populations. In the highly-impaired groups, factor analysis showed that the structure corresponded with the initial structure of the QoL questionnaires: 8 of the 9 dimensions were clearly identified in the MusiQoL and all the dimensions were identified in the SQoL. Although the IIC values reported in the highly-impaired population of MS individuals were similar to those identified in the reference population, the proportion of dimensions with IIC that exceeded 0.2 compared to the reference population was less satisfactory in SCZ individuals. For MS and SCZ populations, the proportion of dimensions with IDV values greater than the IIC values and the proportion of dimensions with IDV exceeding 0.2 compared to the reference population were less satisfactory, which may be explained by the very restricted definition of the decision rule. Internal consistency coefficients calculated in the highly-impaired groups were close to those of the initial reference populations. The floor and ceiling effects were slightly different compared to those reported in the initial validation publication independent of disease type. In addition, satisfactory INFIT statistics supported the unidimensionality of each of the dimensions.

Regarding external validity, highly-impaired populations showed satisfactory suitability indices. The links between QoL scores and age, severity disease score (EDSS and PANSS), and disease duration were closer to the initial reference populations independent of cognitive status and disease. However, links between QoL scores and gender and educational level were less satisfactory. In summary, the suitability indices of the highly-impaired population may be considered completely acceptable considering the small sample size of the defined populations.

Several previous studies have employed similar approaches to define cognitive dysfunction using a single composite, such as memory [7, 15], attention [16], and executive functions [17, 46]. It should be acknowledged that a single test of cognitive functioning would never be entirely appropriate to define an impaired cognitive population. One composite cannot be a perfect reflection of global cognitive function because patients suffer from several neuropsychological deficits. It would be unusual to observe one deficit in isolation [20, 47–49], and QoL measurement may be altered depending on the type of cognitive impairment [50]. Thus, it is necessary to report additional information according to other definitions of cognitive dysfunction using a combination of different composites. To the best of our knowledge, this is the first study that uses the definition of cognitive dysfunction, which integrates a combination of different composites (i.e., memory, attention, and concentration).

Several limitations and strengths of this study should be mentioned:

  1. 1.

    The representativeness of the samples should be discussed. Compared to international and European cohorts, the MS patients in this study exhibited a more severe disability profile [30, 51], and the SCZ patients had a longer illness duration [52]. Thus, an assessment of the reproducibility of our results is needed, using a larger and more diverse group of patients. However, the proportion of cognitively impaired subjects was consistent with the literature for MS [13, 20, 53] and SCZ [54, 55] domains.

  2. 2.

    One important aspect of this study concerns our definition of cognitive dysfunction because there is little consensus according to Achiron and Barak [56]. We defined cognitive impairment using tests in which the French norms have been previously published [35–37]. This eliminated the need for a control group and enabled a consensus in defining patients as non-impaired or impaired for each test. However, our definition may be questionable because of the absence of a consensus on a ‘global definition’ of a patient with global cognitive dysfunction on the basis of a combination of these tests. However, we are convinced that our findings, independent of the definition of cognitive dysfunction, can help researchers to better understand the relevance of self-reported quality of life assessments for patients with cognitive disorders.

  3. 3.

    The suitability indices used to define the satisfactory properties relied on arbitrary decision rules, each of which will be discussed. Nevertheless, this approach enabled the determination of the suitability or unsuitability of different structures using the same decision tree independent of the questionnaire and disease. Thus, future studies may be performed to test different decision trees and to discuss the implications of the subsequent results.

  4. 4.

    Factors previously associated to cognitive performance, such as depression and fatigue [57, 58], and medications [59] were not considered. However, the aim of this study was to provide evidence supporting the conclusion that cognitively impaired patients reliably answer a self-reported QoL questionnaire regardless of the presence or absence of other factors that could have influenced their performance.

Conclusion

These findings confirmed preliminary results, which suggest that cognitive decline, as defined using a global cognitive dysfunction, did not compromise the reliability or validity of self-reported health measures. This study should support the clinical relevance of QoL assessment, thereby enhancing the use of QoL measures in clinical practice for cognitively impaired patients.

References

  1. Apolone G, De Carli G, Brunetti M, Garattini S: Health-related quality of life (HR-QOL) and regulatory issues. An assessment of the European Agency for the Evaluation of Medicinal Products (EMEA) recommendations on the use of HR-QOL measures in drug approval. Pharmacoeconomics. 2001, 19 (2): 187-195. 10.2165/00019053-200119020-00005.

    Article  CAS  PubMed  Google Scholar 

  2. Bottomley A, Jones D, Claassens L: Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European Medicines Agency. Eur J Cancer. 2009, 45 (3): 347-353. 10.1016/j.ejca.2008.09.032.

    Article  PubMed  Google Scholar 

  3. Greenhalgh J, Long AF, Flynn R: The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory?. Soc Sci Med. 2005, 60 (4): 833-843. 10.1016/j.socscimed.2004.06.022.

    Article  PubMed  Google Scholar 

  4. Awad AG: Quality-of-life assessment in schizophrenia: the unfulfilled promise. Expert Rev Pharmacoecon Outcomes Res. 2011, 11 (5): 491-493. 10.1586/erp.11.61.

    Article  PubMed  Google Scholar 

  5. Riemsma RP, Forbes CA, Glanville JM, Eastwood AJ, Kleijnen J: General health status measures for people with cognitive impairment: learning disability and acquired brain injury. Health Technol Assess. 2001, 5 (6): 1-100.

    Article  CAS  Google Scholar 

  6. Gold SM, Schulz H, Monch A, Schulz KH, Heesen C: Cognitive impairment in multiple sclerosis does not affect reliability and validity of self-report health measures. Mult Scler. 2003, 9 (4): 404-410. 10.1191/1352458503ms927oa.

    Article  PubMed  Google Scholar 

  7. Marrie RA, Miller DM, Chelune GJ, Cohen JA: Validity and reliability of the MSQLI in cognitively impaired patients with multiple sclerosis. Mult Scler. 2003, 9 (6): 621-626. 10.1191/1352458503ms971oa.

    Article  PubMed  Google Scholar 

  8. Nishiyama T, Ozaki N: Measurement limit of quality-of-life questionnaires in psychiatric settings. Qual Life Res. 2010, 19 (1): 25-30. 10.1007/s11136-009-9556-1.

    Article  PubMed  Google Scholar 

  9. Voruganti L, Heslegrave R, Awad AG, Seeman MV: Quality of life measurement in schizophrenia: reconciling the quest for subjectivity with the question of reliability. Psychol Med. 1998, 28 (1): 165-172. 10.1017/S0033291797005874.

    Article  CAS  PubMed  Google Scholar 

  10. Baro E, Ferrer M, Vazquez O, Miralles R, Pont A, Esperanza A, Cervera AM, Alonso J: Using the Nottingham Health Profile (NHP) among older adult inpatients with varying cognitive function. Qual Life Res. 2006, 15 (4): 575-585. 10.1007/s11136-005-3691-0.

    Article  PubMed  Google Scholar 

  11. Bureau-Chalot F, Novella JL, Jolly D, Ankri J, Guillemin F, Blanchard F: Feasibility, acceptability and internal consistency reliability of the nottingham health profile in dementia patients. Gerontology. 2002, 48 (4): 220-225. 10.1159/000058354.

    Article  PubMed  Google Scholar 

  12. DePalma JA: Measuring quality of life of patients of traumatic brain injury. Crit Care Nurs Q. 2001, 23 (4): 42-51. 10.1097/00002727-200102000-00004.

    Article  CAS  PubMed  Google Scholar 

  13. Goverover Y, Chiaravalloti N, DeLuca J: The relationship between self-awareness of neurobehavioral symptoms, cognitive functioning, and emotional symptoms in multiple sclerosis. Mult Scler. 2005, 11 (2): 203-212. 10.1191/1352458505ms1153oa.

    Article  PubMed  Google Scholar 

  14. Benedict RH, Cox D, Thompson LL, Foley F, Weinstock-Guttman B, Munschauer F: Reliable screening for neuropsychological impairment in multiple sclerosis. Mult Scler. 2004, 10 (6): 675-678. 10.1191/1352458504ms1098oa.

    Article  PubMed  Google Scholar 

  15. Baumstarck K, Reuter F, Boucekine M, Aghababian V, Klemina I, Loundou A, Pelletier J, Auquier P: Relevance of quality of life assessment for multiple sclerosis patients with memory impairment. Plos ONE. 2012, 7 (12): e50056-10.1371/journal.pone.0050056.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Baumstarck K, Boucekine M, Klemina I, Reuter F, Aghababian V, Loundou A, Pelletier J, Auquier P: What is the relevance of quality of life assessment for patients with attention impairment?. Health Qual Life Outcomes. 2013, 11: 70-10.1186/1477-7525-11-70.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Baumstarck K, Boyer L, Boucekine M, Aghababian V, Parola N, Lancon C, Auquier P: Self-reported quality of life measure is reliable and valid in adult patients suffering from schizophrenia with executive impairment. Schizophr Res. 2013, 147 (1): 58-67. 10.1016/j.schres.2013.03.008.

    Article  PubMed  Google Scholar 

  18. Juniper EF, Guyatt GH, Mesbah M, Ravaud P: Quality of life and pharmacoeconomics in clinical trials. 1996, Philadelphia: Lippincott-Raven

    Google Scholar 

  19. Nunnaly JC, Bernstein IC: Psychometric theory. 1994, New York: Mc Graw-Hill

    Google Scholar 

  20. Amato MP, Zipoli V, Portaccio E: Multiple sclerosis-related cognitive changes: a review of cross-sectional and longitudinal studies. J Neurol Sci. 2006, 245 (1–2): 41-46.

    Article  PubMed  Google Scholar 

  21. Feuillet L, Reuter F, Audoin B, Malikova I, Barrau K, Cherif AA, Pelletier J: Early cognitive impairment in patients with clinically isolated syndrome suggestive of multiple sclerosis. Mult Scler. 2007, 13 (1): 124-127. 10.1177/1352458506071196.

    Article  CAS  PubMed  Google Scholar 

  22. Elvevag B, Goldberg TE: Cognitive impairment in schizophrenia is the core of the disorder. Crit Rev Neurobiol. 2000, 14 (1): 1-21.

    Article  CAS  PubMed  Google Scholar 

  23. Green MF, Kern RS, Heaton RK: Longitudinal studies of cognition and functional outcome in schizophrenia: implications for MATRICS. Schizophr Res. 2004, 72 (1): 41-51. 10.1016/j.schres.2004.09.009.

    Article  PubMed  Google Scholar 

  24. Agartz I, Andersson JL, Skare S: Abnormal brain white matter in schizophrenia: a diffusion tensor imaging study. Neuroreport. 2001, 12 (10): 2251-2254. 10.1097/00001756-200107200-00041.

    Article  CAS  PubMed  Google Scholar 

  25. Bartzokis G, Altshuler L: Reduced intracortical myelination in schizophrenia. Am J Psychiatry. 2005, 162 (6): 1229-1230.

    Article  PubMed  Google Scholar 

  26. Polman CH, Reingold SC, Banwell B, Clanet M, Cohen JA, Filippi M, Fujihara K, Havrdova E, Hutchinson M, Kappos L, Lublin FD, Montalban X, O'Connor P, Sandberg-Wollheim M, Thompson AJ, Waubant E, Weinshenker B, Wolinsky JS: Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol. 2011, 69 (2): 292-302. 10.1002/ana.22366.

    Article  PubMed  PubMed Central  Google Scholar 

  27. APA: DSM-IV. Diagnostic and Statistical Manual of Mental Disorders, 4th ed. Text revised. 2000, Washington, DC: American Psychiatric Association

    Google Scholar 

  28. Kurtzke JF: Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983, 33 (11): 1444-1452. 10.1212/WNL.33.11.1444.

    Article  CAS  PubMed  Google Scholar 

  29. Kay SR, Opler LA, Fiszbein A: Significance of positive and negative syndromes in chronic schizophrenia. Br J Psychiatry. 1986, 149: 439-448. 10.1192/bjp.149.4.439.

    Article  CAS  PubMed  Google Scholar 

  30. Simeoni MC, Auquier P, Fernandez O, Flachenecker P, Stecchi S, Constantinescu C, Idiman E, Boyko A, Beiske A, Vollmer T, Triantafyllou N, O'Connor P, Barak Y, Biermann L, Cristiano E, Atweh S, Patrick D, Robitail S, Ammoury N, Beresniak A, Pelletier J: Validation of the multiple sclerosis international quality of life questionnaire. Mult Scler. 2008, 14 (2): 219-230.

    Article  PubMed  Google Scholar 

  31. Auquier P, Simeoni MC, Sapin C, Reine G, Aghababian V, Cramer J, Lancon C: Development and validation of a patient-based health-related quality of life questionnaire in schizophrenia: the S-QoL. Schizophr Res. 2003, 63 (1–2): 137-149.

    Article  CAS  PubMed  Google Scholar 

  32. Boyer L, Simeoni MC, Loundou A, D’Amato T, Reine G, Lancon C, Auquier P: The development of the S-QoL 18: a shortened quality of life questionnaire for patients with schizophrenia. Schizophr Res. 2011, 121 (1–3): 241-250.

    Google Scholar 

  33. Jensen AR: Scoring the stroop test. Acta Psychol (Amst). 1965, 24 (5): 398-408.

    Article  Google Scholar 

  34. Bowie CR, Harvey PD: Administration and interpretation of the trail making test. Nat Protoc. 2006, 1 (5): 2277-2281. 10.1038/nprot.2006.390.

    Article  CAS  PubMed  Google Scholar 

  35. Van der Linden M, Coyette F, Poitrenaud J, Kalafat M, Calicis F, Wyns C, Adam S: L’épreuve de rappel libre, rappel indicé à 16 items. L’évaluation des troubles de la mémoire Présentation de quatre tests de mémoire épisodique et étalonnage. Edited by: Solal. 2004, Marseille, France, 25-

    Google Scholar 

  36. Wechsler D: WMS-R Echelle clinique de Mémoire de Wechsler-Révisée. Edited by: Les Editions du Centre de Psychologie Appliquée. 1991, Paris, France

  37. Godefroy O: et le Groupe de Reflexion pour l’Evaluation des Fonctions EXécutives (GREFEX). Fonctions exécutives et pathologies neurologiques et psychiatriques. Evaluation en pratique clinique, Solal edn. 2008, Marseille, France: Collection Neuropsychologique

    Google Scholar 

  38. Ware JE, Harris WJ, Gandek B, Rogers BW: MAP-R for Windows: Multitrait-Multi-Item Analysis Program - Revised User’s Guide. 1997, Boston: Health Assessment Lab

    Google Scholar 

  39. Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.

    Article  Google Scholar 

  40. Wright BD, Stone MH: Best test design: Rasch measurement. 1979, Chicago: Mesa press

    Google Scholar 

  41. Achiron A, Barak Y: Cognitive impairment in probable multiple sclerosis. J Neurol Neurosurg Psychiatry. 2003, 74 (4): 443-446. 10.1136/jnnp.74.4.443.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Braw Y, Bloch Y, Mendelovich S, Ratzoni G, Gal G, Harari H, Tripto A, Levkovitz Y: Cognition in young schizophrenia outpatients: comparison of first-episode with multiepisode patients. Schizophr Bull. 2008, 34 (3): 544-554.

    Article  PubMed  Google Scholar 

  43. Zakzanis KK: Distinct neurocognitive profiles in multiple sclerosis subtypes. Arch Clin Neuropsychol. 2000, 15 (2): 115-136. 10.1016/S0887-6177(98)00157-7.

    Article  CAS  PubMed  Google Scholar 

  44. Kujala P, Portin R, Ruutiainen J: The progress of cognitive decline in multiple sclerosis. A controlled 3-year follow-up. Brain. 1997, 120 (Pt 2): 289-297.

    Article  PubMed  Google Scholar 

  45. Fields RD: White matter in learning, cognition and psychiatric disorders. Trends Neurosci. 2008, 31 (7): 361-370. 10.1016/j.tins.2008.04.001.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Baumstarck K, Pelletier J, Aghababian V, Reuter F, Klemina I, Berbis J, Loundou A, Auquier P: Is the concept of quality of life relevant for multiple sclerosis patients with cognitive impairment? Preliminary results of a cross-sectional study. Plos ONE. 2012, 7 (1): e30627-10.1371/journal.pone.0030627. doi:30610.31371/journal.pone.0030627

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Rao SM, Leo GJ, Bernardin L, Unverzagt F: Cognitive dysfunction in multiple sclerosis. I. Frequency, patterns, and prediction. Neurology. 1991, 41 (5): 685-691. 10.1212/WNL.41.5.685.

    Article  CAS  PubMed  Google Scholar 

  48. Benedict RH, Cookfair D, Gavett R, Gunther M, Munschauer F, Garg N, Weinstock-Guttman B: Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc. 2006, 12 (4): 549-558.

    Article  PubMed  Google Scholar 

  49. Chiaravalloti ND, DeLuca J: Cognitive impairment in multiple sclerosis. Lancet Neurol. 2008, 7 (12): 1139-1151. 10.1016/S1474-4422(08)70259-X.

    Article  PubMed  Google Scholar 

  50. Benito-Leon J, Morales JM, Rivera-Navarro J: Health-related quality of life and its relationship to cognitive and emotional functioning in multiple sclerosis patients. Eur J Neurol. 2002, 9 (5): 497-502. 10.1046/j.1468-1331.2002.00450.x.

    Article  CAS  PubMed  Google Scholar 

  51. Amato MP, Grimaud J, Achiti I, Bartolozzi ML, Adeleine P, Hartung HP, Kappos L, Thompson A, Trojano M, Vukusic S, Confavreux C: European validation of a standardized clinical description of multiple sclerosis. J Neurol. 2004, 251 (12): 1472-1480. 10.1007/s00415-004-0567-0.

    Article  PubMed  Google Scholar 

  52. Bebbington PE, Angermeyer M, Azorin JM, Brugha T, Kilian R, Johnson S, Toumi M, Kornfeld A: The European Schizophrenia Cohort (EuroSC): a naturalistic prognostic and economic study. Soc Psychiatry Psychiatr Epidemiol. 2005, 40 (9): 707-717. 10.1007/s00127-005-0955-5.

    Article  PubMed  Google Scholar 

  53. DeLuca J, Barbieri-Berger S, Johnson SK: The nature of memory impairments in multiple sclerosis: acquisition versus retrieval. J Clin Exp Neuropsychol. 1994, 16 (2): 183-189. 10.1080/01688639408402629.

    Article  CAS  PubMed  Google Scholar 

  54. Hughes C, Kumari V, Soni W, Das M, Binneman B, Drozd S, O’Neil S, Mathew V, Sharma T: Longitudinal study of symptoms and cognitive function in chronic schizophrenia. Schizophr Res. 2003, 59 (2–3): 137-146.

    Article  PubMed  Google Scholar 

  55. Dickinson D, Ramsey ME, Gold JM: Overlooking the obvious: a meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia. Arch Gen Psychiatry. 2007, 64 (5): 532-542. 10.1001/archpsyc.64.5.532.

    Article  PubMed  Google Scholar 

  56. Achiron A, Barak Y: Cognitive changes in early MS: a call for a common framework. J Neurol Sci. 2006, 245 (1–2): 47-51.

    Article  CAS  PubMed  Google Scholar 

  57. Arnett PA, Randolph JJ: Longitudinal course of depression symptoms in multiple sclerosis. J Neurol Neurosurg Psychiatry. 2006, 77 (5): 606-610. 10.1136/jnnp.2004.047712.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Debouverie M, Pittion-Vouyovitch S, Brissart H, Guillemin F: Physical dimension of fatigue correlated with disability change over time in patients with multiple sclerosis. J Neurol. 2008, 255 (5): 633-636. 10.1007/s00415-008-0761-6.

    Article  PubMed  Google Scholar 

  59. Oken BS, Flegal K, Zajdel D, Kishiyama SS, Lovera J, Bagert B, Bourdette DN: Cognition and fatigue in multiple sclerosis: potential effects of medications with central nervous system activity. J Rehabil Res Dev. 2006, 43 (1): 83-90. 10.1682/JRRD.2004.11.0148.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors are grateful to all the patients for their participation in the study.

Funding sources

This work was supported by institutional grants from the French 2004 Programme Hospitalier Recherche Clinique and the French 2009 Institut de Recherche en Santé Publique (CUD-QV, Concepts, Usages et Déterminants en Qualité de Vie). The sponsor was represented by Assistance Publique, Hôpitaux de Marseille (Marseille, France). The funders had no role in study design, data collection and analysis, decision to publish, or manuscript preparation.

Author information

Authors and Affiliations

  1. EA3279 Self-perceived Health Assessment Research Unit and Department of Public Health, Aix-Marseille University, APHM, Marseille, France

    Karine Baumstarck, Mohamed Boucekine, Laurent Boyer, Anderson Loundou & Pascal Auquier

  2. EA 3273 Psychology of Cognition, Language, and Emotion Research Centre, Aix-Marseille University, Marseille, France

    Valérie Aghababian

  3. Department of Psychiatry, Sainte-Marguerite University Hospital, 13009, Marseille, France

    Nathalie Parola & Christophe Lançon

  4. Departments of Neurology and CRMBM CNRS6612, Timone University Hospital, APHM, Marseille, France

    Françoise Reuter & Jean Pelletier

Authors
  1. Karine Baumstarck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Boucekine
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Laurent Boyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Valérie Aghababian
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nathalie Parola
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Françoise Reuter
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Anderson Loundou
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Christophe Lançon
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jean Pelletier
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Pascal Auquier
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Karine Baumstarck.

Additional information

Competing interest

The authors declare that they have no competing interests.

Authors’ contribution

Conception and design: CL, JP, PA. Study coordination: KB, LB, CL, JP, PA. Inclusion and clinical data collection: CL, JP. Acquisition of cognitive data: VA, NP, FR. Analysis of data: KB, MB, AL. Interpretation of data: KB, MB, LB, VA, CL, JP, PA. Drafting and writing of manuscript: KB, PA. All the authors approved the manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article

Baumstarck, K., Boucekine, M., Boyer, L. et al. Quantification of relevance of quality of life assessment for patients with cognitive impairment: the suitability indices. BMC Neurol 14, 78 (2014). https://doi.org/10.1186/1471-2377-14-78

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2377-14-78

Keywords

BMC Neurology

ISSN: 1471-2377

Contact us