Email updates

Keep up to date with the latest news and content from BMC Medicine and BioMed Central.

Journal App

google play app store
Open Access Research article

Adaptation and validation of the Treatment Burden Questionnaire (TBQ) in English using an internet platform

Viet-Thi Tran123*, Magdalena Harrington4, Victor M Montori5, Caroline Barnes236, Paul Wicks4 and Philippe Ravaud2367

Author Affiliations

1 Department of General Medicine, Paris Diderot University, Paris, France

2 METHODS Team, Epidemiology and Statistics Sorbonne Paris Cité Research Centre, UMR 1153, INSERM, 1 place du Parvis Notre-Dame, Paris 75181, France

3 Centre d'Épidémiologie Clinique, HôpitalHôtel-Dieu, Assistance Publique-Hôpitaux de Paris, Paris, France

4 PatientsLikeMe, Inc., Cambridge, Massachusetts, USA

5 Division of Health Care and Policy Research, Department of Health Sciences Research and Knowledge and Evaluation Research Unit, Mayo Clinic, Rochester, MN, USA

6 Paris Descartes University, Paris, France

7 Department of Epidemiology, Columbia University Mailman School of Public Health, New York, NY, USA

For all author emails, please log on.

BMC Medicine 2014, 12:109  doi:10.1186/1741-7015-12-109

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1741-7015/12/109


Received:7 February 2014
Accepted:12 June 2014
Published:2 July 2014

© 2014 Tran et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Abstract

Background

Treatment burden refers to the workload imposed by healthcare on patients, and the effect this has on quality of life. The Treatment Burden Questionnaire (TBQ) aims to assess treatment burden in different condition and treatment contexts. Here, we aimed to evaluate the validity and reliability of an English version of the TBQ, a scale that was originally developed in French.

Methods

The TBQ was translated into English by a forward-backward translation method. Wording and possible missing items were assessed during a pretest involving 200 patients with chronic conditions. Measurement properties of the instrument were assessed online with a patient network, using the PatientsLikeMe website. Dimensional structure of the questionnaire was assessed by factor analysis. Construct validity was assessed by associating TBQ global score wıth clinical variables, adherence to medication assessed by Morisky’s Medication Adherence Scale (MMAS-8), quality of life (QOL) assessed by the PatientsLikeMe Quality of Life Scale (PLMQOL), and patients’ confidence in their knowledge of their conditions and treatments. Reliability was determined by a test–retest method.

Results

In total, 610 patients with chronic conditions, mainly from the USA, UK, Canada, Australia, or New Zealand, completed the TBQ between September and October 2013. The English TBQ showed a unidimensional structure with Cronbach α of 0.90. The TBQ global score was negatively correlated with the PLMQOL score (rs = −0.50; p < 0.0001). Low rather than moderate or high adherence to medication was associated with high TBQ score (mean [SD] TBQ score 61.8 [30.5] vs. 37.7 [27.5]; P < 0.0001). The treatment burden was higher for patients who had insufficient knowledge compared with those who had sufficient knowledge about their treatments (mean ± SD TBQ score 62.3 ± 31.3 vs. 47.8 ± 30.4; P < 0.0001) and conditions (63.0 ± 31.6 vs. 49.3 ± 30.7; P < 0.0001). The intraclass correlation coefficient for the retest (n = 282) was 0.77 (95% CI 0.70 to 0.82).

Conclusions

We found that the English TBQ is a reliable instrument in this population, and provide evidence supporting the construct validity for its use to assess treatment burden for patients with one or more chronic conditions in English-speaking countries.

Keywords:
Chronic Disease/therapy; Patient Participation; Quality of Life; Medication Adherence; Questionnaires

Background

Treatment burden is defined as the ‘work’ of being a patient and its effect on the quality of life (QOL) of patients. It represents the challenges associated with everything patients have to do to take care of themselves (e.g. medication intake, drug management, self-monitoring, visits to the physician, laboratory tests, lifestyle changes, administrative tasks to access and coordinate care) [1-3]. This work can represent a tremendous investment of time, attention, cognitive energy, and effort. For example, a patient with a chronic condition may spend 2 hours or more per day on health-related activities [4], and this increases for patients with multiple chronic conditions who receive treatment or recommendations for each of their diseases [5,6]. For these patients, treatment burden could be considered a crucial outcome for disease management [7]. Difficulties with their treatment are often not shared in depth by patients during medical consultations [8], and physicians are often not aware of the challenges their patients face in coping with everything asked of them [9]. Thus, a tool that is simple to understand and easy to administer is needed to identify overburdened patients in daily practice and for research, in order to design new therapeutic strategies that are both efficient and acceptable for patients.

The Treatment Burden Questionnaire (TBQ) is the only existing instrument that measures treatment burden without restricting its scope to a single condition or treatment context [9,10]. The TBQ is composed of 13 items rated on a Likert scale ranging from 0 (not a problem), to 10 (big problem). The TBQ was derived from a literature review and qualitative semi-structured interviews with patients in France. It assesses the burden associated with taking medicine, self-monitoring, laboratory tests, doctor visits, need for organization, administrative tasks, following advice on diet and physical activity, and social impact of the treatment. Item scores can be summed into a global score, ranging from 0 to 130. The instrument was first developed with a sample of patients with one or more chronic conditions, who were recruited from hospitals and general-practice clinics in France.

To measure treatment burden in English-speaking countries, the TBQ needs to be adapted: items must remain comprehensible without changing their original meaning, and it should be recognized that new items could arise in different contexts whereas some existing items might be irrelevant. Patients must be involved in the process to ensure that the resulting tool is clear and relevant [11].

In this study, we aimed to assess the validity and reliability of an English version of the TBQ intended to be used in both routine practice and in research for patients with at least one chronic condition living in the USA, Canada, UK, Australia, or New Zealand.

Methods

Adaptation and validation of the TBQ in English followed a multi-step approach recommended in the literature [12-14]: 1) review the conceptual evidence about treatment burden in English-speaking countries; 2) translate the TBQ into English; 3) pretest the instrument with patients to assess the relevance of items, clarity and wording and; 4) assess validity and reliability by a test–retest of the adapted instrument.

Conceptual evidence of treatment burden in English-speaking countries

During a literature review of MEDLINE via Pubmed, we identified several articles describing the concept of treatment burden in English-speaking countries. In the USA, Eton and colleagues identified three broad themes for treatment burden: 1) work patients must do to take care of their health, 2) problem-focused strategies to facilitate self-care, and 3) factors that exacerbate the perceived burden [2]. In the UK, Gallacher and associates found four similar themes in patients with chronic heart failure and stroke: 1) learning about treatments and their consequences, 2) engaging with others, 3) adhering to treatment and lifestyle changes, and 4) monitoring their treatments [15,16]. Finally, in Australia, Sav and associates identified four inter-related components of treatment burden: 1) financial, 2) time and travel, 3) medication, and 4) healthcare access burdens [17].

The original TBQ encompassed all of these domains, with the exception of the financial treatment burden, because in France, the public health insurance program guarantees healthcare free of charge for patients with chronic conditions. Therefore, we added a new item in the English adaptation of the TBQ: ‘How would you rate the financial burden associated with your healthcare (e.g., out-of-pocket expenses or expenses not covered by insurance)?’

Translation of the TBQ into English

Translation of the TBQ intoEnglish involved a classic ‘forward-backward’ translation method [13]. First, the original instrument in French was translated into English by two bilingual translators; one (CB) had a medical background, and was familiar with the concept of treatment burden. Second, the two obtained translations were synthesized and reviewed by a committee, which included the authors of the original questionnaire. Third, two different translators, blinded to the original version, back-translated the questionnaire into French. Finally, the committee reviewed and synthesized all translations to elaborate English items that were similar to the original items and easy to answer.

Pre-testing the instrument

To assess the relevance of items, clarity, and wording, we pre-tested the obtained instrument with a convenience sample of 200 participants in August 2013 (see Additional file 1). We used an internet platform, the Open Research Exchange (ORE) [18,19], to recruit patients on PatientsLikeMe (PLM) [20], an online network where 200,000 voluntary participants with chronic conditions share data about their treatment, conditions, and symptoms. Members of PLM join the site with the expectation that they will be participating in research. To participate, patients had to have at least one chronic condition (defined as requiring ongoing healthcare for at least 6 months). After having answered the questionnaire, they provided feedback about 1) the clarity, wording, and relevance of the items, and 2) any burden that they felt was not covered or insufficiently covered in the questionnaire in an open-ended manner. Their answers were categorized and discussed by two of the authors (VT-T and CB).

Additional file 1. Demographic and clinical characteristics of patients included in the pretest of the Treatment Burden Questionnaire (TBQ) (n = 200).

Format: DOCX Size: 14KB Download fileOpen Data

Concerning the wording of items, 10 patients (5.0%) felt that the word ‘constraints’ was confusing, thus we replaced the word ‘constraints’ by the word ‘problem’, as suggested by the patients. Patients were also asked whether there were any important elements of treatment burden that they considered to be missing from questions: 15 patients (7.5%) thought that relationships between patients and healthcare providers were insufficiently covered in the original items. Other suggestions were either specific to a particular condition, were related to the burden of disease, or were already covered in the existing items. Thus, we added a new item for testing: ‘How would you rate the difficulties you could have in your relationships with healthcare providers (e.g., feeling not listened to enough or not taken seriously)?’ After the pretest, the English TBQ was therefore composed of 15 items, with rating scales ranging from 0 to 10 and labeled anchors (‘not a problem’ and ‘large problem’).

Assessment of validity and reliability of the English TBQ

We studied the measurement properties of the instrument by 1) describing the item properties, 2) assessing factor structure, 3) assessing construct validity, and 4) assessing reliability by test–retest.

We recruited a convenience sample of patients via the aforementioned internet platform. Patients were eligible if they were 18 years or older, and had at least one condition that had required ongoing health care for at least 6 months. We sent email invitations to a random sample of 3,000 members on the internet platform who did not participate in the pretest and who met the eligibility criteria, encouraging them to connect to the website and complete the questionnaire. To increase the number of respondents, an email reminder was sent after 2 months. Patients consented electronically to participate in the study. The recruitment message outlined the purpose of the study and reminded patients that they were under no obligation to participate, that their aggregated results may be published. Because there were no anticipated adverse consequences for participation, institutional review board (IRB) approval was not sought for this project.

Item properties were described using three criteria: 1) proportion of missing answers, 2) relevance of items assessed by the proportion of ‘does not apply,’ and 3) score distributions.

Factor structure was investigated by exploratory factorial analysis. Scree plots were used to visualize a break between factors with large eigenvalues and those with smaller eigenvalues. Factors that appeared before the horizontal break were assumed to be meaningful. Internal consistency was assessed by Cronbach’s α [21], and was considered acceptable between 0.70 and 0.95 [22].

The global score of the TBQ (TBQ Global score) was the sum of the answers to each item. ‘Does not apply’ or missing answers were considered the lowest possible score (0) because we considered that a patient not concerned by a domain of treatment burden had no burden for that domain.

Construct validity was tested by confirming four pre-specified hypotheses. First, we expected a negative correlation between treatment burden (as measured by the TBQ global score) by the TBQ global score) and quality of life. Quality of life was measured by the PatientsLikeMe Quality of Life (PLMQOL) scale, a validated 24-item questionnaire assessing physical, mental, and social quality of life. PLMQOL scores range from 0 to 100 for each domain (higher scores indicating better quality of life) and are summed for a global assessment of quality of life [23]. Second, we predicted an association between TBQ global score and adherence to medication: the greater the treatment burden, the lower the adherence to treatment. Adherence to medical treatment was measured by Morisky’s Medication Adherence Scale 8 (MMAS-8) [24,25], a validated eight-item questionnaire, with scores ranging from 0 to 8. High adherence is a score of 8; medium adherence, 6 to 7; and low adherence, less than 6 [24]. Third, we hypothesized that patients with better knowledge of their conditions and treatments would have a low treatment burden. Confidence in patients’ knowledge about their treatments and conditions was assessed by two questions: ‘Do you think you have sufficient knowledge about your conditions (e.g., symptoms, disease progression)?’ and ‘Do you think you have sufficient knowledge about your treatments (e.g., possible side effects, expected benefits, other treatment options)?’. Answers were rated on a five-step scale: ‘very sufficient’, ‘sufficient’, ‘average’, ‘insufficient’ and ‘very insufficient’. Finally, we assumed a positive correlation between TBQ global score and the following clinical variables: 1) number of conditions, 2) drug administration (number of tablets, injections, and administrations per day), and 3) medical follow-up (number of different physicians, medical appointments per month, and hospitalizations per year).

To elicit the chronic conditions a patient had, we asked the patient to self identify the condition(s) from a list recommended as core for any measure of multimorbidity [26]. Options were presented as categories illustrated by common conditions; for example: ‘Rheumatologic disease (e.g. osteoporosis, arthritis, or inflammatory polyarthropathies)’. Patients were encouraged to complete their answer with free text. The text was analyzed, and the condition was categorized in the appropriate category by a single investigator (VTT).

The association between the TBQ global score, quality of life score and clinical variables was assessed by Spearman correlation coefficient (rs), which was considered high when greater 0.50, and moderate when 0.35 to 0.50 [27]. Wilcoxon and Kruskal-Wallis tests were used to compare qualitative variables across groups. P < 0.05 was considered statistically significant.

Reliability of the instrument was determined by a test–retest method. Patients were asked to complete the new instrument twice: at baseline and again after 2 weeks when they received an email reminder. Reliability was assessed by the intraclass correlation coefficient (ICC) for agreement [28], defined as the ratio of the subject variance by the sum of the subject variance, the rater variance and the residual. The 95% confidence interval (CI) was determined by a bootstrap method. Agreement was considered acceptable when ICC was greater than 0.60 [29]. Agreement was represented by Bland and Altman plots, which represent the differences between two measurements against the means of the two measurements [30].

Statistical analyses were performed using SAS (version 9.3; SAS Inst., Cary, NC, USA) and R (version 3.0 [31], the R Foundation for Statistical Computing, Vienna, Austria).

Results

In total, 3,000 patients were invited to complete the TBQ, and 610 (20.3%) did so between September and October 2013. The mean ± SD age was 51.5 ± 2.4 years. Patients resided mainly in the USA (57.5%), Canada (8.4%), UK (8.7%), and Australia/New Zealand (3.4%). Some patients (13.3%) lived in other countries (Belgium, Brazil, Chile, Czech Republic, Denmark, Finland, France, Germany, India, Ireland, Israel, Italy, Malaysia, Norway, Oman, Portugal, Russia, South Africa, Spain, Switzerland, Ukraine, and Uzbekistan), or the country of residence was missing (8.7%). The mean ± SD number of chronic conditions was 2.9 ± 1.9 (range 1 to 11) (Table 1).

Table 1. Demographic and clinical characteristics of patients in the validation study (n = 610) and retest of the Treatment Burden Questionnaire (TBQ) for an English-speaking population (n = 282)

We found a high completion rate (>99%) for all items. All items were relevant for all patients, with the proportion of ‘does not apply’ ranging from 0.6% to 7.2%, with the exception of the burden associated with self-monitoring (30.3%) (see Additional file 2). The TBQ global score was the sum of the answers to each of the 15 items, and ranged from 0 to 150 (‘Does not apply’ was considered the lowest possible score). The global score had a high correlation with the score for each item of the TBQ (rs = 0.47 to 0.71) (see Additional file 3).

Additional file 2. Item properties of the Treatment Burden Questionnaire (TBQ) (n = 610 patients).

Format: DOCX Size: 14KB Download fileOpen Data

Additional file 3. Correlation of each item of the Treatment Burden Questionnaire (TBQ) with the global score, omitting that item from the total (n = 610).

Format: DOCX Size: 13KB Download fileOpen Data

Factor structure, assessed by scree plots, favored a unidimensional instrument. The first factor explained 87% of the variance, and had an eigenvalue of 5.91. For subsequent factors, eigenvalues wereless than 0.80 (see Additional file 4).

Additional file 4. Scree plots and eigenvalues for the correlation matrix of the factor analysis (n = 610).

Format: DOCX Size: 28KB Download fileOpen Data

Construct validity showed a significant moderate negative correlation between the TBQ global score and PLMQOL score (rs = −0.50; P < 0.0001). Correlation coefficients ranged from rs = −0.39 (P < 0.0001) for physical quality of life to rs = −0.50 (P < 0.0001) for mental quality of life, indicating that patients with high TBQ score had low quality of life (Table 2). We found a significant association between treatment burden measured by the TBQ global score and adherence to medication measured by the MMAS-8: mean ± SD TBQ global score was 37.7 ± 27.5 for patients with high or moderate adherence, and 61.8 ± 30.5 for patients with low adherence (P < 0.0001) (Table 2). The TBQ score was also significantly associated with patients’ confidence in their knowledge about their treatments and conditions. The mean ± SD TBQ global score was 47.8 ± 30.4 for patients who felt that they had sufficient knowledge about their treatment, versus 62.3 ± 31.3 for those who felt that they had insufficient knowledge (P < 0.0001). The mean ± SD TBQ global score was 49.3 ± 30.7 for patients declaring sufficient knowledge about their conditions versus 63.0 ± 31.6 for those with insufficient knowledge (P < 0.0001) (Table 2). Finally, we found a low to moderate significant positive correlation of TBQ score with clinical variables in terms of number of different conditions, drug administrations (number of tablets, injections, and administrations per day) and medical follow-up (number of different physicians, medical appointments per month, and hospitalizations per year) (see Additional file 5).

Table 2. Association of adherence to medication, patients’ evaluation of their knowledge about their treatment and conditions and QOL with TBQ global score (n = 610)

Additional file 5. Correlation between treatment burden scores and clinical variables in terms of treatment workload (n = 610).

Format: DOCX Size: 13KB Download fileOpen Data

Reliability was assessed by a test–retest method for 282 patients (46%). Participants in the retest showed similar characteristics as patients in the test phase (Table 1). For the TBQ global score, the ICC for agreement was 0.77 (95% CI 0.70 to 0.82) (see Additional file 6). Bland and Altman plots for the global TBQ score showed a mean difference of −0.58; 95% limits of agreement −43.5 and 42.3 (Figure 1).

Additional file 6. Reliability testing by a test–retest method (n = 282).

Format: DOCX Size: 13KB Download fileOpen Data

thumbnailFigure 1. Bland and Altman plot of the test–retest reliability of the TBQ global score (n = 280).

Subgroup analysis showed a high TBQ global score for patients who needed equipment such as wheelchairs or canes (mean ± SD score 69.0 ± 33.4), those who received physical therapy (62.7 ± 33.9), and those who had gastrointestinal (65.4 ± 32.5) or skin (64.9 ± 30.8) diseases (see Additional file 7). TBQ scores did not differ for the most common healthcare location (public hospital, private hospital, general practice, or specialist clinic) (P = 0.97).Overall, treatment burden scores were homogeneous and comparable between countries. The lowest mean (SD) TBQ score was for the item related to self-monitoring (from 0.6 ± 1.1 in Canada to 1.7 ± 2.8 in Australia/New Zealand) and the highest was for the item related to the effect of healthcare on relationships with others (from 4.0 ± 3.5 in Canada to 6.7 ± 3.8 for Australia/New Zealand) (Figure 2).

Additional file 7. Treatment Burden Questionnaire (TBQ) global score by different subgroups (n = 610).

Format: DOCX Size: 13KB Download fileOpen Data

thumbnailFigure 2. Comparison of scores for TBQ items by country (n = 529)a.

Discussion

We adapted the TBQ for patients with one or more chronic conditions living in the USA, Canada, the UK, Australia, or New Zealand. This is the first valid and reliable instrument assessing treatment burden across multiple conditions and treatments.

During the adaptation process, we added two new items to the English TBQ that did not exist in the original study, which took place in France [9]. First, we added an item about the financial treatment burden. In France, the national health program guarantees healthcare free of charge for patients with chronic conditions. However, in countries where the English TBQ was administered, this is not always the case [10,17]. For example, 30% to 47% of patients in the USA may have problems paying medical bills [32]. Second, during the pretest, patients expressed difficulties that they had in their relationships with healthcare providers. This item was not included in the original French questionnaire because the authors felt that it measured a concept different from treatment burden. However, it was mentioned in subsequent qualitative studies [2,15,16] and, in the present study, participants insisted on including this item to take into account how discussion with physicians could affect how much they knew about their conditions and treatment, and how non-optimal relationships with healthcare providers could hinder adherence to treatment, lifestyle changes, or follow-up. During the first study, patients may have felt hindered in mentioning this issue to the investigators during face-to-face interviews and therefore the point was underestimated. Use of a web-based questionnaire has shown a decrease in socially desirable responses, and an increase in willingness to disclose sensitive information [33].

Our results highlight the advantages of using an internet platform: we were able to include 200 patients with chronic conditions from different countries in the pretest in less than 1 month. Therefore, we gathered rich qualitative data on questionnaire items and possible missing concepts, indicating the high content validity of our tool.

The item properties of the English TBQ were comparable with those from the original study in France with 1) a significant floor effect (>15%) for all items, which reflects that patients could have no burden in the aspects of their care that they have already integrated into their lives, and 2) about 30% of ‘Does not apply’ for the item related to self-monitoring. As for the original questionnaire in French, we chose to keep the item about self-monitoring because it was considered a mandatory item for other patients, particularly those with diabetes.

The validation study included 610 patients from different countries with different conditions and treatments. As hypothesized, we highlighted statistically significant associations between the overall treatment burden and adherence to medication, patients’ confidence in their knowledge about their conditions and treatment, and quality of life. To our knowledge, this is the first study to report such associations independent of disease or treatment contexts. Development of interventions to improve patient knowledge about therapeutic options could lead to shared decision making, reduced treatment burden,better adherence to medication, and better quality of life for patients.

We compared TBQ scores between countries and found that most item scores were homogeneous for patients in the USA, UK, Canada, and Australia/New Zealand, with two exceptions. First, we found increased financial treatment burden for patients residing in the USA and Australia. This result was expected because qualitative studies in these countries described the financial burden as one of the issues most widely discussed by patients [10,17]. Second, in the UK, we found increased treatment burden related to patients’ relationships with their healthcare providers. This finding could be related to pay-for-performance initiatives (for example, Quality and Outcomes Framework) that may encourage physicians to focus on biomedical objectives and spend less time listening to patients’ non-medical problems. More research is needed to understand the precise aspects of treatment burden, and why patients might experience different aspects in each of these countries.

This study has several limitations. First, to measure patients' confidence in their knowledge about their treatments and conditions, we used questions that were not validated. However, participants reviewed these questions during the pretest in the same way they reviewed the questions of the TBQ. Patients expressed no difficulties in answering these questions, and we found neither any missing answers, nor a floor or ceiling effect. Second, we recruited patients through the PLM website only, and from this patient group, only 20% of the invited patients responded to the web survey. This response rate was similar to that from other studies involving online surveys. This recruitment method might have selected patients willing to share their experiences with others and/or with severe or rare conditions. We did not include participants who were not able to access a computer. Therefore, our sample is not representative of the general population of patients with one or more chronic conditions: overall patients in our study were younger, more educated, and more often female (similar to other studies involving the PLM website [34-36]). Prevalence of chronic conditions in our study differed from those of chronic conditions of patients seeking healthcare in national surveys. For example, we found a high proportion of patients with neurological conditions, because PLM was initially developed for these patients. Although these biases were considered relatively small, psychometric properties for the TBQ (especially reliability estimates) might differ in other populations. Despite these limitations, use of an online platform has a number of advantages. First, we were able to involve a larger number of patients than in usual cross-cultural adaptation studies (800 participants including pretest) [37] in a very short time (2 months from pretest to results). Second, the recruited patients were geographically dispersed and thus, we might have avoided selecting only patients living near research centers. Finally, patients involved were engaged in research, and therefore provided us with rich feedback at every stage of our research, which may have contributed to the development of questionnaire items closer to patients’ own words and problems.

The present study advances the evidence of the validity of the TBQ. Further studies should focus on testing other psychometric properties such as responsiveness in longitudinal and prospective studies. The TBQ can be implemented in clinical trials assessing interventions intended to mitigate treatment burden and its negative effect on quality of life to develop a Minimally Disruptive Medicine [1].

Conclusions

We adapted and validated the TBQ for English-speaking countries (USA, UK, Canada, and Australia) using an online patient-based platform for direct interaction with patients. This study resulted in the first instrument assessing treatment burdenfor any condition and treatment context in these countries.

Competing interests

MH and PW are employees of PatientsLikeMe, and own stock or stock options in the company. The PatientsLikeMe research and development team has received research support from pharmaceutical companies and private foundations. VTT, VMM, CB and PR have no financial interests in PatientsLikeMe and no other conflicts of interest to disclose.

Authors’ contribution

VTT, MH, VMM, CB, PW, and PR conceived and designed the study. MH and PW acquired the data. VTT and CB analyzed and interpreted the data. VTT drafted the manuscript. MH, VMM, CB, PW, and PR critically revised the manuscript for important intellectual content. PR and PW provided administrative, technical, and material support. All authors saw and approved the final manuscript. PR is the guarantor, had full access to the data in the study, and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Acknowledgments

We thank Laura Smales (BioMedEditing), ADT International (Paris) and ISInfoglobal support (Barcelona) for editing and translation work, and Shimon Rura for help with data collection.

Funding

This study was funded by the French Health Ministry (PHRC AOM13127).

References

  1. May C, Montori VM, Mair FS: We need minimally disruptive medicine.

    BMJ 2009, 339:b2803. PubMed Abstract | Publisher Full Text OpenURL

  2. Eton DT, Ramalho de Oliveira D, Egginton JS, Ridgeway JL, Odell L, May CR, Montori VM: Building a measurement framework of burden of treatment in complex patients with chronic conditions: a qualitative study.

    Patient Relat Outcome Meas 2012, 3:39-49. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Eton DT, Elraiyah TA, Yost KJ, Ridgeway JL, Johnson A, Egginton JS, Mullan RJ, Murad MH, Erwin PJ, Montori VM: A systematic review of patient-reported measures of burden of treatment in three chronic diseases.

    Patient Relat Outcome Meas 2013, 4:7-20. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  4. Jowsey T, Yen L, PM W: Time spent on health related activities associated with chronic illness: a scoping literature review.

    BMC Public Health 2012, 12:1044. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  5. Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW: Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance.

    JAMA 2005, 294:716-724. PubMed Abstract | Publisher Full Text OpenURL

  6. Guthrie B, Payne K, Alderson P, McMurdo ME, Mercer SW: Adapting clinical guidelines to take account of multimorbidity.

    BMJ 2012, 345:e6341. PubMed Abstract | Publisher Full Text OpenURL

  7. Montori VM, Brito JP, Murad MH: The optimal practice of evidence-based medicine: incorporating patient preferences in practice guidelines.

    JAMA 2013, 310:2503-2504. PubMed Abstract | Publisher Full Text OpenURL

  8. Bohlen K, Scoville E, Shippee ND, May CR, Montori VM: Overwhelmed patients: a videographic analysis of how patients with type 2 diabetes and clinicians articulate and address treatment burden during clinical encounters.

    Diabetes Care 2012, 35:47-49. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Tran VT, Montori VM, Eton DT, Baruch D, Falissard B, Ravaud P: Development and description of measurement properties of an instrument to assess Treatment Burden among patients with multiple chronic conditions.

    BMC Med 2012, 10:68. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  10. Eton DT, Oliveira DR, Egginton J, Mair FS, May C, Montori VM: Understanding the burden of treatment in patients with multiple chronic conditions: Evidence from exploratory interviews.

    Qual Life Res 2010, 19:ab.

    1673

    OpenURL

  11. McKenna SP: Measuring patient-reported outcomes: moving beyond misplaced common sense to hard science.

    BMC Med 2011, 9:86. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  12. Acquadro C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials.

    Value Health 2008, 11:509-521. PubMed Abstract | Publisher Full Text OpenURL

  13. Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures.

    Spine (Phila Pa 1976) 2000, 25:3186-3191. PubMed Abstract | Publisher Full Text OpenURL

  14. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P: Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation.

    Value Health 2005, 8:94-104. PubMed Abstract | Publisher Full Text OpenURL

  15. Gallacher K, May CR, Montori VM, Mair FS: Understanding patients’ experiences of treatment burden in chronic heart failure using normalization process theory.

    Ann Fam Med 2011, 9:235-243. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Gallacher K, Morrison D, Jani B, Macdonald S, May CR, Montori VM, Erwin PJ, Batty GD, Eton DT, Langhorne P, Mair FS: Uncovering treatment burden as a key concept for stroke care: a systematic review of qualitative research.

    PLoS Med 2013, 10:e1001473. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  17. Sav A, Kendall E, McMillan SS, Kelly F, Whitty JA, King MA, Wheeler AJ: ‘You say treatment, I say hard work’: treatment burden among people with chronic illness and their carers in Australia.

    Health Soc Care Community 2013, 21:665-674. PubMed Abstract | Publisher Full Text OpenURL

  18. The Open Research Exchange [http://www.openresearchexchange.com webcite]

  19. Wicks P, Heywood B, Heywood J: Online platform to accelerate patient involvement in open instrument development.

    Qual Life Res 2013, 22:55. OpenURL

  20. PatientsLikeMe [http://www.patientslikeme.com webcite]

  21. Cronbach L: Coefficient alpha and the internal structure of tests.

    Psychometrika 1951, 16:297-334. Publisher Full Text OpenURL

  22. Nunnaly J, Bernstein I: Psychometric theory. 3rd edition. New York: McGraw-Hill; 1994. OpenURL

  23. Slawsky K, Massagli M, Wicks P: PRM30 a comparison of the PatientsLikeMe Quality of Life Questionnaire (PLMQOL) with the RAND SF-36.

    Value Health 2011, 14:A426. OpenURL

  24. Morisky DE, Ang A, Krousel-Wood M, Ward HJ: Predictive validity of a medication adherence measure in an outpatient setting.

    J ClinHypertens (Greenwich) 2008, 10:348-354. Publisher Full Text OpenURL

  25. Morisky DE, Green LW, Levine DM: Concurrent and predictive validity of a self-reported measure of medication adherence.

    Med Care 1986, 24:67-74. PubMed Abstract | Publisher Full Text OpenURL

  26. Diederichs C, Berger K, Bartels DB: The measurement of multiple chronic diseases–a systematic review on existing multimorbidity indices.

    J Gerontol A BiolSci Med Sci 2011, 66:301-311. OpenURL

  27. Juniper E, Guyatt G, Jaeschke R: How to develop and validate a new health-related quality of life instrument. In Quality of life and pharmacoeconomics in clinical trials. Edited by Spilker B. Philadelphia - New York: Lippincott - Raven; 1996:49-56. OpenURL

  28. Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability.

    Psychol Bull 1979, 86:420-428. PubMed Abstract OpenURL

  29. Streiner D, Norman G: Health Measurement Scales: a practical guide to their development and use, Fourth Edition edn. Oxford: Oxford University Press; 2008. OpenURL

  30. Bland JM, Altman DG: Measuring agreement in method comparison studies.

    Stat Methods Med Res 1999, 8:135-160. PubMed Abstract | Publisher Full Text OpenURL

  31. The R Project for Statistical Computing [http://www.R-project.org webcite]

  32. Ubel PA, Abernethy AP, Zafar SY: Full disclosure–out-of-pocket costs as side effects.

    N Engl J Med 2013, 369:1484-1486. PubMed Abstract | Publisher Full Text OpenURL

  33. Ekman A, Litton JE: New times, new needs; e-epidemiology.

    Eur J Epidemiol 2007, 22:285-292. PubMed Abstract | Publisher Full Text OpenURL

  34. Bove R, Secor E, Healy BC, Musallam A, Vaughan T, Glanz BI, Greeke E, Weiner HL, Chitnis T, Wicks P, De Jager PL: Evaluation of an online platform for multiple sclerosis research: patient description, validation of severity scale, and exploration of BMI effects on disease course.

    PLoS One 2013, 8:e59707. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Wicks P, Sulham KA, Gnanasakthy A: Quality of life in organ transplant recipients participating in an online transplant community.

    Patient 2014, 7:73-84. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. De la Loge C, Keininger D, Isojärvi J, Massagli MP, Wicks P: Characteristics of users of the epilepsy community of PatientsLikeMe.com and comparison with a representative claims database. In 63rd Annual Meeting of the American Academy of Neurology. Honolulu, USA; 2011. OpenURL

  37. Bowden A, Fox-Rushby JA: A systematic and critical review of the process of translation and adaptation of generic health-related quality of life measures in Africa, Asia, Eastern Europe, the Middle East, South America.

    Soc Sci Med 2003, 57:1289-1306. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1741-7015/12/109/prepub