Email updates

Keep up to date with the latest news and content from BMC Gastroenterology and BioMed Central.

Open Access Highly Accessed Research article

Acceptability, effectiveness, and cost-effectiveness of internet-based exposure treatment for irritable bowel syndrome in a clinical sample: a randomized controlled trial

Brjánn Ljótsson1*, Gerhard Andersson12, Erik Andersson1, Erik Hedman1, Perjohan Lindfors3, Sergej Andréewitch1, Christian Rück1 and Nils Lindefors1

Author affiliations

1 Department of Clinical Neuroscience, Division of Psychiatry, Karolinska Institutet, Stockholm, Sweden

2 Department of Behavioural Sciences and Learning; Swedish Institute for Disability Research, Linköping University, Linköping, Sweden

3 Department of Gastroenterology, Sabbatsberg hospital, Stockholm, Sweden

For all author emails, please log on.

Citation and License

BMC Gastroenterology 2011, 11:110  doi:10.1186/1471-230X-11-110

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-230X/11/110


Received:10 February 2011
Accepted:12 October 2011
Published:12 October 2011

© 2011 Ljótsson et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Internet-based cognitive behavior therapy (ICBT) has shown promising effects in the treatment of irritable bowel syndrome (IBS). However, to date no study has used a design where participants have been sampled solely from a clinical population. We aimed to investigate the acceptability, effectiveness, and cost-effectiveness of ICBT for IBS using a consecutively recruited sample from a gastroenterological clinic.

Methods

Sixty-one patients were randomized to 10 weeks of ICBT (n = 30) or a waiting list control (n = 31). The ICBT was guided by an online therapist and emphasized acceptance of symptoms through exposure and mindfulness training. Severity of IBS symptoms was measured with the Gastrointestinal symptom rating scale - IBS version (GSRS-IBS). Patients in both groups were assessed at pre- and post-treatment while only the ICBT group was assessed 12 months after treatment completion. Health economic data were also gathered at all assessment points and analyzed using bootstrap sampling.

Results

Fifty of 61 patients (82%) completed the post-treatment assessment and 20 of 30 patients (67%) in the ICBT group were assessed at 12-month follow-up. The ICBT group demonstrated significantly (p < .001) larger improvements on the IBS-related outcome scales than the waiting list group. The between group effect size on GSRS-IBS was Cohen's d = 0.77 (95% CI: 0.19-1.34). Similar effects were noted on measures of quality of life and IBS-related fear and avoidance behaviors. Improvements in the ICBT group were maintained at 12-month follow-up. The ICBT condition was found to be more cost-effective than the waiting list, with an 87% chance of leading to reduced societal costs combined with clinical effectiveness. The cost-effectiveness was sustained over the 12-month period.

Conclusions

ICBT proved to be a cost-effective treatment when delivered to a sample recruited from a gastroenterological clinic. However, many of the included patients dropped out of the study and the overall treatment effects were smaller than previous studies with referred and self-referred samples. ICBT may therefore be acceptable and effective for only a subset of clinical patients. Study dropout seemed to be associated with severe symptoms and large impairment. Objective and empirically validated criteria to select which patients to offer ICBT should be developed.

Trial Registration

ClinicalTrials.gov: NCT00844961

Background

Irritable bowel syndrome (IBS) is a functional bowel disorder characterized by recurring symptoms of abdominal pain or discomfort, accompanied by diarrhea or constipation [1]. For a majority of the affected, IBS is chronic and leads to impaired quality of life [2-4]. Compared to normal controls, IBS-patients are about three times more likely to be absent from work [5] and they utilize health care resources at almost double the cost [6]. Given the high prevalence of IBS, ranging between 5 and 11% [7], the societal costs of IBS are substantial [8].

Cognitive behavior therapy (CBT) is considered the most well-studied psychological treatment for IBS [9], but one limitation is that CBT is rarely available in routine care of IBS [10]. Several factors contribute to this, e.g. the lack of trained therapists, high costs of delivering the treatment, and the practical difficulties for patients of scheduling weekly visits at a clinic. To increase the availability of CBT for IBS, our research group has conducted two studies investigating CBT for IBS where participants had therapist contact via the internet (ICBT). In ICBT, patients learn about the treatment interventions by reading self-help texts that contain both educational material and instructions on how to perform the exercises that constitute the treatment. The general principle is that the treatment should reflect face-to-face therapy in terms of content, but using an online therapist to guide the participants through the course of the treatment. The format allows for large patient volumes to be treated and an increasing number of controlled studies indicate that for common psychiatric disorders ICBT is as effective as face-to-face delivered treatment [11-13]. In our trials of ICBT for IBS the treatment was found to be significantly more effective than a waiting list control condition [14] and a treatment based on stress and symptom management [15]. A follow-up study also showed maintenance of improvements over a 15-18 months period [16] and that the treatment was associated with considerable long-term societal cost-savings [17]. The treatment, which is based on exposure to IBS symptoms and mindfulness exercises, has also been evaluated in an uncontrolled pilot study using a group treatment format, showing similar effects [18].

These results indicate that an effective treatment can now be offered to a large number of IBS patients. However, the generalizability of our studies and other studies investigating CBT for IBS with reduced therapist time [19-22] is limited by the fact that study participants have mostly been recruited by referral and self-referral. It could be assumed that these methods of recruitment result in samples of IBS patients who are more willing and able to participate in a minimal contact therapy and who are also more responsive to CBT in general.

In the present study we offered the ICBT that we have previously evaluated with self-referred IBS patients [14,15] to consecutively recruited patients at a gastroenterological outpatient clinic. Our aim was to investigate the acceptability, effectiveness, and cost-effectiveness of the treatment for a representative sample of tertiary care IBS patients. Our primary hypothesis was that, compared to a waiting list, ICBT would lead to greater reductions in IBS-symptoms at the end of treatment. We also hypothesized that ICBT would be superior to a waiting list in terms of cost-effectiveness, improvement in symptom-related anxiety, quality of life, and general functioning. Additionally, the improvements gained from treatment were hypothesized to be maintained 12 months after treatment.

Methods

This study is reported in accordance with the CONSORT statement for non-pharmacological trials [23] and was approved by the regional ethics committee in Stockholm, Sweden.

Sample and recruitment

Power considerations

In our previous study of ICBT for IBS using a waiting list control, we had a between-groups effect size (Cohen's d) of 1.21 (95% CI: 0.73-1.66) on the primary outcome measure at post-treatment [14]. Based on the lower limit of the confidence interval, we powered this study to have an 85% chance to detect an effect size of at least 0.80, comparing treatment to a waiting list, on the primary outcome. This gave a sample of at least 30 participants per study condition.

Inclusion criteria

Participants were eligible for the study if they a) had their first visit at the recruiting clinic and were diagnosed during the recruitment period, b) had IBS symptoms as their primary reason for consultation, c) fulfilled Rome III-criteria for IBS [1], d) were between 18 and 65 years old, e) had no presence of current or previous inflammatory bowel disease, and f) lived in Stockholm County. Eligible patients were excluded if they g) reported debut of IBS symptoms after 50 years of age and were judged to require continued monitoring at the clinic, h) suffered from such severe diarrhea that IBS-symptom modifying drugs with psychotropic effects, such as tricyclic antidepressants or selective serotonin reuptake inhibitors, were judged to be the treatment of choice, i) could not read or write Swedish j) did not have access to the internet, k) were judged to be highly unsuitable for ICBT for somatic or psychological reasons as assessed by the gastroenterologist, or l) were not willing to participate in the study.

Recruitment procedure

All patients were consecutively recruited at a single gastroenterological clinic located in Stockholm, Sweden. Patients came to the clinic by referral or by self-referral. All patients who had their first visit at the clinic between November 19, 2008, and May 13, 2009 were eligible for the study. The recruitment ended in June 22, 2009, so the patients had to have been diagnosed before that date to be included in the study. As our aim was to recruit patients who attended a regular gastroenterological clinic and minimize selection bias, no information about the study was spread through advertisements or to other caregivers in Stockholm. Four gastroenterologists with 10 to 30 years of specialist experience were responsible for the recruitment. After diagnosing a patient with IBS and confirming eligibility criteria the gastroenterologist informed patients about the study. Patients who were willing to participate signed a written consent form. Some patients were contacted by telephone and offered to participate in the study. Reasons for telephone contact could be that the patient did not return for a second visit to receive their diagnosis, that he or she could not immediately decide whether to participate in the study, or that the gastroenterologist had omitted to inform the patient about the study during the visit at the clinic. Patients that agreed to participate in the study via telephone signed the written consent form at the ensuing psychiatric assessment (see below). All included patients were given standardized information about IBS and basic dietary and lifestyle advice on how to manage their IBS (i.e., treatment as usual). If appropriate they were also prescribed medication and/or given information about over-the-counter drugs. To ensure that this basic IBS management would have had its effect before patients begun their participation in the study, the pre-treatment assessment was conducted at least one month after inclusion.

After the recruitment period had ended, the study's coordinating gastroenterologist (P.L.) reviewed all visits at the clinic during the recruitment period to check if all eligible patients had been considered for the study. The clinic's computerized medical record system allowed us to filter out all patients who did not fulfill eligibility criteria. A total of 456 patients had their first visit at the clinic during the recruitment period, and 131 of these were eligible according to their medical record. However, for 16 eligible patients there were no indications that they had been considered for the study and it could not be determined why they had not been included. Upon reviewing the records of these 16 patients, no obvious biases were found that could explain these breaches of the study protocol. Of the 115 patients that were considered for the study, 35 were excluded based on criteria g-j (reasons for exclusion are detailed in Figure 1), 5 patients could not be reached by telephone within the recruitment period, and 75 were included in the study. Of the 75 patients that were included at the clinic, 14 withdrew in the period between inclusion and pre-treatment assessment (reasons for withdrawal are given in Figure 1) and 61 were randomized. Demographics for the randomized participants are given in Table 1 and participant flow through the study is detailed in Figure 1.

thumbnailFigure 1. Participant flow through the trial.

Table 1. Sample characteristics

Randomization

Randomization was performed by sending a list of anonymous participant identification numbers to one of the co-authors (E.H.) who had no involvement in the recruitment, administration, assessment, or treatment of the patients. A true random number service (http://www.random.org webcite) was used to allocate the participants to either ICBT or waiting list, using simple randomization with no restrictions. After randomization the anonymous participant identification numbers were returned together with their allocation to the first author who coordinated the study (B.L.). Since all outcomes that were waiting list controlled were self-assessed, there was no concealment of allocation.

Treatment condition

The ICBT in this study is based on a treatment protocol that has been evaluated previously in group format and delivered via internet [14,15,18]. The treatment aims to break the vicious cycle between avoidance behaviors, symptom severity, and functional impairment. It is based on the proposed central role of symptom-related fear and associated avoidance behaviors in IBS [24]. Since fear alters motility [25] and directs attention towards threat [26], the association between symptom-related stimuli and fear constitutes a solid foundation for positive feedback loops between stress and IBS symptoms, as well as an increased awareness of symptoms. Use of avoidance behaviors to cope with this fear may also lead to long-term aggravation of symptoms because of increased general stress and strengthened negative valence of symptoms. Several studies have confirmed the impact of symptom-related fear and avoidance behaviors on symptom severity and quality of life in IBS [24,27-30].

In comparison to other CBT-protocols for IBS, the main unique feature of the CBT in this study is its strict reliance on acceptance of IBS symptoms and related cognitions and feelings through exposure exercises combined with mindful awareness. It is inspired by the "third wave" of CBT that includes treatments such as acceptance and commitment therapy (ACT) and dialectic behavior therapy (DBT)[31]. In this treatment, exposure is proposed to serve two purposes. Similarly to how exposure has been used in other studies of CBT for IBS [21,32,33], it will result in long-term extinction of the fear response to IBS-related stimuli, leading to reduction in symptoms. But in accordance with reasoning within ACT [31,34], exposure also serves to increase behavioral flexibility in the presence of IBS-related stimuli, while being aware of and accepting the feelings elicited by the stimuli. By practicing a behavioral repertoire that is not influenced by fluctuations in IBS symptoms and mood, patients will perceive symptoms as less threatening to their ability to function.

The treatment also includes mindfulness training. Mindfulness-based stress reduction for IBS has been evaluated in two recent studies [35,36] with mixed results. While patients in both studies experienced improvement in quality of life only one of the studies demonstrated effects on IBS symptoms [36]. Mindfulness training in this treatment does not serve to decrease stress but rather to practice acceptance of aversive inner experiences while engaging in flexible and more functional behavioral responses to these experiences, similarly to how it is used in ACT and DBT [37,38].

The treatment in this study lasted for 10 weeks and was divided into five successive steps. The content of each step is presented in Table 2. Patients had to report that they had worked through a treatment step to get access to the next. Patients were encouraged to work through steps 1-4 during the first half of the treatment and to spend the latter half of the treatment on step 5, in which exposure exercises were introduced. The number of patients in the treatment group reaching each step is presented in Table 2. During treatment, patients also had access to an online closed discussion forum where they could discuss their treatment with each other.

Table 2. Description of the treatment steps and number of patients reaching each step

Three clinical psychologists managed the online therapeutic contact in this study. Therapist contact was usually initiated by the participants who were encouraged to send at least one message per week about their work with the treatment to their therapist. Patients were given feedback within 1-2 days after they had posted a message. On average, patients sent 8.2 (SD = 4.7, range 0-18) messages to their therapist and received 11.8 (SD = 5.7, range 1-21) messages from their therapist. The therapists spent a weekly mean of 7.3 minutes (SD = 5.2, range 0-24.5) per patient. Three types of feedback were generally given by the online therapists: 1) Corrective psychoeducational information if the patient's answers indicated that he/she had not fully grasped the rationale for the treatment. 2) General support to maintain or increase the intensity of the patient's work with the treatment. 3) Guidance on how to perform and evaluate the exercises prescribed by the treatment.

Waiting list condition

Patients randomized to waiting list were crossed over to treatment after the post-treatment assessment was concluded. During the waiting list period these patients were also offered the opportunity to communicate with each other using an online closed discussion forum. The discussion forum was included as a basic control for the effects of weekly activity and attention. Online discussion forums have been shown to alleviate distress associated with breast cancer [39]. However, there was almost no discussion forum activity in the waiting list condition.

Data collection

All measures were administered online, a method which has been shown to be reliable and as valid as traditional paper-and-pencil administration [40,41]. The outcome measures were assessed at three time points; pre-treatment, post-treatment, and 12-month follow-up (ICBT only). Additional data that are not part of this report were also collected. Waiting list group participants completed assessments immediately after and 12 months after having been crossed over to and finishing treatment. Psychiatric assessments of all patients were also conducted before randomization and at 12-month follow-up. This psychiatric assessment, which was performed during a visit at a psychiatric clinic in Stockholm, was not part of the inclusion process and did not guide the treatment intervention.

Primary outcome

The primary outcome measure of the study was the Gastrointestinal Symptom Rating Scale-IBS version (GSRS-IBS) [42]. The GSRS-IBS is a version of the Gastrointestinal Symptom Rating Scale [43] extended with questions about Rome I-criteria for IBS. The GSRS-IBS comprises 13 items covering severity of gastrointestinal symptoms, including pain, bloating, diarrhea, constipation, and satiety. Each item is scored between 1 (no discomfort at all) and 7 (very severe discomfort), rendering a total score between 13 and 91. The GSRS-IBS has demonstrated adequate psychometric properties for the different symptoms that are assessed, with an internal consistency (Chronbach's α) ranging between .74 and .85 [42]. Since IBS symptoms are known to vary considerably over time [44], the mean score of four weekly assessments of GSRS-IBS was used to get reliable estimates of the participants' symptom levels at each assessment point.

Secondary outcomes

Health economic data were collected using the Trimbos and Institute of Medical Technology Assessment Cost Questionnaire for Psychiatry (TIC-P) [45]. This questionnaire assesses monthly health care consumption (direct medical costs) and time spent in other health promoting activities (direct non-medical costs). The TIC-P also assesses monthly sick-leave, reduced work capacity at work and in the domestic realm, and employment status (indirect non-medical costs).

The Irritable Bowel Syndrome Quality of Life Instrument (IBS-QOL) [46] was used to assess the impact on quality of life for patients with IBS, and includes domains such as dysphoric thoughts, symptoms interference with activity, food avoidance, and impact on relationships. The IBS-QOL consists of 34 items scored between 1 and 6 and the total score is transformed to a 0 to 100 scale, where 0 represents minimum quality of life and 100 represents maximum quality of life. The IBS-QOL shows high internal consistency (Chronbach's α = .95) and test-retest reliability (r = .86) [46].

The Visceral Sensitivity Index (VSI) [28] measures the cognitive, affective, attentional, and behavioral dimensions relating to fear of IBS symptoms and associated situations. The VSI comprises 15 items that are scored between 0 and 6, with a total score between 0 (minimum GSA) and 75 (maximum GSA). The VSI has demonstrated high internal consistency (Chronbach's α = .90 - .92) [28] and most notably it has been shown to be a key explanatory variable in predicting IBS diagnostic status [24].

The Sheehan Disability Scales [47] assess symptom induced disability in three domains: social, work, and family from 0 (no disability) to 10 (severe disability), with a total score between 0 and 30. The Sheehan Disability Scales show high internal consistency with Chronbach's α = 0.89 [48].

At 12-month follow-up patients were also asked what type of health care, if any, they had utilized because of IBS-symptoms since the treatment had ended.

Analysis

Main outcome continuous variables were analyzed in SPSS 19 using a linear mixed effects model fitted with full information maximum likelihood estimation (FIML) [49]. Linear mixed models take into account the non-independence of repeated-measures data and individual heterogeneity by including random effects in the model. The superior qualities regarding missing data as well as increased power compared to the traditional repeated measures ANOVA make mixed models the preferred choice for longitudinal data analysis [50]. Linear mixed models were used to examine the difference in rates of change between the ICBT and waiting list from pre- to post-treatment as the fixed effects interaction between group and time. Model selection was determined analytically by means of likelihood ratio tests and included random intercepts. Error terms were held equal across time and were not correlated. Mixed models were also used to examine the effect of time between post-treatment and 12-month follow-up for the ICBT group. Sensitivity analyses were conducted by including treatment seeking within the follow-up period as a covariate in the analyses. These models used the same covariance structures as above.

All available data from all participants and measurement points were used, which made this an intent-to-treat analysis. Under the assumption of data missing at random (MAR), FIML provides unbiased parameter estimates compared to traditional methods (such as last observation carried forward) even with a substantial proportion of missing data [51]. FIML under the assumption of MAR requires that observed variables that are associated with the likelihood of data missingness are included in the analysis [52]. Prior to conducting the primary analysis, the missing data mechanism was assessed by exploring the relationships between baseline characteristics and the presence of missing data in the sample.

All confidence intervals are given with a 95% margin. Between-groups effect sizes were calculated as standardized mean differences (Cohen's d). Conservative estimates of effect sizes were obtained by replacing missing post-treatment data with pre-treatment data.

Cost-effectiveness analysis

The same methodological approach in the cost-effectiveness analysis as in our previous study [17] was used to make the results comparable across studies. Self-reports from TIC-P were used to estimate the costs generated by the participants. Medication costs were based on the market price in Sweden. Costs of health care visits were estimated using national tariffs in Sweden. Productivity losses were based on the human capital approach, which means that the value of reduced work productivity were calculated using average gross earning [53]. Gross earnings were estimated using the average salary in Sweden by education level. Domestic losses were estimated at $ 13.17 in accordance with our previous study [17] and originally estimated by Smit et al. [54]. Costs were converted to US$ using purchasing power parities for the reference year 2010 [55]. The statistical cost data analyses were conducted using STATA 11/IC and SPSS 19 in three steps:

First, cost means between treatment and control group at pre-treatment, post-treatment and at 12-month follow-up were estimated. Similar to our previous study [17], missing cost data was imputed in a last-observation-carried-forward manner, and all costs were extrapolated to a 12-month period. ANCOVA with post-treatment costs as dependent variables and pre-treatment costs as covariates were conducted to assess between-group differences in change from pre- to post-treatment. Paired t-tests were used to test within-group differences from pre- to post-treatment. Bootstrap replications (5000 replications) were used as we expected the cost-data to be non-normally distributed [56].

Second, incremental cost-effectiveness ratio (ICER) was estimated computing differences in costs and effects between both conditions: (C(ICBT) - C(WL))/(E(ICBT) - E(WL)). C refers to the pre-post cost differences and E is the proportion of patients showing clinically significant improvement in both conditions [53]. Similarly to our previous cost-effectiveness study, clinically significant improvement was defined as at least 50% symptom reduction on the GSRS-IBS. This calculation was repeated 5000 times (for each bootstrap sample) generating a scatter of simulated ICERs, which represents the probability of the treatment being cost-effective. Figure 2 presents a scatterplot of the simulated ICERs. If a majority of the ICERs appear in the southeast quadrant of the figure, lower societal costs are achieved alongside beneficial health gains. From a cost-effectiveness perspective, this is the most favorable outcome. ICERs located in the northeast quadrant indicate that better health gains are achieved with ICBT but to higher societal costs compared to no treatment. ICERs in the northwest quadrant indicate that ICBT is inferior to no treatment and results in higher societal costs. ICERs located in the southwest quadrant indicate that ICBT is associated with inferior health gains but produces lowered societal costs compared to no treatment.

thumbnailFigure 2. Cost-effectiveness plane.

Third, the economic long-term impact using 12-month follow-up data was investigated. Since there was no experimental control at 12-month follow-up, the treatment group's follow-up data was imputed and compared with the post-treatment data of the control group. This was done to test whether the extrapolation to a 12-month period was a reliable analysis procedure.

Exploratory analysis

Clinical guidelines recommend that IBS patients should be referred to psychological treatments if they show anxiety, activity disruption or poor coping strategies [7,57]. Since patients were recruited without taking these factors into consideration, we tested whether low levels of anxiety and poor coping strategies (as measured by the VSI) or activity disruption (as measured by the IBS-QOL and Sheehan Disability Scales) predicted low treatment response (as measured by change score on the GSRS-IBS from pre- to post-treatment). This was done in two ways. First, median split was used to compare the outcome between patients with scores above the median and patients below the median on each of the predictor variables, using t-tests. Second, each of the predictor variables was correlated with the outcome, while controlling for the pre-treatment value of GSRS-IBS. These analyses were only performed on the ICBT patients who participated in the post-treatment assessment.

Results

Missing data

A total of 50 of the 61 randomized patients (82%) completed the post-treatment assessment, 23 of 30 (77%) in the ICBT group and 27 of 31 (87%) in the waiting list. Statistical tests of baseline characteristics showed that patients with missing data tended to score higher on GSRS-IBS (m = 48.1, SD = 12.5 vs. m = 40.9, SD = 11.2; t60 = 1.90, p = .06) than patients that completed the post-treatment assessment. Within the ICBT condition, patients that dropped out scored lower on the IBS-QOL at pre-treatment (m = 52.2, SD = 26.1 vs. m = 72.0, SD = 17.1; t28 = 2.36, p = .03). The pre-treatment scores of GSRS-IBS and IBS-QOL were therefore included as candidate covariates in the analyses. If these variables significantly improved the model they were retained in the final model. Of the 30 patients in the ICBT group, 20 (67%) completed the 12-month follow-up assessment. One of these patients did not complete the post-treatment assessment, but was included in the analysis of change between post-treatment and follow-up resulting in 24 patients in this analysis. Of these 24 patients 5 had missing data at either post-treatment or 12-month follow-up. Because of the small groups, no analyses were conducted to examine baseline differences between the 5 patients with missing data and the 19 with complete data.

Group comparisons

Results on the outcome measures at pre- and post-treatment for both groups are displayed in Table 3 together with coefficients for the fixed effects of group, time, interaction effect of group and time, and retained pre-treatment covariates. The mixed effect models demonstrated significant interaction effects between group and time on all outcome measures. The between groups effect sizes at post-treatment were in the upper medium range (d = 0.73-0.79) for all measures except the Sheehan Disability Scales (d = 0.19). Replacing missing post-treatment data with pre-treatment data yielded considerably lower effect sizes on the GSRS-IBS (d = 0.23), IBS-QOL (d = 0.26), and VSI (d = 0.26) and a negligible between-groups effect on Sheehan Disability Scales (d = -0.05).

Table 3. Continuous outcome measures

Follow-up

Table 3 displays the 12-month follow-up scores for the ICBT group. The mixed effects models gave only one significant effect of time, on the IBS-QOL (B = 4.5, t20.1 = 2.2, p = .04). This positive coefficient indicates further improvement on the IBQ-QOL for the ICBT group during the follow-up period while scores on the other outcome measures were maintained. There were no significant effects of time on the GSRS-IBS (B = -2.4, t18.7 = -1.1, p = .27), VSI (B = -0.4, t19.5 = -0.26, p = .80), or the Sheehan Disability Scales (B = -1.4, t21.6 = -1.2, p = .25).

Seven of the 20 patients (35%) reported further treatment seeking because of IBS during the follow-up period, 6 had consulted a physician and 1 had sought complementary treatment, none had sought further psychological treatment. Sensitivity analysis did not indicate any effect of further treatment seeking on maintenance of improvement during the follow-up period.

Cost-effectiveness

Annual cost means are presented in Table 4. We found no significant between-group interaction effects for any cost domain, but a trend regarding work-cutback (F = 3.17, p = .08) favoring the ICBT condition was observed. Paired t-tests showed a within-group cost reduction in domestic loss (p = .01) and reduced medication costs (p = .05) for the ICBT condition. The control group made a significant increase in costs related to work-cutback (p = .03). There were no within-group differences for the treatment group between post-treatment and the 12-month follow-up.

Table 4. Mean annual costs

The cost change for the treatment group was $17,808 - $15,014 = -$2,794 and the cost change in the control group was $15,542 - $18,323 = $2,781. Clinically significant improvement was demonstrated by 6 of 30 (20%) patients in the treatment group and 2 of 31 (6%) patients in the waiting list. The incremental cost effectiveness ratio (ICER) was therefore (-2,794 - 2,781)/(0,20 - 0,06) = -39,821. This means that each significant clinical improvement in IBS was associated with a societal cost-reduction of $39,821. The cost-effectiveness plane (Figure 2) gives a more detailed view of the data: 87% of the ICERs were located in the southeast corner, indicating that ICBT was associated with societal cost reductions and also produced health gains compared to the waiting list. There was an 8% probability of the treatment producing superior health gains but to higher societal costs (northeast quadrant). Only 4% and 1% of the ICERs were located in the least favorable quadrants, the southwest and northwest, respectively.

We repeated the analyses and imputed 12-month follow-up data for the treatment group and compared it with the waiting list's post data. A majority (79%) of the ICERs remained in the southeast corner, indicating robustness of the results.

Prediction of outcome

The VSI, IBS-QOL and Sheehan Disability Scales were used to test if low values predicted low improvement on the GSRS-IBS. Using median split the difference in outcome between high and low scorers on the IBS-QOL, VSI, and SDS were not significant (p = .11 - .23). When the predictors were correlated with the symptom improvement score, controlling for GSRS-IBS baseline score, none significantly predicted the change in GSRS-IBS (p = .12 - .50, r = .15 - .34).

Discussion

The aim of this study was to evaluate the acceptability, effectiveness, and cost-effectiveness of a treatment previously demonstrated to be efficacious in treating a self-selected sample of IBS patients [14,15]. Patients in this study were consecutively recruited from a gastroenterological clinic and were randomized to ICBT or a waiting list. There was considerable dropout in the study, with only 77% of the ICBT patients participating in the post-treatment assessment and 43% completing the treatment. Compared to the waiting list, the ICBT participants experienced reductions in IBS symptoms, anxiety related to IBS symptoms, as well as improvements in IBS-related quality of life. The effects were more pronounced on the IBS-specific measures than the general measure of daily functioning, probably owing to low pre-treatment values on this measure. Despite the large dropout from the ICBT condition, the treatment produced societal cost-savings compared to the waiting list. Additionally, the cost-savings offset the treatment costs both in short- and long-term.

In our previous trial where we used a waiting list as comparison group, the between-groups effect on GSRS-IBS (d = 1.21) [14] was larger than the between-groups effect observed in this trial (d = 0.77). Using conservative estimates, by replacing the missing data with pre-treatment assessments, the between-group effect sizes were even lower. Because of the large proportion of missing data and the fact that patients that dropped out were more impaired than the patients that stayed in the trial, the conservative effect sizes are highly influenced by the dropouts. Still, they indicate that for the whole randomized sample, ICBT was clearly less effective than in our previous studies.

The acceptability of ICBT, as measured by the proportions of patients in the ICBT group that stayed in the study (77%) and completed treatment (43%), also differed between this study and our previous studies. In these, 90%-99% of participants completed the post-treatment assessment [14,15] and 69% of the participants completed all five treatment steps [14]. In addition, while 14 of 75 included patients (19%) withdrew from this study before randomization, 0%-3% withdrew from our previous studies after inclusion [14,15].

These differences in effectiveness and acceptability are likely linked to the differences in recruitment method. In our study of group CBT for IBS [18], gastroenterologists at several clinics referred patients that they judged would benefit from treatment and in our previous studies of ICBT [14,15], patients were self-referred. It would be reasonable to assume that the patients in this study, who were offered to participate simply because they visited a gastroenterological clinic, would be less motivated to engage in treatment. Exposure treatment demands a lot from patients and ICBT also requires them to work independently with planning and conducting the exposure exercises. This may have been too challenging for some patients who might not have applied for the study if we would have used self-referral as recruitment method.

According to clinical guidelines, IBS patients with anxiety, poor coping strategies, or functional impairment should be offered psychological treatment [7,57]. Indeed, a recent study showed that improvement after CBT for IBS was mediated through change in avoidance behaviors and negative thoughts about symptoms [58] and that less adaptive IBS behaviors predicted good outcome [59]. However, in this study we did not observe this association. It seems that patients who displayed comparably low levels of avoidance still experienced symptom improvement by changing these behaviors. The study does suggest that large impairment and severe symptoms may be predictive of treatment dropout. However, our previous studies point in another direction. The average pre-treatment scores on GSRS-IBS and IBS-QOL were markedly higher in those studies than in this study, while participants showed larger improvement and treatment adherence [14,15]. This is in accordance with research demonstrating that IBS patients recruited through the internet are more impaired than clinical patients [60]. Thus, it seems that the method of recruitment is more predictive of treatment outcome than symptom severity and level of impairment. More research is needed to establish what minimum level of avoidance behaviors that is required to benefit from a treatment that targets these behaviors. Other types of psychological treatments for IBS, such as hypnosis, self-management, psychodynamic therapy, and cognitive therapy, may target other mechanisms and require other selection criteria.

An important limitation in this study is our use of a waiting list as a comparison group. Although this practice is common in trials of psychological treatments it has been criticized as it does not control for non-specific factors such as expectancy of improvement and attention from a caregiver [61]. Several trials of psychological treatments for IBS have failed to show differential effects on symptoms when using attention control conditions [32,62-64], and a recent study showed that IBS patients even respond to open-label placebo [65]. These studies underline the need for an active control group when evaluating psychological treatments for IBS. However, ICBT did show superiority to an active control in our previous study where 195 self-referred IBS patients were randomized to ICBT or internet-delivered stress management [15].

Another limitation is that although our aim was to evaluate the treatment for a clinical sample, it was not carried out within a clinical context. Patients had to participate in an extensive pre-treatment assessment, including a psychiatric evaluation and four weeks of weekly symptom ratings, and were then randomized to treatment or waiting list. These circumstances are seldom part of clinical care and may have contributed to the high dropout rate. We did not include patients who had severe diarrhea and were therefore judged to require prescription of psychotropic drugs. Eleven of the 131 eligible patients (8%) were excluded from the study for this reason. It would have been preferable to prescribe the drug and after evaluation of its effects possibly offer these patients participation in the study. However, for practical reasons this was not possible, as it would have altered the inclusion procedure and time frame. This further limits the generalizability of the results regarding these patients.

The cost-effectiveness analysis also has some limitations. We did not use the actual salary of the patients but estimated them based on educational levels. This produces errors in the estimated costs but should not affect the ICER as it relies on the randomization. Further, we estimated the cost of treatment based only on the amount of therapist time. This estimation does not include the cost of writing the treatment manual or developing the web platform used for delivering the ICBT, nor does it include the overhead costs of running an ICBT treatment clinic.

Conclusions

This study shows that ICBT for IBS, based on exposure principles, can be an effective treatment option for some patients at a tertiary care clinic. Patients with large impairment and severe symptoms may be less able or willing to engage in ICBT. From a cost-effectiveness perspective, offering ICBT to clinical patients seems to lead to considerable societal savings compared to no further treatment after regular clinical care, even with large dropout rates and low treatment adherence. For patients that benefit from the treatment, improvements are maintained over a 12-month period. More research is needed to clarify for which patients ICBT based on exposure and mindfulness exercises is best suited.

Abbreviations

CBT: Cognitive Behavior Therapy; FIML: Full Information Maximum Likelihood; GSA: Gastrointestinal Specific Anxiety; GSRS-IBS: The Gastrointestinal Symptom Rating Scale - IBS version; IBS-QOL: The Irritable Bowel Syndrome Quality of Life Instrument; IBS: Irritable bowel syndrome; ICBT: Internet-delivered Cognitive Behavior Therapy; ICER: Incremental Cost Effectiveness Ratio; MAR: Missing At Random; VSI: The Visceral Sensitivity Index

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

BL participated in the design of the study, supervised the treatment of the patients, coordinated the study, and had the main responsibility for writing the treatment manual, conducting data analyses, and drafting of the manuscript. GA participated in the design of the study, analysis of the data, and drafting of the manuscript. EA participated in the design of the study, analyzed the health economic data, and participated in drafting of the manuscript. EH participated in the design of the study, writing the treatment manual, analysis of the data, and drafting of the manuscript. PL supervised the patient recruitment and participated in the design of the study and drafting of the manuscript. SA participated in the design of the study, assessment of the patients, and drafting of the manuscript. CR participated in the design of the study, assessment of the patients, and drafting of the manuscript. NL had main responsibility for designing the study and participated in drafting of the manuscript. All authors read and approved the final manuscript.

Acknowledgements and funding

The authors wish to thank psychologists Lisa Falk, Sara Rydh, and Evelyn Andersson who worked as online therapist, doctors Lars Kjellström, Tom Lindfors, and Arnold Söderlind for recruiting the patients, nurse Monica Hellberg for coordinating the study, and Hugo Hesser for statistical consultation.

This study was funded by the Stockholm City Council, the Stockholm Centre for Psychiatry Research, Linköping University, the Söderström-Königska Foundation, and the Bror Gadelius Foundation. The main funding organization (Stockholm County Council) is a public institution and none of the funding organizations had any role in the design and conduct of the study; in the collection, management, and analysis of the data; or in the preparation, review, and approval of the manuscript.

References

  1. Longstreth GF, Thompson WG, Chey WD, Houghton LA, Mearin F, Spiller RC: Functional bowel disorders.

    Gastroenterology 2006, 130(5):1480-1491. PubMed Abstract | Publisher Full Text OpenURL

  2. Halder SL, Locke GR, Talley NJ, Fett SL, Zinsmeister AR, Melton LJ: Impact of functional gastrointestinal disorders on health-related quality of life: a population-based case-control study.

    Aliment Pharmacol Ther 2004, 19(2):233-242. PubMed Abstract | Publisher Full Text OpenURL

  3. Ford AC, Forman D, Bailey AG, Axon AT, Moayyedi P: Irritable bowel syndrome: a 10-yr natural history of symptoms and factors that influence consultation behavior.

    Am J Gastroenterol 2008, 103(5):1229-1239.

    quiz 1240

    PubMed Abstract | Publisher Full Text OpenURL

  4. Koloski NA, Talley NJ, Boyce PM: The impact of functional gastrointestinal disorders on quality of life.

    Am J Gastroenterol 2000, 95(1):67-71. PubMed Abstract | Publisher Full Text OpenURL

  5. Drossman DA, Li Z, Andruzzi E, Temple RD, Talley NJ, Thompson WG, Whitehead WE, Janssens J, Funch-Jensen P, Corazziari E, et al.: U.S. householder survey of functional gastrointestinal disorders. Prevalence, sociodemography, and health impact.

    Dig Dis Sci 1993, 38(9):1569-1580. PubMed Abstract | Publisher Full Text OpenURL

  6. Talley NJ, Gabriel SE, Harmsen WS, Zinsmeister AR, Evans RW: Medical costs in community subjects with irritable bowel syndrome.

    Gastroenterology 1995, 109(6):1736-1741. PubMed Abstract | Publisher Full Text OpenURL

  7. Spiller R, Aziz Q, Creed F, Emmanuel A, Houghton L, Hungin P, Jones R, Kumar D, Rubin G, Trudgill N, et al.: Guidelines on the irritable bowel syndrome: mechanisms and practical management.

    Gut 2007, 56(12):1770-1798. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  8. Sandler RS, Everhart JE, Donowitz M, Adams E, Cronin K, Goodman C, Gemmen E, Shah S, Avdic A, Rubin R: The burden of selected digestive diseases in the United States.

    Gastroenterology 2002, 122(5):1500-1511. PubMed Abstract | Publisher Full Text OpenURL

  9. Mayer EA: Clinical practice. Irritable bowel syndrome.

    N Engl J Med 2008, 358(16):1692-1699. PubMed Abstract | Publisher Full Text OpenURL

  10. Hungin AP: Self-help interventions in irritable bowel syndrome.

    Gut 2006, 55(5):603-604. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Andersson G: Using the Internet to provide cognitive behaviour therapy.

    Behav Res Ther 2009, 47(3):175-180. PubMed Abstract | Publisher Full Text OpenURL

  12. Bergström J, Andersson G, Ljótsson B, Rück C, Andréewitch S, Karlsson A, Carlbring P, Andersson E, Lindefors N: Internet- versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial.

    BMC Psychiatry 2010, 10(1):54. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  13. Hedman E, Andersson G, Ljótsson B, Andersson E, Rück C, Mörtberg E, Lindefors N: Internet-Based Cognitive Behavior Therapy vs. Cognitive Behavioral Group Therapy for Social Anxiety Disorder: A Randomized Controlled Non-inferiority Trial.

    PLoS ONE 2011, 6(3):e18001. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Ljótsson B, Falk L, Wibron Vesterlund A, Hedman E, Lindfors P, Rück C, Hursti T, Andréewitch S, Jansson L, Lindefors N, et al.: Internet-delivered exposure and mindfulness based therapy for irritable bowel syndrome - a randomized controlled trial.

    Behav Res Ther 2010, 48(6):531-539. PubMed Abstract | Publisher Full Text OpenURL

  15. Ljótsson B, Hedman E, Andersson E, Hesser H, Lindfors P, Hursti T, Rydh S, Rück C, Lindefors N, Andersson G: Internet-Delivered Exposure-Based Treatment vs. Stress Management for Irritable Bowel Syndrome: A Randomized Trial.

    Am J Gastroenterol 2011, 106(8):1481-1491. PubMed Abstract | Publisher Full Text OpenURL

  16. Ljótsson B, Hedman E, Lindfors P, Hursti T, Lindefors N, Andersson G, Rück C: Long-term follow up of internet-delivered exposure and mindfulness based treatment for irritable bowel syndrome.

    Behav Res Ther 2011, 49:58-61. PubMed Abstract | Publisher Full Text OpenURL

  17. Andersson E, Ljótsson B, Smit F, Paxling B, Hedman E, Lindefors N, Andersson G, Rück C: Cost-effectiveness of internet-based cognitive behavior therapy for Irritable Bowel Syndrome: Results from a randomized controlled trial.

    BMC Public Health 2011, 11(1):215. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  18. Ljótsson B, Andréewitch S, Hedman E, Rück C, Andersson G, Lindefors N: Exposure and mindfulness based therapy for irritable bowel syndrome - An open pilot study.

    J Behav Ther Exp Psychiatry 2010, 41(3):185-190. PubMed Abstract | Publisher Full Text OpenURL

  19. Moss-Morris R, McAlpine L, Didsbury LP, Spence MJ: A randomized controlled trial of a cognitive behavioural therapy-based self-management intervention for irritable bowel syndrome in primary care.

    Psychol Med 2010, 40(1):85-94. PubMed Abstract | Publisher Full Text OpenURL

  20. Jarrett ME, Cain KC, Burr RL, Hertig VL, Rosen SN, Heitkemper MM: Comprehensive self-management for irritable bowel syndrome: randomized trial of in-person vs. combined in-person and telephone sessions.

    Am J Gastroenterol 2009, 104(12):3004-3014. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  21. Hunt MG, Moshier S, Milonova M: Brief cognitive-behavioral internet therapy for irritable bowel syndrome.

    Behav Res Ther 2009, 47:797-802. PubMed Abstract | Publisher Full Text OpenURL

  22. Lackner JM, Jaccard J, Krasner SS, Katz LA, Gudleski GD, Holroyd K: Self-administered cognitive behavior therapy for moderate to severe irritable bowel syndrome: clinical efficacy, tolerability, feasibility.

    Clin Gastroenterol Hepatol 2008, 6(8):899-906. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P: Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration.

    Ann Intern Med 2008, 148(4):295-309. PubMed Abstract | Publisher Full Text OpenURL

  24. Labus JS, Mayer EA, Chang L, Bolus R, Naliboff BD: The central role of gastrointestinal-specific anxiety in irritable bowel syndrome: further validation of the visceral sensitivity index.

    Psychosom Med 2007, 69(1):89-98. PubMed Abstract | Publisher Full Text OpenURL

  25. Almy TP, Tulin M: Alterations in colonic function in man under stress; experimental production of changes simulating the irritable colon.

    Gastroenterology 1947, 8(5):616-626. PubMed Abstract OpenURL

  26. Mogg K, Mathews A, Bird C, Macgregor-Morris R: Effects of stress and anxiety on the processing of threat stimuli.

    J Pers Soc Psychol 1990, 59(6):1230-1237. PubMed Abstract | Publisher Full Text OpenURL

  27. Hazlett-Stevens H, Craske MG, Mayer EA, Chang L, Naliboff BD: Prevalence of irritable bowel syndrome among university students: the roles of worry, neuroticism, anxiety sensitivity and visceral anxiety.

    J Psychosom Res 2003, 55(6):501-505. PubMed Abstract | Publisher Full Text OpenURL

  28. Labus JS, Bolus R, Chang L, Wiklund I, Naesdal J, Mayer EA, Naliboff BD: The Visceral Sensitivity Index: development and validation of a gastrointestinal symptom-specific anxiety scale.

    Aliment Pharmacol Ther 2004, 20(1):89-97. PubMed Abstract | Publisher Full Text OpenURL

  29. Jerndal P, Ringstrom G, Agerforz P, Karpefors M, Akkermans LM, Bayati A, Simren M: Gastrointestinal-specific anxiety: an important factor for severity of GI symptoms and quality of life in IBS.

    Neurogastroenterol Motil 2010, 22(6):646-e179. PubMed Abstract | Publisher Full Text OpenURL

  30. Reme SE, Darnley S, Kennedy T, Chalder T: The development of the irritable bowel syndrome-behavioral responses questionnaire.

    J Psychosom Res 2010, 69(3):319-325. PubMed Abstract | Publisher Full Text OpenURL

  31. Hayes SC: Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies.

    Behav Ther 2004, 35(4):639-665. Publisher Full Text OpenURL

  32. Boyce PM, Talley NJ, Balaam B, Koloski NA, Truman G: A randomized controlled trial of cognitive behavior therapy, relaxation training, and routine clinical care for the irritable bowel syndrome.

    Am J Gastroenterol 2003, 98(10):2209-2218. PubMed Abstract | Publisher Full Text OpenURL

  33. Craske MG, Wolitzky-Taylor KB, Labus J, Wu S, Frese M, Mayer EA, Naliboff BD: A cognitive-behavioral treatment for irritable bowel syndrome using interoceptive exposure to visceral sensations.

    Behav Res Ther 2011, 49(6-7):413-421. PubMed Abstract | Publisher Full Text OpenURL

  34. Hayes SC, Villatte M, Levin M, Hildebrandt M: Open, aware, and active: contextual approaches as an emerging trend in the behavioral and cognitive therapies.

    Annu Rev Clin Psychol 2011, 7:141-168. PubMed Abstract | Publisher Full Text OpenURL

  35. Kearney DJ, McDermott K, Martinez M, Simpson TL: Association of participation in a mindfulness programme with bowel symptoms, gastrointestinal symptom-specific anxiety and quality of life.

    Alimentary Pharmacology & Therapeutics 2011. PubMed Abstract | Publisher Full Text OpenURL

  36. Gaylord SA, Palsson OS, Garland EL, Faurot KR, Coble RS, Mann JD, Frey W, Leniek K, Whitehead WE: Mindfulness Training Reduces the Severity of Irritable Bowel Syndrome in Women: Results of a Randomized Controlled Trial.

    Am J Gastroenterol 2011. OpenURL

  37. Chiesa A, Malinowski P: Mindfulness-based approaches: are they all the same?

    J Clin Psychol 2011, 67(4):404-424. PubMed Abstract | Publisher Full Text OpenURL

  38. Lynch TR, Chapman AL, Rosenthal MZ, Kuo JR, Linehan MM: Mechanisms of change in dialectical behavior therapy: theoretical and empirical observations.

    J Clin Psychol 2006, 62(4):459-480. PubMed Abstract | Publisher Full Text OpenURL

  39. Winzelberg AJ, Classen C, Alpers GW, Roberts H, Koopman C, Adams RE, Ernst H, Dev P, Taylor CB: Evaluation of an internet support group for women with primary breast cancer.

    Cancer 2003, 97(5):1164-1173. PubMed Abstract | Publisher Full Text OpenURL

  40. Hedman E, Ljótsson B, Rück C, Furmark T, Carlbring P, Lindefors N, Andersson G: Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation.

    Computers in Human Behavior 2010, 26:736-740. Publisher Full Text OpenURL

  41. Ritter P, Lorig K, Laurent D, Matthews K: Internet versus mailed questionnaires: a randomized comparison.

    J Med Internet Res 2004, 6(3):e29. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  42. Wiklund IK, Fullerton S, Hawkey CJ, Jones RH, Longstreth GF, Mayer EA, Peacock RA, Wilson IK, Naesdal J: An irritable bowel syndrome-specific symptom questionnaire: development and validation.

    Scand J Gastroenterol 2003, 38(9):947-954. PubMed Abstract | Publisher Full Text OpenURL

  43. Dimenäs E, Glise H, Hallerback B, Hernqvist H, Svedlund J, Wiklund I: Well-being and gastrointestinal symptoms among patients referred to endoscopy owing to suspected duodenal ulcer.

    Scand J Gastroenterol 1995, 30(11):1046-1052. PubMed Abstract | Publisher Full Text OpenURL

  44. Guilera M, Balboa A, Mearin F: Bowel habit subtypes and temporal patterns in irritable bowel syndrome: systematic review.

    Am J Gastroenterol 2005, 100(5):1174-1184. PubMed Abstract | Publisher Full Text OpenURL

  45. Haakart-van Roijen L: Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness. Rotterdam: Institute for Medical Technology Assessment; 2002.

  46. Patrick DL, Drossman DA, Frederick IO, DiCesare J, Puder KL: Quality of life in persons with irritable bowel syndrome: development and validation of a new measure.

    Dig Dis Sci 1998, 43(2):400-411. PubMed Abstract | Publisher Full Text OpenURL

  47. Sheehan DV: The Sheehan Disability Scales. In The Anxiety Disease and How to Overcome It. New York: Charles Scribner and Sons; 1983:151. OpenURL

  48. Leon AC, Olfson M, Portera L, Farber L, Sheehan DV: Assessing psychiatric impairment in primary care with the Sheehan Disability Scale.

    Int J Psychiatry Med 1997, 27(2):93-105. PubMed Abstract | Publisher Full Text OpenURL

  49. Verbeke G, Molenberghs G: Linear mixed models for longitudinal data. New York: Springer; 2000. OpenURL

  50. Gueorguieva R, Krystal JH: Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry.

    Arch Gen Psychiatry 2004, 61(3):310-317. PubMed Abstract | Publisher Full Text OpenURL

  51. Salim A, Mackinnon A, Christensen H, Griffiths K: Comparison of data analysis strategies for intent-to-treat analysis in pre-test-post-test designs with substantial dropout rates.

    Psychiatry Res 2008, 160(3):335-345. PubMed Abstract | Publisher Full Text OpenURL

  52. Little RJA, Rubin DB: Statistical analysis with missing data. 2nd edition. Hoboken, N.J.: Wiley; 2002.

  53. Drummond MF, Sculpher MJ, Torrance GW: Methods for the economic evaluation of health care programmes. Oxford University Press, USA; 2005.

  54. Smit F, Willemse G, Koopmanschap M, Onrust S, Cuijpers P, Beekman A: Cost-effectiveness of preventing depression in primary care patients: randomised trial.

    The British journal of psychiatry: the journal of mental science 2006, 188:330-336. Publisher Full Text OpenURL

  55. Organisation for economic co-operation and development: PPPs and exchange rates [http://www.oecd.org] webcite

  56. Efron B, Tibshirani R: An introduction to the bootstrap. New York: Chapman & Hall; 1993.

  57. Drossman DA, Thompson WG: The irritable bowel syndrome: review and a graduated multicomponent treatment approach.

    Ann Intern Med 1992, 116(12 Pt 1):1009-1016. PubMed Abstract OpenURL

  58. Reme SE, Stahl D, Kennedy T, Jones R, Darnley S, Chalder T: Mediators of change in cognitive behaviour therapy and mebeverine for irritable bowel syndrome.

    Psychol Med 2011, 1-11. OpenURL

  59. Reme SE, Kennedy T, Jones R, Darnley S, Chalder T: Predictors of treatment outcome after cognitive behavior therapy and antispasmodic treatment for patients with irritable bowel syndrome in primary care.

    J Psychosom Res 2010, 68(4):385-388. PubMed Abstract | Publisher Full Text OpenURL

  60. Jones MP, Bratten J, Keefer L: Quality of life in patients with inflammatory bowel disease and irritable bowel syndrome differs between subjects recruited from clinic or the internet.

    Am J Gastroenterol 2007, 102(10):2232-2237. PubMed Abstract | Publisher Full Text OpenURL

  61. Talley NJ, Owen BK, Boyce P, Paterson K: Psychological treatments for irritable bowel syndrome: a critique of controlled treatment trials.

    Am J Gastroenterol 1996, 91(2):277-283. PubMed Abstract OpenURL

  62. Drossman DA, Toner BB, Whitehead WE, Diamant NE, Dalton CB, Duncan S, Emmott S, Proffitt V, Akman D, Frusciante K, et al.: Cognitive-behavioral therapy versus education and desipramine versus placebo for moderate to severe functional bowel disorders.

    Gastroenterology 2003, 125(1):19-31. PubMed Abstract | Publisher Full Text OpenURL

  63. Blanchard EB, Lackner JM, Sanders K, Krasner S, Keefer L, Payne A, Gudleski GD, Katz L, Rowell D, Sykes M, et al.: A controlled evaluation of group cognitive therapy in the treatment of irritable bowel syndrome.

    Behav Res Ther 2007, 45(4):633-648. PubMed Abstract | Publisher Full Text OpenURL

  64. Creed F, Fernandes L, Guthrie E, Palmer S, Ratcliffe J, Read N, Rigby C, Thompson D, Tomenson B: The cost-effectiveness of psychotherapy and paroxetine for severe irritable bowel syndrome.

    Gastroenterology 2003, 124(2):303-317. PubMed Abstract | Publisher Full Text OpenURL

  65. Kaptchuk TJ, Friedlander E, Kelley JM, Sanchez MN, Kokkotou E, Singer JP, Kowalczykowski M, Miller FG, Kirsch I, Lembo AJ: Placebos without deception: a randomized controlled trial in irritable bowel syndrome.

    PLoS ONE 2010, 5(12):e15591. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-230X/11/110/prepub