Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Research article

Development of an intervention program to increase effective behaviours by patients and clinicians in psychiatric services: Intervention Mapping study

Bauke Koekkoek12*, Berno van Meijel3, Aart Schene4 and Giel Hutschemaekers15

Author Affiliations

1 ProPersona Mental Health Care, Pro Persona Centre for Education and Science, Wolfheze

2 Altrecht Mental Health Care, Zeist, The Netherlands

3 InHolland University for Applied Sciences, Research Group Mental Health Nursing, Amsterdam, The Netherlands

4 Department of Psychiatry, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands

5 Radboud University, Academic Centre of Social Sciences, Nijmegen, The Netherlands

For all author emails, please log on.

BMC Health Services Research 2010, 10:293  doi:10.1186/1472-6963-10-293


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/10/293


Received:30 March 2010
Accepted:25 October 2010
Published:25 October 2010

© 2010 Koekkoek et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Health clinicians perceive certain patients as 'difficult' across all settings, including mental health care. In this area, patients with non-psychotic disorders that become long-term care users may be perceived as obstructing their own recovery or seeking secondary gain. This negative perception of patients results in ineffective responses and low-quality care by health clinicians. Using the concept of illness behaviour, this paper describes the development, implementation, and planned evaluation of a structured intervention aimed at prevention and management of ineffective behaviours by long-term non-psychotic patients and their treating clinicians.

Methods

The principles of Intervention Mapping were applied to guide the development, implementation, and planned evaluation of the intervention. Qualitative (individual and group interviews), quantitative (survey), and mixed methods (Delphi-procedure) research was used to gain a broad perspective of the problem. Empirical findings, theoretical models, and existing evidence were combined to construct a program tailored to the needs of the target groups.

Results

A structured program to increase effective illness behaviour in long-term non-psychotic patients and effective professional behaviour in their treating clinicians was developed, consisting of three subsequent stages and four substantial components, that is described in detail. Implementation took place and evaluation of the intervention is being carried out.

Conclusions

Intervention Mapping proved to be a suitable method to develop a structured intervention for a multi-faceted problem in mental health care.

Background

In various health care settings, clinicians perceive particular patients as 'difficult'. 'Difficult' is an individual judgment that generally refers to patients who have limited social functioning, make high use of medical services, and generally are unsatisfied with the care they receive [1-6]. The more of these elements are combined and the smaller the perspective of future recovery, the more likely it becomes that a patient is perceived as 'difficult' by a professional. In psychiatric services, most 'difficult' patients are found among patients with long-term non-psychotic illness as mood, anxiety, substance use, and personality disorders that have not responded well to previous treatments [7]. Patients perceived as 'difficult' may be labelled as such in services, and subsequently be at increased risk to be treated less respectfully, less effectively, and to be excluded from health services because of their failure to comply with its implicit and explicit rules for 'proper' patienthood [8-10]. Professionals working with these patients report more stress and burn-out [11,12].

It is not unusual for mental health professionals to ascribe problems in treatment to patients through the use of the 'difficult'-label. This routine has been criticized repeatedly [13-15]. Indeed, it is not always clear which patient behaviours must be considered as originating in the psychiatric disorder itself, and which may be the consequence of an ineffective contact with mental health clinicians or services [16]. In previous work, for instance, we found no association between any specific non-psychotic psychiatric disorder and clinicians' 'difficult'-judgment [17]. However, clinicians' perceptions of the patient (e.g. seeing the patient as able but unwilling to change), the patient's previous service use and the number of psychosocial problems, were independently associated with clinician-perceived difficulty [17]. Thus, patients' responses to illness and treatment (illness behaviour) may prevail over the illness itself. Since the concept of illness behaviour not only refers to the different ways in which people perceive, evaluate, and respond to symptoms [18], but also to the ways in which they seek help and to their behaviour in healthcare systems, this concept is highly relevant to the understanding and prevention of perceived difficulty. Recurring behaviours that are perceived as difficult by clinicians may be described as 'ineffective chronic illness behaviour', which in part may result in 'ineffective professional behaviour' as a response [19]. We therefore use these terms to describe certain 'difficult' behaviours by long-term patients with non-psychotic disorders (e.g. constant complaining about ever-changing problems, recurrent making of suicidal threats, repeated denial of financial problems) and certain ineffective responses by professionals (e.g. not listening to patients' long-term problems, responding only to acute problems, failure to intervene in obvious social problem situations).

Currently, prevention of these two types of ineffective behaviour is not a high priority in mental health services. In general, the management of non-psychotic chronic patients in psychiatric care is poorly developed. While evidence-based treatments for various non-psychotic disorders are available, they are not for non-psychotic chronic disorders. Although some treatments exist for specific subgroups (e.g. chronic depression [20,21] and borderline personality disorder [22,23]), they do not apply to the entire target population [24,25], of which some patients may not (yet) be ready for such treatments. The project described in this paper aims at the development of an intervention program to both prevent and manage these ineffective behaviours among long-term non-psychotic patients who have not benefited from previous treatment, and their key clinicians.

Methods

Intervention mapping (IM), a systematic method for the development, implementation and evaluation of health interventions outlined by Bartolomew et al. [26,27], has proven to be a useful way to construct programs grounded both in theory and empirical data [28,29]. IM proceeds according to the following steps. Step 1 consists of a needs assessment through a review of the scientific literature to analyse the target population, environmental conditions, and determinants of health behaviour. In step 2 the determinants of the health behaviour are used to set objectives for behaviour change, divided in broad performance objectives and concrete change objectives in terms of what a person needs to learn to change his or her behaviour. In step 3, theoretical foundations and empirically evaluated methods and strategies for behaviour change are assessed. In step 4, the methods and strategies are translated into an organized intervention. In step 5, the adoption, implementation and sustainability of the intervention is planned. In step 6, an evaluation plan is provided for and carried out. The strategies used in this project for each of the six steps in Intervention Mapping are reported on in detail below.

For step 1 and 2, we carried out a comprehensive review of the literature on 'difficult' patients. The MEDLINE, CINAHL, and PsycINFO databases were searched for English articles published between 1979 and 2004, retrieving 94 eligible papers [7]. Next we undertook additional research to describe the health behaviour and its determinants: a qualitative interview study among patients [30], a survey among community mental health clinicians [17], and a Delphi-exercise among scientists/policy makers/expert-professionals [16,19,25,31]. We concluded with the formulation of the overall behavioural objective of the intervention, and the more concrete change objectives.

For step 3, we made a theoretical analysis of ineffective chronic illness behaviour [Koekkoek B, Hutschemaekers G, van Meijel B, Schene A: How do patients become to be seen as 'difficult'?: a mixed-methods study in community mental health care, revision submitted], which forms the foundation of the intervention program. We conducted a review of therapeutic methods available to change determinants (assessed in step 1), reach objectives (formulated in step 2), and confront ineffective behaviours of both patients and professionals [search strategy and results available from the 1st author]. Additionally, since empirical findings were limited, we collected data from current best practice sites. We visited three well-known national best practices, specialized in three important domains of long-term non-psychotic disorders (mood disorders, substance abuse disorders, and personality disorders) for data on possible effective practice-based strategies not yet described in the literature. Selection of these best practices took place by searching national scientific and professional journals, searching conference programs and reports, and inviting leaders in the fields (e.g. professors, directors, educators) to suggest best practices.

For step 4, we consulted an expert group of clinicians, scientists, and policy makers over an extended period of time (two years). Some of these experts were participants in one of the problem analysis studies in step 1, others were invited because of their expertise in a specific therapeutic method (for instance clinical case management or behaviour therapy).

In step 5, implementation was prepared with a steering group of scientists and managers in the psychiatric service the intervention was tested in. Before an agreement was reached, the intervention was first presented to a director, a research psychiatrist, and the psychiatrist of the team in which the intervention would be implemented. Next, the intervention and its evaluation were presented to the team members who all agreed to participate. After obtaining ethical permission and the final approval of the institution's chief director, the program was implemented.

In step 6, we designed a mixed-methods pilot study to evaluate the intervention program. This pilot study consists of quantitative and qualitative measurements of outcome and process variables, and is described in more detail later.

Ethical approval was obtained for the patient-related qualitative study and the pilot study from the Institutional Review Board of the organisation the 1st author is affiliated with. Informed consent was obtained from all participating patients in aforementioned patient-related studies.

Results

Outcomes of the Intervention Mapping process will be described according to the six steps.

Step 1: Needs assessment

Analysis of target population

Non-psychotic psychiatric disorders are highly frequent in the general population: lifetime prevalence in the US is 28.8% for anxiety disorders, 19.1% for depressive disorders, 14.6% for substance use disorders [32] and 9.1% for personality disorders [33]. Comparable percentages were found in The Netherlands, United Kingdom, Australia, and other Western countries [34-36]. Together these disorders account for the majority of mental illness in the community, and some of these become chronic. The percentage of non-psychotic patients in long-term care is estimated between 20 and 50% [37-41]. Of these patients, about 28% is perceived as difficult by psychiatric clinicians [17].

Analysis of environmental conditions

Even though the prevalence of non-psychotic psychiatric disorders in The Netherlands, where this study took place, is comparable to that of other countries, the availability of services may be somewhat different. The Dutch mental health care system is paid for by a mixture of federal grants, individual health insurance, co-payment and fee-for-service. However, long-term care for patients with non-psychotic disorders is fully paid for by federal budgets, even for those without insurance. Compared to the USA, Canada and Puerto Rico, a substantially higher percentage of people is treated in mental health services, both in general and specialty health care [42]. Also financially, there are few limits on the availability of long-term care in The Netherlands, compared to other countries [43].

Analysis of behaviour

We found three types of behaviours to be specific to perceived difficulty in mental health care. First, the presence of various psychiatric symptoms that are inconsistent, shifting, temporal and thus prohibiting the making of a clear diagnosis for which treatment can be started. Second, the presence of unusual help-seeking behaviour and interpersonal behaviour that is for instance chaotic (actively seeking help for constantly shifting problems with various agencies), dependent (actively seeking continuation and intensification of help), or ambivalent (actively seeking but not accepting help) that is poorly understood by psychiatric professionals. Third, the presence of various social problems (e.g. debts, poverty, poor housing, unemployment, difficulties in upbringing of children, legal issues etc.) that patients appear to consider as mental health problems but that can often not be solved by psychiatric professionals.

Some of these problems (for instance the described forms of unusual help-seeking) may be typical for people with non-psychotic disorders, others may also apply to people with psychotic disorders. In psychiatric services, however, mental health professionals still seem to hold different views on non-psychotic disorders (generally seen as transient, psychological problems) and psychotic disorders (generally seen as chronic, neurobiological problems) [7]. As such, professionals tend to consider long-term non-psychotic patients largely as responsible for their problems. Subsequently, professionals are ambivalent about considering these patients as chronically ill, and about reinforcement of their claim to the sick role. This ambivalence about legitimateness of chronic illness may cause friction in the therapeutic relationship, resulting in the qualification of the non-psychotic patient as a 'difficult' patient.

Analysis of behavioural determinants

From our literature review and subsequent research studies we concluded that other than patient-related factors are equally relevant in the occurrence of difficulties in the care of non-psychotic chronic patients [7]. While patient-related factors solely focus on, for instance, psychopathology, there are more variables that account for difficulties. Such variables could be categorized in four groups. The 1st is professional-related (e.g. the professional's willingness to engage with long-term patients). The 2nd is interaction-related, (e.g. the quality of the contact between patient and professional). The 3rd is social system-related (e.g. the amount of social support a patient has outside the mental health care system). The 4th is mental health care-related (e.g. the support a professional receives from co-workers and managers to care for long-term patients).

The mental health care-related category was by far the most relevant according to experts. General professionals laid more emphasis on social factors and less on specific diagnoses, professional skills or mental health care factors. Patients, in turn, stressed the importance of the professional's competencies, the quality of the patient-professional interaction and the views on non-psychotic chronic patients held in psychiatric services. As such, ineffective chronic illness behaviour appears to be the consequence of a complex interplay of factors, while these factors are viewed differently by distinct interest groups. Table 1 shows the determinants from our aggregated results, distinguished by patients, professionals and experts.

Table 1. Determinants of ineffective chronic illness behaviour according to research findings among three interest groups

Step 2: Matrix of change objectives

Based on the needs assessment, the overall behavioural outcome was defined as 'an increase of effective behaviours in people with long-term non-psychotic mental illness and their treating professionals'. We established that current ineffective behaviours consist of ineffective chronic illness behaviour by patients, and ineffective professional responses or behaviour by clinicians. These behaviours are caused by several patient-related and non patient-related determinants, and therefore performance objectives should be set on the patient, professional and services level. Next, important and changeable determinants of behaviour need to be chosen. For each of the three (patients, professionals and services), one determinant, taken from table 1, is exemplified in more detail (table 2).

Table 2. Matrix of intervention objectives for each target group

Step 3: Theoretical methods and practical strategies

Far most theoretical models of illness behaviour focus on individuals' help-seeking behaviour and decision-making process before entering the health care system [44]. Few specifically consider illness behaviour of people with psychiatric problems, which appears to differ qualitatively from illness behaviour related to physical problems [44]. A notable exception to this observation is the Network Episode Model [45], that combines the perspective of an illness career with social, cultural, medical and economical variables into a dynamic perspective. Developed by social scientists, this model however is still too general to explain the occurrence of ineffective illness behaviour within psychiatric services. We have, therefore, developed a more detailed model to describe the occurrence of ineffective chronic illness behaviour [Koekkoek B, Hutschemaekers G, van Meijel B, Schene A: How do patients become to be seen as 'difficult'?: a mixed-methods study in community mental health care, revision submitted]. The model shows that the 'difficult'-patient label is given by professionals when certain patient characteristics are present and a specific causal attribution about the patient's behaviours is made. The status of 'difficult' patient is easily reinforced by subsequent patient and/or professional behaviour, turning initial unusual help-seeking behaviour into 'difficult' or ineffective chronic illness behaviour. Furthermore, a lack of resources in the psychiatric service and the patient's social system negatively influence the patient-professional interaction.

The tentative model differentiates between five stages of the treatment process. In stage 1, patient characteristics guide the professional's appraisal process, who labels the patient either or not 'difficult' based on the attribution of patient behaviour (stage 2). As stated earlier, professionals have few resources available on the treatment of these long-term non-psychotic patients [46-48] and therefore are easily demoralized about treatment effectiveness. At the same time, both patients and the general public may have high expectations about cure for these patients, who are sometimes referred to as the 'worried well' [49]. Not only does this term underestimate patients' difficulties, it also pays little attention to the conflicting demands (few resources, high expectations) laid upon clinicians. Clinicians tend to respond with limited involvement and pessimism, which may result in undertreatment (stage 3) or blaming the patient for being ill or not getting better. In stage 4, professional responses to the now-labelled 'difficult'- patient may make the patient conclude that the professional is uncaring or unwilling to offer help. Thus, the patient, with many complex problems and a different style of help-seeking, is confronted with a negative and pessimistic attitude of the professional, resulting in a low dosage of help that aims for management, not recovery. This low-dose help reinforces the original behaviour of patients in distinct ways, thus leading to repetition, perpetuation and even aggravation of the initial problems. In stage 5, patient and professional are reinforcing each others ineffective behaviours based on their previous attributions. These behaviours may have little to do with the problems the patient initially sought help for. In fact, patient and clinician enter a vicious cycle of ineffective chronic illness behaviour (patient) and ineffective chronic professional behaviour (clinician) [Koekkoek B, Hutschemaekers G, van Meijel B, Schene A: How do patients become to be seen as 'difficult'?: a mixed-methods study in community mental health care, revision submitted]. From this theoretical model we have conceptualized the following stages in the intervention program (table 3) - each fitting an important step in the theoretical model.

Table 3. staged intervention program based on theoretical model and empirically validated methods

Step 4: Intervention

In this stage, the theoretical model (described above) and practical methods (described in detail in section 3 of this step) were translated into a manual for the intervention, which we named Interpersonal Community Psychiatric Treatment (ICPT) since the interpersonal contact between patient and professional is the main target of the intervention.

The intervention is designed for use in departments or programs for long-term ambulatory care, to which patients may be referred when short-term treatment, aimed at cure, has been found unsuitable or unsuccessful. In such departments, long-term care tends to turn into an unstructured, aimless, and sheer endless enterprise. Professionals working within these department are used to working with long-term patients with a severe mental illness. Often they do this autonomously but share the clinical responsibility with a doctor or psychiatrist, who has the final medical responsibility and sees the patient at a low frequency.

From our descriptive studies and the theoretical model we concluded that an intervention program should focus on: (1) a clear generic treatment structure (to prevent uninformed and haphazard low-dosage help), (2) a phased model (which fits the patient's level of acceptance of help), (3) a therapeutic style that fits the phase the patient is in, (4) a routine monitoring of the interpersonal contact between patient and (5) professional, and support for team professionals.

(1) Generic structure

Based on various evidence-based treatments of specific non-psychotic disorders [20,22], we introduced a fixed structure for each session, taking 45 minutes as the standard duration. The first 5 minutes are used by the clinician and the patient to set a mutually agreed on agenda for the session, including themes and goals to be discussed. The next 5 minutes are used to look back from the current to the previous session, allowing a process-oriented discussion of the patient's current mental state and that of the elapsed time since the last session. In the following 25-30 minutes the themes, subjects and goals that have been set on the agenda, are discussed and summarized. The last 5 minutes are used to look back on the session and to fill out a report form (clinician) and a feedback form (patient), which will be exemplified below.

(2) Stage model

This model is an explication of the three stages described above (table 3), moving from the 1st stage (optimization of working alliance), through the 2nd stage (clarification of and agreement over goals and tasks) to the 3rd stage (improvement of psychiatric and social functioning). In order to optimize the patient-professional interaction across all stages, it is crucial for the clinician to determine in which stage the treatment contact is located. Clinicians may ask themselves 'diagnostic' questions related to each stage. There are two or three such questions per stage, which are thought and asked during the training and supervision sessions. For the 1st stage such a question is for instance 'do I feel the liberty to discuss the nature of the treatment contact with my patient?'. If the answer to this question is 'no', for example because the professional fears that the patient will become very anxious to lose the treatment contact, the clinician knows that the contact still is in the first stage of optimization of the alliance. As such, the change objective of 'being able to discuss form and content of treatment' (table 2) may not have been reached yet. The stage model helps professionals to structure their treatment, using different methods across different stages.

(3) Therapeutic methods per stage

One of the crucial elements of ICPT, in order to prevent ineffective illness and professional behaviour, is the differentiation of therapeutic styles across treatment stages. This approach is a variation of, but consistent with, the trans-theoretical model of change [50] which differentiates people's readiness to change into various stages. In the 1st stage, in which the working alliance is defined, the suggested methods are relationship management [51-53] and motivational interviewing [54,55], of which especially the latter has a firmly established empirical base. Both methods aim to prevent the usual mental health care 'script' in which the clinician is the one who looks for problems in the patient, and suggests improvements of his or her behaviour, while the patient is a passive recipient of help. Instead, in both methods the clinician is a careful and observant listener who elicits timely responses from the patient and strongly promotes autonomy. In relationship management, the basic rule is to do no harm - referring to the adverse outcomes that have been reported with patients that do not respond well to an actively helping clinician [23,53,56]. Motivational interviewing seeks to create and increase patient's ambivalence, for instance by juxtaposing riskfull behaviour with responsible parenthood in a person who loves his or her child but also engages in repeated self-destructive behaviours.

In the second stage of ICPT, motivational interviewing is used again in a generic way, now to set patient-centred goals. It is complemented with shared decision making [57]. This method, imported from physical health care, makes use of a structured way to make treatment decisions mutually agreed on by patient and professional. We added systematic goal-setting to this procedure. After an initial open question to focus the patient on the future ('what do you want your life to look like in one year from now?'), a more detailed analysis follows of the areas where change is desired. Then, aided by a widely used tool to assess care needs [58] which identifies possible unmet needs that may obstruct progress, specific goals are jointly formulated. This careful process of mutual goal setting seeks to avoid common pitfalls: the patient feeling that treatment goals are forced upon him or her, and the clinician feeling that urgent patient needs (e.g. financial problems) have not come under discussion.

In the third stage of ICPT, two different goal-oriented methods are used to improve personal and social functioning. The more practical variant, often required with patients that have many social problems, is clinical case management [59-61]. This form of psychiatric case-management assumes one responsible clinician who takes an active role to improve the patient's social situation, through helping solving social problems (e.g. problems with housing, income, debts, social activities etc.). This form of case-management is, despite its lower implementation grade than the earlier mentioned Assertive Community Treatment [59], more suitable to situations in which team-wise treatment is not possible. The second variant, possible with patients who have less severe social problems, is behavioural analysis. This generic and empirically supported form of focused behaviour therapy [20,62], assumes that people with long-term non-psychotic disorders mostly find themselves caught in unsatisfactory interpersonal situations. These situations become object of analysis in a stepwise behavioural protocol [20] which focuses on the thoughts, feelings, actions and consequences regarding the patient's interpersonal behaviour. This third stage of ICPT, that may not be reached by all patients, aims to offer true, practical help after goal-setting in stage two has been concluded.

(4) Application of feedback forms

Originally intended for research purposes, feedback forms have gained solid ground in mental health care over the last years. In ICPT, both clinician and patient fill out a form about the session they have just had. Both rate items on the Session Rating Scale [63], thereby informing one another on their (dis)content with the working alliance. In addition, clinicians score in which stage of the treatment contact this session could be located, as well as which methods were used, and if treatment goals were discussed. Patients, on the other hand, rate their own input in the session's content. By these means, both parties are delegated responsibility for the working alliance and their substantive input in the session.

(5) Supervision

Every two weeks, a team-wise supervision takes place in which a treatment situation of two different clinicians is jointly analysed. The stage model is implicitly used by the supervisor, but not forced upon the participants. After a 3-minute description, or through a previously distributed paper sheet with 7 preset questions, the treatment situation is introduced by one of the clinicians. After a 25-minute discussion, the process is finalized by the clinician who introduced the situation, through a short summary and mentioning of learning points. Supervision has been proven to be helpful to reduce stress in community psychiatric nurses [64,65]. We used a brief version of a supervision protocol that has been developed and evaluated in Dutch long-term mental health care [66]. It focuses on the professionals' feelings that may be evoked by working with patients who seem to miss the capacity to improve their independent functioning, are not able to solve their often broad set of psychosocial problems, and have a high level of demands of which they expect the professional to take responsibility for.

Step 5: implementation

A community mental health team consisting of six community psychiatric nurses and two psychiatrists, with a case-load of severely mentally ill patients with both psychotic and non-psychotic disorders was selected as suitable for a pilot study of the intervention. This selection was based on three criteria: (1) representativeness of the psychiatric service and its catchment area, (2) preparedness and possibility of implementing a new treatment program in the service, (3) geographical accessibility of the service for the authors. Implementation was supported by the management team early on, the clinical team was invited to two meetings about the content and form of the program before the final consent for implementation was given. The team also expressed their willingness to participate in group supervision sessions during the research period. Although this may not be the case in other teams, many professionals express their wish to participate in supervision in daily practice. The team-leader, one of the participating clinicians with additional management tasks, and the team psychiatrist functioned as the link between the treatment team and the research team.

The intervention was implemented mainly through a 3-day training program, consisting of the following elements: (1) theoretical overview (4 hours), (2) relationship management skills (8 hours), (3) motivational interviewing and goal setting skills (4 hours), (4) case-management skills (4 hours), and (5) behavioural analysis skills (4 hours). The training was offered by the first author (8 hours), and four specialists in the specific skills (4 hours each). It combined lectures, group discussions, one-on-one and group-wise role-playing, homework assignments, and self-study of provided literature. Substantial effort was put in tailoring the training program to the needs and competencies of the participants. Many of the existing therapeutic approaches for patients with non-psychotic disorders, are aimed at Master-level clinicians, whereas the participating community psychiatric nurses, the key clinicians of patients and also those intended to carry out ICPT, all had Bachelor-level psychiatric nursing qualifications. Tailoring was done by inviting specialists with extensive experience with both the target group of professionals, and the method to be taught.

Report and feedback forms were fully integrated into the institution's electronic patient file, to facilitate easy use of these forms and the intervention program in general. The training program was followed up by biweekly supervision sessions and hands-on support by email, telephone or face-to-face contact, delivered by the first author. Every two weeks, a 30-minute group-wise booster session took place, designated for the answering of questions about, and enhancement of adherence to ICPT.

Step 6: evaluation

Scientific evaluation of the intervention is part of the implementation process. For various reasons a pilot study was designed to investigate the feasibility of the intervention. First, little experience has been developed so far with the implementation of community psychiatric nurse-led interventions. We need to consider that the application of ICPT places high demands on professionals' skills. Therefore, biweekly supervision and constantly available coaching by phone, email or live instruction were offered. It is possible though that some of the interventions may not be successfully carried out by nurses. Although we believe, based on prior experience and preliminary results from the pilot study, that nurses are able to do so, a thorough process evaluation is included. Second, likewise, implementation of innovative programs for the target group of patients with long-term non-psychotic disorders has been scarce. Third, the intervention consists of multiple components of which the individual effectiveness is established, yet not in conjunction with other methods. It may be that the application of several treatment strategies within one integral program weakens the effect of the individual interventions - especially when less thoroughly implemented (e.g. through fewer training hours) than in the original research studies. Fourth, this implementation will be used to improve the intervention and to assess the applicability of several patient-administered measures with this patient group, since they are used only with other groups of patients (e.g. patients with psychotic disorders, short-term patients). Positive results of the pilot study may well result in the design and execution of a randomized controlled trial.

This pilot study will have a duration of six months and both quantitative and qualitative assessments will be made at baseline, 3 months and 6 months. Quantitative assessments will include outcome measures (psychopathology, psychosocial functioning, quality of life) and process measures (service use, treatment satisfaction, and quality of the therapeutic alliance) on patient level. It will also include process measures on the professional level (treatment integrity, work satisfaction, and perceived difficulty). Qualitative interviews will be used to assess the feasibility and usefulness of the intervention program among patients and professionals alike. Among clinicians, satisfaction with the training, the program, the support, and the supervision will be investigated quantitatively (through scores) and qualitatively (through interviews).

Discussion

In this paper we described the systematic development of an intervention program aimed at people with long-term non-psychotic disorders, Interpersonal Community Psychiatric Treatment (ICPT), carried out by community psychiatric nurses in order to prevent ineffective illness and ineffective professional behaviour. By following the steps of the Intervention Mapping process, it has become increasingly clear that behaviours by health clinicians and (illness) behaviours by patients are mutually reinforcing. Thus, this intervention aims not only to change patient's behaviours, but also to change clinicians' behaviours. In fact, patient's behaviours should change through different clinicians' behaviours. A three-stage treatment model was developed, with tailored therapeutic interventions applied in each stage. Implementation mainly took place through a training program, evaluation through a pilot study.

Although the stage model and therapeutic modalities used in this intervention program are relatively straightforward, the health problem it targets is quite complex, and may be more precisely described as an interaction problem within health services. More than in descriptions of other programs aimed at prevention of ineffective health behaviour [e.g. [27,28]], the patient behaviour in this area is very much influenced by the behaviour of health clinicians, and the organisational arrangements of the health services. Ineffective chronic illness behaviour can certainly not be ascribed to patients alone, and therefore an intervention program should also target other parties involved. Although it may appear unusual to target health clinicians' behaviours and health services' policies through an intervention program, in fact many patient behaviours are quite strongly associated with clinicians' professional behaviour [e.g. [67,68]]. Even though studies into the primary or secondary prevention of ineffective chronic illness behaviour are relatively scarce [e.g. [69-71]], we believe that in many health settings, mechanism of mutual reinforcement of ineffective behaviours are relevant but poorly recognized and understudied phenomena. However, the consequences of such reinforcement may be stronger in our population of non-psychotic patients in long-term mental health care. For both patients and professionals, several disincentives (e.g. motivational, financial, and social) may be present in long-term mental health care, requiring a program explicitly aimed at prevention of ineffective behaviours.

The program combines effective methods on various levels. First, it is grounded in the principles of systematic care planning. The stage model of treatment and the generic session structure offers an overall systematic framework. Next, effective therapeutic methods fill this framework with content. Another level encompasses structured feedback professionals receive from their patients, which facilitates improvement of care. At another level, patient-professional cooperation and patient empowerment are important principles that place patient's autonomy in the middle ground. Last, mutual professional support through supervision is an essential element to improve quality and inter-professional cooperation. Several elements of ICPT can be found elsewhere in more detail (for instance goal-setting is very well defined in psychiatric rehabilitation [72]). To our knowledge, however, it is the first time that a number of potentially effective methods is combined into one, ready-to-use program tailored to this patient and professional population - which both have been deprived of theoretical and methodological developments for long.

This study has limitations and strengths. First, large-scale research into the determinants of ineffective chronic illness behaviour is absent. Therefore we had to rely on smaller, though well-focussed, studies. Second, the scope of our findings may be limited by the specifics of the Dutch health care system. As has been noted before, long-term mental health care is relatively well reimbursed in the Netherlands, which may not be so in other countries. However, this limitation applies less to European countries than to the United States, since many European nations have some form of public care for severely mentally ill patients. Third, some elements that are considered important by some, are not present in ICPT. For instance, the patient's social functioning is primarily supported indirectly, i.e. through active encouragement and practical help by the professional, yet not through direct involvement of patient's significant others. Although certainly not discouraged, the introduction of significant others into the mental health care contact is not the program's main goal, which is the optimization of the patient-clinician contact first. Generalization of this improved interpersonal skills is aimed for, however, through the use of behavioural analysis of interpersonal problems. Whether this strategy is sufficiently helpful to improve the patient's social support is to be determined through the pilot study. Fourth, the therapeutic methods chosen for inclusion in ICPT may not be the only ones possible but we have given preference to those methods that best matched the behavioural determinants and had most empirical support. Fifth, whether the key clinicians delivering ICPT, community psychiatric nurses, are able to do so effectively after three days of training in a variety of concepts and methods, needs to be assessed empirically. While the intervention program is full, and the training rather short, follow-up is intensive through constant support and biweekly supervision sessions. Sixth, this intervention program might also have been developed using other methods to derive at health care interventions, for instance the MRC Framework [73]. In this paper, we have not reviewed this and other methods in detail since at an earlier stage we found that Intervention Mapping's strong emphasis on intervention development in general, and goal setting and explication of target groups in particular, suited the complex background of the health problem well. We do acknowledge, though, that other models might have been equally applicable.

One of the strengths of this study is the investigation of the health problem from a variety of angles. Also, the patient's perspective has been researched in substantial detail. Furthermore, the theoretical model has been developed over a period of four years and has been exposed to various rounds of feedback from researchers, practitioners, and patients. These measures, to our belief, have greatly increased the validity of our findings.

Conclusions

Systematic development of an intervention program for a complex health behaviour problem is possible with Intervention Mapping although the method places high demands on clarification of targeted behaviours, determinants, and target groups.

List of abbreviations

IM: Intervention Mapping; ICPT: Interpersonal Community Psychiatric Treatment

Conflict of interests

The authors declare that they have no competing interests.

Authors' contributions

BK, BvM, AS and GH devised the idea of the study and designed the methods. BK led the data collection, analysis, and prepared the manuscript. BvM, AK, AS and GH co-drafted the manuscript. All authors read and approved the final manuscript.

Acknowledgements

This study was funded by ZonMW (The Netherlands Organisation for Health Care Research and Development) 'Geestkracht'-program (Grant 100-002-031), Altrecht Mental Health Care and Gelderse Roos Mental Health Care. We acknowledge the cooperation of the GGZ Eindhoven, Centrum Maliebaan and AMC Psychiatry mental health institutes with our inventory of best practices.

References

  1. Groves JE: Taking care of the hateful patient.

    N Engl J Med 1978, 298(16):883-887. PubMed Abstract | Publisher Full Text OpenURL

  2. Lin EH, Katon W, Von Korff M, Bush T, Lipscomb P, Russo J, Wagner E: Frustrating patients: physician and patient perspectives among distressed high users of medical services.

    J Gen Intern Med 1991, 6(3):241-246. PubMed Abstract | Publisher Full Text OpenURL

  3. Jackson JL, Kroenke K: Difficult patient encounters in the ambulatory clinic: clinical predictors and outcomes.

    Arch Intern Med 1999, 159(10):1069-1075. PubMed Abstract | Publisher Full Text OpenURL

  4. Hahn SR, Kroenke K, Spitzer RL, Brody D, Williams JB, Linzer M, deGruy FV: The difficult patient: prevalence, psychopathology, and functional impairment.

    J Gen Intern Med 1996, 11(1):1-8. PubMed Abstract | Publisher Full Text OpenURL

  5. Hinshelwood RD: The difficult patient. The role of 'scientific psychiatry' in understanding patients with chronic schizophrenia or severe personality disorder.

    Br J Psychiatry 1999, 174:187-190. PubMed Abstract | Publisher Full Text OpenURL

  6. Steinmetz D, Tabenkin H: The 'difficult patient' as perceived by family physicians.

    Fam Pract 2001, 18(5):495-500. PubMed Abstract | Publisher Full Text OpenURL

  7. Koekkoek B, van Meijel B, Hutschemaekers G: "Difficult patients" in mental health care: a review.

    Psychiatr Serv 2006, 57(6):795-802. PubMed Abstract | Publisher Full Text OpenURL

  8. Ring A, Dowrick CF, Humphris GM, Davies J, Salmon P: The somatising effect of clinical consultation: What patients and doctors say and do not say when patients present medically unexplained physical symptoms.

    Soc Sci Med 2005, 61(7):1505-1515. PubMed Abstract | Publisher Full Text OpenURL

  9. O'Reilly D, Gilliland A, Steele K, Kelly C: Reasons for patient removals: results of a survey of 1005 GPs in Northern Ireland.

    Br J Gen Pract 2001, 51(469):661-663. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  10. Pelet A, Besson J, Pecoud A, Favrat B: Difficulties associated with outpatient management of drug abusers by general practitioners. A cross-sectional survey of general practitioners with and without methadone patients in Switzerland.

    BMC Family Practice 2005, 6(1):51. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  11. Stacey CL, Henderson S, MacArthur KR, Dohan D: Demanding patient or demanding encounter? A case study of a cancer clinic.

    Soc Sci Med 2009, 69(5):729-737. PubMed Abstract | Publisher Full Text OpenURL

  12. An PG, Rabatin JS, Manwell LB, Linzer M, Brown RL, Schwartz MD, Investigators MEMO: Burden of difficult encounters in primary care: data from the Minimizing Error, Maximizing Outcomes study.

    Arch Intern Med 2009, 169(4):410-414. PubMed Abstract | Publisher Full Text OpenURL

  13. Rose D, Thornicroft G, Pinfold V, Kassam A: 250 labels used to stigmatise people with mental illness.

    BMC Health Serv Res 2007, 7(1):97. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  14. Krebs E, Garrett J, Konrad T: The difficult doctor? Characteristics of physicians who report frustration with patients: an analysis of survey data.

    BMC Health Serv Res 2006, 6(1):128. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  15. Corrigan PW: Language and stigma.

    Psychiatr Serv 2006, 57(8):1218. PubMed Abstract | Publisher Full Text OpenURL

  16. Koekkoek B, van Meijel B, Schene A, Hutschemaekers G: Problems in psychiatric care of 'difficult patients': a Delphi-study.

    Epidemiol Psichiatr Soc 2009, 18(4):323-330. PubMed Abstract OpenURL

  17. Koekkoek B, van Meijel B, Tiemens B, Schene A, Hutschemaekers G: What makes community psychiatric nurses label non-psychotic chronic patients as 'difficult': patient, professional, treatment and social variables.

    Soc Psychiatry Psychiatr Epidemiol 2010. PubMed Abstract | Publisher Full Text OpenURL

  18. Mechanic D: The concept of illness behaviour: culture, situation and personal predisposition.

    Psychol Med 1986, 16(1):1-7. PubMed Abstract | Publisher Full Text OpenURL

  19. Koekkoek B, van Meijel B, Schene A, Hutschemaekers G: A Delphi study of problems in providing community care to patients with nonpsychotic chronic mental illness.

    Psychiatr Serv 2009, 60(5):693-697. PubMed Abstract | Publisher Full Text OpenURL

  20. McCullough JP: Treatment for chronic depression. Cognitive behavioural analysis system of psychotherapy. New York: Guilford Press; 2000. OpenURL

  21. Keller MB, McCullough JP, Klein DN, Arnow B, Dunner DL, Gelenberg AJ, Markowitz JC, Nemeroff CB, Russell JM, Thase ME, et al.: A comparison of nefazodone, the Cognitive Behavioral-Analysis System of Psychotherapy, and their combination for the treatment of chronic depression.

    New Engl J Med 2000, 342(20):1462-1470. PubMed Abstract | Publisher Full Text OpenURL

  22. Linehan MM: Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press; 1993. OpenURL

  23. Linehan MM, Comtois KA, Murray AM, Brown MZ, Gallop RJ, Heard HL, Korslund KE, Tutek DA, Reynolds SK, Lindenboim N: Two-year randomized controlled trial and follow-up of Dialectical Behavior Therapy vs therapy by experts for suicidal behaviors and borderline personality disorder.

    Arch Gen Psychiatry 2006, 63(7):757-766. PubMed Abstract | Publisher Full Text OpenURL

  24. Koekkoek B, van Meijel B, Hutschemaekers G: Community mental healthcare for people with severe personality disorder: narrative review.

    The Psychiatrist 34(1):24-30. Publisher Full Text OpenURL

  25. Koekkoek B, van Meijel B, Schene A, Hutschemaekers G: Clinical problems in community mental health care for patients with severe borderline personality disorder.

    Community Ment Health J 2009, 45(6):508-516. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Bartholomew LK, Parcel GS, Kok GJ: Intervention mapping: a process for developing theory- and evidence-based health education programs.

    Health Educ Behav 1998, 25(5):545-563. PubMed Abstract | Publisher Full Text OpenURL

  27. Bartholomew LK, Parcel GS, Kok GJ, Gottlieb NH: Intervention Mapping: designing theory and evidence-based health promotion programs. Mountain View, California, Mayfield Publishing Company; 2001. OpenURL

  28. van Oostrom S, Anema J, Terluin B, Venema A, de Vet H, van Mechelen W: Development of a workplace intervention for sick-listed employees with stress-related mental disorders: Intervention Mapping as a useful tool.

    BMC Health Serv Res 2007, 7(1):127. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  29. Ramirez-Garcia P, Cote J: Development of a nursing intervention to facilitate optimal antiretroviral-treatment taking among people living with HIV.

    BMC Health Serv Res 2009, 9(1):113. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  30. Koekkoek B, van Meijel B, van Ommen J, Pennings R, Kaasenbrood A, Hutschemaekers G, Schene A: Ambivalent connections: a qualitative study of the care experiences of non-psychotic chronic patients who are perceived as 'difficult' by professionals.

    BMC Psychiatry, in press. OpenURL

  31. Koekkoek B, van Meijel B, Schene A, Hutschemaekers G: Clinical problems in the long-term care of patients with chronic depression.

    J Adv Nurs 2008, 62(6):689-697. PubMed Abstract | Publisher Full Text OpenURL

  32. Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE: Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication.

    Arch Gen Psychiatry 2005, 62(6):617-627. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  33. Lenzenweger MF, Lane MC, Loranger AW, Kessler RC: DSM-IV Personality Disorders in the National Comorbidity Survey Replication.

    Biol Psychiatry 2007, 62(6):553-564. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  34. Andrews G, Henderson S, Hall W: Prevalence, comorbidity, disability and service utilisation: Overview of the Australian National Mental Health Survey.

    Br J Psychiatry 2001, 178(2):145-153. PubMed Abstract | Publisher Full Text OpenURL

  35. Kessler RC, Üstün TB: The WHO World Mental Health Surveys. Global perspectives in the Epidemiology of Mental Disorders. New York, Cambridge University Press; 2008. OpenURL

  36. Kohn R, Saxena S, Levav I, Saraceno B: The treatment gap in mental health care.

    Bull World Health Organ 2004, 82(11):858-866. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  37. Arvidsson H: Met and unmet needs of severely mentally ill persons--the Psychiatric Care Reform in Sweden.

    Soc Psychiatry Psychiatr Epidemiol 2003, 38(7):373-379. PubMed Abstract | Publisher Full Text OpenURL

  38. Keown P, Holloway F, Kuipers E: The prevalence of personality disorders, psychotic disorders and affective disorders amongst the patients seen by a community mental health team in London.

    Soc Psychiatry Psychiatr Epidemiol 2002, 37(5):225-229. PubMed Abstract | Publisher Full Text OpenURL

  39. Greenwood N, Chisholm B, Burns T, Harvey K: Community mental health team case-loads and diagnostic case-mix.

    Psychiatr Bull 2000, 24(8):290-293. Publisher Full Text OpenURL

  40. Hunter M, Jadresic D, Blaine A, Clancy L, Leyshon N, McDonald E, Sanderson I, Whiffin M, Spearing G: Two weeks in the life of a community mental health team: a survey of case-mix and clinical activity in the north-west of Sheffield.

    Psychiatr Bull 2002, 26(1):9-11. Publisher Full Text OpenURL

  41. Ruggeri M, Salvi G, Bonetto C, Lasalvia A, Allevi L, Parabiaghi A, Bertani M, Tansella M: Outcome of patients dropping out from community-based mental health care: a 6-year multiwave follow-up study.

    Acta Psychiatr Scand Suppl 2007, (437):42-52. PubMed Abstract | Publisher Full Text OpenURL

  42. Alegría M, Kessler RC, Bijl R, Lin E, Heeringa SG, Takeuchi DT, Kolody B: Comparing data on mental health service use between countries. In Unmet need in psychiatry Problems Resources Responses. Edited by Andrews G, Henderson S. Cambridge: Cambridge University Press; 2001:97-118. OpenURL

  43. Sareen J, Jagdeo A, Cox BJ, Clara I, ten Have M, Belik SL, de Graaf R, Stein MB: Perceived barriers to mental health service utilization in the United States, Ontario, and the Netherlands.

    Psych Serv 2007, 58(3):357-364. Publisher Full Text OpenURL

  44. Pescosolido B: Rethinking models of health and illness behaviour. In Complementary and alternative medicine: challenge and change. Edited by Kelner M, Wellman B, Pescosolido B, Saks M. Amsterdam: Harwood Academic Publishers; 2000:175-194. OpenURL

  45. Pescosolido BA, Boyer CA: How do people come to Use mental health services? Current knowledge and changing perspectives. In A Handbook for the Study of Mental Health. Edited by Horwitz AV, Scheid TL. Cambridge: Cambridge University Press; 1999:392-411. OpenURL

  46. Gournay K, Brooking J: Community psychiatric nurses in primary health care.

    Br J Psychiatry 1994, 165(2):231-238. PubMed Abstract | Publisher Full Text OpenURL

  47. Devilly GJ, Gournay K: Community psychiatric nursing with non-psychotic patients: relating process to outcome.

    Aust N Z J Ment Health Nurs 1995, 4(2):53-60. PubMed Abstract OpenURL

  48. Koekkoek B: Steun vanaf een wankele basis. Over het werk van sociaal-psychiatrisch verpleegkundigen op een ambulante behandelafdeling.

    Maandblad Geestelijke volksgezondheid 2004, 59(4):214-226.

    [Providing support from shaky ground. On the work of community psychiatric nurses in an ambulatory centre for adults] (2004)

    OpenURL

  49. Bowers L: Community psychiatric nurse caseloads and the 'worried well': misspent time vital work?

    J Adv Nurs 1997, 26(5):930-936. PubMed Abstract | Publisher Full Text OpenURL

  50. Prochaska JO, DiClemente CC: Stages of change in the modification of problem behaviors.

    Prog Behav Modif 1992, 28:183-218. PubMed Abstract OpenURL

  51. Dawson D, MacMillan H: Relationship management of the borderline patient. New York: Brunner/Mazel; 1993.

  52. Dawson DF: Treatment of the borderline patient, relationship management.

    Can J Psychiatry 1988, 33(5):370-374. PubMed Abstract OpenURL

  53. Hoch JS, O'Reilly RL, Carscadden J: Best practices: Relationship Management therapy for patients with borderline personality disorder.

    Psych Serv 2006, 57(2):179-181. Publisher Full Text OpenURL

  54. Miller WR, Rollnick S: Motivational Interviewing. Preparing People for Change. New York: The Guilford Press; 2002. OpenURL

  55. Burke BL, Arkowitz H, Menchola M: The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials.

    J Consult Clin Psychol 2003, 71(5):843-861. PubMed Abstract | Publisher Full Text OpenURL

  56. Fonagy P, Bateman A: Progress in the treatment of borderline personality disorder.

    Br J Psychiatry 2006, 188(1):1-3. PubMed Abstract | Publisher Full Text OpenURL

  57. Joosten EA, de Jong CA, de Weert-van Oene GH, Sensky T, van der Staak CP: Shared decision-making reduces drug use and psychiatric severity in substance-dependent patients.

    Psychother Psychosom 2009, 78(4):245-253. PubMed Abstract | Publisher Full Text OpenURL

  58. Phelan M, Slade M, Thornicroft G, Dunn G, Holloway F, Wykes T, Strathdee G, Loftus L, McCrone P, Hayward P: The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness.

    Br J Psychiatry 1995, 167(5):589-595. PubMed Abstract | Publisher Full Text OpenURL

  59. Ziguras SJ, Stuart GW: A meta-analysis of the effectiveness of mental health case management over 20 Years.

    Psych Serv 2000, 51(11):1410-1421. Publisher Full Text OpenURL

  60. Kanter J: Clinical Case Management: definition, principles, components.

    Hosp Community Psychiatry 1989, 40(4):361-368. PubMed Abstract | Publisher Full Text OpenURL

  61. Suber RW, (ed.): Clinical Case Management. A guide to comprehensive treatment of serious mental illness. Thousand Oaks, California: Sage; 1994. OpenURL

  62. Cooper JO, Heron TE, Heward WL: Applied Behavior Analysis. 2nd edition. Englewood Cliffs, New Jersey: Prentice Hall; 2007. OpenURL

  63. Duncan BL, Miller SD, Sparks JA, Claud DA, Reynolds LR, Brown J, Johnson LD: The Session Rating Scale: preliminary psychometric properties of a "working" alliance measure.

    Journal of Brief Therapy 2003, 3(1):3-12. OpenURL

  64. Kilminster SM, Jolly BC: Effective supervision in clinical practice settings: a literature review.

    Med Educ 2000, 34(10):827-840. PubMed Abstract | Publisher Full Text OpenURL

  65. Edwards D, Burnard P, Hannigan B, Cooper L, Adams J, Juggessur T, Fothergil A, Coyle D: Clinical supervision and burnout: the influence of clinical supervision for community mental health nurses.

    J Clin Nurs 2006, 15(8):1007-1015. PubMed Abstract | Publisher Full Text OpenURL

  66. Rotteveel RJ, Vanmolkot LML: Het intervisieprotocol. Houvast bij de hulpverlening aan chronische patiënten.

    Maandblad Geestelijke Volksgezondheid 1993, 48(12):1299-1311.

    [The intervision protocol. Structure in working with chronic patients]

    OpenURL

  67. Gilburt H, Rose D, Slade M: The importance of relationships in mental health care: A qualitative study of service users' experiences of psychiatric hospital admission in the UK.

    BMC Health Serv Res 2008, 8(1):92. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  68. Little P, Everitt H, Williamson I, Warner G, Moore M, Gould C, Ferrier K, Payne S: Observational study of effect of patient centredness and positive approach on outcomes of general practice consultations.

    BMJ 2001, 323(7318):908-911. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  69. Waddell G, Main CJ, Morris EW, Di Paola M, Gray IC: Chronic low-back pain, psychologic distress, and illness behavior.

    Spine 1984, 9(2):209-213. PubMed Abstract | Publisher Full Text OpenURL

  70. Whitehead WE, Winget C, Fedoravicius AS, Wooley S, Blackwell B: Learned illness behavior in patients with irritable bowel syndrome and peptic ulcer.

    Dig Dis Sci 1982, 27(3):202-208. PubMed Abstract | Publisher Full Text OpenURL

  71. Wooley SC, Blackwell B, Winget C: A learning theory model of chronic illness behavior: theory, treatment, and research.

    Psychosom Med 1978, 40(5):379-401. PubMed Abstract | Publisher Full Text OpenURL

  72. Anthony WA, Cohen M, Farkas M, Gagne C: Psychiatric Rehabilitation. 2nd edition. Boston: Boston University, Center for Psychiatric Rehabilitation; 2002. OpenURL

  73. Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health.

    BMJ 2000, 321(7262):694-696. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/10/293/prepub