Email updates

Keep up to date with the latest news and content from BMC Psychiatry and BioMed Central.

Open Access Study protocol

Effectiveness and efficiency of assertive outreach for Schizophrenia in Germany: study protocol on a pragmatic quasi-experimental controlled trial

Anke Bramesfeld12, Jörn Moock1, Kirsten Kopke1, Dorothea Büchtemann1, Denise Kästner1, Jeanett Radisch1 and Wulf Rössler13*

Author Affiliations

1 Innovation Incubator, Leuphana University Luneburg, Luneburg, Germany

2 Institute Epidemiology, Social Medicine and Health System Research, Hanover Medical School, Hanover, Germany

3 Clinic for Social and General Psychiatry, University of Zurich, Zurich, Switzerland

For all author emails, please log on.

BMC Psychiatry 2013, 13:56  doi:10.1186/1471-244X-13-56


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-244X/13/56


Received:13 December 2011
Accepted:6 February 2013
Published:15 February 2013

© 2013 Bramesfeld et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

A model of assertive outreach (AO) in which office-based psychiatrists collaborate with ambulatory nursing services for providing intensive home-treatment is currently being implemented in rural areas of Lower Saxony, Germany. The costs of the model are reimbursed by some of the statutory health insurance companies active in Lower Saxony. Effectiveness and efficiency of this model for patients suffering from schizophrenia is evaluated in a pragmatic and prospective trial.

Methods

Quasi-experimental controlled trial: patients receiving the intervention are all those receiving AO; controls are patients not eligible for AO based on their health insurance affiliation. Eligibility criteria: clinical diagnosis of schizophrenia (ICD-10 F.20), aged at least 18 years and being moderately to severely impaired in global functioning. Primary outcome: admission and days spent in psychiatric inpatient care; secondary outcomes: clinical and functional status; patient satisfaction with chronic care; health care costs. Follow-up time: 6 and 12 months.

Discussion

The study faces many challenges typical to pragmatic trials such as the rejection of randomisation by service providers, the quality of treatment as usual (TAU) to which the intervention will be compared, and the impairment of the study subjects. Solutions of how to deal with these challenges are presented and discussed in detail.

Trial registration

International Standard Randomised Controlled Trial Number: http://ISRCTN34900108 webcite, German Clinical Trial Register: http://DRKS00003351 webcite

Keywords:
Home treatment; Psychiatry; Integrated care; Seriously mentally ill; Controlled trial

Background

The aim of modern mental health care is to enable severely mentally ill people to live integrated in the community and live as autonomously as possible. Modern mental health care does not only address psychiatric and other medical needs but also social and economic ones [1,2]. It is, therefore, usually community oriented and is provided by different professions and services. However, the challenge that arises in modern mental health care is to provide continuity of care across services and service sectors [3,4].

One possibility for improving continuity of care is to provide assertive outreach (AO) treatment. AO is an intensive and highly integrated approach for community mental health service delivery [5]. AO usually includes the following elements: it is provided by multi-professional teams with a psychiatrist integrated into the team; AO takes over responsibility of health and social care; within AO regular and frequent home visits are provided [6]. However, until now, the findings are controversial as to how far AO is better capable of improving patients’ clinical outcomes and to what extent it reduces the need for days spent in hospital compared to TAU [7]. While older studies report significant effects of AO on patients’ wellbeing and days spent in hospital [8,9], more recent studies fail to do so [10,11].

In some countries, AO is being implemented nationwide and long-standing experience with AO does exist, such as in England and in the Netherlands. Other countries, such as Germany or Belgium, do not make AO available or rather, they are just in the process of implementing first AO-style models.

We will discuss a study protocol to evaluate the effectiveness and efficiency of a model of AO that is currently being implemented in rural areas of Lower Saxony, Germany. It is, thus, a protocol not of a trial but of a pragmatic study.

The German mental health care system is known for its fragmentation [12]: there are separate budgets for in- and outpatient care. Most outpatient care is provided by office-based psychiatrists who operate as independent entrepreneurs. Also, ambulatory nursing services operate as independent entrepreneurs. The medical services that are provided by office-based psychiatrists and nursing services are reimbursed within the budget framework of the statutory health insurances. A further problem in mental health care relates to the scarcity of services in rural areas including office-based psychiatrists, outpatient departments linked to hospitals and social services specialised in serving the severely and chronically mentally ill. In this health system environment, possibilities for intensified outpatient care and cooperation across sectors are limited, and incentives to keep patients out of hospital are low. Thus, admitting patients to psychiatric inpatient care occurs rather quickly.

In this situation, office-based psychiatrists in the rural areas of Lower Saxony have set up collaboration with ambulatory nursing services in a framework of integrated care with the aim of providing a model of AO. The model provides intensive and integrated home treatment as an alternative to inpatient admission. The model is meant to serve the more severely ill, particularly persons suffering from schizophrenia. As core components, this model offers the following service elements (see also Table  1):

•Outpatient care is provided by a multi-professional team. The team leader is an office-based psychiatrist.

•An outreach crisis service is available 24 hours, seven days a week. It is operated by ambulatory nursing services and is backed up by an office-based psychiatrist.

•Home -treatment is provided by nursing services and –if needed – by the psychiatrist.

•Case management is provided by the nursing services, coordinating all the care that the patient receives. Every patient is assigned to a specific nurse as her/his personal case manager. This nurse is replaced by other nurses only during times of her/his absence.

•Psychoeducation is offered regularly.

•Regular team conferences are held and attended by at least one representative of the nursing service and the psychiatrist.

•Care is provided on the basis of an evidence-informed treatment pathway. This treatment pathway was developed by psychiatrists participating in the intervention. The treatment pathway is based on the German national guideline for Schizophrenia. It considers regional conditions as well as prior experiences with integrated care concepts. The treatment-pathway defines precisely the interaction between the nursing service and the psychiatrist, but also when and how to involve other services such as social services (that have different cost-carriers and budgets than the medical services), rehabilitation services, or inpatient psychiatric care. The treatment pathway is binding for service providers that participate in the AO model. It provides also the basis for reimbursement of services within the AO-model. Thus for purposes of reimbursement service provision in relation to the treatment pathway is continuously monitored.

Table 1. Comparison of service provision in “classic” assertive outreach, assertive outreach as implemented in Lower Saxony and treatment as usual (TAU) in mental health care in Lower Saxony and Germany

Office-based psychiatrists who are interested in offering this type of AO sign up with a management association (IVPNetworks GmbH). This management association takes care that psychiatrists perform according to the treatment guideline and it negotiates specific reimbursement schemes for the intervention with statutory health insurance companies. For the time being, the management association has contracted for AO with the Allgemeine Ortskrankenkasse (AOK) in Lower Saxony and with the Techniker Krankenkasse (TK).a Among the patients served at one office based psychiatrist there can be some patients who are eligible for receiving AO, due to their health insurance affiliation, while others are not. Those eligible have to give written consent to be treated with AO. Currently, about 40 psychiatric practices in Lower Saxony have joined this management association. They provide AO in an area of 16,000 km2 and a population of 2 million (of which approximately one third is insured with the AOK or the TK).

The study presented in this protocol tests the following two main hypotheses:

I. Schizophrenic patients who are served by AO have significantly fewer admissions to psychiatric inpatient treatment than patients receiving TAU.

II. Schizophrenic patients who are served by AO have significantly fewer days of psychiatric inpatient treatment than patients receiving TAU.

In addition, further hypotheses are as follows:

III. Schizophrenic patients being served by AO do significantly better clinically and functionally than patients receiving TAU.

IV. Schizophrenic patients being served by AO are significantly more satisfied with the chronic care they receive than patients receiving TAU.

V. Treating schizophrenic patients by AO is more cost-effective than treating schizophrenic patients by TAU.

Methods

The hypotheses named above will be tested in a prospective and controlled cohort study that is quasi-experimental due to the patient´s health insurance affiliation. The intervention of AO will be tested against TAU. Follow-up occurs after six and 12 months.

Outcome and process parameters

The main outcome parameters are the number of admissions to inpatient treatment as well as the number of days spent there. Further outcome parameters include: psychiatric symptomatology, functional status, life satisfaction, adherence to medication, substance misuse, use of services, and satisfaction with chronic care. For details of the scales that will be used to assess these outcome parameters, please see Table  2.

Table 2. Instruments to assess and process

When selecting scales to measure outcome parameters, we did not only consider specificity and reliability of instruments but also practicability. We expect that the patients, who will be recruited into the study, will be quite impaired by the illness. Therefore, questionnaires need to be simple, easy to handle and not too time-consuming.

All parameters will be assessed at baseline (t0), after six months (t1), and after 12 months (t2) from all patients receiving the intervention and from all controls. The use of services however will be assessed every three months (5 times) from both groups.

The use of services will be assessed by means of the German version of the Client Sociodemographic and Service Receipt Inventory (CSSRI; [22]). The CSSRI assesses the use of services retrospectively for the past three months by questioning the patient. The CSSRI reports not only the quantitative use of inpatient and outpatient medical and psychiatric services and medication, but also the use of other forms of public support. This includes the use of social services, such as housing, rehabilitation services, the patient’s income, including social benefits and other forms of state payments, as well as their vocational affiliation and number of days of sick leave. Thus, the CSSRI assesses not only the main outcome, i.e., days spent in psychiatric inpatient care, but also serves as documentation of the process of care across sectors and services for both the intervention and the control group. Finally, the information gathered by the CSSRI allows for calculating direct as well as indirect health care costs [22,23].

Likewise, the German version of Patient Assessment of Chronic Care (PACIC; [24]) that is used to measure patients´ satisfaction with chronic care, serves as an instrument to measure outcome as well as process. The PACIC assesses whether patients receive specific services and information – such as health education and shared decision making – that are proven to be significant in the care of chronic patients [25]. Originally, the PACIC was developed for somatic medicine. However, it has been shown to be relevant also in the evaluation of care provided to mentally ill patients [26].

Recruitment

Patients will be recruited in the practices of office-based psychiatrists who provide AO. Recruitment will be done by the treating psychiatrist. Unfortunately, we were not successful in convincing the attending psychiatrists to support “real” randomisation of patients receiving AO or those receiving TAU. “Real” randomisation would have meant that the office-based psychiatrists would lose 50% of the extra money they receive from health insurance companies when providing AO. Therefore, a quasi-experimental design will be used instead. As patients allocated to receive the intervention all those patients are considered, who are insured by a health insurance that reimburses AO, and who in fact receive AO. All patients who - due to their health insurance affiliation - are not eligible for AO are considered to be controls. We assume that the affiliation with a specific statutory health insurance company is more or less random. Choice of health insurance company is free, all statutory health insurance companies offer approximately the same services, cost the same and are obliged to insure people regardless of their health and financial status. Even if there might be some differences in social status between the members of different health insurance companies, these differences are most likely obliterated by the social consequences of suffering from schizophrenia.

In this quasi-experimental design, all attending practices recruit the same number of patients receiving the intervention and of patients being controls. An honorarium of 150€ will be paid to the practice per assessment and patient. Patients will receive an honorarium of 20€ per assessment.

Eligibility criteria are: being at least 18 years of age, suffering from schizophrenia (ICD-10 F 20) as diagnosed clinically by the treating psychiatrist, having a maximum score of 60 on the Global Assessment of Functioning Scale (GAF) [14] and being cognitively and linguistically able to fill out the patient questionnaire.

Recruitment is planned to take a year.

Preparing and assisting data collection in the practices

The methodology of the study was developed in close exchange with the psychiatric practices of the management association providing AO. To make this pragmatic trial [26] work, we sought to adjust our study design as closely as possible to the conditions and requirements of daily life and work in the psychiatric practices. Further, all practices are visited by a member of the research team for recruitment and for explaining the study. This team member then becomes the personal contact for this practice throughout the study. The team member trains the practice assistant in handing out and collecting the study materials to patients receiving the intervention and to controls. During recruitment and assessment times the study-team member holds weekly telephone contact to its assigned practice. A telephone hotline is implemented for upcoming urgent questions concerning the study.

Sample size

Previous studies performed in Leipzig, Germany, have shown a mean number of days spent in psychiatric inpatient care by schizophrenic patients of 47 (SD 83) [27]. Further, studies estimated the mean decrease of inpatient days that can be expected from interventions to be 40% [28]. According to Hedeker and colleagues (1999), a baseline sample size of 242 participants in each group would be required to detect a small effect size of 0.2 with a power of 0.80 at a two-tailed significance level of 0.05 [29].

Previous studies have shown that 20% of patients cannot be traced for follow-up or do not return questionnaires over a 12-month survey period [27].We aim to reduce drop-out numbers by keeping records of patients' telephone contact details as well as secondary contact names and addresses at the practices of the attending psychiatrists. If patients fail to return for assessment to the attending practice, they are contacted by phone and asked whether they want to continue with the study. This way, we hope to keep the number of drop-outs at a rate of 10%. Thus, the total number of participants to be initially recruited will be 268 patients per group or 536 in total.

Non-response

Even in case of low rates of non-response, patients who are lost to follow-up represent a potential source of selection bias. Therefore we will present a flow chart containing the numbers of patients in different stages of the study (e.g. screened for eligibility, allocated, follow-up) and report reasons for non-response. Furthermore, we will compare baseline characteristics of non-responders and study participants (age, gender and assessment of functioning) as well as of those who are lost to follow-up and those who retain.

Statistical analysis

We will analyse data using per-protocol analysis, considering only those patients who successfully completed the study, as well as using an intention-to-treat approach. Thereby we would also consider those patients who dropped out of the study or changed their originally allocated group.

We will report baseline demographic and clinical characteristics for each study condition and test for baseline equivalence using parametric and non-parametric test as appropriate. If necessary, we will control for baseline differences. Missing data will be analysed.

Longitudinal data will be analysed using standard models for repeated measures including multivariate mixed effects analysis of variance, random effects and generalized estimating equation (GEE) models, as appropriate.

Whenever possible, measures of "practical relevance" such as proportion of explained variance, accuracy of prediction, or effect size will be reported. Statistical analyses will be performed using standard software packages (SPSS, STATA).

Ethics and dissemination

Written consent is sought from all participants. For those under legal guardianship, consent is also sought from the guardian. The patients’ identity on the questionnaires will be pseudonymised by the recruiting practice. Only the pseudonymised filled-out questionnaires will be sent to the study centre. Thus, there is no direct contact between patients and researchers. The Research Ethics Committee of the Lower Saxony Medical Association approved the study (Ärztekammer Niedersachsen BO/03/2011). It is compliant with the Helsinki Declaration. The reporting of the study will be in accordance with standards of the CONSORT extension for pragmatic trials and the TREND statement [30,31].

Discussion

There are many challenges confronting this pragmatic study on the effectiveness and efficiency of this assertive outreach (AO) model in rural areas of Lower Saxony in Germany:

Researching a real life implemented intervention

While it is common in trials that extra time is planned for the tasks related to research, this is not the case in this pragmatic study evaluating a real-life implemented intervention. All service providers participating in the study do so voluntarily and in addition to their daily routine and regular professional obligations. So first of all, office-based psychiatrists have to be convinced to participate in the study. Then, they have to recruit patients for participating in the study, seek their consent, hand them questionnaires, fill in questionnaires themselves and send pseudonymised data to the study centre. To motivate the psychiatrists to do all these additional tasks in conjunction with the study, they are offered quite a generous honorarium. Further, all practices will have a personal researcher assigned who will support them with advice during the whole process of the study. In addition, the study protocol seeks to keep extra work for service providers to a minimum. Thus, most questionnaires are filled out by the patients themselves. The questionnaire on use of services needs to be filled out by the practice assistant together with the patient.

Despite the challenge of motivating office-based psychiatrists to participate in the study and of keeping their motivation high during the course of the study, a pragmatic study has advantages over an experimental trial. While a trial is always a kind of in vitro artificial situation, a pragmatic study deals with the real life conditions of the health system. This implies that patients appear with the average mix of co-morbidities. Also, health care providers have, on average, a mixture of qualifications compared with top-level trained specialists in academic centres. They all operate within the constraints of the health system. These real life conditions may make research more difficult however, they also increase external validity [32]. In case that a real life study succeeds in showing the effectiveness and efficiency of an intervention, the likelihood increases that this intervention does in fact work [33]. On the other hand, the validity of the results is impaired by possible selection biases, as in the study presented here, real randomisation was not possible. At the same time, the – possibly effective – intervention is likely to be more sustainable than interventions that are only implemented in the context of a trial. Many home treatment interventions that were implemented in the context of a trial were not maintained for long beyond the trial [34].

Researching severely ill people

AO is meant to be an intervention for the more severely mentally ill. To assure this, the Global Assessment of Functioning Scale (GAF) is used as an inclusion criterion. This means that patients in this study experience at least moderate to severe problems in social or vocational functioning. We expect many patients to be much more impaired than GAF 60. As our pre-tests showed, filling out a questionnaire can be quite challenging to such impaired patients. To enable a broad participation also for more severely ill persons, we had to keep the questionnaires as lean as possible. This implies that we preferred shorter, simplified questions over the original longer ones. We boiled down quality of life to one question rating life satisfaction on an 11 point scale [16] as well as restricted the alcohol and drug use scale to two introductory questions referring to the quantity of alcohol and drug intake.

Controlling for TAU

Whether an intervention that changes the modes of services provision such as case management is effective or not, is not only related to the strength and quality of the intervention, but also the quality of TAU to which the intervention is compared is decisive [35,36]. This study will assess the use of services in intervention and TAU condition every three months by means of the Client Sociodemographic and Service Receipt Inventory (CSSRI). Thereby, we will be able to describe in detail characteristics and differences in the care that patients receive in the intervention and TAU group. This will enable us to interpret our outcome findings by considering the process of care.

Bias

We aim to recruit equal numbers of patients receiving the intervention and of controls from the same psychiatrist. Thus, possible bias in respect to context variables will be minimised. Further, the relatively high number of participating psychiatrists should eliminate data distortion due to different physician-patient interaction styles.

The quasi-experimental design that distinguishes participants by their affiliation to a specific health insurance company and thus, their eligibility for AO, can limit the study validity. The data from the study will show whether our assumption is true that schizophrenic patients in different health insurance companies are more or less equal in terms of socio-economic and health status.

Conclusion

In a mental health system that is as fragmented as the German one, it is crucial to find interventions that bridge some of the fragmentation in service provision. The model of AO that is to be researched in this study presents one possible solution to some of the fragmentation of the system. It is innovative in the context of the existing system. By integrating outpatient psychiatric care with ambulatory nursing services, the model provides an AO-style intervention to the severely mentally ill. The findings from the study, regardless of whether they will support or reject the hypotheses, will be of great use for the further development of integrated care and home care in Germany’s mental health system, as well as in other similar health systems.

Endnotes

aThere are 146 statutory health insurance companies in Germany, insuring approximately 90% of the population. AOK and TK are among the larger health insurance companies. AOK Lower-Saxony insures more than one quarter of the population in Lower-Saxony, TK insures close to one tenth of the population in Germany. While AOK insured traditionally have a lower socioeconomic status, TK insured come from an academic and middle class background. Probable social disparities between the insured populations of health insurances companies are originated in former times, when health insurance affiliation was bound to the workplace. For more than 15 years now, choice of health insurance has been free and social disparities between the insured populations of the health insurance companies are levelling out.

Competing interests

There are no conflicting interests of any of the authors in respect to this study.

Authors’ contributions

AB participated in the development of the study design and drafted the paper. JM drafted the methods section and critically revised the other sections. KK participated in the development of the study design and in drafting the paper. DB participated in the development of the study design, in particular the selection of instruments, and revised the paper critically. DK participated in the development of the study design, in particular the selection of instruments, and revised the paper critically. JR participated in the development of the study design and revised the paper critically. WR authored the study design, applied for the funding and revised the paper critically. All authors read and approved the final manuscript.

Acknowledgement

The study is part of the project “Basic Principles and Evaluation of Integrated Care for Mentally Ill Persons”. It is funded by a 2.3 million Euro grant (CCI NO 2007DE161PR001) from the Innovation-Incubator at Leuphana University Luneburg. The Innovation-Incubator is a large scale project at Leuphana University that aims for economic development through research in rural regions in North Lower Saxony. The Innovation-Incubator is funded by European Funds for Regional Development and by the Federal State of Lower Saxony.

We are grateful to the colleagues at IVPNetworks GmbH who manage the intervention described in the study protocol, for supporting this study; also many thanks to Sharon Janicki for revising the language of the article.

References

  1. WHO/ OMS: Rapport sur la santé dans le monde, La santé mentale: Nouvelle conception, nouveaux éspoirs. Genève: Organisation Mondial de la Santé; 2001:2001. OpenURL

  2. WHO: Mental Health Declaration for Europe Facing the Challenges, Building Solutions, Helsinki 12–15.January 2005 edn. Helsinki; 2005. OpenURL

  3. Bachrach L: Continuity of care for chronic mental patients: a conceptual analysis.

    Am J Psychiatry 1981, 138:1449-1456. PubMed Abstract | Publisher Full Text OpenURL

  4. Adair C, McDougall G, Mitton C, Joyce A, Wild T, Gordon A: Continuity of care and health outcomes among persons with severe mental illness.

    Psychiatr Serv 2005, 56:1061-1069. PubMed Abstract | Publisher Full Text OpenURL

  5. Dixon L: Assertive community treatment: twenty-five years of gold.

    Psychiatr Serv 2000, 51:759-765. PubMed Abstract | Publisher Full Text OpenURL

  6. Burns T, Catty J, Wright C: De-constructing home-based care for mental illness: can one identify the effective ingredients?

    Acta Psychiatr Scand Suppl 2006, 429:33-35. PubMed Abstract OpenURL

  7. Catty J, Burns T, Knapp M, Watt H, Wright C, Henderson J: Home treatment for mental health problems: a systematic review.

    Psychol Med 2002, 32:383-401. PubMed Abstract OpenURL

  8. Burns T, Raftery J, Beadsmoore A, McGuigan S, Dickson M: A controlled trial of home-based acute psychiatric services. II: treatment patterns and costs.

    Br J Psychiatry 1993, 163:55-61. PubMed Abstract | Publisher Full Text OpenURL

  9. Burns T, Beadsmoore A, Bhat AV, Oliver A, Mathers C: A controlled trial of home-based acute psychiatric services. I: clinical and social outcome.

    Br J Psychiatry 1993, 163:49-54. PubMed Abstract | Publisher Full Text OpenURL

  10. Sytema S, Wunderink L, Bloemers W, Roorda L, Wiersma D: Assertive community treatment in the Netherlands: a randomized controlled trial.

    Acta Psychiatr Scand 2007, 116:105-112. PubMed Abstract | Publisher Full Text OpenURL

  11. Bhugra D, Ayonrinde O, Butler G, Leese M, Thornicroft G: A randomised controlled trial of assertive outreach vs. treatment as usual for black people with severe mental illness.

    Epidemiol Psychiatr Sci 2011, 20:83-89. PubMed Abstract | Publisher Full Text OpenURL

  12. Salize H-J, Rössler W, Becker T: Mental health care in Germany.

    Eur Arch Psychiatry Clin Neurosci 2007, 257:92-103. PubMed Abstract | Publisher Full Text OpenURL

  13. Winter JP, Calsyn RJ: The Dartmouth Assertive Community Treatment Scale (DACTS). A generalizability study.

    Eval Rev 2000, 24:319-338. PubMed Abstract | Publisher Full Text OpenURL

  14. Saß H, Wittchen H, Zaudig M: Skala zur Globalbeurteilung des Funktionsniveaus für DSM-IV. In Diagnostisches und statistisches Manual psychischer Störungen. Edited by Saß H, Wittchen H, Zaudig M. Göttingen: Hogrefe; 1996. OpenURL

  15. Overall J, Gorham D: The brief psychiatric rating scale.

    Psychol Rep 1962, 10:799-812. Publisher Full Text OpenURL

  16. Wagner GG: Wie die 11er-Skala in das SOEP kam - Ein Beitrag zu den Problemen und Möglichkeiten multidisziplinärer Forschung und zugleich eine Fußnote zum Design der SOEP-Stichprobe. In Arbeitsmarkt- und Sozialpolitikforschung im Wandel: Festschrift für Christof Helberger zum 65. Geburtstag. Edited by Schwarze J, Räbiger J, Thiede R. Hamburg: Verlag Dr. Kovac; 2007:41-62. OpenURL

  17. Üstün TB, Kostanjesek N, Chatterji S, Rehm J: Measuring Health and Disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva: WHO; 2010. OpenURL

  18. Mueser KT, Drake R, Clark R, McHugo G, Mercer-McFadden C, Ackerson TH: Toolkit for evaluating substance abuse in persons with severe mental illness. Cambridge, MA: Center at Human Services Research Institute; 1995. OpenURL

  19. Thompson K, Kulkarni J, Sergejew AA: Reliability and validity of a new Medication Adherence Rating Scale (MARS) for the psychoses.

    Schizophr Res 2000, 42:241-247. PubMed Abstract | Publisher Full Text OpenURL

  20. Gugiu PC, Coryn C, Clark R, Kuehn A: Development and evaluation of the short version of the patient assessment of chronic illness care instrument.

    Chronic Illn 2009, 5:268-276. PubMed Abstract | Publisher Full Text OpenURL

  21. Chisholm D, Knapp MR, Knudsen HC, Amaddeo F, Gaite L, van Wijngaarden B: Client socio-demographic and service receipt inventory–European version: development of an instrument for international research. EPSILON study 5. European psychiatric services: inputs linked to outcome domains and needs.

    Br J Psychiatry Suppl 2000, 39:s28-s33. PubMed Abstract OpenURL

  22. Roick C, Kilian R, Matschinger H, Bernert S, Mory C, Angermeyer M: German adaptation of the client sociodemographic and service receipt inventory - an instrument for the cost of mental health care.

    Psychiatr Prax 2001, 28(Suppl 2):S84-S90. PubMed Abstract | Publisher Full Text OpenURL

  23. Kilian R, Roick C, Matschinger H, Bernert S, Mory C, Angermeyer MC: The analysis of the cost structures of the treatment of schizophrenia by means of standardized assessment instruments.

    Psychiatr Prax 2001, 28(Suppl 2):S102-S108. PubMed Abstract | Publisher Full Text OpenURL

  24. Rosemann T, Laux G, Droesemeyer S, Gensichen J, Szecsenyi J: Evaluation of a culturally adapted German version of the Patient Assessment of Chronic Illness Care (PACIC 5A) questionnaire in a sample of osteoarthritis patients.

    J Eval Clin Pract 2007, 13:806-813. PubMed Abstract | Publisher Full Text OpenURL

  25. Gensichen J, Muth C, Butzlaff M, Rosemann T, Raspe H, Müller de Cornejo G: Die Zukunft ist chronisch: das Chronic Care-Modell in der deutschen Primärversorgung. Übergreifende Behandlungsprinzipien einer proaktiven Versorgung für chronische Kranke.

    Zeitschr ärztl Fortb Qual Gesundheitswesen 2006, 100:365-374. PubMed Abstract | Publisher Full Text OpenURL

  26. Gensichen J, von Korff M, Peitz M, Muth C, Beyer M, Guthlin C: Case management for depression by health care assistants in small primary care practices: a cluster randomized trial.

    Ann Intern Med 2009, 151:369-378. PubMed Abstract | Publisher Full Text OpenURL

  27. Kilian R, Matschinger H, Becker T, Angermeyer MC: A longitudinal analysis of the impact of social and clinical characteristics on the costs of schizophrenia treatment.

    Acta Psychiatr Scand 2003, 107:351-360. PubMed Abstract | Publisher Full Text OpenURL

  28. Puschner B, Steffen S, Gaebel W, Freyberger H, Klein HE, Steinert T: Needs-oriented discharge planning and monitoring for high utilisers of psychiatric services (NODPAM): design and methods.

    BMC Health Serv Res 2008, 8:152. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  29. Hedeker D, Gibbons RD, Waternaux C: Sample size estimation for longitudinal designs with attrition: comparing time-related contrasts between two groups.

    J Educ Behav Stat 1999, 24:70-93. OpenURL

  30. Des Jarlais DC, Lyles C, Crepaz N: Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement.

    Am J Public Health 2004, 94:361-366. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  31. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B: Improving the reporting of pragmatic trials: an extension of the CONSORT statement.

    BMJ 2008, 337:a2390. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  32. Seekles W, van Straten A, Beekman A, van Marwijk H, Cuijpers P: Stepped care for depression and anxiety: from primary care to specialized mental health care: a randomised controlled trial testing the effectiveness of a stepped care program among primary care patients with mood or anxiety disorders.

    BMC Health Serv Res 2009, 9:90. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  33. Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity.

    BMC Med Res Methodol 2003, 3:28. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  34. Wright C, Catty J, Watt H, Burns T: A systematic review of home treatment services–classification and sustainability.

    Soc Psychiatry Psychiatr Epidemiol 2004, 39:789-796. PubMed Abstract OpenURL

  35. Burns T: End of the road for treatment-as-usual studies?

    Br J Psychiatry 2009, 195:5-6. PubMed Abstract | Publisher Full Text OpenURL

  36. Simon G, Fleck M, Lucas R, Bushnell D, LIDO Group: Prevalence and predictors of depression treatment in an international primary care study.

    Am J Psychiatry 2004, 161:1626-1634. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-244X/13/56/prepub