Email updates

Keep up to date with the latest news and content from BMC Psychiatry and BioMed Central.

Open Access Study protocol

Expectations, experiences and attitudes of patients and primary care health professionals regarding online psychotherapeutic interventions for depression: protocol for a qualitative study

Jesús Montero-Marín12, José Miguel Carrasco3, Miquel Roca4, Antoni Serrano-Blanco5, Margalida Gili4, Fermin Mayoral6, Juan V Luciano5, Yolanda Lopez-del-Hoyo7, Barbara Olivan7, Francisco Collazo8, Ricardo Araya9, Rosa Baños1012, Cristina Botella1112 and Javier García-Campayo113*

Author Affiliations

1 Department of Psychiatry, University of Zaragoza, Zaragoza, Spain

2 Faculty of Health and Sports, University of Zaragoza, Huesca, Spain

3 Research Unit, Sociedad Española de Reumatología, Madrid, Spain

4 Institut Universitari d’Investigació en Ciències de la Salut (IUNICS), University of Balearic Islands, Palma de Mallorca, Spain

5 Parc Sanitari Sant Joan de Déu, and Fundación Sant Joan de Déu, Sant Boi de Llobregat, Barcelona, Spain

6 Psychiatric Service, University Hospital Carlos Haya, Malaga, Spain

7 Departamento de Psicología y Sociología, Universidad de Zaragoza, Zaragoza, Spain

8 Servei de Psiquiatria, Hospital Universitari Vall d’Hebron, Barcelona, Spain

9 Academic Unit of Psychiatry, School of Social and Community Medicine, University of Bristol, Bristol, UK

10 University of Valencia, Valencia, Spain

11 Jaume I University, Castellón, Spain

12 CIBER Pathophysiology of Obesity and Nutrition (CB06/03), Carlos III Institute of Health, Madrid, Spain

13 Psychiatry Service, Miguel Servet Hospital, Avda Gomez Laguna 52, 4D 50.009, Zaragoza, Spain

For all author emails, please log on.

BMC Psychiatry 2013, 13:64  doi:10.1186/1471-244X-13-64

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-244X/13/64


Received:20 April 2012
Accepted:13 February 2013
Published:20 February 2013

© 2013 Montero-Marin et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

In the year 2020, depression will cause the second highest amount of disability worldwide. One quarter of the population will suffer from depression symptoms at some point in their lives. Mental health services in Western countries are overburdened. Therefore, cost-effective interventions that do not involve mental health services, such as online psychotherapy programs, have been proposed. These programs demonstrate satisfactory outcomes, but the completion rate for patients is low. Health professionals’ attitudes towards this type of psychotherapy are more negative than the attitudes of depressed patients themselves. The aim of this study is to describe the profile of depressed patients who would benefit most from online psychotherapy and to identify expectations, experiences, and attitudes about online psychotherapy among both patients and health professionals that can facilitate or hinder its effects.

Methods

A parallel qualitative design will be used in a randomised controlled trial on the efficiency of online psychotherapeutic treatment for depression. Through interviews and focus groups, the experiences of treated patients, their reasons for abandoning the program, the expectations of untreated patients, and the attitudes of health professionals will be examined. Questions will be asked about training in new technologies, opinions of online psychotherapy, adjustment to therapy within the daily routine, the virtual and anonymous relationship with the therapist, the process of online communication, information necessary to make progress in therapy, process of working with the program, motivations and attitudes about treatment, expected consequences, normalisation of this type of therapy in primary care, changes in the physician-patient relationship, and resources and risks. A thematic content analysis from the grounded theory for interviews and an analysis of the discursive positions of participants based on the sociological model for focus groups will be performed.

Discussion

Knowledge of the expectations, experiences, and attitudes of both patients and medical personnel regarding online interventions for depression can facilitate the implementation of this new psychotherapeutic tool. This qualitative investigation will provide thorough knowledge of the perceptions, beliefs, and values of patients and clinicians, which will be very useful for understanding how to implement this intervention method for depression.

Keywords:
Depression; Online psychotherapy; Internet-based treatment; Protocol; Qualitative study

Background

Reports from the World Health Organization say that depression will cause the second highest level of disability worldwide by the year 2020 [1]. It is also known that 25% of the population will experience depression symptoms at some point in their lives [2]. Studies confirm that 25-35% of patients visiting primary care suffer from a psychiatric disorder and that more that 80% of these cases are minor psychiatric disorders, mainly depression and anxiety [3]. It is known that family physicians only refer 5-10% of the psychiatric pathologies that they detect to mental health services [4]. Despite this low referral rate, mental health services in Western countries are overburdened. Given the high prevalence of minor psychiatric disorders, health officials worldwide assume that it is not possible to count on the availability of mental health professionals or economic resources to meet this need, and the situation will become even more unfavourable in the near future [5]. For this reason, cost-effective alternatives are being proposed for the treatment of minor psychiatric disorders in general, and depression in particular, that do not involve (or only minimally involve) mental health services. The therapeutic solutions that are most frequently investigated are brief psychotherapies that can be administrated from a personal computer, such as conflict resolution therapy [6], bibliotherapy [7], self-help programs [8] and computer-assisted psychotherapy programs [9].

The term “computer-assisted psychotherapy” is used to refer to any psychotherapy program (all programs currently available use cognitive-behavioural therapy) that uses the patient’s responses to perform some type of decision-making about treatment [10]. This term excludes videoconferences and self-help programs that involve exclusively bibliotherapy, chats, or support groups, among other approaches. Computer programs decrease the work of psychotherapists by more than 80% but do not eliminate it completely. In fact, it has been shown that treatment programs with no human intervention are associated with a higher frequency of dropouts, so their effectiveness is lower. Patients tend to access therapy from a home computer and usually complete short sessions, approximately 20 minutes long, at least once a week for 3–6 months [10]. Research has assessed the effectiveness of computer-assisted psychotherapy for treating psychiatric disorders as varied as anxiety, depressive disorders, alcohol abuse, and psychosomatic illnesses [11-13]. Recent research on the cost-effectiveness of computer-assisted psychotherapy has yielded very satisfactory results [14,15].

In the specific case of depression, studies show that computer-assisted psychotherapy is effective for the treatment of light and moderate depression [9]. This result has led the National Institute for Health and Clinical Excellence of the British National Health Service to support the widespread use of a computer-assisted psychotherapy program (“Beating the Blues”) in the treatment of depression [10]. Other studies show that computer-assisted psychotherapy is very effective, indicating that the program could be viable not only at the primary care level but also in the mental health services context. Computer-assisted psychotherapy could be recommended as a first treatment step for self-help in treating depression and anxiety before visiting a psychiatrist or psychologist [16]. Recent studies have evaluated computer-assisted psychotherapy programs, such as “Blues Begone”, in which there is no psychotherapist present and the program can be administered completely by the patient [17]. The effectiveness of this type of program is also very high, and its use has been evaluated through naturalistic studies and randomised trials [17,18]. The effect size is 0.5 (Cohen’s d) when analysed by intention to treat and 1 (Cohen’s d) when only the patients who complete the program are analysed. In addition, effectiveness is maintained 6 months after finishing the therapy program [18]. Other computer-assisted intervention models are being tested in which treatment is delivered by a therapist in real time via the Internet, and the results of these tests are positive in terms of effectiveness and acceptability [19].

This type of therapy produces a very positive expectation in patients and a high degree of satisfaction [20,21]. However, there are some limitations to its systematic use. The completion rate for patients in clinical trials is 56%. In most cases, patients withdraw for personal reasons, not because of problems with the technology or the social environment. Interestingly, the attitudes of professionals towards this type of psychotherapy are more negative than the attitudes of patients themselves [20,21]. There are few previous studies on the acceptability of computer-based psychotherapy, particularly in the primary care setting [20].

Objectives

The first objective of this research is to describe the profile of depressed patients who would benefit the most from online-assisted psychotherapy. The second objective is to identify expectations, experiences, and attitudes among both patients and health professionals that may serve as barriers to or facilitators of online-assisted psychotherapy by considering the types of information that they require throughout the therapeutic process for adequate intervention development.

Methods

Design

A qualitative study in the context of a randomised controlled trial on the effectiveness of an online psychotherapeutic intervention for depression is proposed. Through in-depth interviews [22], first, an attempt will be made to understand the experiences of depressed patients with online psychotherapy interventions, the reasons why people decided to end treatment, and the expectations of those who are not treated (considered separately to avoid the possible additional therapeutic effect of the interviews). Second, the research will aim to understand the attitudes and experiences of family physicians, department heads, and managers regarding the implementation of this type of therapy. Focus groups [22] will also be formed to explore dynamic interactions in light of cultural characteristics and concrete values that can be the basis for participants’ views and preferences. In this way, qualitative information will be obtained from a collective and group vision that only emerges from individual interviews with some difficulty [23-25]. This methodological triangulation will increase the consistency and rigor of the study by combining multiple techniques. By placing emphasis on different aspects or perspectives of analysis, these techniques complement and balance each other [26]. The project has been approved by the Regional Ethics Committee of Aragón (Spain).

Participants

The study will be performed in the Spanish autonomous communities of Andalucía, Aragón, and Baleares. The patients will be recruited during visits to a primary care physician, and diagnosis will be established using the MINI Neuropsychiatric Interview in Spanish [27]. All participants chosen will report depressive symptoms as listed in the ICD-10 criteria, with Beck Depression Inventory (BDI) scores indicating depression of low severity (i.e., scores of 14–19) [28]. Family physicians, department heads, and managers will be chosen for the implementation of the program prepared for the randomised controlled trial. The patients and health professional participants will be selected while considering the variables that maintain homogeneity and discursive heterogeneity regarding the objectives of the study, such as age, gender, residential setting, affinity for technology, and opinion of other types of interventions or therapies. The department heads and managers, as a minority group, will be chosen only based on whether their workplace is rural or urban. When recruiting patients, we will exclude those patients from the study who are younger than 18 or older than 65 years old, immigrants with language difficulties that prevent them from completing the program, affected by serious psychiatric disorders (e.g., psychosis, dementia), or demonstrate clear technophobia during the interview. Through purposive sampling, an attempt will be made to capture rich and varied information in agreement with the goals of the study [29], thus optimising the representation of participants’ opinions.

A preliminary analysis will allow us to progress though the interviews in an iterative manner until the data are saturated; that is, until the new information becomes redundant and provides no new perspectives. We hope that this will occur after approximately 10 interviews in each of the four groups (depressed patients who completed online psychotherapy; depressed patients who decided to discontinue online psychotherapy treatment; depressed patients who did not receive treatment online; and family physicians, department heads, and managers). After the interviews, four focus groups will be conducted, each consisting of between eight and ten subjects. An attempt will be made to ensure the adequate representation of the stratification variables considered but with intergroup heterogeneity and intragroup homogeneity to allow the groups to be formed appropriately [24,30]. The necessary information to establish the appropriate stratifications will be collected before beginning the interviews and focus groups.

Data collection

The researchers involved in the study will receive training in qualitative social research procedures, in-depth interviews, and focus groups [22]. Topics to be addressed in both the individual interviews and focus groups will be discussed by the team of researchers and will guide the interviewers and moderators in the same direction. In-depth interviews will be carried out by a single interviewer, who will indirectly raise the objectives of the study, questioning interviewees about topics in an open and progressive way. The interviewer will also explain the need for recording the session (only audio) and will take notes about non-verbal language elements. The focus groups will be moderated by an interviewer, and another person from the research team may be present as an observer. The role of the moderator will be to indirectly explain the objectives of the study, introduce the topics of interest, and direct the group dynamics to encourage dialogue and participation. The function of the observer is limited to collecting field notes to provide additional information to the verbal data obtained, such as information related to non-verbal language, responses to the moderator’s interventions, and contextual aspects. The indirect introduction of the objectives will enable us to analyse the participants’ natural approach to the issues of interest.

We will seek to achieve optimum standardisation in the sessions with a specification guide with open and flexible content (Table 1) while allowing the inclusion of issues introduced by the participants [31]. The basic topics to explore, pre-selected by a panel of experts (psychiatrists, psychologists, and sociologists with experience in applying new mental health technologies), will include key issues such as training in new technologies, opinions about therapy in general and about the use of computer-assisted psychotherapy [20], accommodation of therapy into the daily routine, the possibility of developing a virtual and anonymous relationship with the therapist, the process of online communication of thoughts and emotions, re-reading and revising the written material describing thoughts and emotions [32], information needed to adequately address the online therapeutic process [33], material conditions for practice, program content and personal preferences, identification with and applicability of the program, professional support and adherence, experiences of symptomatic changes and their possible relationship with the program [34], continual engagement with the program, and facilitators, barriers, and expected consequences that may result from this type of intervention [35]. Specific topics will be added to understand how to offer this therapy in the primary care context and the modification of the doctor-patient relationship that may result. When interviewing the department heads and managers, resources and risks will be addressed.

Table 1. Topic list

We will ensure the confidentiality and anonymous nature of the study for potential participants. All of the sessions will be audio taped with the consent of the participating subjects, and the material will be transcribed verbatim. Both the interviews and the focus groups will last approximately 60–90 minutes. The two researchers responsible for the focus groups will meet after each session to clarify and exchange views and field notes. This information will be analysed with data from the audio recordings and notes [31].

Data analysis

The body of text (verbatim) will consist of recordings transcribed literally, supplemented by notes from observations and comments from interviewers/moderators and collaborators. The interviewers/moderators will verify the transcripts to guarantee the accuracy of the data. Final validation will be performed by inviting the participants to read and discuss the transcribed content [36].

The preliminary analysis will begin after the first interviews and progress through the interviews iteratively to confirm or discount the topics found [37]. The transcriptions and notes will be reread and analysed by two independent social researchers who are experts in qualitative content analysis, using a vertical, interpretive, emergent, and non-frequency-based approach [22,38]. Through thematic analysis, supported by the initial guide for content specification as the first framework for approximation and using the constant comparative method from fundamental theory, key units of meaning will be identified that enable us to deconstruct every sentence [39]. The information contained in the generated text segments will be compared and grouped through open coding until a common conceptual denomination for all segments of text that share the same thematic unit is reached [40]. Provisional interpretations will be made to highlight the characteristics and relationships of the emerging codes generated, which will form new categories as a result of their gradual fusion [39-41]. These broader categories, defined in an exclusive manner based on agreement among the researchers, will make the conceptual structure denser until a parsimonious solution can be reached. Cases that cannot be classified will be actively sought out during the analysis, and the emerging categories will be redefined in response to these cases [42,43].

The information gathered from focus groups will be analysed using the model of sociological analysis [44,45]. In this technique, the reading and organisation of data are not based on fragmentation of the text but on the interpretation of the different discursive positions among the participants and the identification of the explanatory axes of their interventions [46]. The themes and patterns will be identified and coded by two independent researchers, taking into account the context in which the interventions took place. Each step towards configuring the potential explanatory axes will require an iterative reading to validate and confirm the interpretation of new findings, ensuring the credibility of the process by reviewing the data again from the beginning [47]. At first, the material from different groups will be analysed separately (intra-group analysis), but later, it will be regrouped and pooled to compare the relevant themes (inter-group analysis). The precision of the analysis will be increased by highlighting the consistent results in all groups, and special attention will be given to “sensitive moments” in the interaction as indicators of important discussions. The whole process will be triangulated between the two researchers, and differences will be resolved through discussion.

To manage the data, we will use the analysis program MAXQDA 2007. The results of the thematic content analysis of the interviews and the interpretation of the main explanatory axes in the focus groups will be presented alongside the empirical references in the text, selecting the most representative verbatim segments for use as examples. The researchers will develop a list of concepts identified in the interviews and focus groups and create conceptual diagrams that increase understanding and comparability. The final coding framework will be discussed with the main researcher and therapy coordinator so that all stakeholders agree.

Discussion

Online computer-assisted psychotherapy seems to be an effective and cost-effective approach to treating mild to moderate depression [14,16-18]. In fact, referring patients to computer-assisted psychotherapy after consultation in primary care could relieve some of the burden on mental health services, which are presently unable to meet the demand for mental health care [5]. Knowledge of the expectations, experiences, and attitudes of those involved in the therapeutic process is very important if this new form of treatment is to be implemented successfully. To date, research on these issues has been restricted to the perspective of the patient [32-35] without adequately addressing the perspectives of health officials who would be involved in recommending this type of intervention. Interestingly, these professionals show greater resistance to the use of this kind of intervention than the patients themselves do. The majority of patients who discontinue computer-assisted psychotherapy treatment do so for personal reasons and not because of problems with the technology or the social environment [20,21]. The changes introduced to clinical practice and the doctor-patient relationship by computer-assisted psychotherapy make it important to identify the profile of patients who could benefit most from this therapeutic approach. In addition, it is very important to understand the difficulties that may arise during the therapeutic process to address them and to identify facilitators for completing the treatment.

Qualitative research methods provide a thorough understanding of the perceptions, beliefs, and values of the people being studied, and they are very useful in the health field [48,49]. These methods provide the opportunity to explore the points of view of both patients and medical personnel involved in the therapeutic process, thus helping researchers to understand them [29]. This study does not quantify the hypothetical positive or negative aspects of online therapeutic intervention or the correlations between opinions and other types of variables [25,50]. Through this research, an attempt is made to understand the values and experiences of the participants in the context of the study, which are valid to the extent that they contribute to the knowledge and understanding of the therapeutic reality of this type of intervention.

Competing interests

The authors declare that they have no competing interests.

Authors’ contribution

JM-M, JMC, ASB, MR, MG, RB, CB, RA and JG-C conceptualised the study. JM-M wrote the manuscript and all authors participated in critically revising for important intellectual content and have given final approval of the version to be published.

Authors’ information

Jesús Montero-Marín, Javier García-Campayo, Miquel Roca, Antoni Serrano-Blanco, Margalida Gili, Fermín Mayoral, Juan V. Luciano, Yolanda López del Hoyo and Bárbara Oliván belong to the REDIAPP (Research Network on Preventative Activities and Health Promotion, RD06/0018/0017).

Acknowledgements

This project is funded by the Instituto de Salud Carlos III [Carlos III Health Institute] (PI10/01083) and the Ministerio de Ciencia e Innovación [Ministry of Science and Innovation] (PSI2010-17563). The publication of this document was made possible within the framework of collaboration designed by the Research Network on Preventative Activities and Health Promotion (REDIAPP).

References

  1. World Health Organization: The global burden of disease. Géneve: WHO; 2001. OpenURL

  2. Sartorius N, Goldberg D, Girolamo G: Silva JA Ce, Lecrubier Y, Wittchen HU: Psychological disorders in general medical settings . New York: Hogrefe & Huber Publishers; 1990. OpenURL

  3. Goldber D, Huxley P: Enfermedad mental en la comunidad. [Mental illness in the community]. Madrid: Nieva; 1990. OpenURL

  4. Agüera LF, Reneses B, Muñoz P: Enfermedad mental en atención primaria. [Mental illness in primary care]. Madrid: Flas; 1996. OpenURL

  5. Lehtinen V, Riikonen E, Latineen E:

    Promotion of mental health on the European agenda. Report. Finnish ministry of. Social Affairs and Health: Dpt for Prevention and Promotion. 2000. OpenURL

  6. Cuijpers P, van Straten A, Warmerdam L: Problem solving therapies for depression: a meta-analysis.

    Eur Psychiatry 2007, 22:9-15. PubMed Abstract | Publisher Full Text OpenURL

  7. Cuijpers P: Bibliotherapy in unipolar depression: a metaanalysis.

    J Behav Ther Exp Psychiatry 1997, 28:139-147. PubMed Abstract | Publisher Full Text OpenURL

  8. Bower P, Richards P, Novell K: The clinical and cost-effectiveness of self-help treatment for anxiety and depressive disorders in primary care: a systematic review.

    Br J Gen Pract 2001, 51:838-845. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Kaltenthaler E, Parry G, Beverley C, Ferriter M: Computerised cognitive-behavioural therapy for depression: systematic review.

    Br J Psychiatry 2008, 193:181-184. PubMed Abstract | Publisher Full Text OpenURL

  10. Marks IM, Cavanagh K, Gega L: Computer-aided psychotherapy: revolution or bubble?

    Br J Psychiatry 2007, 191:471-473. PubMed Abstract | Publisher Full Text OpenURL

  11. Andersson G: Using the Internet to provide cognitive behaviour therapy.

    Behav Res Therapy 2009, 47:175-180. Publisher Full Text OpenURL

  12. Craske MG, Rose RD, Lang A, Welch SS, Campbell-Sills L, Sullivan G: Computer-assisted delivery of cognitive behavioral therapy for anxiety disorders in primary-care settings.

    Depress Anxiety 2009, 26:235-242. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  13. Titov N: Status of computerized cognitive behavioural therapy for adults.

    Aust N Z J Psychiatry 2007, 41:95-114. PubMed Abstract | Publisher Full Text OpenURL

  14. McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, Ilson S: Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial.

    Br J Psychiatry 2004, 185:55-62. PubMed Abstract | Publisher Full Text OpenURL

  15. McCrone P, Marks IM, Mataix-Cols D, Kenwright M, McDonough M: Computer-aided self-exposure therapy for phobia/panic disorder: a pilot economic evaluation.

    Cogn Behav Ther 2009, 18:1-9. OpenURL

  16. Learmonth D, Rai S: Taking computerized CBT beyond primary care.

    Br J Clin Psychol 2008, 47:111-118. PubMed Abstract | Publisher Full Text OpenURL

  17. Purves DG, Bennett M, Wellman N: An open trial in the NHS of Blues Begone: a new home based computerized CBT program.

    Behav Cogn Psychother 2009, 37:541-551. PubMed Abstract | Publisher Full Text OpenURL

  18. Cavanagh K, Shapiro DA, Van Den Berg S, Swain S, Barkham M, Proudfoot J: The effectiveness of computerized cognitive behavioural therapy in routine care.

    Br J Clin Psychol 2006, 45:499-514. PubMed Abstract | Publisher Full Text OpenURL

  19. Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, Sharp DJ, Araya R, Hollinghurst S, Peters TJ: Therapist-delivered Internet psychotherapy for depression in primary care: a randomised controlled trial.

    Lancet 2009, 374:628-634. PubMed Abstract | Publisher Full Text OpenURL

  20. Waller R, Gilbody S: Barriers to the uptake of computerized cognitive behaviour therapy: a systematic review of the quantitative and qualitative evidency.

    Psychol Med 2009, 39:705-712. PubMed Abstract | Publisher Full Text OpenURL

  21. Kaltenhthaler E, Sutcliffe E, Parry G, Beverley C, Rees A: The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review.

    Psychol Med 2008, 38:1521-1530. PubMed Abstract | Publisher Full Text OpenURL

  22. Vallés MS: Técnicas cualitativas de investigación social. [Qualitative techniques of social research.]. Madrid: Síntesis Sociología; 2003. PubMed Abstract OpenURL

  23. Ibáñez J: Más allá de la sociología. El grupo de discusión: técnica y crítica. [Beyond sociology. The focus group: techniques and criticism.]. Madrid: Siglo XXI; 1986. PubMed Abstract | Publisher Full Text OpenURL

  24. Callejo J: El grupo de discusión: introducción a una práctica de investigación. [The focus group: introduction to a research practice.]. Barcelona: Ariel; 2001. PubMed Abstract OpenURL

  25. Calderón C, Rotaeche R, Carrera C, Larrañaga M, Merino J: Aproximación cualitativa a las actitudes y expectativas de los médicos en el proceso de informatización de la atención primaria. In In Qualitative approximation to the attitudes and expectations of doctors in the process of computerization of primary care. Edited by Mercado FJ, Gastaldo D, Calderón C, comp. Paradigmas y diseños de la investigación cualitativa en salud. [Paradigms and designs in qualitative research in health.]. Guadalajara: Universidad de Guadalajara; 2002. OpenURL

  26. Denzin N, Lincoln Y: Introduction: entering the field of qualitative research. In Handbook of qualitative research. Edited by Denzin N, Lincoln Y. California: Sage; 1994. OpenURL

  27. Ferrando L, Franco A, Bobes J: MINI international neuropsychiatric interview. Madrid: Instituto IAP; 1998. OpenURL

  28. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J: An inventory for measuring depression.

    Arch Gen Psychiatry 1961, 4:53-63. OpenURL

  29. Kotzeva A, Sola I, Carrasco JM, Díaz P, Gracia FJ, Calderón E, de Gaminde I, Estrada MD, Martínez F, Orrego C, Rotaeche R, Salcedo F, Velazquez P, Alonso-Coello P: Perceptions and attitudes of clinicians in Spain toward clinical practice guidelines and grading systems: a protocol for a qualitative study and a national survey.

    BMC Health Serv Res 2010, 10:328. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  30. Krueger RA: Is it a focus group? tips on How to tell.

    J Wound Ostomy Continence Nurs 2006, 33(4):363-366. PubMed Abstract | Publisher Full Text OpenURL

  31. Brown JB: The Use of focus groups in clinical research. In Doing qualitative research. Edited by Crabtree BF, Miller WL. Thousand Oaks, CA: Sage; 1999:109-124. OpenURL

  32. Beattie A, Shaw A, Kaur S: Primary-care patients expectations and experiences of online cognitive behavioural therapy for depression: a qualitative study.

    Health Expect 2009, 12:45-59. PubMed Abstract | Publisher Full Text OpenURL

  33. Barney LJ, Griffiths KM, Banfield MA: Explicit and implicit information needs of people with depression: a qualitative investigation of problems reported on an online depression support forum.

    BMC Psychiatry 2011, 11:88. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  34. Gerhards SAH, Abma TA, Arntz A, de Graaf LE, Evers SMAA, Huibers MJH, Widderswoven GAM: Improving adherence and effectiveness of computerised cognitive behavioural therapy without support for depression: a qualitative study on patient experiences.

    J Affect Disord 2011, 129:117-125. PubMed Abstract | Publisher Full Text OpenURL

  35. Bendelin N, Hesser H, Dahl J, Carlbring P, Zetterqvist K, Andersson G: Experiences of guided Internet-based cognitive-behavioural treatment for depression: a qualitative study.

    BMC Psychiatry 2011, 11:107. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  36. Morse JM, Barret M, Mayan M, Olson K, Spiers J: Verification strategies for establishing reliability and validity in qualitative research.

    IJQM 2002, 1:13-22.

    http://ejournals.library.ualberta.ca/index.php/IJQM/article/view/4603/3756 webcite

    OpenURL

  37. Pope C, Ziebland S, Mays N: Analysing qualitative data.

    Br Med J 2000, 320:114-116. Publisher Full Text OpenURL

  38. Piñuel JL: Epistemología, metodología y técnicas del análisis de contenido [Epistemology, methodology, and content analysis techniques].

    Estudios de Sociolingüística 2002, 3:1-42. PubMed Abstract | Publisher Full Text OpenURL

  39. Strauss A, Corbin J: Basics of qualitative research. 2nd edition. London: Sage; 1998. OpenURL

  40. Glaser BG, Strauss AL: The discovery of grounded theory. Chicago: Aldine; 1967. OpenURL

  41. Strauss A: Qualitative analysis for social scientists. Cambridge: Cambridge University Press; 1987. OpenURL

  42. Berg BL: Qualitative research methods for the social sciences. 6th edition. Boston, MA: Allyn and Bacon; 2007. OpenURL

  43. Silverman D: Doing qualitative research: a practical handbook. 2nd edition. Los Angeles: SAGE; 2005. OpenURL

  44. Alonso LE: La mirada cualitativa en sociología. Una aproximación interpretativa. [A qualitative approach to sociology. An interpretative approach]. Madrid: Editorial Fundamentos; 1998. OpenURL

  45. Phillips N, Hardy C: Discourse analysis. Investigating processes of social construction. Thousand Oaks CA: Sage; 2002. OpenURL

  46. Conde F: El análisis de la información en la investigación cualitativa. [Information analysis in qualitative research]. In Introducción a la investigación cualitativa. Máster de investigación en atención primaria. [Introduction to qualitative research: research masters in primary care]. Edited by Calderón C, Conde F, de Sanmamed MJ F, Monistrol O. Barcelona: semFYC, UAB, Fundació Dr. Robert; 2004. OpenURL

  47. Miller WL, Crabtree BF: The dance of Interpretation. In Doing qualitative research. Edited by Crabtree BF, Miller WL. Thousand Oaks, CA: Sage; 1999:127-143. OpenURL

  48. Pope C, Mays N: Qualitative research in healthcare. London: BMJ Books; 2000. OpenURL

  49. Murphy E, Dingwall R: Qualitative methods and health policy research. New York: Aldine de Gruyter; 2003. OpenURL

  50. Mercado FJ, Gastaldo D, Calderón C: Investigación cualitativa en salud en Iberoamérica. [Qualitative research in health in Iberoamerica]. Guadalajara: Universidad de Guadalajara; 2002. PubMed Abstract OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-244X/13/64/prepub