Email updates

Keep up to date with the latest news and content from BMC Medical Education and BioMed Central.

Open Access Research article

Self-assessment of intercultural communication skills: a survey of physicians and medical students in Geneva, Switzerland

Patricia Hudelson1*, Noelle Junod Perron1 and Thomas Perneger2

Author Affiliations

1 Department of Community Medicine, Primary Care and Emergency Medicine, University Hospitals of Geneva, 4, rue Gabrielle-Perret-Gentil, 1211 Geneva 14, Switzerland

2 Division of Clinical Epidemiology, University Hospitals of Geneva, 4, rue Gabrielle-Perret-Gentil, 1211 Geneva 14, Switzerland

For all author emails, please log on.

BMC Medical Education 2011, 11:63  doi:10.1186/1472-6920-11-63


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6920/11/63


Received:23 May 2011
Accepted:1 September 2011
Published:1 September 2011

© 2011 Hudelson et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Physicians working with multicultural populations need to know how to elicit the patient's understanding of the illness; determine the patient's sociocultural context and identify any issues that might affect care; communicate effectively across patient-provider social and cultural differences; and collaborate effectively with an interpreter. Skills self-assessment can contribute to identifying training needs and monitoring skills development in these areas.

Methods

As part of a larger study exploring the knowledge, attitudes and practices of Geneva physicians and medical students regarding the care of immigrant patients, we asked respondents to self-rate their ability to perform a range of common yet challenging intercultural communication tasks.

Results

Overall, respondents rated themselves less competent at intercultural tasks than at basic medical skills and less competent at specific intercultural communication skills than at general intercultural skills. Qualified doctors (as opposed to students), those with greater interest in caring for immigrants, and those who rarely encountered difficulties with immigrants rated themselves significantly more competent for all clinical tasks. Having a higher percentage of immigrant patients and previous cultural competence training predicted greater self-rated intercultural communication skills.

Conclusion

Our self-assessment results suggest that students and physicians should be provided with the opportunity to practice intercultural skills with immigrant patients as part of their cultural competence training. To strengthen the validity of self-assessment measures, they should ideally be combined with more objective methods to assess actual skills.

Keywords:
cultural competence; self-assessment; intercultural communication; immigrants

Background

Physicians who work with multiethnic and multilingual patient populations need to know how culture and language can influence clinical communication and care, and learn the skills necessary to identify and respond effectively to patients' diverse needs [1,2]. Such skills include the ability to elicit the patient's understanding of the illness; determine the patient's sociocultural context and identify any issues that might affect care; communicate effectively across patient-provider social and cultural differences; and collaborate effectively with an interpreter [3-5].

In Geneva, Switzerland, cultural and linguistic differences between patients and health care providers are common. Approximately 40% of the Geneva population are of non-Swiss nationality (195 in total), and half of these speak a language other than French as their native language [6]. At the University Hospitals of Geneva, 50% of patients and 50% of staff are of non-Swiss nationality [7], and according to a recent staff survey 28% of physicians are non-native speakers of French [8]. Despite the historic diversity of the Geneva population [9], the integration of intercultural communication and care topics into the medical curriculum is a relatively recent development [10].

In order to gain a general picture of the intercultural challenges faced by Geneva physicians and inform the development of targeted training activities, we conducted a large-scale survey of physicians' and medical students' knowledge, attitudes and skills related to care of immigrant patients. This paper reports on respondents' self-assessments of their clinical and intercultural skills.

Methods

Study population and data collection

A self-administered questionnaire was mailed to doctors and medical students in Geneva, Switzerland. A list of all 1400 physicians working in 11 medical departments at the University Hospitals of Geneva was obtained from the Human Resources department, and a list of all 1800 physicians working in private practice was obtained from the Geneva Medical Association. For each list separately, we assigned a random number to each physician, sorted the physicians in numerical order, and took the first 600 physicians on each list. We also included all 250 local medical students in their clinical years (years 4, 5 and 6) in our sample. The questionnaire was mailed again to non-respondents at 4 and 8 weeks after the initial survey.

Study variables

The questionnaire, which has been described in more detail elsewhere [11] and is available as additional file 1 on the BMC Medical Education website(Hudelson-questionnaire-migrants.pdf), contained questions about respondents' sociodemographic and professional characteristics; their attitudes, opinions and experiences related to the care of immigrant patients; respondents' self-evaluation of clinical and intercultural skills; and vignettes that probed respondents' ability to identify social and cultural factors affecting health and health care that should be explored with a patient, and knowledge of how to collaborate effectively with an interpreter.

Additional file 1. « Questionnaire sur la prise en charge des patients migrants". Questionnaire, in French, exploring the knowledge, attitudes and practices of physicians and medical students regarding the care of immigrant patients.

Format: PDF Size: 64KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

In Geneva, the French term "migrant" (immigrant) is often narrowly associated with asylum seekers. In our study, we explicitly asked respondents to think of immigrants as all persons born and raised outside of Switzerland, in order to encourage them to focus more broadly on patients likely to present cultural and linguistic differences. Most questionnaire items were newly developed or adapted by us. The questionnaire was written in French. The study was approved by the research ethics committee at the University Hospitals of Geneva, and funded by the Swiss Federal Public Health Office.

The self-evaluation questions

For the self-evaluation of clinical skills, respondents were asked, "To what degree do you consider yourself competent in the following tasks" (1 = not at all competent; 5 = perfectly competent). The 14 tasks (see Table 1) included 2 general medical tasks (tasks 1-2), 6 general psychosocial/communication tasks (tasks 2-8), and 6 tasks more specific to immigrant patients (tasks 9-14). Items were developed to reflect common yet challenging clinical and intercultural situations [12-14].

Table 1. Frequency distributions (%) of items that probe self-assessed competency in 14 clinically relevant tasks

Our main interest was to explore self-assessed competency in intercultural communication and care. However, because skills self-assessments have been associated with a number of problems [15], we attempted to strengthen the validity of results by including general medical tasks (at which we expected most respondents to feel quite competent) and general psychosocial/communication tasks (at which we expected respondents to feel somewhat less competent) in order to situate respondents' self-assessments of intercultural skills within a broader range of clinical tasks.

Statistical analysis

We obtained distributions of each of the 14 self-evaluation items on the 5-point competency scale. Then we performed an exploratory factor analysis to group items that co-vary together. This analysis yielded 3 subscales. For each subscale, we obtained the internal consistency coefficient (Cronbach alpha) based on the corresponding items, and we computed a summary score as the mean value of the items, rescaled between 0 ("not at all competent" for all items) and 100 ("perfectly competent" for all items). The summary score was considered to be missing if more than half of the scale items were missing. We obtained means and standard deviations for the 3 scores.

We examined the means of the 3 summary scores across respondent subgroups, defined by the respondent's professional status (doctor in private practice, hospital doctor, medical student), sex, age group, nationality (Swiss or other), work experience in a foreign country, percentage of immigrant patients (0-10%, 11-30%, 31-100%), interest in caring for immigrant patients (none to very high), difficulties in communicating with immigrant patients (with all cases to almost never), and training in cultural competence (yes/no). We used analysis of variance to test differences between groups. For ordinal predictor variables (such as interest in caring for immigrant patients), we obtained tests of linear trend within the analysis of variance (this test separates the between-group sum of squares into a linear component, using one degree of freedom, and an extra-linear component). Then, we constructed a multivariate regression model for each summary score that included only statistically significant predictors (p < 0.05), using general linear models. The analyses were performed using SPSS version 17 [16].

Results

Description of respondent sample

The respondent sample has been described previously [11]. In total 619 out of 1450 respondents returned the survey (response rate 42.7%). Response rate was lower among private doctors (29.8%) than among hospital doctors (52.2%) or among medical students (54.2%, p < 0.001).

Respondents included 176 (28.4%) doctors in private practice, 306 (49.4%) hospital-based doctors and 137 (22.1%) medical students. There were 338 men and 283 women (45.6%; sex was missing for 1 person). Fifty-eight (9.6%) were 24 years old or younger, 354 (58.4%) were 25 to 44 years old, 179 (29.5%) were 45 to 64 years old, and 15 (2.5%) were 65 years old or older (age was missing for 16). The majority of respondents (538, 86.6%) were of Swiss nationality.

Four-hundred sixty-three respondents reported a medical specialty (medical students did not); the most frequent were general internal or general medicine (164, 35.4%), medical subspecialties (63, 13.6%), psychiatry (97, 21.0%), surgery (36, 7.7%), gynecology-obstetrics (29, 6.3%), anesthesiology (27, 5.8%), ophthalmology (13, 2.8%), dermatology (9, 1.9%), ear, nose and throat (9, 1.9%), geriatrics (5, 1.1%), and other (5, 1.1%).

On average, about 30% of respondents' patients were immigrants (standard deviation 20%, quartiles 15%-30%-40%). 78.1% had moderate to high interest in caring for immigrant patients, and 64.6% encountered difficulties in communicating with immigrant patients almost never or in a minority of cases.

Relatively few respondents reported having received any specific training related to caring for patients from other cultures. Rates ranged from 27.7% for medical students, to 32.5% for doctors in private practice.

Self-assessed competency

Respondents rated their competency at 14 clinical tasks (Table 1). As expected, the highest ratings were obtained for the two general medical skills. Eighty-five percent of respondents considered themselves highly skilled (scores of 4 or 5) at obtaining a medical history and 79.9% considered themselves highly competent to perform a physical examination. Respondents generally scored lower on the psychosocial/communication skills, and lowest on the intercultural communication and care tasks. The one exception was working with an interpreter: 58.6% of respondents rated themselves highly competent at this task, ranking it fifth out of the 14 tasks.

The factor analysis produced 3 dimensions, which grouped 6 items reflecting general clinical and communication skills, 4 items related to specific intercultural communication topics, and 4 items related to more general intercultural skills (Table 2).

Table 2. Loadings from the factor analysis of 14 self-assessment items.

We constructed three corresponding scales: a "general clinical and communication skills" scale, an "intercultural communication skills" scale, and a "general intercultural skills" scale. The internal consistency coefficients of these scales were 0.81, 0.66 and 0.69.

The means and standard deviations were 67.6 (15.3) for the "general clinical and communication skills" scale, 50.9 (18.6) for the "specific intercultural communication skills" scale, and 56.8 (20.5) for the "general intercultural skills" scale.

All scores were lower among medical students than among doctors, and among younger respondents. In addition, the "general clinical and communication skills" score was higher in respondents who had experience working in another country and among those who rarely encountered difficulties with immigrants (Table 3). In multivariate analysis, qualified doctors (as opposed to students), those with greater interest in caring for immigrants, and those who rarely encountered difficulties with immigrants had significantly elevated scores.

Table 3. Scale of "basic clinical skills"-- mean scores across subgroups

Univariate results were similar for the "intercultural communication skills" score; in addition, a higher percentage of immigrant patients and previous training in cultural competence also predicted higher scores (Table 4). In multivariate analysis, the final model again included qualified doctor status, interest in caring for immigrants, and low frequency of difficulties with immigrants.

Table 4. Scale of "intercultural communication skills": mean scores across subgroups

The "general intercultural skills" score was higher among women, those with previous work experience abroad, and those with a greater proportion of immigrant patients (Table 5). The multivariate model included all these variables, as well as qualified doctor status.

Table 5. Scale of "general intercultural skills": mean scores across subgroups

Discussion

We evaluated physicians' and medical students' self-assessed skills in intercultural communication and care, and compared these to self-rated ability at other, more generic clinical and communication skills. Our study is limited by a relatively low response rate and the likelihood of higher participation of respondents with greater interest in cross-cultural medicine, and therefore we cannot assume that our descriptive results are fully representative of the local physician population. Nonetheless, our results reflect what we would intuitively expect: overall, respondents rated themselves most competent at general medical skills and least competent at intercultural communication skills. The weakest self-rated skills were those in situations with the greatest social and cultural differences between patient and doctor: undocumented immigrants, asylum seekers, patients with illness and religious beliefs at odds with biomedicine. Somewhat reassuring is the finding that more clinical experience, greater interest in and experience with immigrant patients, and training in cross cultural communication seem to be associated with greater self-confidence with regards to intercultural communication and care. This suggests that cultural competence training programs should emphasize exposure to and practical clinical experience with immigrant patients in order to increase physicians' comfort level with intercultural communication and care [17,18]. A number of authors have written about the benefits of on-the-job learning [19,20] but others have emphasized that such practical experience should include role modeling and critical reflection in order to counterbalance the potential negative consequences of the medical curriculum on attitudes towards immigrant and other underserved populations [21].

An interesting finding was that the factor analysis did not reflect our initial conceptual grouping of clinical skills. A priori, we differentiated between common medical skills (medical history; physical exam), general psychosocial communication skills relevant for all patients, and intercultural skills specific to caring for immigrant patients, hypothesizing that respondents' self-assessments should reflect the amount of emphasis placed on each of these areas in their formal training. However, the factor analysis found that the general medical and some of the general communications skills were correlated and that intercultural communication topics were differentiated from other (non-communication specific) intercultural skills. These two visions are not contradictory, and in fact the factor analysis may better reflect the amount of exposure and experience that respondents have with regards to the different topics. The local medical curriculum places increasing emphasis on communication skills training, and topics such as obtaining a psychosocial history, announcing bad news and adapting the physician's discourse to patients' comprehension levels are regularly addressed. However, topics such as nonconventional therapies, religious practices and requirements, and cultural beliefs about illness are addressed only sporadically. Topics such as social/medical services for undocumented immigrants, working with an interpreter, conducting a physical exam of a Muslim woman wearing a veil, or adapting to patient's information wishes were addressed until recently only in optional continuing education seminars.

Although our study has provided us with useful information for developing future training activities aimed at strengthening physicians' cultural competence, such self-assessment data should be interpreted with caution. Several studies suggest that higher levels of confidence in intercultural situations may actually reflect lower insight and awareness [22-24]. A study in the US found that medical students actually rated their own cultural competency signficantly higher than that of residents and attending physicians, despite there being no formal training in this area [25]. In our study, the fact that respondents' comparative self-assessments reflected what we would intuitively expect, based on their training and experience, provides us with some degree of confidence that our measures are a true reflection of their comfort levels with intercultural communication and care. Nonetheless, while self-assessment can be a useful method for determining self-confidence in intercultural situations [26-29], actual skills are better assessed using external objective measures such as OSCEs, standardized patients, and simulation [30]. Unfortunately, while many of these methods have been used successfully to evaluate intercultural communication skills in small-scale studies and training contexts [31-35], they are too costly and impractical for larger-scale assessments such as described in this paper. Skills self-assessment is likely to continue to be a widely-used method for identifying training needs [36], and future efforts should focus on developing more objective measures of cultural competency that can be integrated into survey instruments [37].

Conclusion

Our self-assessment results suggest that students and physicians should be provided with the opportunity to practice intercultural skills with immigrant patients as part of their cultural competence training. To strengthen the validity of self-assessment measures, they should ideally be combined with more objective methods to assess actual skills.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

PH, NJP and TP participated in the design of the study. TP performed the statistical analyses. PH drafted the manuscript. All authors read and approved the final manuscript.

Acknowledgements

The study was funded by the Swiss Federal Public Health Office, contract 04.000929.

References

  1. Lingard L, Tallett S, Rosenfield J: Culture and physician-patient communication: a qualitative exploration of residents' experiences and attitudes.

    Ann R Coll Physicians Surg Can 2002, 35(6):331-335. PubMed Abstract OpenURL

  2. Betancourt JR, Green AR, Carrillo JE: The challenges of cross-cultural healthcare--diversity, ethics, and the medical encounter.

    Bioethics Forum 2000, 16(3):27-32. PubMed Abstract OpenURL

  3. Betancourt JR, Green AR, Carrillo JE, Ananeh-Firempong O: Defining cultural competence: a practical framework for addressing racial/ethnic disparities in health and health care.

    Public Health Rep 2003, 118(4):293-302. PubMed Abstract | PubMed Central Full Text OpenURL

  4. Tervalon M: Components of culture in health for medical students' education.

    Acad Med 2003, 78(6):570-576. PubMed Abstract | Publisher Full Text OpenURL

  5. Pacheco G: Teaching cultural competence in health care: a review of current concepts, policies and practices. American Institutes for Research (AIR); 2002.

  6. Office Cantonale des Statistiques: Études et documents n° 37: Portrait statistique des étrangers vivant à Genève. Geneva; 2005.

  7. Hôpitaux Universitaires de Genève: Rapport annuel 2009. Geneva, Switzerland; 2009.

  8. Hudelson P: Report of the survey "care of immigrant patients at the University Hospitals of Geneva". Geneva: University Hospitals of Geneva; 2011.

  9. Bureau de l'intégration: Les Cahiers du BIE no 2: Comment l'immigration évolue et modifie Genève. Genève, Switzerland; 2003.

  10. Hudelson P, Stalder H: [Sociocultural diversity and medical education].

    Rev Med Suisse 2005, 1(34):2214-2217. PubMed Abstract OpenURL

  11. Hudelson P, Perron NJ, Perneger TV: Measuring physicians' and medical students' attitudes toward caring for immigrant patients.

    Eval Health Prof 2010, 33(4):452-472. PubMed Abstract | Publisher Full Text OpenURL

  12. Hudelson P: Contextualizing cultural competence training of residents: results of a formative research study in Geneva, Switzerland.

    Med Teach 2006, 28(5):465-471. PubMed Abstract | Publisher Full Text OpenURL

  13. Hudelson P: Improving patient-provider communication: insights from interpreters.

    Fam Pract 2005, 22(3):311-316. PubMed Abstract | Publisher Full Text OpenURL

  14. Priebe S, Sandhu S, Dias S, Gaddini A, Greacen T, Ioannidis E, Kluge U, Krasnik A, Lamkaddem M, Lorant V, et al.: Good practice in health care for migrants: views and experiences of care professionals in 16 European countries.

    BMC Public Health 11(1):187. OpenURL

  15. Hodges B, Regehr G, Martin D: Difficulties in recognizing one's own incompetence: novice physicians who are unskilled and unaware of it.

    Acad Med 2001, 76(10 Suppl):S87-89. PubMed Abstract | Publisher Full Text OpenURL

  16. IBM: SPSS Statistics. 17th edition. Chicago, IL; 2010.

  17. Bell K, Boshuizen H, Scherpbier A, Dornan T: When only the real thing will do: junior medical students' learning from real patients.

    Med Educ 2009, 43(11):1036-1043. PubMed Abstract | Publisher Full Text OpenURL

  18. Griswold K, Zayas L, Kernan J, Wagner C: Cultural awareness through medical student and refugee patient encounters.

    J Immigr Minor Health 2007, 9(1):55-60. PubMed Abstract | Publisher Full Text OpenURL

  19. Wear D, Kuczewski MG: Perspective: medical students' perceptions of the poor: what impact can medical education have?

    Acad Med 2008, 83(7):639-645. PubMed Abstract | Publisher Full Text OpenURL

  20. Lie D, Shapiro J, Cohn F, Najm W: Reflective practice enriches clerkship students' cross-cultural experiences.

    J Gen Intern Med 25(Suppl 2):S119-125. OpenURL

  21. Crandall SJ, Reboussin BA, Michielutte R, Anthony JE, Naughton MJ: Medical students' attitudes toward underserved patients: a longitudinal comparison of problem-based and traditional medical curricula.

    Adv Health Sci Educ Theory Pract 2007, 12(1):71-86. PubMed Abstract | Publisher Full Text OpenURL

  22. Kumas-Tan Z, Beagan B, Loppie C, MacLeod A, Frank B: Measures of cultural competence: examining hidden assumptions.

    Acad Med 2007, 82(6):548-557. PubMed Abstract | Publisher Full Text OpenURL

  23. Nokes KM, Nickitas DM, Keida R, Neville S: Does service-learning increase cultural competency, critical thinking, and civic engagement?

    J Nurs Educ 2005, 44(2):65-70. PubMed Abstract OpenURL

  24. Smith-Campbell B: A health professional students' cultural competence and attitudes toward the poor: the influence of a clinical practicum supported by the National Health Service Corps.

    J Allied Health 2005, 34(1):56-62. PubMed Abstract | Publisher Full Text OpenURL

  25. Thompson B, Crandall S, Haidet P: Student perceptions of residents, attendings, and their own cultural competency: How do they compare? Nashville, TN: AAMC Southern Group on Educational Affairs; 2008.

  26. Shapiro J, Hollingshead J, Morrison E: Self-perceived attitudes and skills of cultural competence: a comparison of family medicine and internal medicine residents.

    Med Teach 2003, 25(3):327-329. PubMed Abstract | Publisher Full Text OpenURL

  27. Park ER, Chun MB, Betancourt JR, Green AR, Weissman JS: Measuring residents' perceived preparedness and skillfulness to deliver cross-cultural care.

    J Gen Intern Med 2009, 24(9):1053-1056. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  28. Jeffreys MR, Dogan E: Factor analysis of the transcultural self-efficacy tool (TSET).

    J Nurs Meas 18(2):120-139. OpenURL

  29. Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, Smarth C, Jenckes M, Feuerstein C, Bass EB, et al.: Self-administered instruments to measure cultural competence of health professionals: a systematic review.

    Teach Learn Med 2007, 19(2):180-190. PubMed Abstract | Publisher Full Text OpenURL

  30. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review.

    JAMA 2006, 296(9):1094-1102. PubMed Abstract | Publisher Full Text OpenURL

  31. Robins LS, White CB, Alexander GL, Gruppen LD, Grum CM: Assessing medical students' awareness of and sensitivity to diverse health beliefs using a standardized patient station.

    Acad Med 2001, 76(1):76-80. PubMed Abstract | Publisher Full Text OpenURL

  32. Green AR, Miller E, Krupat E, White A, Taylor WC, Hirsh DA, Wilson RP, Betancourt JR: Designing and implementing a cultural competence OSCE: lessons learned from interviews with medical students.

    Ethn Dis 2007, 17(2):344-350. PubMed Abstract OpenURL

  33. Perron NJ, Perneger T, Kolly V, Dao MD, Sommer J, Hudelson P: Use of a computer-based simulated consultation tool to assess whether doctors explore sociocultural factors during patient evaluation.

    J Eval Clin Pract 2009, 15(6):1190-1195. PubMed Abstract | Publisher Full Text OpenURL

  34. Rosen J, Spatz ES, Gaaserud AM, Abramovitch H, Weinreb B, Wenger NS, Margolis CZ: A new approach to developing cross-cultural communication skills.

    Med Teach 2004, 26(2):126-132. PubMed Abstract | Publisher Full Text OpenURL

  35. Kalet AL, Mukherjee D, Felix K, Steinberg SE, Nachbar M, Lee A, Changrani J, Gany F: Can a web-based curriculum improve students' knowledge of, and attitudes about, the interpreted medical interview?

    J Gen Intern Med 2005, 20(10):929-934. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  36. Silver I, Campbell C, Marlow B, Sargeant J: Self-assessment and continuing professional development: the Canadian perspective.

    J Contin Educ Health Prof 2008, 28(1):25-31. PubMed Abstract | Publisher Full Text OpenURL

  37. Ho MJ, Lee KL, Green AR: Can cultural competency self-assessment predict OSCE performance?

    Med Educ 2008, 42(5):525. PubMed Abstract | Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6920/11/63/prepub