- Research article
- Open access
- Published:
Performance of a core of transversal skills: self-perceptions of undergraduate medical students
BMC Medical Education volume 16, Article number: 18 (2016)
Abstract
Background
There is an increasingly growing trend towards integrating scientific research training into undergraduate medical education. Communication, research and organisational/learning skills are core competences acquired by scientific research activity. The aim of this study was to assess the perceived performance of a core of transversal skills, related with scientific research, by Portuguese medical students.
Methods
A cross-sectional study was conducted in 611 Portuguese students attending the first, fourth and sixth years of the medical course, during the same academic year. A validated questionnaire was applied for this purpose.
Results
Medical students felt confident regarding the majority of the analyzed transversal skills, particularly regarding team work capacity (72.7 % perceived their own capacity as good). On the other hand, the perceived ability to manage information technology, time and to search literature was classified only as sufficient by many of them. The progression over the medical course and participation in research activities were associated with an increasing odds of a good perceived performance of skills such as writing skills (research activity: OR = 2.00; 95 % CI: 1.34–2.97) and English proficiency (research activity: OR = 1.59; 95 % CI: 1.06–2.38/final year medical students: OR = 3.63; 95 % CI: 2.42–5.45).
Conclusions
In this line, the early exposure to research activities along undergraduate medical education is an added value for students and the implementation of an integrated research program on medical curriculum should be considered.
Background
In the 90s of the last century, following the developments in the USA, several Western European universities responded to the need looking for research capacity beyond medical students [1]. Medical doctors are the first to experience the need for more evidence-based knowledge in order to deliver better patient care. However, their capability to participate in medical research programs, and to inspire them, is often limited by both lack of training during their studies and the reduced amount of time available for research, even in university hospitals [1]. Consequently, there is an increasingly growing trend towards integrating scientific research training into undergraduate medical education [1–3].
Medical curriculum in Europe follows the quality assurance frameworks and the portability of qualifications of the directives of Bologna Process [4]. In Portugal, the medical course was reformulated into an Integrated Master Course in Medicine and is currently composed by a first cycle of three years, corresponding to a degree in basic health sciences, and a second cycle also lasting three years of clinical learning and professional clerkship.
At the Faculty of Medicine of the University of Porto (FMUP), along the first cycle of studies all students participate in random research activities in curricular units such as biochemistry, cellular biology and genetics, and some participate in research projects as extra-curricular activities, usually since the fourth year.
Scientific research involves the collection and processing of new information and its interpretation through logic and previous knowledge and experience [3]. Critical thinking, communication ability, literature searching, cope with information technology, team work, solving-problems and self-improving learning are scientific skills acquired through research activity [5–7]. Some of these skills are required for effective decision-making being a valuable quality required in any program in higher education [8, 9]. However, transversal skills of medical freshman students, as well as their development throughout the medical course, have not yet been assessed, especially considering the recent reforms in medical education. Our research group has been studying several issues related with undergraduate medical education [10–12].
The aim of this study, again reflecting our concerns on this matter, was to assess the perceived performance of a core of transversal skills by undergraduate medical students.
Methods
The specific objectives of this study were: (1) To evaluate if self-perception of medical students about transversal skills execution change over the progression of the medical course and (2) To compare the above objective by gender, type of school attended at high schooling level (public or private) and previous involvement (or not) in research projects.
A cross-sectional study was conducted in order to develop this research. Among the 796 eligible medical students, 611 (76.8 %) have participated in the study. The participants were enrolled in the Master Degree Course in Medicine of FMUP, Portugal. The study included freshman students (first year), those who concluded the first cycle of studies (beginning of the fourth year) and students who completed the entire medical course (end of the sixth year). All students from the first and fourth years answered the questionnaire at once at the beginning, and those from the six year at the end, of the same academic year.
Medical students were invited to fulfill an anonymous self-administered and validated questionnaire: “Importance of Transversal Skills for Clinical Practice” (ITS4CP) developed by the authors [12]. The transversal skills included in the questionnaire were adapted from AMEE Medical Education Guide [3].
'The perceived ability to perform the transversal skills was assessed through this questionnaire, following the Likert scale: 1 (good), 2 (sufficient), 3 (insufficient) and 4 (poor). This scale showed a good reliability and validity: the reliability was high for the 11 skills and the three factors described below, and the construct validity was set by the Confirmatory Factor Analysis (CFA). The 11 transversal skills were grouped into three factors: communication skills (CS), research skills (RS) and organisational/learning skills (OS). The CS factor included writing communication (WC), oral communication (OC) and visual communication (VC). The RS factor included the ability to perform literature searching (LS), cope with information technology (IT) and data analysis (DA) and English proficiency (EP). The OS factor included team work (TW) capacity, time management (TM), the ability to solve problems (SP) and to self-improve learning (IL). CFA was used to test the fit of the model with 3-factor structure considering the 11 skills as items. CFA fit was assessed using different indexes: (i) the Tucker–Lewis Index (TLI) [13], (ii) the Comparative fit index (CFI) [14], (iii) the Route mean square error of approximation (RMSEA) [15], and (iv) the Standardized root mean square residual (SRMR) [16]. A good model fit is indicated by a CFI and TLI values of 0.90 or higher [16] and values of RMSEA and SRMR close to 0 [17]. The internal reliability of the scale was tested using the Cronbach’s alpha coefficient.
The perceived ability to perform the transversal skills was recoded, in comparison with the scale shown in Additional file 1, in two categories sufficient (0) vs. good (1), given that no student perceived his/her own ability as insufficient or poor. The percentage of medical students who perceived their performance as good was estimated. Odds ratio (OR) was used to estimate the magnitude of the association between the perceived ability to perform each transversal skill and several factors (gender, academic year, participation in research projects and high school). Unconditional logistic regression adjusted for all variables was used to estimate the OR and the respective 95 % confidence interval. All statistics analyses were performed with the R 2.12.1 [18].
The ethical principles of this research followed the guidelines approved by the Ethics Committee of FMUP.
Results
Characteristics of the sample are summarized in Table 1. The Cronbach’s alpha of the analysis of the 11 transversal skills ranges from 0.651 to 0.818 indicating a moderate to high internal consistency. According to the theoretical model, in the CFA it was assumed that items WC, OC, and VC belong to factor CS (Communication Skills), items LS, IT, DA and EP belong to factor RS (Research Skills), and items TW, TM, SP and IL belong to factor OS (Organizational/learning Skills) and they were correlated with each other. Figure 1 shows the factor loadings supporting these relations. The model global fitness was tested and confirmed. The Cronbach alpha was 0.69, 0.81, 0.80 for factor CS, RS and OS, respectively.
No student perceived his/her own ability to perform the transversal skills as insufficient or poor. More than 50 % of students considered their own ability to manage information technology, of time management and to perform literature searching as sufficient. In relation to the other transversal skills, more than 50 % of students considered their own ability to perform them as good (Fig. 2). 72.7 % of medical students perceived their own capacity of team work as good (Fig. 2).
The progression over the medical course, as well as the participation in research activities, was associated with an increasing odds of a good perceived performance of communication skills (Table 2). Regarding writing skills, an approximate 2-fold increase in odds of a good performance was observed in sixth year students and in those who participated in research activities (Table 2).
The progression over the medical course and the participation in research activities were also associated with an increasing odd of a good perceived performance of research skills and organisational/learning skills (Tables 3 and 4). More than 3-fold increase in odds of a good perceived English proficiency was observed in the students of the sixth year of medical course (Table 3).
Male students were associated with an increasing odds of a good perceived manage of information technology and a good performance of data analysis, comparatively to female students (Table 3).
Attending a private school at high school was associated with an increasing odds of a good performance in the majority of skills, although without statistical significance (Tables 2, 3 and 4).
Discussion
This group of medical students felt confident regarding the majority of the studied transversal skills. The progression along the medical course, as well as the participation in research activities might have contributed to this perception. These findings are in line with what has already been investigated regarding the improvement of transversal skills due to the engagement in research activities [5–7].
On the other hand, the perceived ability to manage information technology, time management and to perform literature searching was classified as sufficient by many of the students. Therefore, improvements in medical education should be further explored in order to develop these competences.
Regarding the information technology, medical educators are rapidly integrating technology into the medical curricula as a necessary intervention [19, 20]. According to Ranasinghe et al., there is a need to improve computer literacy among freshman medical students, by increasing computer training in schools, or by introducing computer training in the initial stages of the medical course [21]. The study by Lim et al. showed that 81.5 % of final year medical students consider their computer skills adequate, despite additional steps need to be taken to increase the use of Internet as a method of instruction [22]. Several studies have explored the incorporation of personal digital assistants (PDAs) [23, 24], e-learning modalities [25] and social networking for interprofessional instruction [26] in medical education.
In order to avoid the workload that medical students usually face, many schools are implementing policies to restrict student work hours [27]. In line with this workload, our students also had difficulties in time management.
Literature searching is an essential competence for both research and clinical activities, and our students could benefit and feel more confident with specific training on this skill. A literature review examining the effectiveness of literature searching skills instruction for medical students showed that although the current instructional methods are effective, there is little evidence that learning persists over time [28].
On the other hand, a significant number of medical students perceived their own team work capacity as good. This ability should continue to be explored during the medical course, for instance through students’ involvement in small research groups. Indeed, teamwork has become a major focus in healthcare [29], partially, in consequence of the report provided by the Institute of Medicine, which details the high rate of preventable medical errors, mainly originated from dysfunctional or nonexistent teamwork [30].
In relation to the putative determinants of perceptions about transversal skills, students who participated in research projects revealed an increased odd of good perceived performance in all transversal skills, including those mentioned above. In this analysis, writing ability stood out between communication skills. In health professions education, writing has been used as a tool to promote a variety of learning goals, but students in medical professions often lack the required writing skills during their education and career [31, 32]. Participation in research activities is therefore essential since students who write concisely and logically, use terminology accurately and justify their assertions, show better academic performance [31]. Furthermore, scientific writing for publication is competitive and demanding for researchers [33], and training in writing skills along the medical course is associated with a significant improvement in text quality, structure and argumentation [34].
Students who finished the medical course demonstrated a significant increase of odds to have a good perceived English proficiency. Probably, this is explained by the need to use international scientific literature during the study years in medical school. However, students should feel confident in their English proficiency from the beginning of the course in order to have an efficient acquisition of knowledge. For the novice English-as-a-second-language researcher, the pressure to publish compounds the difficulties of mastering the English language [33]. In addition, in most countries around the world, local medical students outperform international students, in an academic sense, probably because of the acquision of language proficiency skills [35]. According to Hays et al. Australian medical students whose primary language is other than English, yet with poor English oral communication skills, should be encouraged to speak English away from the medical school and should be offered additional tuition so that their skills in other languages are not lost to the health-care system [36]. On the other hand, Mirza et al. reported that communication skills training purely in English can leave Arab medical students ill equipped to communicate with patients in their own communities and tongue [37].
In relation to problem solving skills, fourth year students demonstrated a significant decrease in the odds of good perceived performance, contrary to freshman and final year students. Problem solving skills has been defined as a hypothetical-deductive activity engaged by physicians, in which the early generation of hypotheses influences the subsequent gathering of information [38]. In the fourth year of the medical course, students begin the clinical practice, hence their perception of a poorer performance can be, partially, explained by the unfulfilled expectations during the first cycle of studies, as well as the fear of becoming incompetent practitioners. Therefore, the need to include instructional activities to promote the development of problem-solving abilities should be asserted in the medical curriculum.
Concerning gender, male students were associated with an increasing odds of a good perceived management of information technology, comparatively to female students. This finding has been reported by some authors who showed that females had more negative attitudes towards computers and Internet than males [39, 40]. Comparison at high schooling level between private and public schools, showed no significant differences. Nonetheless, further studies are needed to explore whether private schools offer a better support for students’ research competences than public schools.
This study assessed the putative performance of a core of transversal skills by Portuguese medical students based on their perceptions. An increased body of evidence shows that student perceptions about several aspects of their competences can be valuable for extracting evaluative conclusions regarding the quality of medical education [41, 42], despite this approach could be seen as a study limitation.
No student perceived his own ability to execute the transversal skills as insufficient or poor, a finding that may reflect a limitation of the used Likert scale, that require to be revised in future studies. This study has the inherent limitations of a cross-sectional study. Thus, a follow-up study of these students’ cohorts could also provide additional information of their transversal skills’ perceptions, as well as important data for the design of a medical educational program.
Conclusions
In conclusion, this group of medical students felt confident regarding the majority of the studied skills, particularly team work capacity. However, conceptual models of medical education modalities should be further explored to improve skills, such as both information technology and time management as well as literature searching.
The progression over the medical course and participation in research activities were associated with an increased odd of a good perceived performance of all transversal skills. Thus, the early exposure to research activities along undergraduate medical education is an added value for students and the implementation of an innovative integrated research program into the medical curriculum should be considered.
References
van Schravendijk C, Marz R, Garcia-Seoane J. Exploring the integration of the biomedical research component in undergraduate medical education. Med Teach. 2013;35(6):e1243–51.
Abu-Zaid A, Alkattan K. Integration of scientific research training into undergraduate medical education: a reminder call. Med Educ Online. 2013;18:22832.
Laidlaw A, Aiton J, Struthers J, Guild S. Developing research skills in medical students: AMEE Guide No. 69. Med Teach. 2012;34(9):754–71.
Cumming A. The Bologna process, medical education and integrated learning. Med Teach. 2010;32(4):316–8.
Greenhalgh T. Doing an intercalated BSc can make you a better doctor. Med Educ. 2003;37:760–1.
Remes V, Helenius I, Sinisaari I. Research and medical students. Med Teach. 2000;22(2):164–7.
Parker R. Skill development in graduate education. Mol Cell. 2012;46(4):377–81.
Cheung C, Rudowicz E, Kwan ASF, Yue XD. Assessing university students’ general and specific critical thinking. Coll Stud J. 2002;36(4):504–25.
Athari Z, Sharif SM, Nasr AR, Nematbakhsh M. Assessing critical thinking in medical sciences students in two sequential semesters: Does it improve? J Educ Health Promot. 2013;31(2):5.
Barbosa J, Severo M, Fresta M, Ismail M, Ferreira MA, Barros H. How students perceive medical competences: a crosscultural study between the Medical Course in Portugal and African Portuguese Speaking Countries. BMC Med Educ. 2011;11:24.
Loureiro E, Severo M, Bettencourt P, Ferreira MA. Third year medical students perceptions towards learning communication skills: implications for medical education. Patient Educ Couns. 2011;85(3):e265–71.
Ribeiro L, Severo M, Pereira M, Ferreira MA. Scientific Skills as Core Competences in Medical Education: What Medical Students think? Int J Sci Educ. 2015;37(12):1875–85.
Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.
Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46.
Steiger JH. Structural Model Evaluation and Modification - an Interval Estimation Approach. Multivar Behav Res. 1990;25(2):173–80.
Hu LT, Bentler PM. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Struct Equ Model. 1999;6(1):1–55.
Browne MW, Cudeck C. Alternative ways of assessing model fit. Sociol Methods Res. 1993;21:230–58.
R.C. Team. R: A language and environment for statistical computing. 2013. Available from: http://www.R-project.org/.
Robin BR, McNeil SG, Cook DA, Agarwal KL, Singhal GR. Preparing for the changing role of instructional technologies in medical education. Acad Med. 2011;86(4):435–9.
George P, Dumenco L, Dollase R, Taylor JS, Wald HS, Reis SP. Introducing technology into medical education: Two pilot studies. Patient Educ Couns. 2013;93(3):522–4.
Ranasinghe P, Wickramasinghe SA, Pieris WR, Karunathilake I, Constantine GR. Computer literacy among first year medical students in a developing country: a cross sectional study. BMC Res Notes. 2012;14(5):504.
Lim T, Wong W, Lim K. Perceived skill and utilisation of information technology in medical education among final year medical students, Universiti Putra Malaysia. Med J Malaysia. 2005;60(4):432–40.
Ho K, Lauscher HN, Broudo M, Jarvis-Selinger S, Fraser J, Hewes D, Scott I. The impact of a personal digital assistant (PDA) case log in a medical student clerkship. Teach Learn Med. 2009;21(4):318–26.
Tempelhof MW. Personal Digital Assistants: A Review of Current and Potential Utilization Among Medical Residents. Teach Learn Med. 2009;21(2):100–4.
Hawthorne K, Prout H, Kinnersley P, Houston H. Evaluation of different delivery modes of an interactive e-learning programme for teaching cultural diversity. Patient Educ Couns. 2009;74(1):5–11.
King S, Greidanus E, Carbonaro M, Drummond J, Patterson S. Merging social networking environments and formal learning environments to support and facilitate interprofessional instruction. Med Educ Online. 2009;14:5.
Friedman E, Karani R, Fallar R. Regulation of medical student work hours: a national survey of deans. Acad Med. 2011;86(1):30–3.
Just M. Is literature search training for medical students and residents effective? A literature review. J Med Libr Assoc. 2012;100(4):270–6.
Lerner S, Magrane D, Friedman E. Teaching teamwork in medical education. Mt Sinai J Med. 2009;76(4):318–29.
Kohn L, Corrigan J, Donaldson M. To Err Is Human: Building a Safer Health Care System. Washington, DC: National Academy Press; 2000.
Rawson RE, Quinlan KM, Cooper BJ, Fewtrell C, Matlow JR. Writing-skills development in the health professions. Teach Learn Med. 2005;17(3):233–8.
Stephens MB, Reamy BV, Anderson D, Olsen C, Hemmer PA, Durning SJ, Auster S. Writing, self-reflection, and medical school performance: the Human Context of Health Care. Mil Med. 2012;177(9 Suppl):26–30.
Wang MF, Bakken LL. An academic writing needs assessment of English-as-a-second-language clinical investigators. J Contin Educ Health Prof. 2004;24(3):181–9.
Bitran M, Zúñiga D, Flotts P, Padilla O, Moreno R. A workshop to improve written communication skills of medical students. Rev Med Chil. 2009;137(5):617–24.
Mann C, Canny B, Lindley J, Rajan R. The influence of language family on academic performance in Year 1 and 2 MBBS students. Med Educ. 2010;44(8):786–94.
Hays RB, Pearse P, Cooper CW, Sanderson L. Language background and communication skills of medical students. Ethn Health. 1996;1(4):383–8.
Mirza D, Hashim M. Communication skills training in English alone can leave Arab medical students unconfident with patient communication in their native language. Educ Health (Abingdon). 2010;23(2):450.
Shumway JM, Vargas ME, Heller LE. Methods for teaching problem-solving in medical schools. Educ Med Salud. 1984;18(1):46–61.
Broos A. Gender and information and communication technologies (ICT) anxiety: male self-assurance and female hesitation. Cyberpsychol Behav. 2005;8(1):21–31.
Li N, Kirkup G. Gender and cultural differences in Internet use: A study of China and the UK. Computers & Education. 2007;48(2):301–17.
Lizzio A, Wilson K, Simons R. University students’ perceptions of the learning environment and academic outcomes; implications for theory and practice. Stud High Educ. 2002;27:27–51.
Scicluna HA, Grimm MC, O'Sullivan AJ, Harris P, Pilotto LS, Jones PD, McNeil HP. Clinical capabilities of graduates of an outcomes-based integrated medical program. BMC Med Educ. 2012;12(23):23.
Acknowledgments
Authors thank the students of FMUP that enrolled this study by fulfilling the questionnaire, and Joana Mendes for helping in manuscript writing. This work was performed under the financial support of FCT/MEC; PIDDAC; FEDER; COMPETE (POFC) with the following reference FCOMP-01-0124-FEDER-041872 FCT (EXPL/IVC-PEC/1302/2013, RES4MED: Aprender medicina através da investigação).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare having no competing interests.
Authors’ contributions
LR designed the study, carried out the design research, and participated in the draft of the manuscript. MS participated in the study design and performed the statistical analysis. MAF participated in the study design and made a critical review of the manuscript. All authors read and approved the final manuscript.
Authors’ information
LR is Assistant Professor at the Faculty of Medicine of the University of Porto.
MS is researcher at the Faculty of Medicine of the University of Porto and Public Health Institute of the University of Porto. MAF is Full Professor and Director of the Faculty of Medicine of the University of Porto.
Additional file
Additional file 1:
Questionnaire
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Ribeiro, L., Severo, M. & Ferreira, M.A. Performance of a core of transversal skills: self-perceptions of undergraduate medical students. BMC Med Educ 16, 18 (2016). https://doi.org/10.1186/s12909-016-0527-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-016-0527-2