Email updates

Keep up to date with the latest news and content from BMC Medical Education and BioMed Central.

Open Access Research article

eLearning among Canadian anesthesia residents: a survey of podcast use and content needs

Clyde T Matava12*, Derek Rosen23, Eric Siu4 and Dylan M Bould5

Author Affiliations

1 Department of Anesthesia and Pain Medicine, Hospital for Sick Children, Toronto, ON, Canada

2 Department of Anesthesia, Faculty of Medicine, University of Toronito, Toronto, Ontario, Canada

3 Department of Anesthesia, Toronto General Hospital, University Hospital Network, Toronto, Ontario, Canada

4 Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada

5 Department of Anesthesiology, Children’s Hospital of Eastern Ontario, University of Ottawa, Ottawa, ON, Canada

For all author emails, please log on.

BMC Medical Education 2013, 13:59  doi:10.1186/1472-6920-13-59

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6920/13/59


Received:17 September 2012
Accepted:15 April 2013
Published:23 April 2013

© 2013 Matava et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Podcasts are increasingly being used in medical education. In this study, we conducted a survey of Canadian anesthesia residents to better delineate the content needs, format preferences, and usage patterns among anesthesia residents.

Methods

10/16 Canadian anesthesia program directors, representing 443/659 Canadian anesthesia residents, allowed their residents to be included in the study. 169/659 (24%) residents responded to our survey. A 17-item survey tool developed by the investigators was distributed by email eliciting information on patterns of podcast use, preferred content, preferred format, and podcast adjuncts perceived to increase knowledge retention.

Results

60% (91/151) had used medical podcasts with 67% of these users spending up to 1 hour per week on podcasts. 72.3% of respondents selected ‘ability to review materials whenever I want’ was selected by the majority of respondents (72%) as the reason they found podcasts to be valuable. No clear preference was shown for audio, video, or slidecast podcasts. Physiology (88%) and pharmacology (87%) were the most requested basic science topics while regional anesthesia (84%), intensive care (79%) and crisis resource management (86%) were the most requested for procedural, clinical and professional topics respectively. Respondents stated they would most likely view podcasts that contained procedural skills, journal article summaries and case presentations and that were between 5-15 minutes in duration A significantly greater proportion of senior residents (81%) requested podcasts on ‘pediatric anesthesia’ compared to junior residents 57% (P = 0.007).

Conclusions

The majority of respondents are using podcasts. Anesthesia residents have preferred podcast content, types, length and format that educators should be cognizant of when developing and providing podcasts.

Keywords:
Podcasts; Residents; e-learning; Survey; Needs; Content; Anesthesia

Background

Podcasting is a technology that allows for the distribution of video and audio recordings (podcasts) over the internet as digital media files. These podcasts can be viewed online or downloaded to a user’s computer or handheld multimedia device (i.e. portable mp3 player, smart phone, tablet device) and carried with them [1]. Podcasts are increasingly being used in medical education [2-5]. They have the key advantage that the presentation of information does not have to be linked with any particular time or location [6,7]. They can be a significant learning aid to auditory learners (audio podcasts) and visual learners (video podcasts) for distance education [7-9]. In addition to inexpensive production costs, podcasts also confer high ease of use, rapidity of deployment, and offer the opportunities to share information around the world [8,10-13]. Finally, podcasts may be better suited than lectures to the learning styles of “Generation Y” medical students and residents [1,14-18].

A major limitation of achieving and maintaining high user rates in podcasting is the development of high quality content that matches the needs of the targeted user-group [4,13]. To better delineate these needs and usage patterns, we conducted a survey of Canadian anesthesia residents. We hypothesized that anesthesia residents have clear podcast content needs and usage patterns which may depend on the year of training.

Methods

Following approval by the Research Ethics Board at Children’s Hospital of Eastern Ontario, we contacted 16 anesthesia residency program directors for permission to recruit their residents into the study. We defined junior residents as post-graduate year 1-3 (PGY 1-3) and senior residents as PGY 4-5.

Survey design

A review of the literature and commonly used textbooks was conducted in order to identify anesthesia topics for inclusion in a 17-item survey tool. The survey was constructed using the online tool, Qualtrics, at http://www.qualtrics.com webcite (Provo, UT, USA) using published guidelines for the creation of online surveys [19-21]. Following pretesting by the authors and pilot testing on anesthesia fellows, the final survey tool was translated into French, followed by further pilot testing of the French version. Options for both English and French translations were provided to all respondents. The final survey tool (Additional file 1) elicited information on residents’:

1. Current patterns of podcast use;

2. Preferred content (divided into 4 categories: basic sciences, procedural, clinical and professional topics);

3. Preferred podcast formats (duration and content type);

4. Podcast adjuncts perceived to increase knowledge retention.

Additional file 1. Survey tool. The survey used for this study is attacehd as a separate file.

Format: PDF Size: 97KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Survey distribution and collection

Our sampling frame consisted of all residents enrolled in anesthesia residency programs across Canada for the 2010-2011 academic year. E-mail invitations were sent to anesthesia program directors’ offices asking them to forward these emails to their residents. Three reminder emails were sent to program directors, each a month apart. As an incentive, residents were invited to enter into a prize draw for an iPad™(Apple, Cupertino, CA) on completion of the survey. All responses were kept anonymous and delinked from identifying information. All responses were stored on http://www.qualtrics.com webcite and exported to an Excel (Microsoft, Redmond, WA) spreadsheet for analysis. Consent for participation in the study was implied by completion of the survey.

Data analysis

We analysed the perceived needs in podcast content of all respondents and compared the data of junior residents to senior residents. Data analysis was performed using Prism version 5.0b for Mac OS X (GraphPad Software, San Diego, CA). Descriptive statistics were used to summarize the data. and two-tailed Fisher’s exact test was used to analyze nominal data. A value of P < 0.05 was considered to indicate statistically significant differences.

Results

Demographic and current patterns of use

10/16 anesthesia program directors, representing 443 residents, gave permission for their residents to be included in the study. 216 residents in the remaining 6 programs did not participate in the study. 169 residents responded (38% response rate).

Sixty percent (91/151) reported using medical podcasts (Table 1), with 67% of users spending up to 1 hour per week on podcasts (Figure 1). Accessing (streaming) podcasts online via a computer 45% (73/159) and downloading to a portable media device (mp3 player, smartphone, tablet) 38% (61/159) were both popular methods for reviewing podcasts (Table 2). Almost half of respondents would use podcasts as part of routine study while less than a third would use them prior to a case in the Operating room (OR)/clinic/Intensive Care Unit (ICU) (Table 2). The majority of respondents selected ‘ability to review materials whenever I want’ (72%) and ‘…wherever I want’ (66%) as reasons why they found podcasts to be valuable. Respondents showed no clear preference when asked which of audio, video, or slidecasts (podcasts with audio and still images or Microsoft Powerpoint slides) best suited their learning styles (Table 2).

Table 1. Proportions of podcast users and non-users

thumbnailFigure 1. Hours spent on podcasts per week by respondents.

Table 2. Podcast use characteristics of all respondents

The majority of respondents, 98% (58/60), who do not use podcasts selected ‘I did not know they were available’ as the reason for non-use. Only 11.7% (7/60) of non-users did not use podcasts because of ‘no access’ to an iPod / MP3 player/ smartphone (Table 3).

Table 3. Reasons for non-use of podcasts

Preferred podcast content

Physiology (89%) and pharmacology (88%) were the most requested basic science topics by all respondents (Figure 2A). The most requested clinical topics included intensive care (80%) and thoracic anesthesia (74%) (Figure 2B). Under the procedural topic category, respondents requested podcasts on regional anesthesia (84%) and advanced airway skills (80%) (Figure 2C), while crisis resource management (86%), and morbidity/mortality (67%) were most requested for the professional category (Figure 2D). Research methods/statistics (37%) and dental anesthesia (24%) were the least popular topics for podcasts.

thumbnailFigure 2. Rankings of content topics by respondents. a. Ranking of basic science topics by respondents (%). b. Ranking of clinical topics by respondents (%). c. Ranking of procedural topics by respondents (%). d. Ranking of professional topics by respondents (%).

There were noticeable differences in perceived podcast topic need by level of training. A significantly greater proportion of senior residents (81%) requested podcasts on ‘pediatric anesthesia’ compared to junior residents 57% (P = 0.007) (Table 4). Similarly, greater proportions of senior residents compared to junior residents requested podcasts on ‘thoracic anesthesia‘ and ‘mortality and morbidity in anesthesia’, however, these were not statistically significant (Table 4).

Table 4. Preferred podcast topics* by training level

A significantly greater proportion of male respondents (63%) preferred podcasts on ‘ultrasound guided vascular access’ compared to female respondents (34%) (P = 0.0005). Similarly significantly more male respondents (55%) versus female respondents (35%) preferred podcasts content on ‘Basic skills in anesthesia, e.g. rapid sequence induction, basic airway skills, prone positioning and TIVA’ (P = 0.01).

Preferred podcast formats

Respondents demonstrated a preference for podcasts containing procedural skills, journal article summaries and case presentations, that were of 5-15 minutes (min) duration (Figure 3). Didactic lecture podcasts of 15-30 min duration were more likely to be viewed compared to either shorter podcasts or those longer than > 45 min (Figure 3). For all other categories, respondents preferred shorter podcasts of 5-15 minutes and were particularly less likely to view podcasts of > 45 min (Figure 3). Practice oral exam questions were very popular among residents, with 25% responding that they would be ‘likely’ and 67% ‘very likely’ to watch these podcasts (Table 5). Residents also perceived the inclusion of pre-, and post-test multiple-choice questions (MCQs) in podcasts to be effective for knowledge retention (Table 6).

thumbnailFigure 3. Preferred podcast duration by content type. (Data are in percentage of respondents).

Table 5. Percentage of respondent’s likelihood of watching a podcast type (N = 151)*

Table 6. Methods perceived by residents to be effective for facilitating knowledge retention during podcast use

Discussion

We have demonstrated that the majority of respondents (60%) use podcasts. Anesthesia residents appear to have well defined podcast content preferences. Furthermore, anesthesia residents have preferred podcast types, length and format, along with a preference for podcasts to incorporate multiple-choice questions.

In the absence of prior work on podcast use among medical residency trainees, our study provides initial data on podcast use and preferred content among anesthesia residents. Residents’ preferences on content, duration and format should be considered by podcast creators and program directors for developing new material that better suits the needs of trainees.

Whilst 60% of anesthesia residency respondents using medical podcasts does suggest a high uptake of this relatively new technology, it is slightly lower than the 71.2% usage reported by Fietze et al in a survey of Faculty of Economics and Social Studies students at the University of Flensburg, Germany [22]. This may reflect a difference in the update and use of technology between countries or disciplines. There are no similar published studies of podcast use among medical trainees. The relatively high use of podcasts in our study may be explained in part by the proliferation of mobile devices, such as internet-ready smartphones, that support both audio and video files. Thirty-eight percent of the residents accessed podcasts on a mobile device (smartphone, iPod, mp3 players, etc.). Other advances in technology which may have contributed to higher rates of podcasts use include the wider availability of high-speed internet, wireless network-capable tablet devices and greater computer literacy among medical personnel.

Half of the anesthesia residents in this current study reported using podcasts as part of routine studying, while under a fifth used them for learning prior to a case in the OR/clinic/ICU. The level of podcasts use for just-in-time learning in our study appears to be low when compared to levels of use reported among health care students [3,6,23]. The existence of relevant podcast topics may result in an increase of podcasts as just-in-time learning.

There was a surprising finding of gender based differences in podcast topics focused on technical skills. Male respondents preferred podcast content on the use of ultrasound guided vascular access. This finding is not easily explained by our study and warrants further studies investigating gender based preferences on techincal procedures among anesthesia trainees and consultant level anesthesiologists.

Our study also demonstrated that there was no clear preference in podcast type. Podcasts with video, slideshows, or just audio podcasts were equally popular. While investigating specific respondents’ specific learning styles was out of the scope of our study, previous work looking at learning styles among anesthesia residents suggested that anesthesia trainees tend to have an aptitude for auditory and visual learning, which may be well complemented with audio-visual podcasts [14-17]. Furthermore, anesthesia video podcasts may also provide training in procedural skills, which are a key component in anesthetic practice. Respondents in our study also selected commonly cited advantages for podcast use, such as portability and ease of accessibility, as reasons they find them valuable [6,7,24-26].

An important finding in our study is that residents have preferred podcast content topics (Table 2). These preferences exist across the spectrum of categories from basic sciences, procedural and clinical, to professional and ethical topics. Topics received similar ratings by both junior and senior residents. A surprising finding was the popularity of basic science topics such as physiology and pharmacology. Physiology and Pharmacology are traditionally taught via didactic sessions. Residents may prefer these topics to be offered via podcasts as they can be readily available for revision. Our study did not explore whether residents would prefer to completely abandon traditional didactic lectures in preference of podcasts.

Residents in this study selected highly complex procedural skill topics such as regional anesthesia and difficult airway as preferred content for podcasts. This is not surprising as procedural skills are core competencies required of anesthesiologists and anesthesia trainees [27]. Recent studies have highlighted the superior nature of video in the teaching and learning of procedural skills over traditional paper based methods for surgical residents and undergraduate students [1,25,28]. In essence, it is easier to learn a new procedure or review one by watching a video demonstration rather than by reading about it on paper [29].

The training level of respondents seemed to dictate relatively few differences in topic preferences. Senior residents chose pediatric anesthesia content more frequently than junior residents. This may be because junior residents have not yet been exposed to pediatric patients and are less familiar with this course material, whilst senior residents may feel the need to have more information on this topic to supplement their regular lectures. Similarly, senior residents preferred crisis management as well as morbidity and mortality in anesthesia as professional topics for podcasts. This may reflect their greater exposure to these issues in the operating room and their awareness of the importance of a reflective practice as they near the completion of their training.

Our study demonstrated that residents are more likely to view podcasts of procedural skills, journal article summaries of 5-15 min duration and recorded didactic lecture podcasts of 15-30 min. This may be explained by the fact that respondents perceive that a certain amount of time is necessary to convey key learning objectives. This data will guide podcasts creators to meet the needs of residents in podcasting. Interestingly, 92% percent of respondents were ‘likely‘ or ‘very likely‘ to watch practice oral exam podcasts. This is an obvious area for development and it is likely these podcasts would prove popular as they allow for exam-focused studying amongst medical trainees [30]. Residents also perceived the use of multiple-choice questions to be effective for knowledge retention. This is supported by recent studies that demonstrate that teaching with the ‘testing effect’ enhances knowledge retention and the finding that residents would prefer this feature is encouraging for the practical implementation of this evidence-based medical education [31]. Podcast producers may incorporate this by having audio or video pre- and post-exposure MCQs spliced into podcasts.

Some methodological issues limited our study. Firstly, non-response bias is common and unavoidable with anonymized electronic surveys [32]. We acknowledge that by completing an online survey on medical podcasts, our respondents have demonstrated a certain level of computer literacy and podcast awareness that may have made them more likely to respond to the survey. Furthermore, non-response bias may have been exaggerated by the incentive of an iPad™ as this would appeal to those who enjoy use of such technology. It is also possible that those residents who did not use podcasts were therefore less familiar with this topic and so did not respond to the survey. Secondly, the response rate of 38% was relatively low. However, this response rate is comparable to the response rates of previously published surveys among health professionals, whose response rates have ranged from 26%-46% [32,33]. Our response rate may be explained in part by survey fatigue as medical trainees are increasingly inundated with multiple surveys resulting in lower response rates [34].

Conclusions

Our study is the first to report podcast content needs and preferred formats among specialty trainees. Anesthesia residents appear to have well defined podcast content preferences. In addition, senior and junior anesthesia residents generally have similar podcast content needs with differences in a few categories. Anesthesia residents also report preferred podcast type, length and format for specific content. This allows educators to produce training level specific podcast material. This podcast needs assessment may help inform podcast creators and program directors on content and formats for podcast development.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

CTM designed the study. CTM and DR conducted the study, collected and analyzed the data. CM wrote the manuscript. DR, ES, DMB reviewed the manuscript. All authors read and approved the final manuscript.

Acknowledgements

We greatly appreciate the work of Dr Frederic Jacques in translating our survey into Canadian French and that of Dr Paula Meyler in proofing this.

References

  1. White JS, Sharma N, Boora P: Surgery 101: evaluating the use of podcasting in a general surgery clerkship.

    Med Teach 2011, 33(11):941-943.

    Epub 2011/10/26

    OpenURL

  2. Rainsbury JW, McDonnell SM: Podcasts: an educational revolution in the making?

    J R Soc Med 2006, 99(9):481-482.

    Epub 2006/09/02

    OpenURL

  3. Nast A, Schafer-Hesterberg G, Zielke H, Sterry W, Rzany B: Online lectures for students in dermatology: a replacement for traditional teaching or a valuable addition?

    J Eur Acad Dermatol Venereol 2009, 23(9):1039-1043. OpenURL

  4. Wilson P, Petticrew M, Booth A: After the gold rush? A systematic and critical review of general medical podcasts.

    J R Soc Med 2009, 102(2):69-74.

    Epub 2009/02/12

    OpenURL

  5. Walkinshaw E: Medical podcasts going viral.

    CMAJ 2011, 183(14):1577-1578.

    Epub 2011/09/14

    OpenURL

  6. Vogt M, Schaffner B, Ribar A, Chavez R: The impact of podcasting on the learner and satisfaction of undergraduate nursing students.

    Nurse Educ Pract 2010, 10:38-42. OpenURL

  7. Shantikumar S: From lecture theatre to portable media: students’ perceptions of an enhanced podcast for revision.

    Med Teach 2009, 31(6):535-538.

    Epub 2008/10/22

    OpenURL

  8. Boulos M, Maramba I, Wheeler S: Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education.

    BMC Med Educ 2006, 15:41. OpenURL

  9. Smith S, Roberts N, Partridge M: Comparison of a web-based package with tutor-based methods of teaching respiratory medicine: subjective and objective evaluations.

    BMC Med Educ 2007, 7:41. OpenURL

  10. Kamel Boulos MN, Wheeler S: The emerging Web 2.0 social software: an enabling suite of sociable technologies in health and health care education.

    Health Info Libr J 2007, 24(1):2-23. OpenURL

  11. Wheeler SC: University vodcast experiment student perceptions of learning support in distance education.

    Quart Rev Distance Edu 2002, 3(4):419-430. OpenURL

  12. Jham BC, Duraes GV, Strassler HE, Sensi LG: Joining the podcast revolution.

    J Dent Educ 2008, 72(3):278-281.

    Epub 2008/03/05

    OpenURL

  13. Meade O, Bowskill D, Lymn JS: Pharmacology podcasts: a qualitative study of non-medical prescribing students’ use, perceptions and impact on learning.

    BMC Med Educ 2011, 11:2.

    Epub 2011/01/13

    OpenURL

  14. Baker JDI, Wallace CT, Cooke JE, Alpert CC, Ackerly JA: Success in residency as a function of learning style.

    Anesthesiology 1986, 65(3A):A472. OpenURL

  15. Banner MJ, Good ML, Gravenstein JS, et al.: Matching learning style of anesthesiology residents to learning environment improves learning.

    Anesthesiology 1992, 77(3A):A1114. OpenURL

  16. Cohen I: The learning styles of anesthesiology trainees.

    Anesthesiology 2003, 99:A1316. OpenURL

  17. Larsson J, Holmstrom I, Lindberg E, Rosenqvist U: Trainee anaesthetists understand their work in different ways: implications for specialist education.

    Br J Anaesth 2004, 92(3):381-387.

    Epub 2004/01/27

    OpenURL

  18. Sandars J, Morrison C: What is the Net generation? the challenge for future medical education.

    Med Teach 2007, 29(2–3):85-88. OpenURL

  19. Passmore C, Dobbie AE, Parchman M, Tysinger J: Guidelines for constructing a survey.

    Fam Med 2002, 34(4):281-286.

    Epub 2002/05/23

    OpenURL

  20. Burns KE, Duffett M, Kho ME, et al.: A guide for the design and conduct of self-administered surveys of clinicians.

    CMAJ 2008, 179(3):245-252.

    Epub 2008/07/30

    OpenURL

  21. Bryson GL, Turgeon AF, Choi PT: The science of opinion: survey methods in research.

    Can J Anaesth 2012, 59(8):736-742.

    Epub 2012/05/23

    OpenURL

  22. Laing C, Wootton A: Using podcasts in higher education.

    Health Info Internet 2007, 60:7-9. OpenURL

  23. Devitt P, Smith J, Palmer E: Improved student learning in ophthalmology with computer-aided instruction.

    Eye 2001, 15:635-639. OpenURL

  24. Pilarski P, Johnstone D, Pettepher C, Osheroff N: From music to macromolecules: using rich media/podcast lecture recordings to enhance the preclinical educational experience.

    Med Teacher 2008, 30:630-632. OpenURL

  25. Bhatti I, Jones K, Richardson L, Foreman D, Lund J, Tierney G: E-learning vs lecture: which is the best approach to surgical teaching?

    Colorectal Dis 2011, 13(4):459-462.

    Epub 2010/01/01

    OpenURL

  26. Dobson JL: Learning styles preferences and course performance in an undergraduate physiology class.

    Adv Physiol Educ 2009, 33:308-314. OpenURL

  27. Bould MD, Crabtree NA, Naik VN: Assessment of procedural skills in anaesthesia.

    Br J Anaesth 2009, 103(4):472-483.

    Epub 2009/09/02

    OpenURL

  28. Cook C, Heath F, Thompson RL: A meta-analysis of response rates in Web- or internet-based surveys.

    Educ Psychol Meas 2000, 60(6):821-836. OpenURL

  29. Zhang J, Peteron R, Ozolins I: Student approaches for learning in medicine: what does it tell us about the informal curriculum?

    BMC Med Educ 2011, 11(1):87. OpenURL

  30. Holzinger A, Kickmeier-Rust MD, Wassertheurer S, Hessinger M: Learning performance with interactive simulations in medical education: Lessons learned from results of learning complex physiological models with the HAEMOdynamics SIMulator.

    Comput Educ 2009, 52(2):292-301. OpenURL

  31. Larsen DP, Butler AC, Roediger HL III: Test-enhanced learning in medical education.

    Med Educ 2008, 42(10):959-966. OpenURL

  32. Braithwaite D, Emery J, de Lusignan S, Sutton S: Using the Internet to conduct surveys of health professionals: a valid alternative?

    Fam Pract 2003, 20(5):545-551. OpenURL

  33. VanDen KE, Parlow J, Goldstein D, Milne B: In Canada, anesthesiologists are less likely to respond to an electronic, compared to a paper questionnaire.

    Can J Anesth/J canadien d’anesthésie 2004, 51(5):449-454. OpenURL

  34. Porter SR, Whitcomb ME, Weitzer WH: Multiple surveys of students and survey fatigue.

    New Directions for Institutional Res 2004, 121:63-73. OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6920/13/59/prepub