Low-cost otolaryngology simulation models for early-stage trainees: a scoping review

Abstract

Background

Medical simulation is essential for surgical training yet is often too expensive and inaccessible in low- and middle-income countries (LMICs). Furthermore, in otolaryngology-head and neck surgery (OHNS), while simulation training is often focused on senior residents and specialists, there is a critical need to target general practitioners who carry a significant load of OHNS care in countries with limited OHNS providers. This scoping review aims to describe affordable, effective OHNS simulation models for early-stage trainees and non-OHNS specialists in resource-limited settings and discuss gaps in the literature.

Methods

This scoping review followed the five stages of Arksey and O’Malley’s Scoping Review Methodology. Seven databases were used to search for articles. Included articles discussed physical models of the ear, nose, or throat described as “low-cost,” “cost-effective,” or defined as <$150 if explicitly stated; related to the management of common and emergent OHNS conditions; and geared towards undergraduate students, medical, dental, or nursing students, and/or early-level residents.

Results

Of the 1706 studies screened, 17 met inclusion criteria. Most studies were conducted in HICs. Most models were low-fidelity (less anatomically realistic) models. The most common simulated skills were peritonsillar abscess aspiration and cricothyrotomy. Information on cost was limited, and locally sourced materials were infrequently mentioned. Simulations were evaluated using questionnaires and direct observation.

Conclusion

Low-cost simulation models can be beneficial for early medical trainees and students in LMICs, addressing resource constraints and improving skill acquisition. However, there is a notable lack of contextually relevant, locally developed, and cost-effective models. This study summarizes existing low-cost OHNS simulation models for early-stage trainees and highlights the need for additional locally sourced models. Further research is needed to assess the effectiveness and sustainability of these models.

Key points

Question: What is the current landscape of low-cost otolaryngology-head and neck surgery simulation for early medical trainees and students?

Finding: In this scoping review we identified 17 studies that met inclusion criteria. Most studies were developed in high-income countries, and most models were not locally sourced.

Meaning: There is a notable lack of low-cost OHNS simulation models that are relevant for early medical trainees and students.

Introduction

Medical simulation is a valuable component of training [1]. Historically, simulation usage has been predominantly centered in high-income countries (HICs). Consequently, there exists an opportunity to expand access to simulation education in low- and middle-income countries (LMICs) [2, 3]. While low-cost simulation models have been explored in HICs, the specific models used in these settings may not be applicable to LMICs due to lacking the same resources. Studies have demonstrated that using locally sourced materials and readily available devices is cost-effective [4]. Furthermore, low-fidelity, or less anatomically realistic, simulation may confer similar benefits compared to high-fidelity, or highly anatomically realistic, simulation though with lower costs [5, 6]. Despite the potential benefits of simulation in LMICs, there is limited literature, particularly for surgical specialties where workforce shortages, ethical considerations, and financial constraints limit opportunities for practice [7].

In otolaryngology-head and neck surgery (OHNS), simulation training has an opportunity to address the burden of disease centered in LMICs through training of general practitioners (GPs) and primary care providers in regions where subspecialists are limited. The burden of OHNS disease is high, with 1.5 billion people worldwide experiencing hearing loss, primarily in LMICs [8]. Paradoxically, low-income countries have 50 times fewer OHNS providers than high income countries [9]. Given the burden of OHNS disease far outweighs the current number of providers, it is imperative to train primary healthcare provider to help increase access to essential OHNS care. Simulation is a central component of many HIC OHNS training programs [10,11,12,13], [14], ; however, many models are largely directed at the skill set of senior residents and physicians. Given that primary care providers such as GPs in LMICs may be the first or only providers available in rural or first-level hospitals, the opportunity to develop skills that are critical for managing OHNS emergencies and common conditions is essential to developing confidence and preventing morbidity and mortality.

To address the gap in simulation models for primary care practitioners in common and emergent OHNS conditions, this scoping review aims to describe and evaluate available low-cost OHNS simulation models geared toward early-stage medical trainees or GPs.

Methods

Study design

Given limited and heterogenous literature, a scoping review was selected and conducted in February 2023 in accordance with Arksey and O’Malley’s Scoping Review Methodology and following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Extension for Scoping Reviews Guidelines [15, 16]. The search strategy aimed to address the research question regarding the outcomes of using low-cost OHNS simulation models for early-stage trainees in education.

Literature search

A search strategy was developed to capture the maximal results, which included the main search concepts of “simulation,” “otolaryngology,” “education,” and “low cost.” These terms were combined using Boolean operators OR (within critical constructed concepts) and AND (between key concepts). The specific search strategy was adapted to each data base. The search was conducted in the following databases: PubMed, MEDLINE, EBSCO, Scopus, Science Direct, CINAHL, EMBASE, and Web of Science (Supplemental Table 1).

Inclusion criteria included studies of any language that discussed the development or implementation of a physical model of the ear, nose, or throat that were explicitly described as “low-cost,” “cost-effective,” or defined as <$150 if explicitly stated related to the care or management of OHNS conditions (operative or non-operative). Models were only considered if they were applicable for training of undergraduate students, medical, dental, or nursing students, and/or early-level residents, and we excluded simulations that would not be applicable to a GP (i.e., advanced OHNS resident level skills). Original research of any study type was included. Letters to the editor, abstracts, systematic reviews, virtual reality simulations, electronic simulations, and studies that utilized mannequin models were not included.

The study team completed a primary title and abstract screening using a Covidence database (Veritas Health Innovation Ltd, Melbourne) based on the search criteria. Two reviewers each independently screened the titles and abstracts of all identified articles for relevance to the research question. A third independent reviewer resolved disagreements over article eligibility. In the full-text review, data was extracted and recorded following the Arksey and O’Malley’s “descriptive-analytical” approach for data extraction, and the information was summarized from selected articles on an Excel spreadsheet [15]. At least two authors reviewed extracted data from the included articles. A third reviewer resoled any remaining conflicts. Snowball sampling was used to identify gray literature from study reference lists.

Statistical analysis

Outcomes included study characteristics (authors, year, language, journal of publication, study design), context (study country, target population) simulation details (specialty of simulation model, cost, fidelity of model, materials used, local sourcing of materials, condition being simulated), and model evaluation (evaluation of surgical skill and efficacy of model). Summary statistics were performed using Microsoft Excel. Categorical variables were presented as counts and percentages n(%). There were no continuous data.

Results

The initial search returned 3355 studies. After 1649 duplicates were removed, 1706 studies underwent title and abstract screening. Of these, 1607 were excluded. Ninety studies were screened for full text review based on inclusion and exclusion criteria. Seventy-four studies met inclusion criteria (Fig. 1). Table 1 provides an overview of the included low-cost simulation models for essential OHNS conditions.

Fig. 1

PRISMA Flow diagram of data analysis procedure

Table 1 Summary of Included Articles

Characteristics of studies

Of the studies examined, 82% (n = 14) of studies were conducted in HICs, and the majority were conducted in the United States or in the United Kingdom (Fig. 2). 94% (n = 16) of the studies utilized a cross-sectional study design. Most articles targeted general OHNS care (n = 8, 47%). 35% (n = 6) of the models were low-fidelity models (less anatomically realistic). The characteristics of the studies are summarized in Table 2. Simulation fidelity was assessed using the Simulation Fidelity (SiFi) scale, a validated 6-point scale to describe simulation fidelity across five domains, with scores of 0–1 meaning low-fidelity, 2–3 meaning medium fidelity, and 4–5 meaning high fidelity (Table 3) [17].

Fig. 2

Global distribution of Low-Cost ENT Simulation Model Studies

Reflexivity Statement

This scoping review emerged from collaborative work within the Global OHNS Initiative involving LMIC and HIC researchers. This piece was written to promote more accessible and equitable avenues to education and training for LMIC researchers. Our authorship group consists of five LMIC authors and five HIC authors. Five of the ten authors are women. All authors contributed substantially to the conception, drafting, and revision of this piece. All authors approved the final version. Everyone has agreed to be accountable for all aspects of the work, aligning with ICJME Authorship Criteria

Table 2 Description of Included Articles by Type

Table 3 Simulation Fidelity Scale Evaluation of Simulation Models

Skills

The most common simulated skills were peritonsillar abscess aspiration (n = 6, 35%), cricothyrotomy (n = 4, 24%), myringotomy with tube placement (n = 2, 12%), and other ear models (2, 12%). Nasal packing (n = 1, 6%), auricular hematoma (n = 1, 6%), and tracheostomy care (n = 1, 6%) were also included.

Audience

One (6%) study was geared towards medical students, eight (47%) towards residents, two (12%) towards both medical students and residents, one (6%) towards nurses, one towards anesthesia students, and one (6%) towards paramedics. Out of the eight resident-focused models, three were geared towards emergency medicine residents. Two (12%) models were geared towards attendings or consultants, and both models were included given the models’ transferability to simulate other more basic skills.

Cost

Eleven (65%) models reported a dollar value associated with their model. The average price per model was $52.00 USD (range: $10 - $150). Prices were all converted directly to USD and were standardized to a 2024 estimated cost. The remaining models were described as “low-cost” by authors without specific information about the cost of the materials. Fifteen (88%) studies reported using locally sourced materials. Model reusability is reported in Table 1.

Simulation evaluation

Sixteen (94%) studies assessed model efficacy. Models were evaluated using both questionnaires (n = 8, 47%), direct observation of skills (n = 4, 24%), or both (n = 4, 24%). Three of the eight studies that included direct observation (38%) used video monitoring to evaluate clinical skill. Participant questionnaires included a variety of themes such as participants’ comfort with the skill, model realism, ease of use, and participant confidence performing the skill.

Discussion

Given the substantial burden of OHNS disease worldwide and current limited OHNS workforce, simulation training tools tailored for primary care providers are critical in developing OHNS knowledge and skills to increase access to OHNS care globally [8, 9]. Existing low-cost OHNS simulations primarily target residents and consultants and can often overlook the essential skill set required by GPs [18, 19]. These skills encompass emergent and common OHNS conditions such as epistaxis, emergent surgical airway, and ear and nose foreign body removal. Equipping medical students and early-trainees with basic OHNS care skills is vital. This type of task shifting can alleviate delays in care, transportation challenges, and alleviate the burden on tertiary centers.

This is the first study to evaluate low-cost OHNS simulations tailored to GPs and early-trainee education, emphasizing locally sourced models. The low number of studies identified in this review highlights that simulations addressing the skill set of early trainees and primary care providers is an area for future educational research depending on regional needs and resource availability. Our findings describe the available low-cost simulations in OHNS and highlights insufficient availability of such models. Future work should focus on developing additional low-cost, contextually appropriate models to bridge gaps in healthcare training and delivery in resource-constrained settings.

A variety of approaches have been employed to develop low-cost OHNS simulation models. For instance, studies such as those by Chudek et al. (2021, UK) and Taylor et al. (2014, USA) utilized inexpensive materials like latex gloves, custard, and latex moulage for simulating peritonsillar abscess aspiration [1, 2]. These models offer a cost-effective solution for training primary care providers in essential procedures.

Conversely, studies such as Bright et al. (2021, India) and Bhalla et al. (2021, UK) employed thermoplastic ray cast and cork as materials for nasopharyngeal swabbing and peritonsillar abscess aspiration simulations, respectively [3, 4]. While these models may have slightly higher initial costs, their reusable components contribute to long-term cost-effectiveness and sustainability.

Moreover, innovative approaches were seen in studies like Botto et al. (2019, Italy) and Ozkaya Senuren et al. (2020, Turkey), where wooden tablets and sheep trachea were utilized for cricothyrotomy simulations [5, 6]. These models demonstrate adaptability to local resources and highlight the potential for contextually appropriate simulation solutions.

In terms of dissemination and implementation, workshops, online resources, and collaborative initiatives with local healthcare organizations could facilitate the adoption of these low-cost simulation models. By sharing detailed instructions and training materials, such as those provided by Molin et al. (2020, USA), the reach and impact of these models can be expanded to benefit primary care providers in diverse settings [7].

Simulated medical models have proven highly effective in imparting essential OHNS procedure skills and can provide an important avenue to improve surgical training in resource constrained environments. However, our data show that most low-cost simulation models (n = 14, 82%) are developed and utilized in HIC, which aligns with prior studies that report a lack of locally developed low-cost simulations in LMIC contexts [7]. Furthermore, many “low-cost” simulation models rely on high-cost materials such as 3D printers or specialized mannequins, which may not be available in LMICs. When considering model sustainability and applicability of these models in LMICs, it is important to recognize the limitations of certain high-fidelity models in such resource-constrained environments. Prior studies demonstrate that low fidelity simulation models do not necessarily lead to worse skill outcomes, which emphasizes the potential of low-cost, less intricate models as valuable tools for skill acquisition [5, 20].

A previous systematic review of low-cost simulations in OHNS identified 18 studies on low-cost ENT simulations [14]. However, only five of these simulations were relevant to GPs as shown in Table 4. In contrast, our study included 17 simulations directly applicable to GPs. There is potential for expanding the range, reach, and applications of existing models. Most of the models in our study focused on peritonsillar abscess simulations, which may not always fall within a GP’s scope of practice. Future efforts should focus on exploring simulation models that use locally sourced materials and align with the skill requirements of primary care providers in LMICs. Specifically, investigations into simple yet effective simulation approaches, such as task trainers or hybrid models incorporating both physical and virtual elements, could be prioritized to address the diverse educational needs and resource constraints in these settings. Specifically, more models focusing on skills like epistaxis management and nasal/ear foreign body removal are essential to address common conditions encountered by primary care providers in LMICs.

Table 4 Low-cost OHNS simulations identified in prior studies versus our results

Additionally, several of the existing models could be adapted for a broader set of GP-level skills, such as using ear models for foreign body removal and cerumen management, in addition to myringotomy. There is also a clear need for alternatives to animal models, which can be harder to procure or reuse, leading to higher operation and maintenance costs. Additionally, most models in this study did not explore the use of locally sourced materials. Collaborating with LMICs to adapt models to utilize locally available materials is an essential next step to enhance accessibility and effectiveness. Finally, our study identified heterogeneity in evaluations of the efficacy of these simulations in augmenting the knowledge, skills, and confidence of GPs. This suggests that future research should incorporate standardized metrics that evaluate educational utility of low-cost OHNS simulations.

Our study has several limitations. Not all the studies we included provided exact cost information for the simulations, which, if available, could have contributed to our understanding of the cost-effectiveness of these models. Reusability of the models was reported, however not incorporated into the cost calculation. We also did not independently evaluate fidelity and instead relied on fidelity assessments as reported by the authors for the scope of this study. Furthermore, excluding studies involving 3D printing or mannequins might have resulted in overlooking potentially useful insights regarding the development and components of these models. As 3D printing technology becomes more affordable, cost and access may not be a barrier in the future, opening exciting possibilities for its integration into future research studies and innovations across various fields. Additionally, a notable portion of the studies reviewed did not compare efficacy directly to high-fidelity models, highlighting the need for further research regarding the effectiveness of these simulations.

Conclusion

Low-cost, locally sourced OHNS simulations for GPs, early trainees, and students hold immense promise in LMICs. This tailored simulation-based training not only addresses the financial constraints faced by educational institutions but also considers local factors, including the local burden of OHNS diseases, available resources, hospital infrastructure, and the distinct roles and responsibilities of GPs in these settings. By conducting country-specific studies, these simulations could offer a practical and sustainable solution to enhance OHNS knowledge and skills among primary care providers, ultimately improving healthcare delivery and patient outcomes. Our scoping identified a range of potential simulation models that hold promise for replication in LMICs, along with crucial gaps that warrant exploration for the development of contextually relevant, low-cost models.