Open Access Open Badges Research article

Identifying inaccuracies on emergency medicine residency applications

Eric D Katz1*, Lee Shockley2, Lawrence Kass3, David Howes4, Janis P Tupesis4, Christopher Weaver5, Osman R Sayan6, Victoria Hogan7, Jason Begue7, Diamond Vrocher7, Jackie Frazer7, Timothy Evans8, Gene Hern9, Ralph Riviello10, Antonio Rivera1, Keith Kinoshita1 and Edward Ferguson1

Author Affiliations

1 Division of Emergency Medicine, Washington University in St. Louis, St. Louis, MO, USA

2 Department of Emergency Medicine, Denver Metro Health Center, Denver, CO, USA

3 Department of Emergency Medicine, Pennsylvania State University, Hershey, PA, USA

4 Division of Emergency Medicine, University of Chicago, Chicago, IL, USA

5 Department of Emergency Medicine, Indiana University School of Medicine, Indianapolis, IN, USA

6 Department of Emergency Medicine, NewYork-Presbyterian Hospital, New York, NY, USA

7 Department of Emergency Medicine, University of Alabama, Birmingham, AL, USA

8 Department of Emergency Medicine, Medical College of Virginia, Richmond, VA, USA

9 Department of Emergency Medicine, Highland General Hospital, Oakland, CA, USA

10 Department of Emergency Medicine, Thomas Jefferson University, Philadelphia, PA, USA

For all author emails, please log on.

BMC Medical Education 2005, 5:30  doi:10.1186/1472-6920-5-30

Published: 16 August 2005



Previous trials have showed a 10–30% rate of inaccuracies on applications to individual residency programs. No studies have attempted to corroborate this on a national level. Attempts by residency programs to diminish the frequency of inaccuracies on applications have not been reported. We seek to clarify the national incidence of inaccuracies on applications to emergency medicine residency programs.


This is a multi-center, single-blinded, randomized, cohort study of all applicants from LCME accredited schools to involved EM residency programs. Applications were randomly selected to investigate claims of AOA election, advanced degrees and publications. Errors were reported to applicants' deans and the NRMP.


Nine residencies reviewed 493 applications (28.6% of all applicants who applied to any EM program). 56 applications (11.4%, 95%CI 8.6–14.2%) contained at least one error. Excluding "benign" errors, 9.8% (95% CI 7.2–12.4%), contained at least one error. 41% (95% CI 35.0–47.0%) of all publications contained an error. All AOA membership claims were verified, but 13.7% (95%CI 4.4–23.1%) of claimed advanced degrees were inaccurate. Inter-rater reliability of evaluations was good. Investigators were reluctant to notify applicants' dean's offices and the NRMP.


This is the largest study to date of accuracy on application for residency and the first such multi-centered trial. High rates of incorrect data were found on applications. This data will serve as a baseline for future years of the project, with emphasis on reporting inaccuracies and warning applicants of the project's goals.