Research article

Assessing the quality of reports of randomized trials in pediatric complementary and alternative medicine

David Moher^1,2 , Margaret Sampson¹ , Kaitryn Campbell³ , William Beckner⁴ , Leah Lepage¹ , Isabelle Gaboury¹ and Brian Berman⁴

¹Thomas C. Chalmers Centre for Systematic Reviews, Children's Hospital of Eastern Ontario Research Institute, Canada

²Department of Pediatircs, University of Ottawa, Canada

³Faculty of Information and Media Studies, University of Western Ontario, Canada

⁴University of Maryland, Complementary Medicine Program, USA

author email corresponding author email

BMC Pediatrics 2002, 2:2doi:10.1186/1471-2431-2-2

Published:	27 February 2002

Abstract

Objective

To evaluate the quality of reports of complementary and alternative medicine (CAM) randomized controlled trials (RCTs) in the pediatric population. We also examined whether there was a change in the quality of reporting over time.

Methods

We used a systematic sample of 251 reports of RCTs that used a CAM intervention. The quality of each report was assessed using the number of CONSORT checklist items included, the frequency of unclear allocation concealment, and a 5-point quality assessment instrument.

Results

Nearly half (40%) of the CONSORT checklist items were included in the reports, with an increase in the number of items included. The majority (81.3%) of RCTs reported unclear allocation concealment with no significant change over time. The quality of reports achieved approximately 40% of their maximum possible total score as assessed with the Jadad scale with no change over time. Information regarding adverse events was reported in less than one quarter of the RCTs (22%) and information regarding costs was mentioned in only a minority of reports (4%).

Conclusions

RCTs are an important tool for evidence based health care decisions. If these studies are to be relevant in the evaluation of CAM interventions it is important that they are conducted and reported with the highest possible standards. There is a need to redouble efforts to ensure that children and their families are participating in RCTs that are conducted and reported with minimal bias. Such studies will increase their usefulness to a board spectrum of interested stakeholders.