Research article

A review of the methodological features of systematic reviews in maternal medicine

Lumaan Sheikh¹ , Shelley Johnston¹ , Shakila Thangaratinam^1,2 , Mark D Kilby¹ and Khalid S Khan¹

¹Academic Unit, Birmingham Women's Hospital, University of Birmingham, Birmingham B15 2 TG, UK

²Clinical Lecturer in Obstetrics and Gynaecology and Clinical Epidemiology, Academic Unit, 3rd floor, Birmingham Women's Hospital, Birmingham B15 2TG, UK

author email corresponding author email

BMC Medicine 2007, 5:10doi:10.1186/1741-7015-5-10

Published:	24 May 2007

Abstract

Background

In maternal medicine, research evidence is scattered making it difficult to access information for clinical decision making. Systematic reviews of good methodological quality are essential to provide valid inferences and to produce usable evidence summaries to guide management. This review assesses the methodological features of existing systematic reviews in maternal medicine, comparing Cochrane and non-Cochrane reviews in maternal medicine.

Methods

Medline, Embase, Database of Reviews of Effectiveness (DARE) and Cochrane Database of Systematic Reviews (CDSR) were searched for relevant reviews published between 2001 and 2006. We selected those reviews in which a minimum of two databases were searched and the primary outcome was related to the maternal condition. The selected reviews were assessed for information on framing of question, literature search and methods of review.

Results

Out of 2846 citations, 68 reviews were selected. Among these, 39 (57%) were Cochrane reviews. Most of the reviews (50/68, 74%) evaluated therapeutic interventions. Overall, 54/68 (79%) addressed a focussed question. Although 64/68 (94%) reviews had a detailed search description, only 17/68 (25%) searched without language restriction. 32/68 (47%) attempted to include unpublished data and 11/68 (16%) assessed for the risk of missing studies quantitatively. The reviews had deficiencies in the assessment of validity of studies and exploration for heterogeneity. When compared to Cochrane reviews, other reviews were significantly inferior in specifying questions (OR 20.3, 95% CI 1.1–381.3, p = 0.04), framing focussed questions (OR 30.9, 95% CI 3.7- 256.2, p = 0.001), use of unpublished data (OR 5.6, 95% CI 1.9–16.4, p = 0.002), assessment for heterogeneity (OR 38.1, 95%CI 2.1, 688.2, p = 0.01) and use of meta-analyses (OR 3.7, 95% CI 1.3–10.8, p = 0.02).

Conclusion

This study identifies areas which have a strong influence on maternal morbidity and mortality but lack good quality systematic reviews. Overall quality of the existing systematic reviews was variable. Cochrane reviews were of better quality as compared to other reviews. There is a need for good quality systematic reviews to inform practice in maternal medicine.