Email updates

Keep up to date with the latest news and content from BMC Pregnancy and Childbirth and BioMed Central.

Open Access Research article

Validity and reliability of criterion based clinical audit to assess obstetrical quality of care in West Africa

Catherine M Pirkle14*, Alexandre Dumont2, Mamadou Traore3 and Maria-Victoria Zunzunegui14

Author Affiliations

1 Department of Social and Preventive Medicine, Université de Montréal, Montréal, Canada

2 Research Institute for Development, Université Paris Descartes, Sorbonne Paris Cité, UMR 216, Paris, France

3 URFOSAME, District health centre of the Commune V, Bamako, Mali

4 Hospital Research Centres of the University of Montreal Hospital Complex (CRCHUM), Montréal, Canada

For all author emails, please log on.

BMC Pregnancy and Childbirth 2012, 12:118  doi:10.1186/1471-2393-12-118

Published: 29 October 2012

Abstract

Background

In Mali and Senegal, over 1% of women die giving birth in hospital. At some hospitals, over a third of infants are stillborn. Many deaths are due to substandard medical practices. Criterion-based clinical audits (CBCA) are increasingly used to measure and improve obstetrical care in resource-limited settings, but their measurement properties have not been formally evaluated. In 2011, we published a systematic review of obstetrical CBCA highlighting insufficient considerations of validity and reliability. The objective of this study is to develop an obstetrical CBCA adapted to the West African context and assess its reliability and validity. This work was conducted as a sub-study within a cluster randomized trial known as QUARITE.

Methods

Criteria were selected based on extensive literature review and expert opinion. Early 2010, two auditors applied the CBCA to identical samples at 8 sites in Mali and Senegal (n = 185) to evaluate inter-rater reliability. In 2010–11, we conducted CBCA at 32 hospitals to assess construct validity (n = 633 patients). We correlated hospital characteristics (resource availability, facility perinatal and maternal mortality) with mean hospital CBCA scores. We used generalized estimating equations to assess whether patient CBCA scores were associated with perinatal mortality.

Results

Results demonstrate substantial (ICC = 0.67, 95% CI 0.54; 0.76) to elevated inter-rater reliability (ICC = 0.84, 95% CI 0.77; 0.89) in Senegal and Mali, respectively. Resource availability positively correlated with mean hospital CBCA scores and maternal and perinatal mortality were inversely correlated with hospital CBCA scores. Poor CBCA scores, adjusted for hospital and patient characteristics, were significantly associated with perinatal mortality (OR 1.84, 95% CI 1.01-3.34).

Conclusion

Our CBCA has substantial inter-rater reliability and there is compelling evidence of its validity as the tool performs according to theory.

Trial registration

Current Controlled Trials ISRCTN46950658

Keywords:
Criterion-based clinical audit; Questionnaire development; Quality of care; Validity; Reliability; Resource-limited settings