Systematic review of effect of community-level interventions to reduce maternal mortality

Abstract

Background

The objective was to provide a systematic review of the effectiveness of community-level interventions to reduce maternal mortality.

Methods

We searched published papers using Medline, Embase, Cochrane library, CINAHL, BNI, CAB ABSTRACTS, IBSS, Web of Science, LILACS and African Index Medicus from inception or at least 1982 to June 2006; searched unpublished works using National Research Register website, metaRegister and the WHO International Trial Registry portal. We hand searched major references.

Selection criteria were maternity or childbearing age women, comparative study designs with concurrent controls, community-level interventions and maternal death as an outcome. We carried out study selection, data abstraction and quality assessment independently in duplicate.

Results

We found five cluster randomised controlled trials (RCT) and eight cohort studies of community-level interventions. We summarised results as odds ratios (OR) and confidence intervals (CI), combined using the Peto method for meta-analysis. Two high quality cluster RCTs, aimed at improving perinatal care practices, showed a reduction in maternal mortality reaching statistical significance (OR 0.62, 95% CI 0.39 to 0.98). Three equivalence RCTs of minimal goal-oriented versus usual antenatal care showed no difference in maternal mortality (1.09, 95% CI 0.53 to 2.25). The cohort studies were of low quality and did not contribute further evidence.

Conclusion

Community-level interventions of improved perinatal care practices can bring about a reduction in maternal mortality. This challenges the view that investment in such interventions is not worthwhile. Programmes to improve maternal mortality should be evaluated using randomised controlled techniques to generate further evidence.

Background

There are 529,000 maternal deaths each year, 99.6% of these in developing countries [1] where health care provision is rudimentary. The lifetime risk of maternal death was estimated in 2000 as 1 woman in 16 in sub-Saharan Africa and 1 in 46 in south-central Asia, compared to 1 in 2800 in developed regions [1]. Most maternal deaths are preventable. Despite numerous initiatives by governments, WHO, UNICEF, UNFPA, World Bank and others, and a Millennium Development Goal (MDG 5) to reduce maternal mortality by three-quarters by 2015, there has been little improvement [2]. In some areas mortality has worsened [3]. Whether intervention programmes have been simple or complex, few have robustly assessed their effect on maternal deaths. Indeed, some authors have advocated that due to the large population sizes needed and the difficulty in obtaining reliable data, maternal mortality is an unsuitable indicator for assessing safe motherhood initiatives [4].

Meeting MDG 5 is likely to need a combination of strategies, including those at community-level, utilizing best evidence on antenatal, intrapartum and postpartum care. Complete access to facility based obstetric care may be best practice [5] but is likely to be many years away and even then will not be acceptable or accessible to all [6, 7]. It is plausible that community-level interventions could improve outcomes by increasing the standard of out-of-facility care through training or education, or by improving care-seeking behaviour and access to facility level care. However, opinions diverge as to whether investment in community-level interventions is worthwhile [5, 8]. We undertook a systematic review to assess the effectiveness of community-level interventions to reduce maternal mortality.

Methods

Sources

We searched the following electronic databases: MEDLINE, EMBASE, CINAHL, BNI, CAB ABSTRACTS, IBSS, Cochrane (Central, DARE and NHS EED and Systematic Reviews), Web of Science (SCI-expanded and SSCI), LILACS and African Index Medicus from database inception or at least from 1982 to June 2006 for terms including maternal mortalit*, communi* intervention*, participat*intervention*, midwi* and birth* attend* (see Additional file 1), and used Reference Manager 11 software http://www.refman.com to keep track of citations identified. We followed up references in published papers, contacted leading authors, and hand searched major relevant journals up to July 2007. We searched for unpublished work using the National Research Register website http://www.nrr.nhs.uk, 2006 issue 2, searched 30 June 2006), metaRegister http://www.controlled-trials.com/mrct/, searched 30 June 2006) and the WHO International Trial Registry portal http://www.who.int/trialsearch, searched 24 May 2007). No language restrictions were applied.

Study selection

We developed a protocol using recommended methods for collating data from randomised controlled trials and cohort studies with concurrent controls following QUOROM and MOOSE checklists [9–12]. Selection criteria were general maternity populations or women of childbearing age (15 to 49 years) taking part in a community-level intervention. We defined a "community-level" intervention as one which is either accessed locally at the woman's home, village, school or local clinic, or delivered by any person within the community, including health personnel or lay individual. Studies conducted in primary care settings designed to provide normal pregnancy and childbirth services and refer women with complications to higher levels of care were eligible for inclusion. All eligible studies had to report on maternal deaths and have controls of concurrent comparable populations experiencing either "usual care", including hospital based care, or other community interventions. We used the ICD10 definition of maternal mortality (death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes). We excluded studies of pharmacological and nutritional interventions since these have already been the subject of other systematic reviews. We also excluded studies on non-general maternity or childbearing age populations, such as women with a particular disease. No language restrictions were applied.

Two authors (EK and CMacA) independently assessed titles and abstracts of all potential references for eligibility and retrieval of full papers. In cases of uncertainty the original papers or raw data were obtained or authors contacted to reach a decision about eligibility after consideration of the published information. All retrieved papers were assessed in duplicate (by EK and HW), using checklists of inclusion and exclusion criteria.

Two authors (EK and either CM or KSK) independently quality assessed studies and extracted data using a piloted data extraction form. We defined study quality as the extent to which design, methods, execution and analysis minimised bias in assessment of effectiveness, focusing on internal validity [9]. We classified studies as high, medium, low (or unclear) quality with respect to selection, performance, measurement and attrition biases as shown in Table 1. Individual studies were described by study type, intervention, location and date, numbers taking part, population denominator (eg pregnancy or live birth) and study quality (Table 2). Any discrepancies were resolved by discussion with additional authors (CMacA and HW).

Table 1 Quality assessment criteria

We extracted data to generate maternal mortality rates for the intervention and comparator arms of the included studies. For cluster randomised trials we computed the design effect from data presented in the study reports (intra-class correlation coefficients, cluster adjusted estimates and confidence intervals) using STATA 9.2 http://www.stata.com and adapted sample sizes and numbers of events to make appropriate allowance for clustering [13]. Where such data could not be found, we computed a design effect using the mean intra-class correlation coefficient from the trials in which they were computable. We summarised results of individual studies as odds ratios (OR) and confidence intervals adjusted for clustering, which we pooled using the Peto method validated for meta-analysis of rare events [14]. We considered results of randomised trials and cohort studies separately. Meta-analysis were only considered for studies without a high risk of bias, which were then stratified according to the purpose of the intervention.

Results

We identified 768 relevant references, of which 13 studies met our inclusion criteria (Figure 1). The quality of the studies was extremely variable (Table 2). Eleven of the studies involved 118,467 maternities (pregnant women, pregnancies, deliveries or live births). Two studies had no data on participant numbers. We found five cluster randomised controlled trials, of which the trials by Jokhio [15] and Munjanja [16] had large numbers of participants but few clusters. Of the eight non-randomised studies, only one scored "high" and two "medium " in any of the four quality assessments. The rest scored either "low" or unclear"

Figure 1

Study selection process.

Table 2 Characteristics and maternal mortality outcomes of included studies

None of the trials was powered to assess maternal mortality, although one trial did show a significant reduction based on small numbers of deaths [15]. Of the randomised controlled trials, two evaluated interventions to improve perinatal care practices [15, 17]. Both aimed to educate lay birth attendants in awareness of basic concepts of maternal and neonatal care, reduce unsafe delivery practices, and increase referral where there may be problems [15, 17, 18]. Both provided adequate information to estimate the impact of the cluster design on maternal mortality outcomes. No adjustment for the cluster design was required for maternal mortality, as the intra-class correlation coefficient (ICC) was estimated to be zero. Three trials with equivalence hypotheses assessed reduced frequency but goal-oriented antenatal care models [16, 19, 20]. None of these trials adjusted for cluster effect for maternal mortality (for the meta-analysis we presumed that they also would have an ICC of zero, and no adjustment for clustering was made).

The outcomes of all included studies are shown in Table 2. The non-randomised studies were of insufficient quality to draw conclusions about their effectiveness.

For the studies with low risk of bias, separate meta-analyses were undertaken for the two types of intervention (Figure 2). Interventions to improve perinatal care practices showed a statistically significant difference in maternal mortality favouring treatment (OR = 0.62; 95% CI 0.39 to 0.98, p = 0.042). The meta-analysis to examine whether minimal targeted antenatal care was non-inferior to standard care showed no difference in maternal mortality (OR = 1.09; 95% CI 0.53 to 2.25, p = 0.81), although the confidence interval was wide.

Figure 2

Effect of improved perinatal care and minimal goal-oriented antenatal care models on maternal mortality.

Discussion

This systematic review found a paucity of comparative studies of community-level interventions measuring maternal mortality. Only the RCTs provided reliable evidence. Meta-analysis of the interventions aimed at improving perinatal care practices, already shown to be effective in reducing perinatal or neonatal mortality, showed a reduction in maternal mortality. This constitutes evidence that is too strong for the effect of community-level perinatal care practices on reducing maternal mortality to be dismissed.

From the outset, we employed a broad definition of "community-level" to include interventions which were accessed or delivered locally in the community. This meant that three studies of antenatal care practices met our inclusion criteria, as they were conducted in local clinics. These trials of minimal but goal-oriented antenatal care, designed to determine whether this model was as effective as standard, more frequent "westernised" care, showed no difference in maternal death. These results confirm and consolidate the findings of the Cochrane review on patterns of antenatal care for low risk pregnancy [21] and the WHO systematic review of routine antenatal care [22], incorporating a more recent trial by Majoko et al [19]. The implications for antenatal care practice are fully discussed in these reviews and will not be repeated here.

This systematic review employed an exhaustive search strategy, with a wide range of databases and searches, enabling us to compile a comprehensive collection of potentially relevant studies reporting maternal deaths. We had considered that inclusion of non-randomised controlled studies could have provided the review with added breadth. Unfortunately, poor quality, in particular high chance of selection bias resulting from lack of randomisation, renders their results highly inconclusive. One of these studies, in Matlab, Bangladesh, represented a major initiative in the attempt to change maternity services to reduce maternal mortality. Community midwives worked with community health workers and traditional birth attendants to attend home-births, detect and manage obstetric complications and refer to higher level care as required. A decrease in mortality was observed (OR 0.35, 95% CI 0.14 to 0.88) which was taken as sufficient evidence to extend the intervention[23]. However, an adjacent comparison area subsequently experienced a similar decrease in mortality, and the improvement in mortality rates in both areas was later largely ascribed to women's self-referral to accessible hospital emergency obstetric care[24]. More recently, other factors have also been postulated, such as safe abortion and family planning to reduce abortion deaths [25]. After 30 years, the Matlab studies have been unable to determine with certainty the effectiveness of interventions.

A limitation of this review was the paucity of eligible randomised trials and the necessity to undertake two meta-analyses because of the two distinct types of intervention. Meta-analysis is a powerful and valid tool for combining rare outcomes, provided that appropriate methods are used which avoid large sample approximations [14]. There were however, inadequate data to test for heterogeneity, which should be considered a secondary issue when pooling rare outcomes [14]. Visually, heterogeneity for the antenatal care models appeared to be low but it is difficult to assess with so few trials.

Another potential limitation arises from the outcome of interest being extremely rare. This review included only studies which stated whether deaths had occurred. This meant that two small studies which did not report maternal deaths [26, 27] (one with a death, one without) found in the reviews on antenatal care patterns were not included in the present review. We cannot exclude the possibility that other studies may have known of, but not reported, maternal deaths.

The interventions were so similar in the three reduced but goal-oriented antenatal care trials that, the decision to pool their data was obvious. Combining results of both trials of improved perinatal health care practices may initially seem counter-intuitive. The intervention in Nepal was focussed on facilitator-led women's groups [17, 18] and the intervention in Pakistan on linkage and training of traditional birth attendants [15]. However, we believe a meta-analysis of these trials to be appropriate, since the interventions in both aimed to improve the standard of perinatal care, by increasing hygienic practices and integrating modestly improved primary health care services, as reflected in process outcomes for both trials. Both trials were in resource-poor rural settings.

The evidence from this review, albeit based on only two trials and both in rural Asia, suggests that community-level interventions to improve perinatal care practices can also reduce maternal mortality. Few would contest the importance of continuing to establish maternity services which allow women to deliver in a health facility and have timely access to comprehensive obstetric emergency care. These services must provide appropriate evidence-based care, be adequately resourced and acceptable to women. In many countries with high maternal mortality, the strategy of intra-partum care based in health centres "is simply not achievable with current resources and infrastructure, and without other evidence-based options, countries could be left without adequate guidance about how to proceed" [8]. Alongside strengthening facility based care, therefore, there is a need to develop and properly evaluate community-level strategies to improve maternal health outcomes, including mortality, especially in rural areas. Such strategies are inevitably complex and multifaceted. Thus process outcomes that describe how the strategy is implemented (eg distribution and use of clean delivery kits, use of sterile blade to cut the cord, whether birth attendant washed her hands) and the participants' experience (eg referral to higher level care, type and place of delivery) are necessary to understand "how" the intervention works and will improve the generalisability of the results.

The studies in Nepal and Pakistan have clearly shown that it is possible to design, implement and evaluate large scale interventions using randomised controlled designs. These trials have already produced valid policy-relevant evidence to show that neonatal and perinatal mortality can be reduced by community-level interventions to improve perinatal care practices. Such interventions, directed at improving maternity services, are likely to influence both maternal and perinatal outcomes but many studies are primarily generated and evaluated from one perspective only. Debate as to whether perinatal mortality can serve as a proxy for maternal mortality [15] may be less appropriate than directing concerted efforts to reduce and measure both within maternity services programmes. Many countries and agencies do implement large-scale and expensive programmes which could generate effectiveness evidence by incorporating cluster trial techniques, such as rolling out the programme in a randomised manner ('randomised roll-out'). This type of approach will, in the medium to longer term, produce evidence on which to base policies on how to achieve significant reductions in maternal mortality.

Conclusion

In summary, this review found that only RCTs provided reliable evidence. This evidence suggests that community-level interventions that improve perinatal practices can reduce maternal mortality. This finding challenges the view that investment in community-level interventions is not worthwhile, although further studies in different settings and contexts are needed. Study designs now allow for robust evaluation of large-scale programmes. It is imperative that we use randomised techniques to obtain more conclusive evidence of how to achieve the 5th MDG of reducing maternal mortality.