Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Risk-adjusted operative delivery rates and maternal-neonatal outcomes as measures of quality assessment in obstetric care: a multicenter prospective study

BMC Pregnancy and Childbirth volume 15, Article number: 20 (2015) Cite this article

Abstract

Background

Although the evaluation of caesarean delivery rates has been suggested as one of the most important indicators of quality in obstetrics, it has been criticized because of its controversial ability to capture maternal and neonatal outcomes. In an “ideal” process of labor and delivery auditing, both caesarean (CD) and assisted vaginal delivery (AVD) rates should be considered because both of them may be associated with an increased risk of complications.

The aim of our study was to evaluate maternal and neonatal outcomes according to the outlier status for case-mix adjusted CD and AVD rates in the same obstetric population.

Methods

Standardized data on 15,189 deliveries from 11 centers were prospectively collected. Multiple logistic regression was used to estimate the risk-adjusted probability of a woman in each center having an AVD or a CD. Centers were classified as “above”, “below”, or “within” the expected rates by considering the observed-to-expected rates and the 95% confidence interval around the ratio. Adjusted maternal and neonatal outcomes were compared among the three groupings.

Results

Centers classified as “above” or “below” the expected CD rates had, in both cases, higher adjusted incidence of composite maternal (2.97%, 4.69%, 3.90% for “within”, “above” and “below”, respectively; p = 0.000) and neonatal complications (3.85%, 9.66%, 6.29% for “within”, “above” and “below”, respectively; p = 0.000) than centers “within” CD expected rates. Centers with AVD rates above and below the expected showed poorer and better composite maternal (3.96%, 4.61%, 2.97% for “within”, “above” and “below”, respectively; p = 0.000) and neonatal (6.52%, 9.77%, 3.52% for “within”, “above” and “below”, respectively; p = 0.000) outcomes respectively than centers with “within” AVD rates.

Conclusions

Both risk-adjusted CD and AVD delivery rates should be considered to assess the level of obstetric care. In this context, both higher and lower-than-expected rates of CD and “above” AVD rates are significantly associated with increased risk of complications, whereas the “below” status for AVD showed a “protective” effect on maternal and neonatal outcomes.

Peer Review reports

Background

Quality of care is an important topic in modern obstetrics of which risk-adjusted caesarean delivery (CD) rate is often used as an indicator, with the implicit assumption that low rates may reflect evidence-based intervention [1-8].

Although the evaluation of risk-adjusted CD rates is an important factor in quality assessment, it is just one of the elements to be considered in the process of labor and delivery auditing. In this regard, a comprehensive assessment should encompass both maternal and neonatal outcomes according to mode of delivery [4]. Several studies focused on the association between institutional adjusted CD rates and outcomes reporting controversial results. In their retrospective cohort study on 748,604 low risk singleton pregnancies, Gould et al. observed that neonatal morbidity (birth asphyxia and intensive care-therapeutic interventions) was increased both in low- and high-CD rate hospitals [5]. Bailit et al., considering the Washington State Birth Events Records for 1995 and 1996, showed that asphyxiated infants were likely to be delivered by caesarean in hospitals in which CD rates were above the predicted range [6]. In another study, the same authors showed a mixed picture for hospitals with CD rates above the expected, with some poorer and some improved maternal and neonatal outcomes [7]. Srinivas et al. evaluated both maternal and neonatal composite outcomes according to institutional adjusted CD rate in a population-based cohort from 401 hospitals. Their conclusion was that lower-than-expected risk-adjusted CD rates were associated with an increased risk of maternal or neonatal complications and that above than expected risk-adjusted CD rates did not result in improved outcomes [8].

All the above mentioned studies have however limited their attention to the CD rate. None of them has evaluated the association between the risk of adverse maternal and neonatal outcomes and the outlier status for both adjusted caesarean and assisted vaginal delivery rates (AVD) in the same obstetric population. Including the rate of assisted vaginal delivery in this analysis may be crucial in the assessment of quality of care. In fact, institutions with low frequencies of risk-adjusted CD rates might have, as a balance, high adjusted AVD rates, potentially associated with adverse outcomes [9]. Limiting the evaluation of the obstetrics performance to the CD rates could therefore be misleading and not reflect the true outcomes of that center.

The aim of our study, carried out on more than 15,000 deliveries of 11 different centers of Friuli Venezia Giulia, a north-eastern region of Italy, was to determine the prevalence of adverse maternal and neonatal outcomes according to the mode of delivery. We tested the hypothesis that institutions with risk-adjusted AVD and CD rates above or below the expected would have higher and lower rates, respectively, of maternal and neonatal complications.

Methods

We prospectively collected data on all deliveries occurring in the 11 hospitals of Friuli Venezia Giulia in a period of 18 months between July 2006 and December 2007. Friuli Venezia Giulia is a region of North-Eastern Italy accounting roughly for 10,000 deliveries per year with one of the lowest overall regional CD rate in Italy (23.4% in 2010). Virtually all births of the region were included in the study, given the very low rate of home births and the absence of midwifery-led centers in the area. The Institutions of the region, referred to as A to M, are level one units, serving low risk pregnancies, with the exception of centers I and M that are level three units (range 369–1,810 deliveries/year/unit).

To eliminate the potential bias generated by different definitions and heterogeneous collection of data, we created a regional computerized database considering maternal characteristics (maternal age and pre-pregnancy body mass index-BMI), variables related to pregnancy (parity, gestational age at delivery, singleton or multiples, presence of previous CD), antenatal clinical risk factors, mode of delivery and short term neonatal and maternal outcomes. Data on pregnancies were prospectively collected at the time of delivery and before maternal/neonatal discharge and were systematically reviewed every month by the referent obstetrician of each center.

Special attention was devoted to completeness and accuracy of data. During the study period, two of the authors (GM and SA) organized periodical multicenter meetings to discuss the results and provide assistance. The study was approved by the institutional review board of the coordinating center (Institute for Maternal and Child Health – IRCCS Burlo Garofolo, Trieste, project 86/05 – February 28, 2007) and access to the data was approved by all hospital trust administrations. According to the Italian law on privacy, data were anonymized at every institution where each patient was assigned a unique identifier.

Short term maternal and neonatal complications were analyzed both as single and combined complications (life threatening, non-life threatening and composite).

Life threatening maternal complications were defined as follow (criteria modified from McMahon [10]): 1. Major PPH (post-partum hemorrhage greater than 1000 mL or requiring blood transfusion) [11]; 2. Post-partum hysterectomy; 3. Obstetric wound hematoma requiring re-intervention; 4. Thromboembolic disease; 5. Uterine rupture. Non-life threatening maternal morbidities included: 1. Minor PPH (post-partum hemorrhage between 500 and 1000 mL) [11]; 2. III-IV degree perineal tears; 3. Asymptomatic wound dehiscence; 4. Endometritis or pyrexia needing antibiotic treatment; 5. Bowel or bladder injury; 6. Anaesthesiological complications; 7. Any other condition requiring admission to intensive care unit (ICU).

Life threatening neonatal complications (criteria modified from Fong [12]) included: 1. Mortality within 7 days of life; 2. Mortality within 28 days; 3. Abnormal neurologic status (encephalopathy as defined by Sarnat and Sarnat [13]), neonatal convulsions and intracranial hemorrhage (including all classes of intraventricular hemorrhage, epidural hemorrhage, and subdural hemorrhage). Non-life threatening neonatal morbidities were assessed as follow: 1. Pulmonary disorders, including transient tachypnoea of the newborn and respiratory distress syndrome, as defined by Hjalmarson [14]; 2. Bacterial infections including pneumonia and sepsis, diagnosed clinically with or without confirmation by blood cultures; 3. Umbilical artery cord pH at birth less than 7.00; 4. Umbilical artery cord base deficit greater than 12 mmol/L at birth; 5. Apgar score less than 7 at five minutes in term newborns; 6. Any other condition (birth trauma included) requiring neonatal intensive care (NICU) admission in term newborns for more than 24 hours (37–42 weeks/birth weight >2500 grams).

Incidence of complications was analyzed for all cases and divided into spontaneous vaginal (SVD), assisted vaginal (AVD), overall vaginal (VD) and caesarean deliveries (CD). Both women and newborns could have more than one complication, thus the total number of single complications is higher than the number of women or newborns with complications. In case of multiple pregnancies, if one of the newborns had a complication, this was considered as a neonatal complication. Only cases with complete data on all of the above indicated variables were included in the final analysis. Pregnancies complicated by antepartum stillbirths and/or life-threatening fetal congenital anomalies and deliveries with infants weighting less than 500 grams and/or below 24 weeks’ gestation were excluded to avoid potential bias in the evaluation of the outcomes.

Associations between type of delivery (CD vs. SVD, CD vs. VD and AVD vs. SVD) and single or composite complications were analyzed calculating crude and adjusted risk ratios (RRs) and p values, resulting from log-binomial regressions [15]. Considering that we had approximately 50 comparisons, we adopted a conservative Bonferroni correction dividing the significance level of 0.05 by 50: thus we considered p < 0.001 as statistically significant.

CD and AVD rates were adjusted for maternal age (reference 20–24 years, <20 years, 25–29 years, 30–35 years, >35 years), maternal pre-pregnancy BMI (reference 18.5-24.9 kg/m2, <18.5 kg/m2, 25 – 29.9 kg/m2, ≥30 kg/m2) [16], gestational age at delivery (reference 37–41 weeks, <30 weeks, 30–36 weeks, >41 weeks) classification of pregnancy at risk (reference no risk, low/intermediate risk, high risk), parity (reference multiparous, nulliparous), gestations (reference singleton, twin), presentation (reference cephalic, other), presence of previous CD (reference no past CD, one, more than one) newborn birth weight (reference 2,500-4,000 grams, <1,000 grams, 1,000-1,499 grams, 1,500-2,499 grams, >4,000 grams). Pregnancy was classified as at low-intermediate or high risk on the basis of the following definitions: 1. Low risk: if no pre-existing or ante partum risk factor was identified; 2. Intermediate risk: presence of pre-existing maternal medical conditions complicating the pregnancy, but not representing per se an absolute indication to CD or induction of labor (e.g. chronic hypertension, pregnancy-associated hypertension, gestational diabetes, obstetric cholestasis, polyhydramnios and Rh-isoimmunization); 3. High risk: presence of pre-existing maternal diseases or other obstetric conditions suggesting the need for delivery, such as HIV infection, pre-existing diabetes, severe pre-eclampsia, placenta previa, oligohydramnios and intrauterine growth restriction defined as fetal abdominal circumference or estimated fetal weight less than the 10th centile [7]. In case of a multiple pregnancy, we considered the lowest newborn birth weight. Finally, given the acknowledged high risk of complications related to the delivery in the presence of impeding maternal and fetal compromise, the degree of urgency was also considered into the risk-adjustment (reference maternal and fetal compromise, no maternal and fetal compromise) [17].

Following these adjustments, we calculated for each of the 11 centers the expected AVD and CD rates.

According to the methodology adopted by Bailit et al., a logistic regression model was initially developed to generate the predicted probability of operative deliveries (CD and AVD) for each patient. Second, the probabilities of operative deliveries for all patients were added together for each center to obtain the predicted number of CDs and AVDs for that institution. We then divided these predicted numbers of deliveries by the total number of patients who were delivered at that hospital to obtain the institutional expected caesarean and assisted vaginal delivery rates. Units were herein classified by evaluating the ratio of observed-to-expected rates and considering the 95% confidence interval (CI) around the ratio. If the 95% CI of the resulting ratio included 1, the center was classified as within the expected. If the 95% CI was above or below 1, the centers were respectively classified as above or below the expected [7]. Maternal and neonatal outcomes were thus analyzed according to the outlier status of the centers as within, above and below the expected rates. The incidences of maternal and neonatal complications were adjusted by maternal age, maternal BMI, pregnancy at risk (no, low, high), parity, fetal presentation, number of fetuses, presence of previous CD (no, one, more than one), gestational age at delivery and neonatal birth weight and delivery grade of urgency. Finally, given the potential influences of obstetric volume and the organization of newborn care on outcomes, complication rates were also adjusted by considering the number of deliveries per center (reference ≥1000 deliveries/year, <1000 deliveries/year) and the presence of a Neonatal Intensive Care Unit (reference available, non-available) [18-20]. Differences among adjusted outcomes were evaluated with the analysis of variance (ANOVA) with Bonferroni corrections for single comparisons between within vs. above and within vs. below the expected CD and AVD rates. Finally, considering we already had applied the correction to each outcome, we additionally corrected for the number of outcomes and considered as significant p values below 0.003.

All statistical analyses were performed using Stata/IC 11.2 software (StataCorp, College Station, TX, USA).

Results

From a total number of 15,726 pregnancies, we excluded from the analysis cases with life-threatening fetal congenital anomalies (18 cases), all antepartum stillbirths (16) and incomplete records, regarding maternal age (18), BMI (441), classification of pregnancy at risk (10), neonatal complications (29) and maternal complications (5). Analyses were consequently carried out on 15,189 pregnancies.

Distributions of non-missing independent variables and CD/AVD rates were similar across the analyzed and the excluded records (data not shown).

CD and AVD rates by institution ranged from 14.3% to 34.1% and from 3.9% to 10.2% (Figure 1). Four hospitals (36.4%: B, D, L and M) had adjusted CD rates above the predicted confidence interval; four centers (36.4%: A, F, H, I) were below the interval and three centers (27.2%: C, E and G) fell within the interval for their patient population. With regard to AVD, two hospitals (18.3%: G and M) had adjusted rates above the predicted confidence interval; three (27.2%: E, H, L) were below the interval, and six (54.5%: A, B, C, D, F, I) were within the interval.

Figure 1
figure 1

Institutional caesarean and assisted vaginal delivery rates (percentage). Centers are reported in capital letters.

Full size image

Analysis of maternal and neonatal outcomes according to mode of delivery

The incidence and crude and adjusted RRs of maternal and neonatal outcomes according to mode of delivery are listed in Tables 1 and 2. Outcomes varied substantially by mode of delivery and some of them were obviously associated with only one mode of delivery (e.g. III-IV degree perineal tears). If a condition was inherent of a mode of delivery, then no comparative analysis was performed.

Table 1 Incidence of outcomes (individual and composite) by mode of delivery
Full size table
Table 2 Risk ratios for outcomes (individual and composite) by mode of delivery
Full size table

We assessed the outcomes by mode of delivery with bivariate and multivariate analyses in order to control for all possible confounders that can be both related to the need of an operative delivery and to the increased risk of adverse outcomes.

Considering either SVD or VD (SVD plus AVD) as the reference, CD was associated with a significantly higher risk of endometritis-infection (adjusted RRs 4.74 and 4.33 respectively) and selective neonatal complications such as pulmonary disorders (adjusted RRs 2.07 and 2.12, respectively). The risk of Apgar score less than 7 at five minutes was higher in CDs than SVDs (adjusted RR 2.06), and any other condition requiring NICU admission in neonates at term occurred more frequently in CDs than VDs (adjusted 1.99). In regard to the “protective effect”, CD was associated with a better composite maternal outcome for life threatening complications than VD. However the difference was not significant if the comparison considered only SVD.

When compared with SVD, AVD had a significantly higher risk of major and minor PPH (adjusted RRs 2.41 and 1.41, respectively), III-IV degree tears (adjusted RRs 2.26) and life threatening, non-life threatening and overall composite adverse maternal outcomes (adjusted RRs 2.24, 1.57 and 1.67, respectively).

As for the neonate, AVD was associated with a higher risk of mortality within 28 days (adjusted RRs 7.12), arterial cord pH less than 7.00 and base deficit greater than 12 mmol/l (adjusted RRs 7.02 and 3.28, respectively), Apgar score less than 7 at five minutes (adjusted RR 5.00), and life threatening, non-life threatening and overall composite neonatal morbidities (adjusted RRs 3.31, 1.78 and 1.92 respectively).

Multivariate Analysis of Maternal and Neonatal Outcomes According to Outlier Status

Adjusted maternal and neonatal outcomes according to the outlier status for CD and AVD are described in Tables 3 and 4, respectively.

Table 3 Adjusted outcomes (individual and composite) by caesarean delivery rates outlier status
Full size table
Table 4 Adjusted outcomes (individual and composite) by assisted vaginal delivery rates outlier status
Full size table

With regard to caesarean deliveries, the “above” group had worse maternal outcomes if compared to the “within” reference group. The incidence of major and minor PPH, hysterectomy, III-IV degree tears, endometritis-infection, any other condition requiring admission to intensive care unit, as well as life threatening, non-life threatening and overall composite maternal adverse outcomes, was significantly higher in centers with above the expected CD rates. This group showed also significantly higher frequencies of almost all the neonatal complications (except for cord pH <7).

It is of interest to note that similar results were also observed in centers with CD rates below the expected (Table 3).

Higher rates of selected maternal complications (PPH, wound hematoma, uterine rupture, III-IV degree tears, anaesthesiological complications, and non-life threatening and overall composite maternal adverse outcomes) were also observed in centers with AVD rates above the expected. This group had also significantly higher rates of unfavorable neonatal outcomes for almost all the considered conditions.

Inversely, institutions with an AVD rate below the expected had significantly better maternal and neonatal outcomes than the “within” AVD rates institutions (Table 4).

Discussion

There is a worldwide growing debate on quality assessment in obstetric care and this issue represents an important part of the National Health Systems (NHS) agenda [21-24].

Whether processes or outcome measures are used as markers of quality, an ideal assessment should encompass variables that are clinically relevant, easy to define and observe. Although the evaluation of CD rates – according to their adjusted rates – has been suggested as one of the most important indicators of quality, it has been criticized because of its controversial ability to capture both maternal and neonatal outcomes [8].

Our multicenter study is the first to determine the adjusted incidence of adverse maternal and neonatal outcomes according to institutional outlier status for both adjusted AVD and CD rates.

We observed that both centers with CD rates above or below the expected had a higher incidence of almost all the maternal and neonatal clinically significant adverse outcomes. Moreover, centers with higher-than-expected AVD rates showed higher incidence of complications, whereas those with a rate of AVD below the expected had a significantly lower rate of selected and composite maternal and neonatal outcomes (Figures 2 and 3).

Figure 2
figure 2

Forest plots of life threatening, non-life threatening and overall composite maternal and neonatal complications, by caesarean delivery rates outlier status.

Full size image
Figure 3
figure 3

Forest plots of life threatening, non-life threatening and overall composite maternal and neonatal complications, by assisted vaginal delivery rates outlier status.

Full size image

These results are of clinical relevance. As first, both CD rates and AVD rates must be considered for a correct evaluation of the performance of every maternity unit. If assisted vaginal deliveries are not considered as part of the quality care assessment, the evaluation can be misleading. Centers with CD rates within the expected can in fact be thought to provide a good care, while they may actually dispense less optimal levels of care if their AVD rates are found to be higher-than-expected. The status of center G represents an example: the adjusted CD rate was within the expected and thus associated with “good outcomes”, but its “above” AVD rate was associated with an increased risk of complications. Second, both CD rates above and below the expected can be considered as an indicator of increased risk of maternal or neonatal morbidities. In this regard, it is clear that the best maternal and neonatal outcomes are offered by those institutions, as center E, that maintain a CD rate within the expected range and have a simultaneous low rate of AVD.

From our data, it seems that mode of delivery by itself cannot completely explain the differences in the most severe adverse maternal and neonatal outcomes as observed in different outlier status of operative deliveries.

In fact, if compared with SVD, as demonstrated in other studies [25], AVDs were associated with an increased risk of selected maternal and neonatal composite adverse outcomes. Caesarean deliveries, instead, increased only the risk of endometritis, newborn pulmonary disorders and Apgar less than 7 at five minutes.

The causal link between above and below the expected risk-adjusted CD rates and poorer maternal and especially neonatal outcomes is unclear. This relationship does not imply causality, but suggests that an association is present.

Despite the differences in study design, our results support the conclusions of Gould, Bailit, Srinivas: institutional CD rates both “above” or “below” the expected may be considered as indicators of increased risk of maternal or neonatal morbidities. Gould et al. focused their analysis only on outcomes of low risk pregnancies [5]. Bailit et al. evaluated the risk of adverse maternal and neonatal outcomes by considering only the outlier status for primary and not overall adjusted CD rates [6,7]. Srinivas et al. considered only selected measures of complications, such as maternal wound infection, post-partum hemorrhage, blood transfusion and neonatal mortality, asphyxia or seizures [8]. The main limitation of these studies was the model of risk adjusting outcomes. All of them based their analyses on retrospective collection of pregnancy data derived from birth certificates and hospital discharge records containing ICD-9 diagnoses codes. Moreover they did not consider relevant variables for risk adjustment such as, for example, maternal BMI, obstetric volume and conditions of impeding maternal or neonatal compromise. Medical records, birth certificates, diagnosis related group codes (DRG) and International Classification of Diseases - 9th Revision (ICD-9) codes are commonly used as resources for research and quality surveillance in obstetric practice. However, these large datasets, which are usually used for other purposes such as for insurances or health statistics, often lack the information needed to homogenously risk-adjust the outcomes of interest for patient characteristics. [21,22,26,27]. Even though our study was not based on a large number of deliveries, it should be considered as one of the few in which the operative delivery rates and the incidence of maternal and neonatal complications were adjusted for unambiguous data. Information on maternal characteristics, antenatal obstetric conditions/risk factors and maternal/neonatal outcome variables was prospectively gathered in a dedicated database that allowed us to collect standardized and homogeneous data, excluding only 3.6% of the records from the final analysis because of missing data. Nevertheless our study, by prospectively collecting information on twelve maternal and ten neonatal adverse outcome variables, provided the information that overall CD rates – not only primary – may be considered as a measure of quality of care.

In regard to the association of outlier status for CD rates and neonatal morbidity, it might be hypothesized that increased morbidity observed in the “below” CD rate group might suggest that certain infants delivered vaginally could potentially have benefited from caesarean delivery. Alternatively, in these centers, an inappropriate delayed timing in the conduction of the delivery might have resulted in a higher rate of neonatal morbidity.

The increased rate of neonatal complications observed in the “above” CD rate group might be explained considering that the selection process in this group, though leading to more caesarean deliveries, failed to consider many cases that might have benefited from the caesarean delivery [5].

Moreover, strategies for managing labor and organizational models may vary between institutions and these might account for both different incidences of adverse outcomes and operative delivery rates [23,24,28].

Walsh et al. observed that both AVDs and CDs in the second stage of labor are associated with a similar increased risk of serious neonatal complications [29]. In our context, we may suppose that any inappropriate anticipation of an obstetric intervention in the second stage of labor, without respecting its “physiological” duration or without managing second stage according to the recommended guidelines, might increase the rate of both caesarean and operative deliveries and worsen the obstetric outcomes [22,24,28].

The literature does not clarify whether the hospital delivery volume might influence both the rate of operative deliveries and of maternal and neonatal complications [18-20,30]. In this regard, it is possible that smaller units might have a lower threshold for operative deliveries due to organizational reasons and lack of resources required to respond to medical emergencies. For the same reasons, these institutions could also present worse outcomes. This might not be the case of our study, because inter institutional variations in operative delivery rates and frequencies of adverse outcomes remained either between centers with less than 1000 deliveries/year and institutions with more than 1000 deliveries/year, despite the inclusion of obstetric volume, of type of neonatal organization (NICU availability) and delivery grade of urgency (emergency – no emergency) into the adjusted model. As suggested by Janakiraman et al., it might be that the increased risk of maternal and neonatal complications could be related to hospital performance, independently from delivery volumes [20].

Despite the clinically relevant conclusions, we are aware that our study has its limitations. First, we did not consider separately every antenatal risk factor, labeling the pregnancy as “at risk” according to selected groups of risk conditions. However, other studies adopted this classification considering that a successful model for adjusting assisted delivery rates should consider the most relevant risk factors that must be acceptable to practicing obstetricians [21-23,31]. Second, we did not include other variables, such as race/ethnicity or socio-economic status or habits (e.g. smoking), in the risk adjustment. However, the former was not assessed because of the very low prevalence of non-Caucasians in our region and considering this variable should not have a relevant role in the prediction of operative delivery [32]; the latter was not considered because the collected data included all the clinical adverse conditions that are associated with “bad” habits (e.g. intrauterine growth restriction, preterm delivery). Third, there is no wide agreement on which indicators of outcome need to be evaluated to assess obstetric quality. In this regard, we considered the short term clinically meaningful indicators that are included in the Agency for Health Care Research and Quality report, in the Adverse Outcome Index and in the recent model proposed by Sibanda et al. on behalf of the Royal College of Obstetricians and Gynaecologists [33-36]. Finally, a further limitation of our study was the inability to assess what factors contributed to adverse outcomes in the outlier settings. In this context caesarean and assisted vaginal deliveries might reflect the differences to a selected processes of care (e.g. training, adherence to guidelines) that might explain inter-institutional variation of outcomes [30]. Nonetheless the aim of our study was not to measure the process of care, but to evaluate whether variations of both CD and AVD rates among institutions could explain differences in outcomes.

Conclusions

Our results support the belief that evaluating the CD rates without taking into account the AVD rates might not provide a reliable view of obstetric performance. In this context, the case-mix adjustment for a complete and standardized set of variables and the knowledge of the outlier status for both assisted vaginal and caesarean deliveries are crucial to properly assess the level of care among institutions, giving the opportunity to modify the management and improve the outcomes [4,37].

However we are aware that more research is required to develop a consensus about accepted, reproducible and clinically relevant indicators of maternal and neonatal outcomes that need to be evaluated in the process of labor audit [38].

Abbreviations

Adj:

Adjusted

AVD:

Assisted vaginal delivery

BD:

Base deficit

BMI:

Body mass index

CD:

Caesarean delivery

ICU:

Intensive care unit

NICU:

Neonatal intensive care unit

PPH:

Post-partum hemorrhage

RR:

Risk ratio

SVD:

Spontaneous vaginal delivery

TED:

Thromboembolic disease

VD:

Vaginal delivery

References

  1. American College of Obstetricians and Gynecologists, Task Force on Cesarean Delivery Rates. Evaluation of cesarean delivery. Washington DC: American College of Obstetricians and Gynecologists; 2000 [http://www.acog.org/Resources_And_Publications/Task_Force_and_Work_Group_Reports_List]

    Google Scholar 

  2. Bailit J, Garrett J. Comparison of risk-adjustment methodologies. Obstet Gynecol. 2003;102:45–51.

    PubMed  Google Scholar 

  3. Bailit JL, Joanne M, Garrett JM. Stability of risk-adjusted primary cesarean delivery rates over time. Am J Obstet Gynecol. 2004;190:395–400.

    Article  PubMed  Google Scholar 

  4. Robson M, Hartigan L, Murphy M. Methods of achieving and maintaining an appropriate caesarean section rate. Best Pract Res Clin Obstet Gynaecol. 2013;27:297–308.

    Article  PubMed  Google Scholar 

  5. Gould JB, Danielsen B, Korst LM, Phibbs R, Chance K, Main E, et al. Cesarean delivery rates and neonatal morbidity in a low-risk population. Obstet Gynecol. 2004;104:11–9.

    Article  PubMed  Google Scholar 

  6. Bailit J, Garrett J, Miller W, McMahon M, Cefalo R. Hospital primary cesarean delivery rates and the risk of poor neonatal outcomes. Am J Obstet Gynecol. 2002;187:721–7.

    Article  PubMed  Google Scholar 

  7. Bailit JL, Love TE, Dawson NV. Quality of obstetric care and risk-adjusted primary caesarean delivery rates. Am J Obstet Gynecol. 2006;194:402–7.

    Article  PubMed  Google Scholar 

  8. Srinivas SK, Fager C, Lorch SA. Evaluating risk-adjusted caesarean delivery rate as a measure of obstetric quality. Obstet Gynecol. 2010;115:1007–13.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Janakiraman V, Ecker J. Quality in obstetric care: measuring what matters. Obstet Gynecol. 2010;116:728–32.

    Article  PubMed  Google Scholar 

  10. McMahon MJ, Luther ER, Bowes WA, Olshan AF. Comparison of a trial of labor with an elective second caesarean section. N Engl J Med. 1996;335:689–95.

    Article  CAS  PubMed  Google Scholar 

  11. Royal College of Obstetricians and Gynaecologists. Prevention and Management of Postpartum Haemorrhage. In: Green-top Guideline No. 52. London: RCOG; 2009.

    Google Scholar 

  12. Fong KW, Ohlsson A, Hannah ME, Grisaru S, Kingdom J, Cohen H, et al. Prediction of perinatal outcome in fetuses suspected to have intrauterine growth restriction: Doppler US study of fetal cerebral, renal, and umbilical arteries. Radiology. 1999;213:681–9.

    Article  CAS  PubMed  Google Scholar 

  13. Sarnat HB, Sarnat MS. Neonatal encephalopathy following fetal distress: a clinical and electroencephalographic study. Arch Neurol. 1976;33:696–705.

    Article  CAS  PubMed  Google Scholar 

  14. Hjalmarsson O. Epidemiology and classification of acute, neonatal respiratory disorders: a prospective study. Acta Paediatr Scand. 1981;70:773–83.

    Article  Google Scholar 

  15. Zhang J, Yu KF. What’s the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. JAMA. 1998;280:1690–1.

    Article  CAS  PubMed  Google Scholar 

  16. World Health Organization. Obesity: Preventing and Managing the Global Epidemic. Report of the WHO Consultation. WHO Technical Report Series. Geneva: World Health Organization; 2000.

    Google Scholar 

  17. Royal College of Obstetricians and Gynaecologists, Royal College of Anaesthetists. Classification of urgency of caesarean section - a continuum of risk. RCOG press 2010. [http://www.rcog.org.uk/classification-of-urgency-of-caesarean-section-good-practice-11]

  18. Snowden JM, Cheng YW, Kontgis C, Caughey AB. The association between hospital obstetric volume and perinatal outcomes in California. Am J Obstet Gynecol. 2012;207:1–7. 478.

    Article  Google Scholar 

  19. Kyser KL, Lu X, Santillan DA, Santillan MK, Hunter SK, Cahill AG, et al. The association between hospital obstetrical volume and maternal postpartum complications. Am J Obstet Gynecol. 2012;207:1–17. 42.

    Article  Google Scholar 

  20. Janakiraman V, Lazar J, Joynt KE, Jha AK. Hospital volume, provider volume, and complications after childbirth in U.S. hospitals. Obstet Gynecol. 2011;118:521–7.

    Article  PubMed  Google Scholar 

  21. Bailit JL. Measuring the quality of inpatient obstetrical care. Obstet Gynecol Surv. 2007;62:207–13.

    Article  PubMed  Google Scholar 

  22. Bailit JL, Srinivas SK. Where should I have my baby? Am J Obstet Gynecol. 2012;207:1–2.

    Article  PubMed  Google Scholar 

  23. Bailit JL. Measurement is just the beginning. Am J Obstet Gynecol. 2013;208:427–8.

    Article  PubMed  Google Scholar 

  24. Spong CY, Berghella V, Wenstrom KD, Mercer BM, Saade GR. Preventing the first cesarean delivery: summary of a joint Eunice Kennedy Shriver national institute of child health and human development, society for maternal-fetal medicine, and American college of obstetricians and gynecologists workshop. Obstet Gynecol. 2012;120:1181–93.

    PubMed  PubMed Central  Google Scholar 

  25. Lumbiganon P, Laopaiboon M, Gülmezoglu AM, Souza JP, Taneepanichskul S, Ruyan P, et al. Method of delivery and pregnancy outcomes in Asia: the WHO global survey on maternal and perinatal health 2007–08. Lancet. 2010;375(9713):490–9.

    Article  PubMed  Google Scholar 

  26. Chescheir N, Meints L. Prospective study of coding practices for caesarean deliveries. Obstet Gynecol. 2009;114:217–23.

    Article  PubMed  Google Scholar 

  27. Goff SL, Pekow PS, Markenson G, Knee A, Chasan-Taber L, Lindenauer PK. Validity of using ICD-9-CM codes to identify selected categories of obstetric complications, procedures and co-morbidities. Paediatr Perinat Epidemiol. 2012;26:421–9.

    Article  PubMed  Google Scholar 

  28. National Collaborating Centre for Women’s and Children’s Health (UK). Caesarean section - National Institute for Health and Clinical Excellence Guidance. RCOG Press 2011. [http://www.nice.org.uk/guidance/CG132]

  29. Walsh CA, Robson M, McAuliffe FM. Mode of delivery at term and adverse neonatal outcomes. Obstet Gynecol. 2013;121:122–8.

    Article  PubMed  Google Scholar 

  30. Grobman WA, Bailit JL, Rice MM, Wapner RJ, Varner MW, Thorp Jr JM, et al. Can differences in obstetric outcomes be explained by differences in the care provided? Am J Obstet Gynecol. 2014;211:1–16. 147.

    Article  Google Scholar 

  31. Bailit JL, Schulkin J, Dawson NV. Risk-adjusted cesarean rates: what risk factors for cesarean delivery are important to practicing obstetricians? J Reprod Med. 2007;52:194–8.

    PubMed  Google Scholar 

  32. Bailit JL, Love TE. The role of race in cesarean delivery rate case mix adjustment. Am J Obstet Gynecol. 2008;198:1–5. 69.

    Article  Google Scholar 

  33. Agency for Healthcare Research and Quality. Patient safety indicators. 2010 [http://www.qualityindicators.ahrq.gov/psi_overview.htm]

  34. Gregory KD, Korst LM, Lu MC, Fridman M. AHRQ patient safety indicators: time to include hemorrhage and infection during childbirth. Jt Comm J Qual Patient Saf. 2013;39:114–22.

    PubMed  Google Scholar 

  35. Mann S, Pratt S, Gluck P, Nielsen P, Risser D, Greenberg P, et al. Assessing quality obstetric care: development of standardized measures. Jt Comm J Qual Patient Saf. 2006;32:497–505.

    PubMed  Google Scholar 

  36. Sibanda T, Fox R, Draycott TJ, Mahmood T, Richmond D, Simms RA. Intrapartum care quality indicators: a systematic approach for achieving consensus. Eur J Obstet Gynecol Reprod Biol. 2013;166:23–9.

    Article  PubMed  Google Scholar 

  37. Gee RE, Winkler R. Quality measurement. What It means for obstetricians and gynecologists. Obstet Gynecol. 2013;121:507–10.

    Article  PubMed  Google Scholar 

  38. Main EK, Morton CH, Melsop K, Hopkins D, Giuliani G, Gould JB. Creating a public agenda for maternity safety and quality in cesarean delivery. Obstet Gynecol. 2012;120:1194–8.

    PubMed  Google Scholar 

Download references

Acknowledgments

The study was funded by the grant No.86/05 of Institute for Maternal and Child Health – IRCCS Burlo Garofolo, Trieste (Italy). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Authors are very grateful to collaborators grouped under the name of “Multicenter Study Group on Mode of Delivery in Friuli Venezia Giulia”, residents and midwives of the participating centers for their help with data collection.

The Multicenter Study Group on Mode of Delivery in Friuli Venezia Giulia - Collaborators/Institutions

Carmine Gigli, Daniele Domini (Department of Obstetrics and Gynecology, Hospital of Gorizia, Gorizia), Claudio Fiscella, Sara Casarsa (Department of Obstetrics and Gynecology, Hospital of Latisana, Latisana-Udine), Carlo Zompicchiatti, Michela De Agostinis (Department of Obstetrics and Gynecology, Hospital of Palmanova, Palmanova-Udine), Attilio D’Atri, Raffaela Mugittu (Department of Obstetrics and Gynecology, Hospital of Monfalcone-Gorizia), Santo La Valle, Cristina Di Leonardo (Department of Obstetrics and Gynecology, San Giorgio Private Hospital, Pordenone), Valter Adamo, Silvia Smiroldo (Department of Obstetrics and Gynecology, S. Maria degli Angeli Hospital, Pordenone), Giovanni Del Frate, Monica Olivuzzi (Department of Obstetrics and Gynecology, Hospital of San Daniele del Friuli, San Daniele Del Friuli-Udine), Silvio Giove, Maria Parente (Department of Obstetrics and Gynecology, S.Maria dei Battuti Hospital, San Vito al Tagliamento-Pordenone), Daniele Bassini, Simona Melazzini (Department of Obstetrics and Gynecology, S.Antonio Abate Hospital, Tolmezzo-Udine), Secondo Guaschino, Andrea Sartore, Davide De Santo (Department of Obstetrics and Gynecology, Institute for Maternal and Child Health – IRCSS Burlo Garofolo, Trieste), Sergio Demarini, Gabriele Cont (Department of Neonatal Intensive Care Unit, Institute for Maternal and Child Health – IRCSS Burlo Garofolo, Trieste), Diego Marchesoni, Alberto Rossi (Department of Obstetrics and Gynecology, S.Maria della Misericordia Hospital-University of Udine, Udine), Giorgio Simon (Regional Health Agency of Friuli Venezia Giulia), Giorgio Tamburlini (Research Direction, Institute for Maternal and Child Health – IRCSS Burlo Garofolo, Trieste).

Author information

Authors and Affiliations

  1. Department of Obstetrics and Gynecology, Institute for Maternal and Child Health – IRCCS Burlo Garofolo, Via dell’Istria 65/1, Trieste, 34137, Italy

    Gianpaolo Maso, Monica Piccoli, Sara Parolin, Caterina Businelli & Salvatore Alberico

  2. Epidemiology and Biostatistics Unit, Institute for Maternal and Child Health – IRCCS Burlo Garofolo, Trieste, Italy

    Lorenzo Monasta, Luca Ronfani & Marcella Montico

  3. Department of Obstetrics and Gynecology, Institute for Maternal and Child Health – IRCCS Burlo Garofolo and Department of Medical Sciences, University of Trieste, Trieste, Italy

    Francesco De Seta

  4. Department of Neonatology and Neonatal Intensive Care, Institute for Maternal and Child Health – IRCCS Burlo Garofolo, Trieste, Italy

    Laura Travan

Authors
  1. Gianpaolo Maso
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lorenzo Monasta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Monica Piccoli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luca Ronfani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marcella Montico
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Francesco De Seta
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sara Parolin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Caterina Businelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Laura Travan
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Salvatore Alberico
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

on behalf of The Multicenter Study Group on Mode of Delivery in Friuli Venezia Giulia

Corresponding author

Correspondence to Gianpaolo Maso.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

GM, SA, LR conceived and designed the study. LM, MM analyzed the data. GM, LM, MP, LR interpreted the data. GM, LM, MP wrote the first draft of the manuscript. MM, LR, FDS, SP, CB, LT SA contributed to the writing of the manuscript. GM, LM, MP, LR, MM, SP, CB, FDS, LT, SA read and met ICMJE criteria for authorship. All authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maso, G., Monasta, L., Piccoli, M. et al. Risk-adjusted operative delivery rates and maternal-neonatal outcomes as measures of quality assessment in obstetric care: a multicenter prospective study. BMC Pregnancy Childbirth 15, 20 (2015). https://doi.org/10.1186/s12884-015-0450-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-015-0450-2

Keywords

BMC Pregnancy and Childbirth

ISSN: 1471-2393

Contact us