Although the association between mortality and admission to intensive care units (ICU) in the "after hours" (weekends and nights) has been the topic of extensive investigation, the timing of discharge from ICU and outcome has been less well investigated. The objective of this study was to assess effect of timing of admission to and discharge from ICUs and subsequent risk for death.
Adults (≥18 years) admitted to French ICUs participating in Outcomerea between January 2006 and November 2010 were included.
Among the 7,380 patients included, 61% (4,481) were male, the median age was 62 (IQR, 49-75) years, and the median SAPS II score was 40 (IQR, 28-56). Admissions to ICU occurred during weekends (Saturday and Sunday) in 1,708 (23%) cases, during the night (18:00-07:59) in 3,855 (52%), and on nights and/or weekends in 4,659 (63%) cases. Among 5,992 survivors to ICU discharge, 903 (15%) were discharged on weekends, 659 (11%) at night, and 1,434 (24%) on nights and/or weekends. After controlling for a number of co-variates using logistic regression analysis, admission during the after hours was not associated with an increased risk for death. However, patients discharged from ICU on nights were at higher adjusted risk (odds ratio, 1.54; 95% confidence interval, 1.12-2.11) for death.
In this study, ICU discharge at night but not admission was associated with a significant increased risk for death. Further studies are needed to examine whether minimizing night time discharges from ICU may improve outcome.
Patients who suffer acute illness and are admitted during the "after hours" (weekends or nights) may be at higher risk for adverse outcome as compared to patients admitted during weekdays . Cavallazzi et al recently conducted a meta-analysis of ten studies conducted in adult ICUs and found that while night time admission was not associated with an increased risk, a small but significant increased risk for death was associated with weekend admission . Since, Kuijsten et al reported a relative risk for death associated with admission in the afterhours of 1.059 (95% confidence interval 1.031-1.088) among 149,894 admissions to Dutch ICUs . More recently Kevat et al reported on 245,057 admissions to Australian ICUs and found an increased risk for hospital mortality associated with admission during evenings/nights (17% vs. 14%; p < 0.001) and during weekends (20% vs. 14%; p < 0.001) . The existence and determinants of afterhours admission effects therefore remains a topic of controversy.
While admission to ICU in the after hours has been closely scrutinized, less attention has been directed to how the timing of discharge from ICU may influence outcome [5-10]. Patient discharges in the afterhours may be a reflection of limited ICU bed capacity and potentially patients may suffer an increased mortality risk due to premature discharge or limited availability of care in the ward setting in the afterhours [5,7-10]. The objective of this study was to investigate whether an after hours effect on mortality may be present among patients admitted to and discharged from ICU.
This study utilized an inception cohort design. All data was obtained using the Outcomerea database . All first admissions among adults (≥18 years) between January 2006 and November 2010 with complete admission and discharge dates and times were included. According to French law, this study did not require individual patient consent, as it involved research on a previously developed and approved database.
The Outcomerea database
Outcomerea is a prospective observational study that includes detailed clinical and outcome data on patients admitted to participating French ICUs . In some cases participants in the Outcomerea group have enrolled consecutive patients admitted to ICU and in others sampling has been performed where all consecutive admissions during a period of time during the year or all admissions to certain ICU beds are included. Data included in the Outcomerea database has been collected by senior physicians in the participating ICUs. For each patient, the data were entered into an electronic case-report forms using VIGIREA® and RHEA® data-capture software (OUTCOMEREA™, Rosny-sous-Bois, France), and all case-report forms were then entered into the OUTCOMEREA® data warehouse. The data-capture software automatically conducts multiple checks for internal consistency of most of the variables at entry in the database. Queries generated by these checks were resolved with the source ICU before incorporation of the new data into the database. At each participating ICU, data quality was controlled by having a senior physician from another participating ICU check a 2% random sample of the study data. A one-day coding course is organized annually with the study investigators and contrast research organization monitors.
Once all of the admissions to ICU were identified fulfilling enrollment criteria, the following information were extracted for each patient at presentation: age and sex, admission category (medical, scheduled surgery, or unscheduled surgery). Severity of illness was evaluated at presentation to ICU using the Simplified Acute Physiology Score (SAPS II) and sepsis-related organ failure assessment (SOFA) . Knaus scale definitions were used to record pre-existing chronic organ failures including respiratory, cardiac, hepatic, renal, and immune system failures . The requirement for assisted ventilation, renal replacement therapy, and use of corticosteroids at admission was recorded. The presence of sepsis, severe sepsis, and septic shock was established using standard criteria . The length of stay in ICU and ICU and hospital deaths were recorded. A weekend was a priori defined by the period from 00:00 Saturday to 23:59 Sunday, days as 08:00 to 17:59, and nights as 18:00 to 07:59.
Analysis was performed using Stata version 11.2 (Stata Corp, College Station, TX). To avoid the assessment of multiple outcomes for a single patient, only first ICU presentations were analyzed from patients with multiple ICU admissions. Normally or near-normally distributed variables were reported as means ± standard deviations (SD) and non-normally distributed variables as medians with inter-quartile ranges (IQR). Means were compared using the Student t test and medians using the Mann-Whitney U test. Differences in proportions among categorical data were assessed using Fisher's exact test for pair-wise comparisons and the chi2 test for multiple group trend analysis. Where data missing occurred they were not replaced and are reported with reduced n.
Logistic regression models were developed to assess the independent effects of day and time of admission to and discharge from ICU on in-hospital mortality. Factors included in the initial models were admission SAPS II, medical/surgical classification, presence of septic shock, decision to forego life sustaining therapy (DFLST) order, variables found to be significant to the p < 0.1 level in univariate analyses, and weekend/weekday and day/evening admission time were included in the initial models. The discharge SOFA score was also included in the discharge timing model. Backward step-wise variable elimination was then performed to develop the most parsimonious models. Discrimination was assessed using the area under the receiver operator characteristic (ROC) curve and calibration using the Hosmer-Lemeshow goodness of fit test.
A total of 7,380 adult patients were included. Sixty-one percent (4,481) of the patients were male, the median age was 62 (IQR, 49-75) years, and the median SAPS II score was 40 (IQR, 28-56). Admissions were from the emergency department in 3,625 (49%), inpatient wards in 2,973 (40%), other intensive care areas in 415 (6%), and other/unknown in 367 (5%); the median stay in hospital prior to ICU admission was 0 IQR, 0-2) days. Admissions to ICU occurred during weekends (Saturday and Sunday) in 1,708 (23%) cases, during the night (18:00-07:59) in 3,855 (52%), and on nights and/or weekends in 4,659 (63%) cases. Among 5,992 survivors to ICU discharge, 903 (15%) were discharged on weekends, 659 (11%) at night, and 1,434 (24%) on nights and/or weekends.
The overall ICU and in-hospital mortality rates were 1,388/7,380 (19%) and 1,743/7,380 (24%), respectively. The crude risk for in-hospital death associated with time of ICU admission was highest in the late morning as shown in Figure 1. On the other hand, the crude risk for in-hospital death after ICU discharge was lowest during the daytime with rates increasing after early evening and were highest in the early morning (Figure 1). Although admission during night (878/3,855; 23%) as compared to day (865/3,525; 25%); p = 0.079) hours was not associated with mortality, discharge from ICU at night (62/659; 9%) as compared to daytime (293/5,333; 5%; p = 0.0002) hours was associated with subsequent in-hospital mortality.
Figure 1. Mortality associated with hour of admission to and discharge from ICU.
The crude in-hospital mortality rate varied (p = 0.045) according to the day of the week of ICU admission as shown in Figure 2. An increased crude ICU-mortality (353/1708; 21% vs. 1035/5672 (18%); p = 0.026) and overall hospital mortality (432/1708; 25% vs. 1311/5672; 22%; p = 0.005) was observed with admission to ICU during weekends as compared to weekdays. The day of discharge of survivors from ICU was not associated (p = 0.086) with overall risk for in-hospital death (Figure 2). A weekend ICU discharge was not associated with subsequent in-hospital death (60/903; 7% vs. 295/5089; 6%; p = 0.32). Although there was no increased risk for in-hospital death associated with admission during nights and/or weekends as compared to weekday days (1,096/4,659; 24% vs. 647/2,721; 24%; p = 0.82), patients discharged from ICU on nights and/or weekends were more likely to die in-hospital as compared to those discharged during weekday days (111/1,434; 8% vs. 244/4,558; 5%; p = 0.001).
Figure 2. Mortality associated with day of admission to and discharge from ICU.
Patients admitted during weekdays were different based on a number of characteristics from those admitted during nights and/or weekends as shown in Table 1. The overall length of ICU stay was a median of 3 (IQR, 1-7) days and was not different for those admitted on weekends or weekdays (p = 0.075) or in the after hours (p = 0.11). Patients discharged during daytime hours during weekdays were also different from those discharged on weekends and/or nights as shown in Table 2. During the course of the ICU stay, 538 patients had a new decision to forego life sustaining therapy (DFLST) order established. New DFLST orders were less likely to be established on a weekend than a week day as shown in Figure 3.
Table 1. Characteristics of adults admitted to ICU during weekday/daytime as compared to nights/weekends
Table 2. Characteristics of adults discharged alive from ICU during weekday/daytime as compared to nights/weekends
Figure 3. Day of the week for new decision to forgo life sustaining therapy (DFLST) orders after admission to ICU.
Multivariable logistic regression models were developed to assess factors associated with in-hospital death. In the first model (Table 3), neither admission on evenings or weekends to the ICU was associated with increased risk for in-hospital death. In order to assess the potential effect of the timing of ICU discharge on mortality, a second logistic regression model was developed limited to patients surviving to ICU discharge. As shown in Table 4, discharge from ICU during nights was independently associated with subsequent in-hospital mortality. Discharge during Friday, Saturday, and Sundays was associated with an increased risk for death although this was only statistically significant for Fridays (Table 4).
In this study we found that while most admissions to ICU occur in the after hours and that weekend admissions were associated with a higher crude case-fatality rate, the day of the week or night time admission was not associated with mortality once adjustment for confounding variables was performed (Table 3). However, the timing of discharge was associated with the subsequent risk for in-hospital death especially with night discharges (Table 4).
Since the initial reports identifying higher neonatal mortality rates associated with weekend deliveries more than 30 years ago there has been hundreds of subsequent publications evaluating potential after hours effects in wide ranges of patients and settings [15,16]. Where after hours effects may be present, it is important issue to define them and explore their determinants. On one hand, an increased risk for death associated with care during different times of the day or week may reflect inconsistencies in availability or quality of care and is a major safety issue that must be addressed. On the other hand, patients admitted in the after hours may be intrinsically at higher risk for death by virtue of a different case-mix, increased severity of illness, or some other unmeasured factor as compared to patients admitted during usual daytime hours.
There is ongoing debate as to whether there may be, and what are the determinants of, after hours admission effects associated with admission to ICUs. In the meta-analysis conducted by Cavallazzi et al, weekend but not night time admission was found to be associated with adverse outcome . However, this study has been followed by a large Dutch study that indicated that weekend but not evening admission was associated with adverse outcome . To further the controversy, an Australian study including nearly one quarter million ICU admissions subsequently was published supporting an increased risk for evening/night and weekend admissions . These differences likely at least reflect heterogeneity among study design and different organisational characteristics among participating study ICUs . A number of factors have been suggested to influence after hours effects not limited to reduced nurse and other healthcare worker staffing, closed versus open ICU models, experience and availability of attending intensivists and/or housestaff, and access to treatments and procedures in the after hours [2,3,5-10]. Generally speaking, among our study ICUs while nursing staffing tends to be comparable or only slightly reduced on weekends and evenings, there are significant decreases in allied healthcare workers including physiotherapists and respiratory therapists, and medical staff including residents, fellows, and attending physicians. It is noteworthy, however, that all of our ICUs employed a closed model and that an attending physician is mandated to remain in-house 24/7.
Although much focus has been placed on potential after hours effects associated with the timing of admission, less attention has been paid to course of care subsequent. From the ICU perspective, few studies have evaluated the effects of the time of discharge from ICU and subsequent outcome. While one study from Finland showed no effect , others from Denmark , The United Kingdom , Australia/New Zealand [8,9], and Canada [10,17] found adverse outcome associated with after hours discharges from the ICU. Few clinicians would agree that discharges late at night would be considered to represent optimal care. In most of our participating ICUs weekend day discharges are discouraged and all night discharges are not standard practice. Many weekend and virtually all night discharges are considered premature discharges. These are nearly always due to limited bed capacity in the ICU and need to admit a more acutely or severely ill patient . It is also notable that we observed an increase in risk for subsequent mortality following discharge on Fridays and an increased risk that was not statistically significantly associated with weekend day discharges. We speculate that this increased risk for death could be reflective of decreased intensity of care on wards on weekends. Unlike ICUs which are resource intensive and designed for 24/7 acute care, many other areas of hospitals are typically be less prepared for managing acute patients with consistent support over the hours of night and days of the week. It is also important to recognize that placing limitations on patient care such as restrictions on resuscitation may also influence the outcome of patients after discharge from ICU. We identified that new DFLST orders were less likely to be written on weekends (Figure 3) and that they were important determinants of outcome (Tables 3 and 4).
There are some study limitations that merit discussion. First, it is important to note that there is no general consensus as to what defines "after hours" or weekend care and definitions have varied among studies to date. Our a priori selected definitions may not necessarily reflect the exact times when staffing or other service delivery changes may occur, and we did not consider national holidays or seasonal variability. It is notable that a post hoc analysis defining a weekend from Friday at 18:00 to Monday at 07:59 and found that this made no appreciable difference in our conclusions. However, in post hoc analyses examining six-hourly time periods of 00:00-05:59, 06:00-11:59, 12:00-17:59, and 18:00-23:59 (as suggested by the results in Figure 1), crude in-hospital mortality rates were 22%, 33%, 22%, and 22% (p < 0.001) associated with admission and were 11%, 6%, 5%, and 9% (p = 0.002) associated with ICU discharge during these periods, respectively. Second, this study was a retrospective review. Although data are collected in a prospective manner in Outcomerea, data were not specifically collected for purposes of this study protocol per se. While we observed no overall effect on outcome associated with timing of admission to ICU, the possibility exists that certain subgroups of patients, timing of pre-ICU care, or differences in provision of care in the pre-ICU setting may have influenced outcome. A third limitation is that because our study is focussed in the ICU environment, we do not have detailed data on subsequent care provided on wards. As a result we may only speculate as to why patients discharged at night suffered higher mortality. Finally, although multiple centres were included in this study, more than one-half of the patients were enrolled from two ICUs with small numbers included from some sites, limiting the ability to assess inter-facility variability.
In this study we found no association between the timing of admission to ICU and subsequent outcome after controlling for a number of variables in multivariable analysis. However, the timing of discharge, especially during the night was associated with adverse mortality outcome. Further investigation is needed to examine whether minimization of after hours discharges and/or augmentation of ward care post-ICU discharge may improve the ultimate outcome of critical illness.
The authors declare that they have no competing interests.
KL and JFT conceived the study and KL and AV performed the data extraction and the statistical analyses. KL wrote the draft version of the manuscript and BM, BS, AT, EA, DGT, ASD, SJ, HK, CC, MD, JFT are clinical investigators of the Outcomerea study groups and critically revised the draft manuscript. All the authors approved the final submission.
Acknowledgements and Funding
The study was funded by the OUTCOMEREA organization.
Jean-François Timsit (Hôpital Albert Michallon and INSERM U823, Grenoble, France), Elie Azoulay (Medical ICU, Hôpital Saint Louis, Paris, France), Yves Cohen (ICU, Hôpital Avicenne, Bobigny, France), Maïté Garrouste-Orgeas (ICU Hôpital Saint-Joseph, Paris, France), Lilia Soufir (ICU, Hôpital Saint-Joseph, Paris, France), Jean-Ralph Zahar (Microbiology Department, Hôpital Necker, Paris, France), Christophe Adrie (ICU, Hôpital Delafontaine, Saint Denis, France), Michael Darmon (Medical ICU, University hospital St Etienne, France), Bertrand Souweine (CHU Gabriel Montpied, Clermont Ferrand, France), and Christophe Clec'h (ICU, Hôpital Avicenne, Bobigny, and INSERM U823, Grenoble, France).
Biostatistical and informatics expertise: Jean-Francois Timsit (Hôpital Albert Michallon and Integrated research center U823, Grenoble, France), Corinne Alberti (Medical Computer Sciences and Biostatistics Department, Robert Debré, Paris, France), Aurélien Vesin (Integrated research center U823, Grenoble, France), Stephane Ruckly, (Integrated research center U823, Grenoble, France), Christophe Clec'h (ICU, Hôpital Avicenne, Bobigny, and INSERM U823, Grenoble, France), and Didier Nakache (Conservatoire National des Arts et Métiers, Paris, France), Kevin Laupland (Integrated research center U823, Grenoble, France).
Investigators of the Outcomerea database:
Christophe Adrie (ICU, Hôpital Delafontaine, Saint Denis, France and Physiology, Hôpital Cochin, Paris, France), Bernard Allaouchiche (ICU, Edouard Herriot Hospital, Lyon), Claire Ara-Somohano (CHU, Grenoble France), Jean-Pierre Bedos (Medical surgical ICU, André Mignot Hospital, Versailles-Le Chesnay, France), Agnes Bonadona (CHU Grenoble France), Christine Cheval (SICU, Hôpital Saint-Joseph, Paris, France), Jean-Pierre Colin (ICU, Hôpital de Dourdan, Dourdan, France), Michael Darmon (ICU, CHU Saint Etienne), Yohann Dubois (CHU Grenoble, France), Anne-Sylvie Dumenil (Hôpital Antoine Béclère, Clamart France), Adrien Descorps-Declere (Hôpital Antoine Béclère, Clamart France), Rebecca Hamidfar-Roy (CHU Grenoble, France), Samir Jamali (ICU, Hôpital de Dourdan, Dourdan, France), Hatem Khallel (ICU, Cayenne General Hospital), Christian Laplace (ICU, Hôpital Kremlin-Bicêtre, Bicêtre, France), Alexandre Lauttrette (ICU, CHU G Montpied, Clermont-Ferrand), Thierry Lazard (ICU, Hôpital de la Croix Saint-Simon, Paris, France), Eric Le Miere (ICU, Hôpital Louis Mourier, Colombes, France), Laurent Montesino (ICU, Hôpital Bichat, Paris, France), Bruno Mourvillier (ICU, Hôpital Bichat, France), Benoît Misset (ICU, Hôpital Saint-Joseph, Paris, France), Delphine Moreau (ICU, Hôpital Saint-Louis, Paris, France), Etienne Pigné (ICU, Hôpital Louis Mourier, Colombes, France), Benjamin Planquette (Medical surgical ICU, André Mignot Hospital, Versailles-Le Chesnay, France), Bertrand Souweine (ICU, CHU G Montpied, Clermont-Ferrand), Carole Schwebel (CHU A Michallon, Grenoble, France), Lilia Soufir (Surgical ICU, St Joseph Hospital, Paris, France), Gilles Troché (Hôpital Antoine, Béclère, Clamart France), Marie Thuong (ICU, Hôpital Delafontaine, Saint Denis, France), Guillaume Thierry (ICU, Hôpital Saint-Louis, Paris, France), Dany Toledano (CH Gonnesse, France), Gilles Troché (Medical surgical ICU, André Mignot Hospital, Versailles-Le Chesnay, France) and Eric Vantalon (SICU, Hôpital Saint-Joseph, Paris, France).
Study monitors: Caroline Tournegros, Loic Ferrand, Nadira Kaddour, Boris Berthe, Samir Bekkhouche, Kaouttar Mellouk.
Obel N, Schierbeck J, Pedersen L, Storgaard M, Pedersen C, Sorensen HT, Hansen B: Mortality after discharge from the intensive care unit during the early weekend period: a population-based cohort study in Denmark.
Anaesth Intensive Care 2004, 32(5):697-701. PubMed Abstract
Anaesth Intensive Care 2007, 35(4):477-485. PubMed Abstract
Accessed January 31, 2011
Garrouste-Orgeas M, Montuclard L, Timsit JF, Reignier J, Desmettre T, Karoubi P, Moreau D, Montesino L, Duguet A, Boussat S, et al.: Predictors of intensive care unit refusal in French intensive care units: a multiple-center study.
The pre-publication history for this paper can be accessed here: