Abstract
Background
The analysis of nonfatal recurring events is frequently found in studies on chronicdegenerative diseases. The aim of this paper is to estimate the probability of readmission of patients with Chronic Obstructive Pulmonary Disease (COPD) or with Respiratory Failure (RF).
Methods
The Repeated hospital admissions of a patient are considered as a Markov Chain. The transitions between the states are estimated using the NelsonAalen estimator. The analysis was carried out using the Puglia Region hospital patient discharge database for the years 1998–2005. Patients were selected on the basis of first admission between 01/01/2001 and 31/12/2005 with ICD9CM code of COPD or RF as principal and/or secondary diagnosis. For those selected two possible transitions were considered in the case they had the second and third admission with an ICD9CM code of COPD or RF as principal diagnosis.
Results
The probability of readmission is increased in patients with a diagnosis of RF (OR = 1.618 in the first transition and 1.279 in the second) and also in those with a diagnosis of COPD or RF as the principal diagnosis at first admission (OR = 1.615 in the first transition and 1.193 in the second). The clinical gravity and the ward from which they were discharged did not significantly influence the probability of readmission.
Conclusion
The time to readmission depends on the gravity of the pathology at onset. In patients with a grave clinical picture, either COPD or Respiratory Failure, when treated and controlled after the first admission, they become minor problems and they are indicated among secondary diagnoses in any further admission.
Background
The analysis of nonfatal recurring events, for example repeated admissions, is frequently found in studies on chronicdegenerative diseases like obstructive chronic bronchitis. A repeated admission implies that the patient passes from an acute phase to another acute phase or worse. The hospital history of the patient can thus be considered as a "followup" [1] and the subject becomes the protagonist of a Markov process at the finished states, whose transitions between states correspond to the occurrence of one or more events of interest.
Multistate models that exploit the properties of Markov chains are widely used in medical research because they have a methodological framework useful to describe complex outcomes which are dependent on time [2].
The aim of this study is to evaluate the probability of readmission, that is the probability of transition between two states in patients diagnosed with obstructive chronic bronchitis (admission with principal and/or secondary diagnosis ICD9CM: "491.20 – Obstructive chronic bronchitis without acute exacerbation", "491.21 – Obstructive chronic bronchitis with acute exacerbation") and respiratory failure ("518.81 – RF").
Chronic Obstructive Pulmonary Disease (COPD) is one of the most pressing health problems internationally such that by 2020 it is forecast to be the third cause of death [3]. It is a disease which progresses slowly and is frequently diagnosed at a relatively late stage. With acute exacerbation the patient needs to be hospitalised, often for prolonged periods [4]. In Italy, with an aging population, hospitalisation for this disease is increasing, and it is now in fourth place for hospital admissions (data 2003) [5]. Because of this high number of admissions and subsequent public health costs, we wished to examine hospital readmission as one of the factors in COPD reaching such a high position for admissions and identify any possible prevention strategies.
The probability of readmission can depend on variables such as demographic characteristics and linked clinical situations and so in order to estimate the probabilities of transition of the stochastic process we used a regression model which takes account of the covariates. A Cox proportional hazards regression model was used to obtain the estimates of the covariates while for the transition probabilities a NelsonAalen estimator was used.
Methods
Statistical Analysis
The patient hospital admission history was taken to be a finite state Markov chain, that is a stochastic model with two properties:
for each instant of time t, for each pair of states i, j and for each finite series of states k_{0},..., k_{t  1 }the probability of an "event" at time t + 1 depends exclusively on the actual state of the process and not on the previous states: this conditioned probability P{X_{t + 1 }= jX_{t }= i} is called transition probability at time t of the state i at the state of j;
further the transition probability is stationary in time Pr{X_{t + 1 }= jX_{t }= i} = P{X_{1 }= jX_{0 }= i} = p_{ij}
The matrix P = [p_{ij}], is the transition matrix.
In our case we presume that the transition also depends on other factors associated with the subject, so we are interested in the estimate of the matrix P[s, t; Z_{0}], of dimension k × k, of the transition probability of the state h at the time s at the state j at time t, for a particular covariate vector Z_{0}.
The transition from one admission to the next can be of only two states (readmission/not readmission) and in the data there are variables available that we presume to be constant in time, observed at the moment of the discharge prior to the readmission. The risk function, that represents the probability of the transition at time t from one state to the next for an individual with a covariate vector Z_{i}, is usually assumed to have the form defined by Cox [6]
where λ_{0}(t) is the basic non specific risk function that depends only on t, for an individual with covariate vector Z_{i }= (Z_{i1. }Z_{i2},.., Z_{ip}) = 0; while exp (β^{T }Z_{i}) is the function chosen to express the effect of the covariate on the basic risk. λ_{0}(t) e β^{T }= (β_{1. }β_{2},..., β_{p}) are the regression coefficients associated with the covariate.
In the study of recurring events the generalisation of the Cox model proposed by Andersen e Gill [7] is often used. Their approach models the repeated admissions, for each subject, as separate observations with the risk not influenced by the number of events (admissions) that the individual undergoes and strongly presumes independence between the multiple observations of a person in time.
In the generalisation proposed by AndersenGill (1) assumes the following form:
where Y_{i}(t) is an indicator of risk of the process that can assume values 0 or 1 indicating, when it has the value 1, that the individual is under observation at time t. The time in the AndersenGill model is defined as the time that runs between one state (admission) and the next.
Once the value
Presuming that T_{1.}..T_{i},...T_{m }are discrete times observed for the m transition taken place in the time interval [s, t], a consistent estimator of P[s, t; Z_{0}] is:
where
represents the NelsonAalen estimator calculated on discrete times and corresponds the covariate vector Z_{hj0}, I is the identity matrix of dimension k × k [810].
Let ΔH_{kj }= N_{j } N_{k}, in (4) J_{h }(T_{i}) ΔN_{hj }(T_{i}) represent the number of subjects that at time i make the transition from the state h to the state j; Z_{hj0 }represents the covariate vector of a typical subject; Y_{hj }(T_{i}) and Z_{hjl }respectively indicate the subject that is at state h before the time T_{i }and his covariate vector.
Taking into account that the Cox model and its generalisations is defined at proportional risk and namely that the risk relationship in the different groups must remain proportional to the different times, that is it must not vary in time, only those explicative variables that respect the conditions of proportionality have been included in the model. These conditions have been verified with the Log Rank test and where necessary with the Wilcoxon test [11].
Once that the probability transition had been estimated a comparison was carried out between the various typologies of patients with COPD, each with a demographic and clinical covariate vector given upon entering the study.
The model applied to the data of the subjects with COPD was a three state Markov chain with two possible transitions, from the first to second admission and from the second to the third; the third admission was taken as an absorption state (the probability of a patient to remain in this state is equal to 1) (Figure 1).
Figure 1. Markov Model at three "states" for patients with Chronic Obstructive Pulmonary Disease.
Admission episodes following the third admission (representing about 15% of the total number of repeated readmissions, Table 1) have not been included in the model because of their low number and because their inclusion would have made the AndersenGill model unstable.
Table 1. Number of records for number of admissions.
Population included in the study
The analysis was carried out using the Puglia Region hospital patient discharge database for the years 1998–2005, selecting those patients with a first admission for COPD or Respiratory Failure, as principal or secondary diagnosis between the dates 01/01/2001 and 31/12/2005, such that this "followup" was of four years.
Only those subjects who in the three years previous to the beginning of the observation period did not have an admission with one of the codes for COPD or RF as principal or secondary diagnosis were selected so as to ensure the selection of those patients who had a first admission in the period under analysis. For each patient a variable was created to indicate admissions prior to the start date of the "followup" with one of the following diagnoses: Simple chronic bronchitis (491.0), Mucopurulent chronic bronchitis (491.1), Other chronic bronchitis (491.8), Unspecified chronic bronchitis (491.9), Emphysema (492.x), Asthma (493.x).
To optimise the calculation procedure and to identify a patient typology, the analysis was limited to a subgroup who at the first state of the "followup" were of age ≥ 55 (91.48% of admissions for COPD or RF) and who had a first admission for COPD or Acute Respiratory Failure (RF), as principal or secondary diagnosis between the dates 01/01/2001 and 31/12/2005. Those with a second admission within 365 days of the discharge for the first admission, with one of the codes for COPD or RF as principal diagnosis, come into the second state of the Markov chain; the same criteria were adopted between the second and third admissions to identify those who come into the third state.
The variables used within the model were age, sex, anamnesis of chronic respiratory disease previous to 2001, the presence of COPD or RF as principal diagnosis at the start date, the gravity of the disease as indicated by ICD9CM of COPD (491.20 without acute exacerbation, 491.21 with acute exacerbation) and acute respiratory failure (518.81), the Charlson index for the gravity of the condition, the presence of other comorbidities not included in the Charlson index, the type of ward and type of hospital at discharge.
The Charlson index, developed in 1987 [12] and adapted to health data banks by Deyo et al. [13], is based on ICD9CM diagnosis codes and contains 17 categories of comorbidity, each with an associated weight of from 1 to 6; the overall comorbidity score takes into account both the number of comorbidities and their gravity. In this study the category for COPD has not been considered, it being the morbidity under study.
Because the Charlson index considers the clinical severity without taking into account other pathologies which can influence the probability of readmission, four other covariates were introduced into the model from the presence of at least one of them in the discharge database. These are the ICD9CM codes that make up the four supplementary subgroups by additional diagnosis included patients who had at least one ICD9 coding for the following diseases: Upper respiratory infection (460, 462, 464, 465, 466, 487), Lower respiratory infection (480, 481, 482, 483), Septicaemia (038.x), Heart Failure (428) [14].
The type of ward and the type of hospital at discharge are important factors for the regression model as they indicate how the disease was managed and so are potentially influential on the probability of readmission.
The variables excepting those of age and the Charlson index were made dicotomic. The variable time corresponds to the number of days between an admission and the next and represents the risk interval in which the transition can happen. For those admissions on the same day as discharge to the same ward or to a different one or even to a different hospital the time interval has been taken as 1.
Results
The number of patients aged ≥ 55 selected for the "followup" were 123,162 of which 27,550 (22.37%) were readmitted within 365 days. For 33.53% (9,238/27,550) of them the second admission was with one of the three ICD9CM codes for COPD or RF as the principal diagnosis. Of these 36.38% had a third admission (3,361/9,238) and of these last there were 1,935 (57.57%) with COPD or RF as the principal diagnosis and so with the transition from the second to the third state of the Markov chain.
In Table 2 are shown the characteristics of the three groups which make up the three states: at the beginning of the "followup", after the first transition and after the second. The patients are mainly male over 70 years of age. The percentage of patients with COPD or RF as the principal diagnosis increases passing from the first to third admission. In the beginning the prevalent diagnosis is obstructive chronic bronchitis without mention of acute exacerbation while at second and third admission the prevalent diagnoses are RF and especially obstructive chronic bronchitis with acute exacerbation. The Charlson index score is quite low in all three states, and there is a low frequency of the other comorbidities considered. The first discharge is prevalently from Internal Medicine; while in the second and third there is increasingly a discharge from Pneumology. At the same time the number of local hospitals diminished with a respective increase in specialised hospitals.
Table 2. Patient characteristics at start of "Followup", after the first transition and after the second transition.
For the dicotomic variables the presumption of the proportionality of the risk necessary for the correct use of the Cox regression model was checked. From this check, using the LogRank test, there was a lack of proportionality of the relative risk functions to the variables which indicate the presence of "Upper respiratory tract infections" (p > 0,05) and of "Septicaemia" (p > 0,05), for this reason they were not used in the regression model.
For the variables sex, heart failure, anamnesis of chronic respiratory disease, COPD or RF as prime diagnosis at first admission, diagnosis "491.21", diagnosis "518.81", discharge ward Intensive Care, or Recovery and Rehabilitation, or Pneumology, or other medical and surgery, lower respiratory tract infections, and hospital type the presumption of proportionality was found to be valid (p = 0,050 for sex, p = 0.035 for heart failure and p < 0,001 for the others).
The factor of discharge from an Internal Medicine ward was inserted into the model in that an admission to this ward more frequently causes a shorter readmission time and so, in this case, for the validity of the proportionality, the value supplied by the Wilcoxon test (p = 0,0129) seemed more appropriate in that it attributes a greater weight to the differences between the functions of probability of readmission at the beginning of the process.
In Table 3 there are the values of each parameter, its significance, and the odds ratio. Age and sex are not significant on the probability of admission for both the second and third times. Neither is the ward type at discharge significant for both changes of state except for Intensive Care that shows a significant increase in the risk of admission for a second time of 168.8%. The Charlson index shows a nonpositive influence in the risk of readmission in both the first and second transition. A significant increase of readmission risk for a second admission is shown by having had an anamnesis of chronic respiratory disease before the "followup" start date (risk increase of 9.7%) and especially a diagnosis of COPD or RF as prime diagnosis at first admission (risk increase of 61.5%). For the passage from second to third state an anamnesis of chronic respiratory disease is no longer significant, while a diagnosis of COPD or RF as prime diagnosis at first admission remains significant even if the risk increase is less than in the first transition (19.3%). In the passage from first to second state the specific diagnoses of COPD "491.21" and RF "518.81" significantly increase the risk of readmission compared to those with a diagnosis "491.20", 18.7% and 61.8% respectively. In the second transition only the covariate relative to the diagnosis "Acute respiratory failure" remained significant continuing to increase the risk of readmission by 27.9%. The non significance of discharge from Intensive Care in the second transition is probably due their higher mortality and so lack of participation in the transition to the third admission. This is in part confirmed by the analysis of the discharge mode at second admission which shows that 42.67% (198/464) of the patients discharged from Intensive Care are discharged "died" while other wards show a discharge mortality of only 2.06% (181/8,774). The type of hospital where the patient is treated is significant only in the first transition, giving an increased risk of readmission of 13.2% for those discharged from nonuniversityresearch hospitals.
Table 3. AndersenGil Model estimated for patients with COPD.
Figure 2 shows the probability over time of transition from first to second admission and Figure 3 shows it for transition from second to third admission for patients with the same demographic characteristics (male aged 74), the same severity (Charlson index score 0.5) but with four different typologies at the start of the "followup" each composed of a combination of two of four different factors. The first factor (A) is entry to the study with a secondary diagnosis of ICD9CM 491.20 without specific comorbidities (lower respiratory tract infection or heart failure), without having had admissions for diseases correlated to COPD or RF prior to the period under observation.
Figure 2. Transition Probability between the first and second recovery for four subjects entered in the followup (Id 1 and Id 3 are in less serious condition, Id 2 and Id 4 are in more serious condition).
Figure 3. Transition Probability between the second and third recovery for four subjects entered in the followup (Id 1 and Id 3 are in less serious condition, Id 2 and Id 4 are in more serious condition).
The second factor (B) is entry to the study with a prime diagnosis of acute respiratory failure and a secondary diagnosis of lower respiratory tract infection and an anamnesis of chronic respiratory disease.
The third factor (C) is a discharge from the Pneumology ward of an local hospital.
The fourth factor (D) is a discharge from the Intensive Care ward of any nonlocal hospital.
The first subject Id 1 has factors A and C. The second subject Id 2 has factors B and C. The third subject Id 3 has factors A and D. The fourth subject Id 4 has factors B and D.
The probability of transition from the first to the second state is constantly higher in subjects Id 3 and Id 4 compared to Id 1 and Id 2 with a risk ratio over 1.5 (Table 4A) The trend for all is almost linear. In both typologies C and D the probability of readmission of the more serious subjects of factor B, Id 2 and Id 4, compared to those of factor A, Id 1 and Id 3, was higher in the first six months dropping low or even to null (RR = 1) in the six months following. (After 30 days from discharge Id 2/Id 1 RR = 1.7 and Id 4/Id 3 RR = 1.48.)
Table 4. Transition Probability and Relative Risk at 30, 90, 180 and 270 days from previous admission.
The transition from the second to the third state shows higher values than in the first transition as can be seen from the relative risks for both Id 2/Id 1 and Id 4/Id 3, constantly higher in the first 180 days. As in the first transition the second transition showed a higher risk for those treated in Pneumology (Id 2/Id 1) rather than in Intensive Care (Id 4/Id 3). Comparing Id 3 with Id 1 and Id 4 with Id 2 shows the relationship between the types of patient treatment. Each of these over time assumed values lower than 1.00, showing that the ward/hospital type has no influence on the probability of a third admission.
Discussion
The aim of this study was to evaluate the recurrence of hospitalisation for COPD using the information available in the Puglia patient discharge database so as to determine which characteristics can give an increase in risk of readmission to hospital over time.
Time in hospital prior to entry in the "followup", with a diagnosis correlated to COPD or RF are influential only on the probability of a second admission.
A principal diagnosis of COPD or RF ("491.20", "491.21" or "518.81") at entry into the "followup", is a strong predictive factor for the probability of readmission, increasing it. A specific principal or secondary diagnosis of COPD or RF has a discriminating effect on the probability of transition to a second admission, remarkably increasing it in patients with Acute Respiratory Failure and in a lesser way in those with Obstructive chronic bronchitis with acute exacerbation.
In the passage from second to third admission, the probability is influenced mainly by the time variable which ameliorates the significance of the covariate compared to the first transition. The significant factors for the probability of a third admission give a lower increase in risk than for the first transition. A discharge from an Intensive Care ward produces contradictory effects, in time, on the probability of a third admission; this could be due to a greater mortality associated with this ward, given the greater severity of patients admitted to this ward; for this it would be useful carry out a record linkage between the Death Register and the Discharge forms, unfortunately the different records are not yet date aligned. In general however the discharge ward does not have significance in the probability of readmission. This is probably due to the ward not being a real variable for the subject under analysis but a variable of the hospital organisation; thus it would be good idea to utilise a multivariate hierarchical model to estimate the coefficients where the type of hospital could be inserted. There could be dependence on the observations inside the second level unit [15] which could be the hospital or the type of ward.
The admission history here analysed (COPD or RF as principal or secondary diagnosis at the second and third admission), characterised by a high incidence of nonacute COPD shown in prime diagnosis at the start of the "followup", allows us to hypothesise on the non significance or slight relevance of the Charlson index on the probability or readmission. In fact, in the case where a patient has a more severe clinical picture, as shown by the presence of at least one of the categories of the Charlson index, a successive readmission can be more probable for one of the categories in the index rather than for COPD or RF. In fact COPD or RF, treated and checked thanks to the first admission, become minor problems and in any further admission they are indicated among the secondary diagnoses and are not considered as possible events for successive transitions.
Furthermore, previous studies on mortality after hospitalisation for COPD have shown a higher rate of mortality among patients with more comorbidities [16]; such patients do not contribute to the transition as foreseen by the stochastic model and so the effect of the Charlson index does not show in the determination of the odds ratio.
Variables entered in the model observed the assumption of proportional risk for the Cox model. This allows us to consider transition probability as timestationary. Only two variables, septicaemia and acute upper respiratory infection, didn't respect the timestationary assumption and they have been removed from the model under study because of their low frequency in our sample, although they could be very important risk factors for hospital readmission. In different settings violation of timestationary transition probability could occur and a different model must be adopted.
The choice to limit analysis to only three states, with the third admission as the absorbing state, gave satisfactory results in our study. Death was preferentially used as the absorbing state when data were available.
The characteristics of patients to be included in this study derived from the need to use administrative databases, as the only information available, to conduct epidemiological evaluation. If the aim was to evaluate the probability of admissionreadmission cycle the administrative database could be considered reliable, because the states of the process correspond to the admission event.
In the case of an evaluation leaning towards a more epidemiological aspect of the pathology, even if hospital admission are good data, these data must be considered a proxy of the real process represented by the exacerbation of the pathology.
Conclusion
The application of the assumptions of the Markov chain to the hospital history of the patients affected by Chronic Bronchitis, permits a clear analysis of the probability that patients with certain determined characteristics will have a new admission to hospital. More, the use of the health region database in multistate models permits the evaluation of the probabilities of readmission in different scenarios, especially because, as Borg et al. conclude [17], large longterm clinical studies would not be feasible. The method, using the NelsonAalen estimator for the probabilities of transition, interprets the data showing it can integrate the effect of time and the other covariates. To estimate the coefficients in the Cox model, a multilevel model should be performed, a model which takes into account that the patients transit inside a hierarchical health system.
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
NB defined the theoretical setting, build up software for data analysis, conducted analysis and interpretation of data, drafted the manuscript. PT conceived the study, defined the study case and choose ICD code, proposed risk adjustment methods, contributed to interpretation of data, drafted the manuscript. AM revised the clinical setting, defined the study case, revised the manuscript. GS defined the theoretical setting, contributed to interpretation of data, contributed to draft the manuscript.
References

Tavares Paes A, Pedroso de Lima AC: A SAS macro for estimating transition probabilities in semiparametric models for recurrent events.
Computer Methods and Programs in Biomedicine 2004, 75:5965. Publisher Full Text

Scheike TH, Zhang M: Direct Modelling of Regression Effects for Transition Probabilities in Multistate Models.
Scandinavian Journal of Statistics 2007, 34:1732. Publisher Full Text

Kinnunen T, Säynäjäkangas O, Keistinenc T: The COPDinduced hospitalization burden from first admission to death.
Respir Med 2007, 101:294299. PubMed Abstract  Publisher Full Text

Wouters EF: Economic analysis of the confronting COPD survey: an over of results.
Respir Med 2003, 97:S3S14. PubMed Abstract  Publisher Full Text

Prima Conferenza Nazionale BPCO [http://www.goldcopd.it/materiale/wcd06/cs2006.pdf] webcite

Cox DR: Regression models and life tables (with discussion).
Journal of the Royal Statistics Society, B 1972, 34:187220.

Andersen PK, Gill RD: Cox's regression model for counting processes: a large sample study.
Ann Statist 1982, 10:11001120. Publisher Full Text

Aalen OO: Nonparametric inference for a family of counting processes.
The Annals of Statistics 1978, 6:701726. Publisher Full Text

Aalen OO: Nonparametric estimation of partial transition probabilities in multiple decrement models.
The Annals of Statistics 1978, 6:534545. Publisher Full Text

Aalen OO, Johansen S: An empirical transition matrix for nonhomogeneous Markov chains based on censored observations.

Fu P, Laughlin MJ, Zhang H: Comparison of survival times in a transplant study of hematologic disorders.
Contemp Clin Trials 2006, 27(2):17482. PubMed Abstract  Publisher Full Text

Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.
J Chron Dis 1987, 40:373383. PubMed Abstract  Publisher Full Text

Deyo RA, Cherkin DC, Ciol MA: Adapting a clinical comorbidity index for use with ICD9CM administrative databases.
J Clin Epidemiol 1992, 45:613619. PubMed Abstract  Publisher Full Text

Grasso ME, Weller WE, Shaffer TJ, Diette GB, Anderson GF: Capitation, Managed Care, and COPD.
Am J Respir Crit Care Med 1998, 158(1):133138. PubMed Abstract  Publisher Full Text

Kandel DB, Kiros GE, Schaffran C, Hu MC: Racial/ethnic differences in cigarette smoking initiation and progression to daily smoking: a multilevel analysis.
Am J Public Health 2004, 94(1):12835. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Almagro P, Calbo E, Ochoa de Echagüen A, Barreiro B, Quintana S, Heredia JL, Garau J: Mortality After Hospitalization for COPD.
Chest 2002, 121:14411448. PubMed Abstract  Publisher Full Text

Borg S, Ericsson A, Wedzicha J, Gulsvik A, Lundbäck B, Donaldson GC, Sullivan SD: A Computer Simulation Model of the Natural History and Economic Impact of Chronic Obstructive Pulmonary Disease.
Value in Health 2004, 7(2):153167. PubMed Abstract  Publisher Full Text
Prepublication history
The prepublication history for this paper can be accessed here: