Skip to main content
Download PDF

A Prognostic Model for Estimating the Time to Virologic Failure in HIV-1 Infected Patients Undergoing a New Combination Antiretroviral Therapy Regimen

BMC Medical Informatics and Decision Making volume 11, Article number: 40 (2011) Cite this article

Abstract

Background

HIV-1 genotypic susceptibility scores (GSSs) were proven to be significant prognostic factors of fixed time-point virologic outcomes after combination antiretroviral therapy (cART) switch/initiation. However, their relative-hazard for the time to virologic failure has not been thoroughly investigated, and an expert system that is able to predict how long a new cART regimen will remain effective has never been designed.

Methods

We analyzed patients of the Italian ARCA cohort starting a new cART from 1999 onwards either after virologic failure or as treatment-naïve. The time to virologic failure was the endpoint, from the 90th day after treatment start, defined as the first HIV-1 RNA > 400 copies/ml, censoring at last available HIV-1 RNA before treatment discontinuation. We assessed the relative hazard/importance of GSSs according to distinct interpretation systems (Rega, ANRS and HIVdb) and other covariates by means of Cox regression and random survival forests (RSF). Prediction models were validated via the bootstrap and c-index measure.

Results

The dataset included 2337 regimens from 2182 patients, of which 733 were previously treatment-naïve. We observed 1067 virologic failures over 2820 persons-years. Multivariable analysis revealed that low GSSs of cART were independently associated with the hazard of a virologic failure, along with several other covariates. Evaluation of predictive performance yielded a modest ability of the Cox regression to predict the virologic endpoint (c-index≈0.70), while RSF showed a better performance (c-index≈0.73, p < 0.0001 vs. Cox regression). Variable importance according to RSF was concordant with the Cox hazards.

Conclusions

GSSs of cART and several other covariates were investigated using linear and non-linear survival analysis. RSF models are a promising approach for the development of a reliable system that predicts time to virologic failure better than Cox regression. Such models might represent a significant improvement over the current methods for monitoring and optimization of cART.

Peer Review reports

Background

Modern combination antiretroviral therapy (cART) can suppress plasma viral load to undetectable levels in a large proportion of HIV-1 infected patients. The risk for a patient to experience virologic failure has been decreasing consistently during the last decade in high-income countries [1–5].

Part of this high rate of virologic success may be due to the increasing ability of more potent and tolerable antiretroviral drugs targeting a wider range of molecular targets, providing physicians the opportunity to tailor cART regimens according to patients' background and to manage treatment failure promptly. Additionally, better understanding of the mechanisms of drug resistance allows optimization of treatment regimens based on an individual's virus genotype. Although the prevalence of drug resistance seems to be decreasing in recent years [6], despite modern cART options [7], drug resistance remains a concern in chronically infected patients with a long treatment history and in treatment-naïve patients who have been infected with drug resistant isolates [8]. Overall, patients remain at risk of developing drug resistance.

Genotypic susceptibility scores (GSSs) have been developed for interpreting HIV-1 drug susceptibility based on the sequence of the virus genome coding for drug targets. GSSs usually consist of a set of general rules for scoring susceptibility to individual drugs. These systems are curated and updated by panels of experts and made freely available via the internet, and in some cases, as web-services. The most popular systems include the Stanford HIVdb [9], Agence Nationale de Recherche sur le Sida (ANRS) [10], and Rega [11] algorithms. Recently, machine learning methods have been also introduced to model HIV-1 drug resistance and to optimize cART design. These machine learning methods explore a larger set of variables besides the viral genotype (such as viral load, CD4+ T cell counts, demographic information, treatment history), and include techniques such as artificial neural networks [12], mutagenetic trees [13], Bayesian networks [14], and random forests [15]. Both GSSs and machine learning approaches have been proven to usefully predict virologic outcome at fixed time points (e.g. n-weeks) after cART initiation or switch [14–18]. The state-of-the art systems, available as free web-services, are able to select a set of suitable cARTs for a patient, given the patient's viral genotype and other background information, ensuring the maximal probability of viral load reduction after n-weeks of uninterrupted treatment [19, 20].

Systems that predict the actual time to virologic failure, indicated by a viral load rebound following a cART-induced viral load reduction, or no viral load reduction after a few months of uninterrupted therapy, have not been developed yet. However, GSSs have been already associated with the time for achieving an undetectable viral load [18]. In this work we explore the predictive ability of linear and non-linear survival models with respect to the time to virologic failure endpoint, along with its prognostic factors. A model that could predict an individual's duration of virologic success with a cART regimen would provide valuable information in tailoring cART choice.

Methods

Study design

We considered patients enrolled in the Antiretroviral Resistance Cohort Analysis (ARCA), a national observational cohort [21] of HIV-1-infected patients followed up at > 100 clinical and laboratory units in Italy. At the time of this study, data from > 20,000 patients and > 23,000 HIV-1 pol gene sequences were available. Patients are anonymized and included in the ARCA database after signature of an informed consent to provide their data for academic not-for-profit studies. The ARCA initiative is compliant with the Declaration of Helsinki, and each participating centre is subject to a local ethics committee that follows national (and European where applicable) regulations.

Eligible patients were those starting a new cART from January 1999 onwards, comprising 2 nucleotide or nucleoside reverse transcriptase inhibitors (NRTI) plus either another NRTI or a non-nucleoside reverse transcriptase inhibitor (NNRTI), or a protease inhibitor (PI), or a ritonavir-boosted protease inhibitor (PI/r). Treatments included both a new therapy after virologic failure (defined as an HIV-1 RNA > 400 copies/ml while on therapy) and a first-line therapy in drug-naïve patients. Further selection criteria were a cART duration of more than 90 days, and the availability of at least one subsequent HIV-1 RNA determination after 90 days, using ultra-sensitive assays. Patients were excluded that had cART switches due to treatment simplification or early (e.g. < 90 days) changes of one or more drugs associated with tolerability/adherence issues.

The study endpoint was the time to virologic failure, quantified as the first HIV-1 RNA > 400 copies/ml beginning from the 90th day after the cART start date and before the treatment discontinuation date. If the cART had not been discontinued yet, any HIV-1 RNA determination after the 90th day of therapy was to be considered. Data were censored at the last available HIV-1 RNA determination < = 400 copies/ml available before the treatment stop date, ignoring HIV-1 RNA determinations after the cART discontinuation.

The following variables were coupled with each patient's record of cART switch/initiation and subsequent HIV-1 RNA determinations: calendar year; baseline HIV-1 RNA, obtained within [-90, 0] days from the cART start date, without other treatment changes during that time interval; baseline CD4+ T cell count, [-90, +30] days from the cART start date; age; gender; mode of HIV-1 transmission; nationality; previous AIDS-defining events, hepatitis B/C virus co-infection (either HBsAg or HCV antibody positive serostatus); time passed from the first HIV-1 positive antibody test to the first cART initiation; duration of prior antiretroviral exposure; number of previous antiretroviral therapy switches (any drug change for any reason); previous drug class exposures (combinations of NRTI/NNRTI/PI/other classes); previous suboptimal treatment (less than three drugs in a regimen); achievement of an HIV-1 RNA < = 50 copies/ml at any time point during the cART follow up; a baseline HIV-1 pol genotype (encompassing at least positions 1-99 in the protease and positions 1-250 in the reverse transcriptase), obtained within [-90, +15] days from the cART start date, without other therapies used during that time interval except the failing regimen, when applicable.

The baseline HIV-1 genotype was successively processed by calculating the GSS using the latest available version from 3 interpretation systems (Rega 8.0.2, ANRS 2009.07, and HIVdb 6.0.9) with respect to the associated cART. We used the standard susceptible/intermediate/resistant categorization for all GSS, as by the output by the HIVdb web-service [9], which were assigned the numerical values of 1.0/0.5/0.0, respectively. The algebraic sum of GSS, calculated for drugs included in the cART coupled to each genotype, was regarded as the overall GSS of that cART regimen. Viral subtype was determined with the Rega subtyping tool [22]. Unassigned subtypes were defined as undetermined.

Statistical analysis

Cox multivariable proportional hazard regression (with robust variance estimation via a grouped jackknife) [23] and random survival forests (RSF) [24] were considered (with 30 to 100 single trees to be grown).

The Cox proportional hazard model is a general non-parametric regression technique which is not based on any assumptions concerning the underlying survival distribution. The model assumes that the underlying hazard rate (rather than survival time) is a function of the independent covariates. Let Y i denote the observed time (either censoring time or event time) for subject i, and let C i be the indicator that the time corresponds to an event (i.e. if C i = 1 the event occurred and if C i = 0 the time is a censoring time). The hazard function Λ(t|X) for the Cox proportional hazard model has the form

This expression gives the hazard at time t for an individual with covariate vector (explanatory variables) X. The term Λ0(t) is called the baseline hazard, and it is the hazard for the respective individual when all independent variable values are equal to zero. The model is called proportional hazard because, while no assumptions are made about the shape of the underlying hazard function, the model equations specify a multiplicative relationship between the underlying hazard function and the log-linear function of the covariates. There is a log-linear relationship between the independent variables and the underlying hazard function. In addition, given two observations with different values for the independent variables, the ratio of the hazard functions for those two observations does not depend on time.

RSF are an extension used to analyze censored data of the random forests machine-learning method, an ensemble of several decision trees for classification and regression. A random survival tree is a special form of decision tree for survival analysis. The tree is constructed using a training data set made of observation data points of time, status/event, and associated predictor covariates. A binary tree is grown by inferring node splits upon the set of covariates as follows. The space of observations is recursively divided into two disjoint sub-spaces, thus inferring a node split, based on an optimal cut-off value of a predictor. The log-rank statistic is used usually as a criterion for node splitting in survival trees. In detail, a proposed split at node h on a given predictor x takes always the form x ≤ c and x > c. This split induces two children nodes and two sub-sets of survival data. A good split should maximize survival differences across the two sets of data. Let t 1 < t 2 < ... < t n be the distinct death times in the parent node h, and let d i,j and Y i,j equal the number of deaths and individuals at risk at time t i in the children nodes j = 1, 2. Note that Y i,j is the number of individuals in the child node j who are alive at time t i , or who have an event (death) at time t i . The log-rank statistics for a node split at value c for a variable x is

The larger the absolute value for L (x,c) is, the better the split is. Each tree node contains the number of total and censored observations falling into the current category, as well as a Kaplan-Maier estimation of the cumulative survival for the group is calculated at the end nodes. Since the predictive performance of one survival/decision tree can be poor, different trees can be combined together to obtain improved performance. RSF are an ensemble average of different survival trees. Each tree is grown on different bootstrap samples of the original data set, and a randomization is introduced in the recursive node splitting phase by considering a random sub-set of predictors at each step. These characteristics enable to approximate complex functions with a generally low generalization error. One theoretical advantage of RSF over the Cox regression is that the latter relies on the restrictive assumption of the proportional hazards. In addition, RSF manage automatically the non-linear interactions among variables, whilst in Cox regression non-linear and higher-order interactions need to be explored explicitly.

Cox regression and RSF models were fitted on the whole study population and on the subset of therapy-naïve patients. An additional sensitivity analysis was carried out by considering only those patients with at least two follow-up HIV-1 RNA determinations, where a HIV-1 RNA viral load < = 50 copies/ml occurred at any time point during the cART follow up.

The predictive ability of the RSF and Cox regression was evaluated by means of the Harrell's c-index measure [25], comparing either linear predictions of Cox regression or mortality rates of RSF against observed time/event pairs, using the bootstrap .632 method (100 runs) for assessing the generalization error on unseen data [26]. The c-index is defined as the probability of agreement for any two randomly chosen observations, where agreement means that the observation with the shorter survival time of the two also has the larger risk score. A previous study in the different context of breast cancer research successfully used the c-index to compare RFS and Cox regression [27].

The free software environment for statistical computing and graphics "R" was employed for all statistical analyses and graph generations [28]. Besides the "base" package, the "survival", "randomSurvivalForest", and "Hmisc" libraries were used to fit Cox regression models, RSF and to calculate c-index statistics, respectively.

Results

A total of 2,337 cART regimens from 2,158 patients were considered. The proportion of patients who were previously therapy-naïve was 34% (n = 733). Table 1 summarizes patients' characteristics.

Table 1 Characteristics of the study population
Full size table

We observed 1,067 virologic failures over 2,820 person years of follow-up (rate = 37.8 per 100 person years). By Kaplan-Meier estimation, median (95% CI) time to virologic failure was 659 (533-784) days for all patients, and 2,510 (1,715-N/A) days for those previously therapy-naïve. By two years, the estimated proportion of patients not experiencing virologic failure was 0.48 (0.46-0.51) when considering the whole set of patients, and 0.71 (0.67-0.75) for those previously therapy-naïve.

Multivariable Cox analysis revealed that higher GSSs (each fitted in separate models including the other covariates), a more recent calendar year, patients administered 2NRTI+1PI/r, as compared to those undertaking 2NRTI+1NNRTI, and younger age were independently associated with a decreased hazard of virologic failure. Conversely, a higher HIV-1 RNA, a lower CD4+ count, and previous drug class exposure were associated with an increased hazard. Table 2 summarizes the results. Variable importance and partial standardized mortality plots of RSF (fitted using 100 trees) in general confirmed the Cox hazards (see Additional file 1, supplementary figures S1 and S2).

Table 2 Multivariable Cox proportional hazard model showing relative hazards (RH) for time-to-virologic-failure, fitted on the whole study population (n = 2,337)
Full size table

The evaluation of extra-sample predictive performance (via the bootstrap .632 method, on 100 runs) is shown in Figure 1. In detail, the multivariable Cox models fitted with different GSSs yielded an average (st.dev) c-index of 0.7060 (0.007) for Rega, 0.7048 (0.007) for ANRS, and 0.7068 (0.007) for HIVdb. As expected, univariable Cox models fitted with the single GSSs were greatly outperformed by their multivariable versions, yielding -respectively- an average (st.dev) c-index of 0.6277 (0.007), 0.6271 (0.007), and 0.6330 (0.007). Additionally, a likelihood-ratio-test conducted on the Cox regression, considering a null model with the sole GSS and an extended model with all covariates, reported a consistently worse fit of the null model as compared to the extended model (Lnull = -7573.536, Lextended = -7361.47, χ2 = 424.13 on 41 degrees of freedom, p < 0.0001).

Figure 1
figure 1

Extra-sample performance evaluation of Cox regression and Random Survival Forests models by means of c-index distributions (100 bootstrap runs). Boxplots indicate average and interquartile range, whilst whiskers indicate 95% confidence intervals.

Full size image

The c-index performance of RSF, grown with the limited number of 30 trees due to the high computational burden, using the same covariate settings as in the multivariable Cox regression, were 0.7298 (0.009) for Rega, 0.7276 (0.009) for ANRS, and 0.7319 (0.008) for HIVdb.

By executing all pairwise Student's t-tests (adjusted for multiple comparisons with the Benjamini-Hochberg method) comparing the c-index distributions, we find statistically significant differences between univariable vs. multivariable Cox models, univariable Cox models vs. RSF, and multivariable Cox models vs. RSF (all p < 0.0001). When comparing the performance of Rega, ANRS and HIVdb within the same model settings, we found evidence of a significantly better performance of HIVdb as compared to ANRS in the univariable Cox (p < 0.0001), multivariable Cox and (p = 0.053), and RSF (p = 0.0005). HIVdb outperformed Rega only under the univariable Cox modeling. Conversely, Rega and ANRS did not show any appreciable difference in any of the within-model c-index distributions. However, it has to be noted that all the GSS had the same average c-index values up to the third decimal.

When executing a sensitivity analysis on the subset of treatment-naïve patients (n = 733), multivariable Cox regression confirmed the relative hazards of the GSS of the regimen (RH = 0.50, 95%CI 0.36-0.70, p < 0.0001, per one point increase of HIVdb), and of HIV-1 RNA (RH = 1.51, 95%CI 1.15-1.97, p = 0.0026, per one Log10 copies/ml higher). Other factors independently associated with the endpoint were being non-Italian born (RH = 1.87, 95%CI 1.09-3.22, p = 0.023, as compared to Italian born), subtype C (RH = 2.16, 95%CI 1.05-4.44, p = 0.036, as compared to subtype B), and calendar year 2004 (RH = 2.08, 95%CI 1.31-3.31, p = 0.0019, as compared to 2007 and after). Differences among cART regimens were not relevant.

In a second sensitivity analysis, only patients who reached an HIV-1 RNA < = 50 copies/ml from the cART start date onwards were selected (n = 1,578, of which 622 treatment-naïve). By fitting a multivariable Cox regression, variables independently associated with the endpoint were consistent with those obtained for the subset of treatment-naïve patients (data not shown).

Discussion

In this study we investigated linear and non-linear survival models for predicting the time to virologic failure in HIV-1-infected patients undergoing a new cART regimen, with the aim to assess both prognostic factors of virologic failure and performance of predictions, in light of the development of a reliable expert system.

In contrast to 2NRTI+1PI/r, older age, higher HIV-1 RNA, and lower CD4+ counts, an increased hazard of virologic failure was associated with low GSSs of cART, a less recent calendar year, administration of 2NRTI+1NNRTI, and the ART-naïve status. HIV-1 RNA and GSS remained associated with the endpoint when considering only treatment-naïve patients in a sensitivity analysis.

When looking at the goodness-of-fit of the models, the inclusion of additional covariates besides the GSS in a multivariable Cox regression yielded a significant improvement in the likelihood. Furthermore, RSF proved to be a promising approach, improving performance over that obtained by using the Cox method.

This study has some limitations. First, there was a study selection bias, since only cART regimens that were undertaken for at least 90 days were considered. Early-switches and simplifications were excluded from the analysis. In addition, the main study endpoint was a pure virologic criterion and did not include stops due to other reasons. Although we selected only clinics with the ability to perform ultra-sensitive assays, the viral load threshold at > 400 copies/ml was arbitrary and might not capture all the actual virologic failures. Other thresholds for defining virologic failure, such as a viral load > 50 copies/ml or > 1,000 copies/ml might overestimate or underestimate true failure, respectively. We observed a lower hazard of virologic failure for regimens containing ritonavir-boosted PI as compared to those containing NNRTI, and this might be a reflection of both the selection bias and the endpoint definition.

In regards to the statistical methods, we did not investigate the potential benefit in terms of likelihood fit given by the inclusion of interaction terms in the Cox regression. It is possible that a Cox model with higher-order interactions is able to reach the performance obtained by using the RSF. For the practical perspective of a time to event prediction model, Cox regression presents some problems with the baseline hazard function estimation, while the RSF gives output in terms of mortality ensembles. We also tested accelerated failure time models, which are able to give reliable predictions in terms of actual time scales, and their performance was comparable to the results of the Cox regression (data not shown).

Conclusions

This study demonstrates the feasibility of an expert system that predicts the actual time course of a new cART as the estimate of time to virologic failure, and the reliability of the system's predictions can be improved both by including additional covariates besides the viral genotype and by using non-linear regression techniques. The implementation of such a system would create a more clinically-oriented treatment decision tool and more effectively tailor patient cART regimens.

References

  1. Lampe FC, Gatell JM, Staszewski S, Johnson MA, Pradier C, Gill MJ, de Lazzari E, Dauer B, Youle M, Fontas E, Krentz HB, Phillips AN: Changes over time in risk of initial virologic failure of combination antiretroviral therapy: a multicohort analysis, 1996 to 2002. Arch Intern Med. 2006, 166 (5): 521-8. 10.1001/archinte.166.5.521.

    Article  CAS  PubMed  Google Scholar 

  2. May MT, Sterne JA, Costagliola D, Sabin CA, Phillips AN, Justice AC, Dabis F, Gill J, Lundgren J, Hogg RS, de Wolf F, Fätkenheuer G, Staszewski S, d'Arminio Monforte A, Egger M, Antiretroviral Therapy (ART) Cohort Collaboration: HIV treatment response and prognosis in Europe and North America in the first decade of highly active antiretroviral therapy: a collaborative analysis. Lancet. 2006, 368 (9534): 451-8.

    Article  PubMed  Google Scholar 

  3. Lampe FC, Smith CJ, Madge S, Kinloch-de Loes S, Tyrer M, Sabin CA, Chaloner C, Youle M, Johnson MA, Phillips AN: Success of clinical care for human immunodeficiency virus infection according to demographic group among sexually infected patients in a routine clinic population, 1999 to 2004. Arch Intern Med. 2007, 167 (7): 692-700. 10.1001/archinte.167.7.692.

    Article  PubMed  Google Scholar 

  4. Prosperi MC, Cozzi-Lepri A, Antinori A, Cassola G, Torti C, Ursitti MA, Pellizzer GP, Giacometti A, d'Arminio Monforte A, De Luca A, the Icona Foundation Study Group: Favourable evolution of virologic and immunological profiles in treated and untreated patients in Italy in the period 1998-2008. HIV Med. 2010, Aug 17,

    Google Scholar 

  5. Deeks SG, Gange SJ, Kitahata MM, Saag MS, Justice AC, Hogg RS, Eron JJ, Brooks JT, Rourke SB, Gill MJ, Bosch RJ, Benson CA, Collier AC, Martin JN, Klein MB, Jacobson LP, Rodriguez B, Sterling TR, Kirk GD, Napravnik S, Rachlis AR, Calzavara LM, Horberg MA, Silverberg MJ, Gebo KA, Kushel MB, Goedert JJ, McKaig RG, Moore RD: Trends in multidrug treatment failure and subsequent mortality among antiretroviral therapy-experienced patients with HIV infection in North America. Clin Infect Dis. 2009, 49 (10): 1582-90. 10.1086/644768.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Di Giambenedetto S, Bracciale L, Colafigli M, Cattani P, Pinnetti C, Bacarelli A, Prosperi M, Fadda G, Cauda R, De Luca A: Declining prevalence of HIV-1 drug resistance in treatment-failing patients: a clinical cohort study. Antivir Ther. 2007, 12: 835-9.

    CAS  PubMed  Google Scholar 

  7. UK Collaborative Group on HIV Drug Resistance; UK CHIC Study Group: Long-term probability of detecting drug-resistant HIV in treatment-naive patients initiating combination antiretroviral therapy. Clin Infect Dis. 2010, 50 (9): 1275-85.

    Article  Google Scholar 

  8. Wensing AM, van de Vijver DA, Angarano G, Asjö B, Balotta C, Boeri E, Camacho R, Chaix ML, Costagliola D, De Luca A, Derdelinckx I, Grossman Z, Hamouda O, Hatzakis A, Hemmer R, Hoepelman A, Horban A, Korn K, Kücherer C, Leitner T, Loveday C, MacRae E, Maljkovic I, de Mendoza C, Meyer L, Nielsen C, Op de Coul EL, Ormaasen V, Paraskevis D, Perrin L, Puchhammer-Stöckl E, Ruiz L, Salminen M, Schmit JC, Schneider F, Schuurman R, Soriano V, Stanczak G, Stanojevic M, Vandamme AM, Van Laethem K, Violin M, Wilbe K, Yerly S, Zazzi M, Boucher CA, SPREAD Programme: Prevalence of drug-resistant HIV-1 variants in untreated individuals in Europe: implications for clinical management. J Infect Dis. 2005, 192: 958-66. 10.1086/432916.

    Article  PubMed  Google Scholar 

  9. Stanford HIV drug resistance data base. [http://hivdb.stanford.edu/index.html]

  10. ANRS Genotypic Interpretation System. [http://www.hivfrenchresistance.org]

  11. Rega Genotypic Interpretation System. [http://jose.med.kuleuven.be/lab/index.php?id=30]

  12. Wang D, Larder B, Revell A, Montaner J, Harrigan R, De Wolf F, Lange J, Wegner S, Ruiz L, Pérez-Elías MJ, Emery S, Gatell J, D'Arminio Monforte A, Torti C, Zazzi M, Lane C: A comparison of three computational modelling methods for the prediction of virologic response to combination HIV therapy. Artif Intell Med. 2009, 47 (1): 63-74. 10.1016/j.artmed.2009.05.002.

    Article  PubMed  Google Scholar 

  13. Altmann A, Däumer M, Beerenwinkel N, Peres Y, Schülter E, Büch J, Rhee SY, Sönnerborg A, Fessel WJ, Shafer RW, Zazzi M, Kaiser R, Lengauer T: Predicting the response to combination antiretroviral therapy: retrospective validation of geno2pheno-THEO on a large clinical database. J Infect Dis. 2009, 199 (7): 999-1006. 10.1086/597305.

    Article  CAS  PubMed  Google Scholar 

  14. Deforche K, Cozzi-Lepri A, Theys K, Clotet B, Camacho RJ, Kjaer J, Van Laethem K, Phillips A, Moreau Y, Lundgren JD, Vandamme AM, EuroSIDA Study Group: Modelled in vivo hiv fitness under drug selective pressure and estimated genetic barrier towards resistance are predictive for virologic response. Antivir Ther. 2008, 13: 399-407.

    PubMed  Google Scholar 

  15. Prosperi MC, Altmann A, Rosen-Zvi M, Aharoni E, Borgulya G, Bazso F, Sönnerborg A, Schülter E, Struck D, Ulivi G, Vandamme AM, Vercauteren J, Zazzi M, EuResist and Virolab study groups: Investigation of expert rule bases, logistic regression, and non-linear machine learning techniques for predicting response to antiretroviral treatment. Antivir Ther. 2009, 14 (3): 433-42.

    PubMed  Google Scholar 

  16. Rhee SY, Fessel WJ, Liu TF, Marlowe NM, Rowland CM, Rode RA, Vandamme AM, Van Laethem K, Brun-Vezinet F, Calvez V, Taylor J, Hurley L, Horberg M, Shafer RW: Predictive Value of HIV-1 Genotypic Resistance Test Interpretation Algorithms. Journal of Infectious Diseases. 2009, 200 (3): 453-463. 10.1086/600073.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Zazzi M, Prosperi M, Vicenti I, Di Giambenedetto S, Callegaro A, Bruzzone B, Baldanti F, Gonnelli A, Boeri E, Paolini E, Rusconi S, Giacometti A, Maggiolo F, Menzo S, De Luca A, ARCA Collaborative Group: Rules-based HIV-1 genotypic resistance interpretation systems predict 8 week and 24 week virologic antiretroviral treatment outcome and benefit from drug potency weighting. J Antimicrob Chemother. 2009, 64 (3): 616-24. 10.1093/jac/dkp252.

    Article  CAS  PubMed  Google Scholar 

  18. Frentz D, Boucher CA, Assel M, De Luca A, Fabbiani M, Incardona F, Libin P, Manca N, Müller V, O Nualláin B, Paredes R, Prosperi M, Quiros-Roldan E, Ruiz L, Sloot PM, Torti C, Vandamme AM, Van Laethem K, Zazzi M, van de Vijver DA: Comparison of HIV-1 genotypic resistance test interpretation systems in predicting virologic outcomes over time. PLoS One. 2010, 5 (7): e11505-10.1371/journal.pone.0011505.

    Article  PubMed  PubMed Central  Google Scholar 

  19. The EuResist HAART optimisation engine. [http://engine.euresist.org/]

  20. RDI HIV-TRePS. [http://www.hivrdi.org/treps/login.php]

  21. The ARCA cohort. [http://www.hivarca.net]

  22. Rega subtyping tool. [http://www.bioafrica.net/rega-genotype/html/subtypinghiv.html]

  23. Therneau T, Grambsch P: Modeling Survival Data: Extending the Cox Model. 2000, New-York: Springer-Verlag

    Book  Google Scholar 

  24. Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS: Random survival forests. Ann App Statist. 2008, 2: 841-860. 10.1214/08-AOAS169.

    Article  Google Scholar 

  25. Newson R: Confidence intervals for rank statistics: Somers' D and extensions. Stata Journal. 2006, 6: 309-334.

    Google Scholar 

  26. Efron B, Tibshirani R: Improvements on Cross-Validation: The .632+ Bootstrap Method. Journal of the American Statistical Association. 1997, 438 (92): 548-560.

    Google Scholar 

  27. Omurlu IK, Ture M, Tokatli F: The comparisons of random survival forests and Cox regression analysis with simulation and an application related to breast cancer. Expert Systems with Applications. 2009, 36 (4): 8582-8588. 10.1016/j.eswa.2008.10.023.

    Article  Google Scholar 

  28. R: language and environment for statistical computing. [http://www.R-project.org]

Pre-publication history

Download references

Acknowledgements and Funding

This work has been partly supported by EU-funded projects DynaNets (grant #233847) and CHAIN (grant #223131). We thank David Nolan from University of Florida for revising the English language.

The ARCA cohort comprises the following members: Andrea Giacometti, ANCONA - Clinica di Malattie Infettive; Luca Butini, ANCONA - Immunologia Clinica; Romana del Gobbo, ANCONA - Malattie Infettive; Stefano Menzo, ANCONA - Virologia; Danilo Tacconi, AREZZO - Malattie Infettive; Giovanni Corbelli, ASCOLI PICENO - Malattie Infettive; Stefania Zanussi, AVIANO - Centro di Riferimento Oncologico; Stefania Zanussi, AVIANO - Laboratorio Centro di Riferimento Oncologico; Laura Monno, BARI - Clinica Malattie Infettive Università; Grazia Punzi, BARI - Virologia; Franco Maggiolo, BERGAMO - Malattie Infettive; Annapaola Callegaro, BERGAMO - Microbiologia e Virologia; Leonardo Calza, BOLOGNA - Malattie Infettive S. Orsola; Maria Carla Re, BOLOGNA - UO Microbiologia, Lab. Retrovirus; Raffaele Pristerà, BOLZANO - Malattie Infettive; Paola Turconi, BRESCIA - Fleming Labs; Dr. Domenico Potenza, BRINDISI - U.O. di Malattie Infettive; Antonella Mandas, CAGLIARI - Centro S.I.D.A., Policlinico Universitario; Sauro Tini, CITTA' DI CASTELLO - Medicina Generale; Alessia Zoncada, CREMONA - Malattie Infettive; Elisabetta Paolini, CREMONA - Servizio Immunoematologia e Medcina Trasfusionale; Giorgio Amadio, FERMO - Malattie Infettive; Laura Sighinolfi, FERRARA - Malattie Infettive AOU S. Anna; Giuliano Zuccati, FIRENZE - Centro MTS; Massimo Morfini, FIRENZE - Ematologia CAREGGI; Roberto Manetti, FIRENZE - Immunoallergologia CAREGGI; Paola Corsi, FIRENZE - Malattie Infettive CAREGGI; Luisa Galli, FIRENZE - Malattie Infettive Pediatria Meyer; Massimo Di Pietro, FIRENZE - Malattie Infettive SM Annunziata; Filippo Bartalesi, FIRENZE - Malattie Infettive Università; Grazia Colao, FIRENZE - Virologia CAREGGI; Andrea Tosti, FOLIGNO - Malattie Infettive/SERT; Antonio Di Biagio, GENOVA - Clinica Malattie Infettive AOU S. Martino; Maurizio Setti, GENOVA - Clinica Medica Immunologia; Bianca Bruzzone, GENOVA - Laboratorio di Igiene Ospedale S. Martino; Antonio Di Biagio, GENOVA - Malattie Infettive Ospedale S. Martino; Giovanni Penco, GENOVA - Malattie Infettive Ospedali Galliera; Michele Trezzi, GROSSETO - Malattie Infettive; Anna Orani, LECCO - Malattie Infettive; Riccardo Pardelli, LIVORNO - Malattie Infettive; Irene Arcidiacono, LODI - Malattie Infettive; Alberto Degiuli, LODI - Virologia Lodi; Michele De Gennaro, LUCCA - Malattie Infettive; Alessandro Chiodera, MACERATA - Malattie Infettive; Alfredo Scalzini, MANTOVA - Malattie Infettive Ospedale 'C. Poma'; Loredana Palvarini, MANTOVA - Virologia; Paolo Almi, MASSA - Malattie Infettive; Giovanni Todaro, MESSINA - Malattie Infettive; Nicola Gianotti, MILANO - HSR - Studio MUSA; Paola Cicconi, MILANO - Clinica di Malattie Infettive Ospedale S. Paolo; Stefano Rusconi, MILANO - Dipart. Scienze Cliniche, Sez. Malattie Infettive - Università degli Studi; Maria Rita Gismondo, MILANO - Laboratorio Microbiologia Ospedale L. Sacco (Dipart. Scienze Cliniche, Sez. Malattie Infettive); Maria Rita Gismondo, MILANO - Laboratorio Microbiologia Ospedale L. Sacco (Prima Divisione Malattie Infettive); Valeria Micheli, MILANO - Laboratorio Microbiologia Ospedale L. Sacco (Seconda Divisione Malattie Infettive); Maria Luisa Biondi, MILANO - Laboratorio di diagnostica molecolare infettivologica AO S. Paolo; Nicola Gianotti, MILANO - Malattie Infettive San Raffaele; Amedeo Capetti, MILANO - Prima Divisione Malattie Infettive Ospedale L. Sacco; Paola Meraviglia, MILANO - Seconda Divisione Malattie Infettive Ospedale L. Sacco; Enzo Boeri, MILANO - Virologia HSR; Monica Pecorari, MODENA - Virologia; Alessandro Soria, MONZA - Malattie Infettive; Laura Vecchi, MONZA - UO Microbiologia AO S. Gerardo; Cristina Mussini, MODENA - Clinica Malattie Infettive;, NAPOLI - Malattie Infettive AOUS Federico II; Maurizio Santirocchi, NARNI - SERT; Diego Brustia, NOVARA - Malattie Infettive AO Maggiore; Paolo Ravanini, NOVARA - Virologia; Federico Dal Bello, PADOVA - Virologia; Nino Romano, PALERMO - Centro Riferimento AIDS Università; Salvatrice Mancuso, PALERMO - Servizio Riferimento Regionale Diagnosi AIDS; Carlo Calzetti, PARMA - Divisione Malattie Infettive ed Epatologia Azienda Ospedaliera; Renato Maserati, PAVIA - Ambulatorio Clinica Malattie Infettive S. Matteo; Gaetano Filice, PAVIA - Clinica Malattie Infettive e Tropicali; Fausto Baldanti, PAVIA - Virologia S. Matteo; Daniela Francisci, PERUGIA - Malattie Infettive; Giustino Parruti, PESCARA - Malattie Infettive; Ennio Polilli, PESCARA - Virologia Pescara; Daria Sacchini, PIACENZA - Malattie Infettive; Chiara Martinelli, PISA - Malattie Infettive; Rita Consolini, PISA - Pediatria I Università; Linda Vatteroni, PISA - Virologia; Angela Vivarelli, PISTOIA - Malattie Infettive; Alessandro Nerli, PRATO - Malattie Infettive; Lucia Lenzi, PRATO - Virologia; Bianca Bruzzone, POINT NOIRE - Kento-Mwana; Giacomo Magnani, REGGIO EMILIA - Malattie Infettive; Patrizia Ortolani, RIMINI - Malattie Infettive RIMINI; Massimo Andreoni, ROMA - Cattedra Malattie Infettive Tor Vergata; Guido Palamara, ROMA - IRCCS S. Gallicano; Caterina Fimiani, ROMA - Immunologia Clinica Umberto I; Lucia Palmisano, ROMA - Istituto Superiore di Sanità; Andrea De Luca, ROMA - Istituto di Clinica Malattie Infettive Cattolica; Simona Di Giambenedetto, ROMA - Laboratorio virologia Cattolica; Andrea Antinori, ROMA - Malattie Infettive INMI Spallanzani; Vincenzo Vullo, ROMA - Malattie Infettive e Tropicali La Sapienza - Umberto I; Ombretta Turriziani, ROMA - Medicina Sperimentale e Patologia - Sezione Virologia - La Sapienza; Carlo Federico Perno, ROMA - Monitoraggio Terapie Antivirali e Antineoplastiche INMI Spallanzani; Carlo Federico Perno, ROMA - Virologia DMS Tor Vergata; Marco Montano, ROMA - Virologia per Malattie Infettive Tor Vergata; Chiara Dentone, SAN REMO - Malattie Infettive; Angela Gonnelli, SIENA - Malattie Infettive; Andrea De Luca, SIENA - Malattie Infettive 2; Maurizio Zazzi, SIENA - Virologia; Michele Palumbo, TERNI - Malattie Infettive; Valeria Ghisetti, TORINO - Laboratorio di Virologia, Ospedale Amedeo di Savoia; Stefano Bonora, TORINO - Malattie Infettive Amedeo di Savoia; Palma Delle Foglie, TRENTO - Malattie Infettive; Cristina Rossi, TREVISO - Malattie Infettive; Prof. Paolo Grossi, VARESE - Clinica Malattie Infettive e Tropicali; Elena Seminari, VARESE - Virologia; Federica Poletti, VERBANIA - Malattie Infettive VERBANIA; Vincenzo Mondino, VERBANIA - Virologia; Marina Malena, VERONA - Centro di Medicina Preventiva-ULSS 20; Emanuela Lattuada, VERONA - Malattie Infettive.

Author information

Authors and Affiliations

  1. Infectious Diseases Clinic, Catholic University of the Sacred Heart, Rome, Italy

    Mattia CF Prosperi, Simona Di Giambenedetto, Iuri Fanti & Andrea De Luca

  2. Department of Pathology, Immunology and Laboratory Medicine, Emerging Pathogens Institute, College of Medicine, University of Florida, Gainesville, Florida, USA

    Mattia CF Prosperi

  3. Department of Molecular Biology, University of Siena, Siena, Italy

    Genny Meini & Maurizio Zazzi

  4. Microbiology and Virology Laboratory, San Martino Hospital, Genoa, Italy

    Bianca Bruzzone

  5. Department of Microbiology and Virology, Ospedali Riuniti di Bergamo, Bergamo, Italy

    Annapaola Callegaro

  6. Infectious Diseases Clinic, Ospedale Galliera, Genoa, Italy

    Giovanni Penco

  7. Virology Laboratory, Section of Microbiology, Department of Biomedical Sciences, Ospedale Generale di Torrette, Università Politecnica delle Marche, Ancona, Italy

    Patrizia Bagnarelli

  8. Microbiology Laboratory, L. Sacco Hospital, Milan, Italy

    Valeria Micheli

  9. Immuno-Ematology and Transfusion Medicine Service, Cremona Hospital, Cremona, Italy

    Elisabetta Paolini

  10. Infectious Diseases Clinic, San Martino Hospital, Genoa, Italy

    Antonio Di Biagio

  11. Virology Laboratory, Amedeo di Savoia Hospital, Turin, Italy

    Valeria Ghisetti

  12. Infectious Diseases Clinic, Santa Maria Annunziata Hospital, Florence, Italy

    Massimo Di Pietro

  13. Infectious Diseases Unit II, University Hospital of Siena, Siena, Italy

    Andrea De Luca

Authors
  1. Mattia CF Prosperi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simona Di Giambenedetto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Iuri Fanti
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Genny Meini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bianca Bruzzone
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Annapaola Callegaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Giovanni Penco
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Patrizia Bagnarelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Valeria Micheli
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Elisabetta Paolini
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Antonio Di Biagio
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Valeria Ghisetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Massimo Di Pietro
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Maurizio Zazzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Andrea De Luca
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

the ARCA cohort

Corresponding author

Correspondence to Mattia CF Prosperi.

Additional information

Competing interests

ADL received speakers' honoraria, served as consultant or participated in advisory boards for GlaxoSmithKline, Gilead, Bristol-Myers Squibb, Abbott Virology, Tibotec-Janssen, Siemens Diagnostics, and Monogram Biosciences.

MZ received research funding from Pfizer, served as a consultant for Abbott Molecular, Boehringer Ingelheim, Gilead Sciences, and Janssen, and served on speakers' bureaus for Abbott, Bristol-Myers Squibb, Merck, and Pfizer.

SDG received speakers' honoraria or consultancy fees from Abbott, GlaxoSmithKline, Gilead, Boehringer Ingelheim, Jansen-Tibotec, Merck-Sharp & Dohme, and Bristol Myers Squibb.

BB has received funds for speaking, consultancy and travel from ViiV Healthcare, Gilead Sciences, Abbott Molecular, Janssen-Cilag and Siemens Health Care.

Other authors: none to declare.

Authors' contributions

MCFP: statistical analyses, machine learning modeling, manuscript writing; SDG: study design; IF: data base administration, data extraction; GM, BB, AC, GP, PB, VM, EP, ADB, VG, MDP: local data base administration, local data manipulation and provision to the ARCA cohort, clinical activity, patient care; MZ: molecular biology expertise, sequencing; ADL: research group leading, manuscript revision. All authors read and approved the final manuscript.

Electronic supplementary material

12911_2011_423_MOESM1_ESM.DOC

Additional file 1:Supplementary material. Supplementary figures describing performance and variable importance measures of Random Survival Forests. (DOC 164 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Prosperi, M.C., Di Giambenedetto, S., Fanti, I. et al. A Prognostic Model for Estimating the Time to Virologic Failure in HIV-1 Infected Patients Undergoing a New Combination Antiretroviral Therapy Regimen. BMC Med Inform Decis Mak 11, 40 (2011). https://doi.org/10.1186/1472-6947-11-40

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6947-11-40

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us