Skip to main content
  • Research article
  • Open access
  • Published:

Physician's manual reporting underestimates mortality: evidence from a population-based HIV/AIDS treatment program

Abstract

Background

In clinical and cohort research, mortality estimates are often derived from manual reports generated by physicians or electronic reports from vital event registries. We examined the rate of underreporting of deaths by manual methods as compared with electronic reports from a vital event registry.

Methods

The retrospective analyses included deaths among participants registered in an observational cohort who initiated highly-active antiretroviral therapy (HAART) between August 1, 1996 and June 30, 2006. Deaths were routinely reported manually by physicians and through annual electronic record linkages with a population-based vital event registry. Multivariate logistic regression was carried out to assess independent predictors of death reporting by manual methods.

Results

Of the 3,116 individuals included in the analyses, 622 (20.0%) died during follow-up. Manual reporting by physicians only identified 377 (60.6%), while electronic linkages captured 598 (96.1%) of all deaths. Multivariate analysis indicated that deaths among individuals with lower CD4 cell count, higher HIV plasma viral load, a history of injection drug use, and under the care of an HIV-experienced physicians were more likely to be reported manually. Furthermore, non-accidental deaths were more likely to be reported manually, and manual reporting of deaths increased over time.

Conclusions

Relying only on manual reports to ascertain deaths significantly underestimates the total number of deaths in the population. This can generate important biases when evaluating the impact of therapeutic interventions in the populational setting.

Peer Review reports

Background

Accurate estimates of mortality are necessary for HIV surveillance, including assessments of antiretroviral treatment programs [1–4]. Several methods can be used to record deaths in a population, including physician reporting, vital statistics, and hospital registries [1, 2]. Sampling-based approaches, verbal autopsies, morgue and burial data provide additional proxies, particularly in settings where vital event data may not be available [5–9].

Reporting methods for HIV deaths vary in terms of their sensitivity and specificity [10–13]. Autopsy and chart reviews, for example, have better specificity than death certificates since they describe the underlying causes of death in detail [3, 4]. In clinical and cohort research, mortality estimates are often derived from manual reports generated by physicians [10] or electronic reports from vital event registries [14, 15]. Previous studies of the HIV-positive and HIV-negative population have found varying degrees of agreement between deaths reported manually by physicians and population census data [16–20].

In this analysis, data derived from a population-based cohort of HIV-infected individuals on HAART in British Columbia (BC), Canada, are used to compare the number of deaths reported manually by physicians to the number of deaths reported electronically by a vital event registry.

Methods

This study is based on HIV-positive men and women at least 18 years of age in the HAART Observational Medical Evaluation and Research (HOMER) cohort. HOMER is a prospective, observation population-based cohort of individuals enrolled in a province-wide HIV/AIDS Drug Treatment Program (DTP) in BC, Canada. The HOMER cohort includes data on individuals who entered the DTP antiretroviral-naïve to HAART between August 1, 1996 and June 30, 2006, with follow-up to June 30, 2007.

The HIV/AIDS DTP and the HOMER cohort have been approved by the University of British Columbia (UBC) Research Ethics Board at its St Paul's Hospital site. Individuals in HOMER were not required to provide written informed consent for the purposes of the analyses presented herein. These administrative analyses occur within the context of a universal health care system in which individuals receive medical care, laboratory monitoring, and HAART free of charge.

If a death occurs among an individual enrolled in the DTP, the HAART prescribing and/or primary care physician is responsible to report the death to the program (manual reporting). A record linkage between the DTP and the BC Vital Statistics death registry is also performed annually to capture all deaths among individuals enrolled in the DTP (electronic reporting). In addition to these death data, the HOMER cohort captures clinical indicators and socio-demographic information among individuals enrolled in the DTP.

Analyses included bivariate comparisons of individuals who died and did not die and multivariate logistic regression to examine factors associated with manual methods of reporting deaths among the deceased. The following covariates were considered in these analyses: physician practice setting (dichotomized into rural and urban categories according to Statistics Canada Census denominations [21, 22]); HIV experience among physicians (defined as the number of HIV-positive individuals the physician had previously treated at the time a patient was enrolled into the DTP [5]); calendar year of death, cause of death, age, sex, history of injection drug use, adherence to HAART (defined as the number of days of antiretroviral medications dispensed divided by the number of days of follow-up during first year of treatment, and expressed as a percent [23]), and baseline CD4 cell count and HIV plasma viral load. CD4 cell count was recorded using flow cytometry and fluorescent monoclonal antibody analysis (Beckman Coulter, Inc., Mississauga, Ontario, Canada), and HIV viral load was measured using the Roche Amplicor Monitor assay (Roche Diagnostics, Laval, Quebec, Canada) using either the standard method or the ultrasensitive adaptation.

All analyses are conducted using SAS version 9.1.3 (SAS, Cary, North Carolina, United States). Statistical tests are two-sided and p-values of less than 0.05 are considered statistically significant.

Ethical Statement

Ethical approval was requested and obtained for this study. The HIV/AIDS Drug Treament Program and the HOMER cohort have been approved by the University of British Columbia (UBC) Research Ethics Board at its St Paul's Hospital site.

Results

Between August 1, 1996 and June 30, 2006, 622 (20.0%) deaths occurred among the 3,116 individuals in HOMER. Manual reporting identified 377 (60.6%), while electronic linkages captured 598 (96.1%) of all deaths. Manual reporting identified 377 (60.6%), while electronic linkages captured 598 (96.1%) of all deaths. Manual reporting alone captured only 24 (3.9%) deaths, while vital statistics alone captured 245 (39.4%) of all deaths. The remaining 353 (56.8%) deaths were reported by both sources. Based on a review of the principal cause of death, the vast majority of deaths (535 [86%]) were deemed non-accidental (i.e. HIV-related (373 [60%]), circulatory system-related (35 [5.6%]), malignancy-related (21 [3.4%]), hepatitis-related (19 [3%]), respiratory-system related (15 [2.4%]), digestive system related (14 [2.2%]), according to the International Statistical Classification of Diseases and Related Health Problems coding system [24]. The remaining 87 (14.0%) deaths were deemed accidental (i.e. accidental poisoning by and exposure to noxious substances (60 [9.6%]), intentional self-harm (16 [2.6%]).

In bivariate analyses, deaths were more likely to occur among individuals who were older (median age: 41 versus 39; p < 0.001), had a history of injection drug use (37.3% versus 27.4%; p < 0.001), had a less HIV-experienced physician (median number of HIV-positive patients: 30 versus 70; p < 0.001), had an AIDS defining illness at baseline (17.7% versus 14.3%; p = 0.038), had a lower CD4 cell count at baseline (median CD4: 140 cells/mm3 versus 200 cells/mm3; p < 0.001), had a plasma HIV viral load ≥100,000 copies/mL at baseline (65.9% versus 53.0%; p < 0.001), and had lower adherence to HAART (61.7% versus 39.2% of patients who are < 95% adherent to HAART; p < 0.001).

Table 1 shows the results of the multivariate logistic regression examining factors associated with manual methods of reporting deaths among the deceased. Deaths among those with lower CD4 cell count, higher HIV plasma viral load, a history of injection drug use, and under the care of an HIV-experienced physician were more likely to be reported manually. Furthermore, non-accidental deaths were more likely to be reported manually, and manual reporting of deaths increased over time. Of the 245 patients captured by vital statistics, 16 (6.5%) were lost to follow-up (not seen over 6 months) versus 4(1.1%) of the 377 patients captured by manual reporting. Using a lost to follow-up definition of "not seen in over 12 months", vital statistics recorded 6 (2.4%) patients versus 1(0.3%) by manual reporting. The number of deaths captured by vital statistics compared to manual reporting was still significantly different after accounting for loss to follow-up (p < 0.05).

Table 1 Unadjusted and adjusted models showing independent predictors of manual reporting of deaths

Discussion

Our results demonstrate that manual methods of death reporting by physicians underestimated the total number of deaths in the population by 40%. Annual electronic linkages with the vital statistics death registry captured 96% of deaths, suggesting an improved death registry sensitivity. The remaining 4% of deaths not identified through this linkage may be attributed to missing data or discrepancies in the patient identifiers being matched. While electronic linkages identify a high proportion of the mortality cases, the disadvantage is that there must be accurate, up-to-date demographic information such as names, birthdates, and health care numbers for the matching process. Even though manual reporting only covers about 60% of all deaths in our cohort, any patient identifier discrepancies can be easily clarified with the physician office staff members.

Our findings are similar to those identified by the United States Centres for Disease Control, which found that only 54% of deaths had been manually reported to the District of Columbia between 2000 and 2005 [17]. In this study, the higher proportion of deaths captured by electronic methods as compared to manual methods suggests that electronic record linkage is essential to accurately ascertain deaths among persons with HIV [17]. The improved rate of manual reporting in our study could be a consequence of its longer duration (1996-2006) and enhanced physician training for manual reporting over time. Improvements in reporting can enhance the accuracy of HIV prevalence estimates and distribution of HIV treatment and prevention resources in regions with the highest burden [17].

Studies from the United States suggest that underreporting may be due to lack of physician knowledge about the administrative process for reporting deaths, and intentional non-reporting to protect patient confidentiality [16]. It is promising to note that manually reporting of deaths has increased over time in our cohort. Also of interest, HIV-experienced physicians were more likely to manually report deaths in our study. This suggests that educational initiatives may be able to enhance manual death reporting when vital registration systems are not available or accurate, such as in resource-limited settings. Additional physician or health working training for those caring for HIV-infected individuals may be required to effectively quantify the actual number of deaths.

Access to vital registration records could be an invaluable resource to effectively ascertain the number of deaths among patients enrolled in a population based HIV/AIDS treatment program. Cohort studies relying solely on manually reported data may be significantly underestimating actual mortality. In addition, patients recorded as lost to follow up may not be captured as a death by vital registration systems. Thus, this data limitation calls for studies to analyze separate outcomes based on the time to loss to follow up and the time to death.

Our study has some strengths and limitations. Strengths include having a large observational database and using physician reported data in conjunction with vital statistics records to obtain socio-demographic and clinical information on patients. However, the HOMER cohort provides varying amounts of detail on each patient's clinical and socio-demographic characteristics. Specifically, patient ethnicity was unknown for more than half of the 622 deaths. Therefore, we were unable to compare differences between the number of HIV deaths reported by physicians and the death registry stratified by patient ethnicity. Inclusion of this variable would have been relevant, given that studies in the United States have found disagreement between physician and vital statistic reporting of deaths by ethnic group [18–20]. We also realize that confounder variables such as socio-economic status may have influenced our results, however, this classification is not made for individuals in the HOMER cohort.

Conclusion

Our results demonstrate that physicians' manual HIV death reports underestimated mortality among individuals on HAART in BC by 40%. Cohorts relying only on physician reported deaths are potentially underreporting the total number of deaths among HIV-infected individuals. This represents a major limitation for studies using exclusively physicians' manual HIV death reports to ascertain mortality rates, as this practice can generate important biases when evaluating the impact of therapeutic interventions in the populational setting. The use of both manually reported data systematically cross-checked and supplemented with vital registration records is ideal for capturing the majority of deaths in an observational cohort of HIV-infected patients.

References

  1. Ajdacic-Gross V, Zellweger U, Wang J, Fleerackers Y, Somaini B: How complete is AIDS surveillance in Europe? An eagle eye comparison with mortality data. J Epidemiol Community Health. 2001, 55: 52-56. 10.1136/jech.55.1.52.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Barchielli A, Buiatti E, Galanti C, Giovannetti L, Acciai S, Lazzeri V: Completeness of AIDS reporting and quality of AIDS death certification in Tuscany (Italy): a linkage study between surveillance system of cases and death certificates. Eur J Epidemiol. 1995, 11: 513-517. 10.1007/BF01719302.

    Article  CAS  PubMed  Google Scholar 

  3. Sackoff JE, Hanna DB, Pfeiffer MR, Torian LV: Causes of death among persons with AIDS in the era of highly active antiretroviral therapy: New York City. Ann Intern Med. 2006, 145: 397-406.

    Article  PubMed  Google Scholar 

  4. Bernicker EH, Atmar RL, Schaffner DL, Greenberg SB: Unanticipated diagnoses found at autopsy in an urban public teaching hospital. Am J Med Sci. 1996, 311: 215-220. 10.1097/00000441-199605000-00004.

    Article  CAS  PubMed  Google Scholar 

  5. Wood E, Hogg RS, Yip B, Harrigan PR, O'Shaughnessy MV, Montaner JSG: Is there a baseline CD4 cell count that precludes a survival response to modern antiretroviral therapy?. AIDS. 2003, 17: 711-720. 10.1097/00002030-200303280-00009.

    Article  PubMed  Google Scholar 

  6. Miller CL, Kerr T, Strathdee SA, Li K, Wood E: Factors associated with premature mortality among young injection drug users in Vancouver. Harm Reduction Journal. 2007, 4: 1-10.1186/1477-7517-4-1.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Wood E, Hogg RS, Yip B, Moore D, Harrigan PR, Montaner JS: Impact of baseline viral load and adherence on survival of HIV-infected adults with baseline CD4 cell counts > or = 200 cells/microl. AIDS. 2006, 20: 1117-1123. 10.1097/01.aids.0000226951.49353.ed.

    Article  PubMed  Google Scholar 

  8. Landon BE, Wilson IB, Wenger NS, Cohn SE, Fichtenbaum CJ, Bozzette SA, Shapiro MF, Cleary PD: Specialty training and specialization among physicians who treat HIV/AIDS in the United States. J Gen Intern Med. 2002, 17: 12-22. 10.1046/j.1525-1497.2002.10401.x.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Kitahata MM, Van Rompaey SE, Shields AW: Physician experience in the care of HIV-infected persons is associated with earlier adoption of new antiretroviral therapy. J Acquir Immune Defic Syndr. 2000, 24: 106-114.

    Article  CAS  PubMed  Google Scholar 

  10. Lifson AR, INSIGHT Cause of Death Writing Group, Belloso WH, Carey C, Davey RT, Duprez D, El-Sadr WM, Gatell JM, Gey DC, Hoy JF, Krum EA, Nelson R, Nixon DE, Paton N, Pedersen C, Perez G, Price RW, Prineas RJ, Rhame FS, Sampson J, Worley J: Determination of the underlying cause of death in three multicenter international HIV clinical trials. HIV Clin Trials. 2008, 9: 177-185. 10.1310/hct0903-177.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Delgado J, Heath KV, Yip B, Marion S, Alfonso V, Montaner JS, O'Shaughnessy MV, Hogg RS: Highly active antiretroviral therapy: physician experience and enhanced adherence to prescription refill. Antivir Ther. 2003, 8: 471-478.

    PubMed  Google Scholar 

  12. Kitahata MM, Van Rompaey SE, Dillingham PW, Koepsell TD, Deyo RA, Dodge W, Wagner EH: Primary care delivery is associated with greater physician experience and improved survival among persons with AIDS. J Gen Intern Med. 2003, 18: 95-103. 10.1046/j.1525-1497.2003.11049.x.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Landon BE, Wilson IB, Cohn SE, Fichtenbaum CJ, Wong MD, Wenger NS, Bozzette SA, Shapiro MF, Cleary PD: Physician specialization and antiretroviral therapy for HIV. J Gen Intern Med. 2003, 18: 233-241. 10.1046/j.1525-1497.2003.20705.x.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wood E, Montaner JS, Tyndall MW, Schechter MT, O'Shaughnessy MV, Hogg RS: Prevalence and correlates of untreated human immunodeficiency virus type 1 infection among persons who have died in the era of modern antiretroviral therapy. J Infect Dis. 2003, 188: 1164-1170. 10.1086/378703.

    Article  PubMed  Google Scholar 

  15. Druyts EF, Rachlis BS, Lima VD, Harvard SS, Zhang W, Brandson EK, Strathdee SA, Montaner JSG, Hogg RS: Mortality is influenced by locality in a major HIV/AIDS epidemic. HIV Med. 2009, 10: 274-281. 10.1111/j.1468-1293.2008.00684.x.

    Article  CAS  PubMed  Google Scholar 

  16. Hessol NA, Buchbinder SP, Colbert D, Scheer S, Underwood R, Barnhart JL, O'Malley PM, Doll LS, Lifson AR: Impact of HIV infection on mortality and accuracy of AIDS reporting on death certificates. Am J Public Health. 1992, 82: 561-564. 10.2105/AJPH.82.4.561.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Centres for Disease Control (CDC): Electronic Record Linkage to Identify Deaths Among Persons with AIDS --- District of Columbia, 2000--2005. MMWR. 2008, 57: 631-634.

    Google Scholar 

  18. Sorlie PD, Rogot E, Johnson NJ: Validity of demographic characteristics on the death certificate. Epidemiology. 1992, 3: 181-184. 10.1097/00001648-199203000-00018.

    Article  CAS  PubMed  Google Scholar 

  19. Rosenberg HM, Maurer JD, Sorlie PD, Johnson NJ, MacDorman MF, Hoyert DL, Spitler JF, Scott C: Quality of death rates by race and Hispanic origin: A summary of current research, 1999: National Center for Health Statistics. Vital Health Stat 2. 1999, 129: 1-20.

    Google Scholar 

  20. Arias E, Schauman WS, Eschbach K, Sorlie PD, Backlund E: The validity of race and Hispanic origin reporting on death certificates in the United States. Vital Health Stat 2. 2008, 148: 1-23.

    PubMed  Google Scholar 

  21. Statistics Canada: 2006 Census Dictionary: More information on Urban area (UA). [http://www12.statcan.gc.ca/english/census06/reference/dictionary/geo049a.cfm]

  22. Statistics Canada: 2006 Census Dictionary: More information on Rural area (RA). [http://www12.statcan.gc.ca/english/census06/reference/dictionary/geo042a.cfm]

  23. Wood E, Montaner JS, Yip B, Tyndall MW, Schechter MT, O'Shaughnessy MV, Hogg RS: Adherence and plasma HIV RNA responses to highly active antiretroviral therapy among HIV-1 infected injection drug users. CMAJ. 2003, 169: 656-661.

    PubMed  PubMed Central  Google Scholar 

  24. World Health Organization: International Statistical Classification of Diseases and Related Health Problems: 10th Revision. [http://www.who.int/classifications/apps/icd/icd10online/]

Pre-publication history

Download references

Acknowledgements

The authors express their gratitude to Eric Druyts, Svetlana Draskovic, Elizabeth Ferris, Kelly Hsu, and Peter Vann for research and administrative assistance.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert S Hogg.

Additional information

Competing interests

RS Hogg has held grant funding from the National Institutes of Health, Canadian Institutes of Health Research National Health Research Development Program, and Health Canada. He has also received funding from Agouron Pharmaceuticals Inc, Boehringer Ingelheim Pharmaceuticals Inc, Bristol-Myers Squibb, GlaxoSmithKline, and Merck Frosst Laboratories for participating in continued medical education programmes. JSG Montaner has received grants from, served as an ad hoc advisor to, or spoken at various events sponsored by Abbott, Argos Therapeutics, Bioject Inc, Boehringer Ingelheim, BMS, Gilead Sciences, GlaxoSmithKline, Hoffmann-La Roche, Janssen-Ortho, Merck Frosst, Pfizer, Schering, Serono Inc, TheraTechnologies, Tibotec, Trimeris. He has also held grant funding from the Canadian Institutes of Health Research and National Institutes of Health. He has also received funding for research and continuing medical education programs from a number of pharmaceutical companies including Abbott, Boehringer Ingelheim, and GlaxoSmithKline.

Authors' contributions

CGA, AA, KC, BY, JSGM and RSH contributed to the study design, data gathering, interpretation of results and manuscript draft. KC performed the analysis. CGA edited the manuscript. All authors revised the manuscript critically for important intellectual content; and gave final approval of the version to be submitted.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Au-Yeung, C.G., Anema, A., Chan, K. et al. Physician's manual reporting underestimates mortality: evidence from a population-based HIV/AIDS treatment program. BMC Public Health 10, 642 (2010). https://doi.org/10.1186/1471-2458-10-642

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2458-10-642

Keywords