Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Highly Accessed Research article

ICD-10 coding algorithms for defining comorbidities of acute myocardial infarction

Lawrence So12, Dewey Evans3 and Hude Quan1*

Author Affiliations

1 Department of Community Health Sciences and Centre for Health and Policy Studies, University of Calgary, Calgary, Alberta, Canada

2 Department of Economics, University of Calgary, Calgary, Alberta, Canada

3 British Columbia Cardiac Registry and Evaluation Services, Provincial Health Services Authority, Vancouver, British Columbia, Canada

For all author emails, please log on.

BMC Health Services Research 2006, 6:161  doi:10.1186/1472-6963-6-161


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/6/161


Received:6 September 2006
Accepted:15 December 2006
Published:15 December 2006

© 2006 So et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Background

With the introduction of ICD-10 throughout Canada, it is important to ensure that Acute Myocardial Infarction (AMI) comorbidities employed in risk adjustment methods remain valid and robust. Therefore, we developed ICD-10 coding algorithms for nine AMI comorbidities, examined the validity of the ICD-10 and ICD-9 coding algorithms in detection of these comorbidities, and assessed their performance in predicting mortality. The nine comorbidities that we examined were shock, diabetes with complications, congestive heart failure, cancer, cerebrovascular disease, pulmonary edema, acute renal failure, chronic renal failure, and cardiac dysrhythmias.

Methods

Coders generated a comprehensive list of ICD-10 codes corresponding to each AMI comorbidity. Physicians independently reviewed and determined the clinical relevance of each item on the list. To ensure that the newly developed ICD-10 coding algorithms were valid in recording comorbidities, medical charts were reviewed. After assessing ICD-10 algorithms' validity, both ICD-10 and ICD-9 algorithms were applied to a Canadian provincial hospital discharge database to predict in-hospital, 30-day, and 1-year mortality.

Results

Compared to chart review data as a 'criterion standard', ICD-9 and ICD-10 data had similar sensitivities (ranging from 7.1 – 100%), and specificities (above 93.6%) for each of the nine AMI comorbidities studied. The frequencies for the comorbidities were similar between ICD-9 and ICD-10 coding algorithms for 49,861 AMI patients in a Canadian province during 1994 – 2004. The C-statistics for predicting 30-day and 1 year mortality were the same for ICD-9 (0.82) and for ICD-10 data (0.81).

Conclusion

The ICD-10 coding algorithms developed in this study to define AMI comorbidities performed similarly as past ICD-9 coding algorithms in detecting conditions and risk-adjustment in our sample. However, the ICD-10 coding algorithms should be further validated in external databases.

Background

Acute myocardial infarction (AMI) outcomes are studied frequently in health service research with hospital discharge administrative data [1-8]. Risk adjustment is an important tool used in health service research to account for differences in AMI patient's characteristics. To develop such a tool for AMI patients, Tu et al. [3] initially selected 43 comorbidities that were used as potential risk factors for AMI in United States hospital report cards. The nine comorbidities were chosen from the 43 comorbidities based on their clinical plausibility and statistical significance. Along with adjustments for sex and age, these 9 comorbidities were found to substantially predict AMI mortality in Ontario provincial database, and were validated in 2 external databases from Manitoba, Canada and California, the United States. Subsequently, many studies have assessed its validity and employed the AMI prediction method [4,5,9-21]. Grunau et al. compared Tu et al's disease specific prediction rule to many other methods [20]. These authors found that Tu's method performed better than other general methods that summarized comorbidities as a score, or included comorbidities that are less relevant for AMI outcomes. Hence, Canada has accepted Tu's risk adjustment method to generate public reports of AMI outcomes [21].

With the introduction of tenth revision of the International Classification of Disease (ICD-10) coding system by the World Health Organization (WHO) [22] in 1992, this risk adjustment tool may no longer be valid. ICD-10 is significantly different from ICD-9 coding system, differing in the richness of clinical information and use of alphanumeric codes relative to numeric codes in ICD-9. Hence, previously validated [23] ICD-9 coding algorithms used for the nine comorbidities cannot be applied to the new ICD-10 data. Without valid ICD-10 coding algorithms, administrative data can not be used to measure and control for patients' comorbidities when studying their clinical outcomes. Further, future policy and quality decisions using ICD-10 data require the development and validation of ICD-10 coding algorithms for these comorbidities.

The objective of this study was to develop ICD-10 coding algorithms for the nine AMI comorbidities. The validity of these newly developed ICD-10 algorithms was determined by reviewing medical charts in recording AMI comorbidities. We then applied the ICD-10 and past ICD-9 coding algorithms to administrative data from a large Canadian province. Comparisons between the two coding algorithms were made by comparing their performance in predicting in-hospital, 30-day, and 1-year AMI mortality.

Methods

Development of ICD-10 Coding Algorithm

A three step process was employed to develop the ICD-10 coding algorithms for the nine AMI comorbidities, which include shock, diabetes with complications, congestive heart failure, cancer, cerebrovascular disease, pulmonary edema, acute renal failure, chronic renal failure, and cardiac dysrhythmias [3]. In the first step, the ICD-10 Canadian computerized code finder was used to generate a list of all relevant ICD-10 codes, matching to clinical terms of the comorbidities. Two coders trained in both ICD-9 and ICD-10 coding systems independently generated separate lists, which were then compared to form a single list of ICD-10 codes. A physician was consulted for the disagreements between the two coders on the codes.

In the second step, ICD-9-CM coding descriptions from the ICD-9-CM manual were used to generate a list of matching ICD-10 codes. Again, each coder independently generated a list of ICD-10 codes, which then were compared to form a single list. This second list was merged with the list from step one to form a comprehensive ICD-10 code list. In the third step, four physicians independently reviewed this list, and then met to determine whether each coding algorithm met the clinical meaning based on their experiences. The four physicians are specialists in neurology, general internal medicine, and psychiatry. For the disagreements about the codes on the list, an additional physician was consulted to finalize the list of coding algorithms for the nine comorbidities.

Alberta Chart Review data

A simple random sample from four teaching hospitals was used to select 4,008 patients' charts to be reviewed. These records were patients who were discharged between July and December 2003 in the province of Alberta, Canada. In this study period, hospital discharge data were coded in ICD-10. Two reviewers with coding and medical training reviewed the charts and determined the presence of the nine comorbidities. Moreover, the charts were re-coded by regular health record coding staff in ICD-9 to create a 'real world ICD-9 dataset'. Therefore, three databases were generated for the same charts, including the originally coded ICD-10 data, chart review data and re-coded ICD-9 data. Of these 4,008 records, there were 193 patients with AMI, based on their chart information. We included these 193 patients for assessment of validity of ICD-9 and ICD-10 data in recording the nine comorbidities.

ICD-9 and ICD-10 Administrative Data

We used hospital discharge abstract data from 1994 to 2004 fiscal year from the province of British Columbia, Canada. This administrative data was coded in ICD-9 between 1994 and 2000 fiscal year, and then was coded in ICD-10 between 2001 and 2004 fiscal year. To define AMI patients, we abstracted patients with the most responsible diagnosis field coded as 410.x in the ICD-9 data and I21.x and/or I22.x in ICD-10 data. In addition, we kept all patients with coronary artery disease (those with the most responsible diagnosis field coded as 414.0 in ICD-9 and I25.1 in ICD-10), AMI (the secondary diagnosis fields coded as 410.x in the ICD-9 data and I21.x and/or I22.x in ICD-10 data) and underwent coronary angioplasty or bypass graft surgery (48.1, 48.02, 48.03 of Canadian Classification of Procedure (CCP) [24] for ICD-9 data and 1IJ76 of Canadian Classification of Intervention (CCI) [25] for ICD-10), but excluded patients who underwent heart valvuloplasty surgeries (47.1 and 47.2 of CCP for ICD-9 and 1HV80, 1HU80, 1HT80, 1HS80, 1HS90, 1HT90, 1HU90, 1HV90 of CCI for ICD-10 data). Furthermore, we excluded AMI patients with the exclusion criteria: 1. not a British Columbia resident, 2. age less than 20 years, and 3. length of hospital stay less than or equal to one day. Patients who are discharged on the same day of the admission or the following day were excluded to remove emergency room deaths and to improve the accuracy of AMI diagnosis. After excluding patients meeting these criteria, patients were sorted by their earliest AMI admission. Admissions following the earliest admission or admissions in 1994 were excluded. Finally, these AMI patients were linked with British Columbia vital statistics to determine deaths after discharge.

Statistical Analysis

In order to validate the ICD-9 and ICD-10 coding algorithm, we compared ICD-9 and ICD-10 data with chart review data in defining comorbidities. Chart review data was used as a 'criterion standard'. Sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) statistics were calculated for comorbidities in ICD-9 and ICD-10 data.

After validating the ICD-9 and ICD-10 coding algorithms, we applied them to British Columbia's administrative data and produced descriptive statistics for the study population. Logistic regressions were used to predict AMI mortality with ICD-9 and ICD-10 coded comorbidities. An alternative modeling approach is to use a Cox regression to account for the risk of mortality over time. However, logistic regression was used to predict mortality in the fixed period. This approach has been commonly used in previous studies. Therefore, comparability of our study to previous studies could be increased by using the logistic regression approach. Using the above nine comorbidities and the study populations' age and sex, we predicted in-hospital, 30-day and 1-year AMI mortality. Each OR should be interpreted as controlling for all nine comorbidities, age and sex. No model building strategy was employed because this 11 variable prediction rule had been validated by Tu et al's study and referenced subsequently by studies using this prediction rule [4,5,9-21].

The regressions between ICD-9 and ICD-10 coded comorbidities were evaluated by comparing their C-statistics, Brier Scores, and R-squares. A C-statistic evaluates each model's ability to discriminate deceased from alive patients by comparing the observed to predicted values. A C-statistic equal to 0.5 indicates random prediction, while a value of one indicates perfect prediction [26]. If the C-statistics generated from ICD-9 regressions are similar to the C-statistics from ICD-10 regressions, then we could infer that ICD-10 coded comorbidities perform comparably to ICD-9 coded comorbidities. Another measure we used to assess the models' predicted probabilities was the Brier score. The Brier score measures the mean squared difference between expected probability of dying and its actual occurrence [27]. Low Brier scores indicate that there is a small difference, which shows that the model predicted well. The R-square summary statistic is used to assess how well the model fits with the data. In particular, R-square measures the proportion of the total variation in mortality explained by the logistic regression model.

Results

Agreement between Administrative Data and Chart Review Data

Table 1 shows ICD-9 and 10 coding algorithms for defining the nine comorbidities. The comparison of ICD-9 and our ICD-10 coding algorithms and medical charts is shown in Table 2. Frequencies for six AMI comorbidities were similar among ICD-9, ICD-10 and chart review data. Three comorbidities, i.e. cerebrovascular disease, pulmonary edema and cardia dysrhythmias had similar frequencies between ICD-9 and ICD-10 data, but lower frequencies compared with chart review data. Each comorbidity recorded in ICD-9 and ICD-10 datasets was very similar in sensitivity, specificity, PPV and NPV (see Table 3). However, the validity varied across comorbidities in both datasets. Sensitivities ranged from 7.1–100% and PPVs ranged from 33.3–100% in both ICD-9 and ICD-10 data, respectively. Specificity for all comorbidities was higher than 93% in both datasets. NPV was low for cardiac dysrhythmias (56.1% in ICD-9 and 55.6% in ICD-10 data) and higher than 86% for the remaining eight comorbidities. The width of the 95% confidence intervals for the nine comorbidities shows the low prevalence for most of the comorbidities in the chart review data except for cardiac dysrhythmias and congestive heart failure.

Table 1. ICD-9 and ICD-10 Codes for AMI Comorbidities

Table 2. Prevalence of comorbidity in Alberta chart review data, ICD-9, and ICD-10 data among AMI patients (N = 193)

Table 3. Agreement between ICD-9/ICD-10 and Alberta chart review data among AMI patients (N = 193)

Frequency and Mortality in Administrative Data

Given the similarity to chart review data for the majority of ICD-9 and ICD-10 coded comorbidities, we applied the coding algorithms to hospital discharge abstract dataset. There were 29,610 AMI cases in ICD-9 dataset (1995–2000 fiscal years) and 20,251 in ICD-10 dataset (2001–2004 fiscal years). The frequencies for age, gender and comorbidities were similar between the two datasets (see Table 4). Patients were predominantly male (approximately 66%) and older than 50 years old (approximately 90%). Congestive heart failure and cardiac dysrhythmias were the two most prevalent comorbidities, while pulmonary edema was the least prevalent comorbidity. The absolute difference in the frequencies between ICD-9 and ICD-10 coded comorbidities was less than 2%.

Table 4. Prevalence of comorbidities among AMI patients (%)

The in-hospital, 30-day, and 1-year mortality rates for the AMI patients were 8.5%, 9.9%, and 16.5% in ICD-9 data and 6.8%, 9.0% and 16.4% in ICD-10 data, respectively. Comorbidity specific mortality rates between the two datasets revealed a similarity (see Table 5). Shock and acute renal failure had high mortality. The absolute difference in in-hospital, 30-day and 1-year mortality rates between the two datasets differed less than 10% for 8 comorbidities and acute renal failure had an absolute difference of 16.0% for in-hospital mortality rate.

Table 5. Mortality by comorbidities among AMI patients from the BC provincial database (N = 49,861)

Predicting Mortality in Administrative Data

The ability of the ICD-10 regression to discriminate between those deceased or alive was similar to the ICD-9 regression's ability, as shown by the C-statistics in Table 6. The C-statistics only varied between 0.81 and 0.83 for predicting in-hospital, 30-day, and 1-year mortality. Moreover, the odds ratios estimated by the ICD-9 and ICD-10 regressions showed similar model performance between the two datasets. The same result was observed when comparing the Brier scores between ICD-9 and ICD-10 regressions. The lower Brier scores for ICD-10 regressions relative to ICD-9 regression indicated that it performed slightly better than the ICD-9 regressions. Both ICD-9 and ICD-10 models explained approximately 20 percent of the variation in mortality, as shown by the R-squares in Table 6. The small difference between ICD-9 and ICD-10 models' R-squares shows again the similarity between the two coding systems.

Table 6. Risk adjusted odds ratios (OR) for mortality in ICD-9 and ICD-10 data among AMI patients

All the regressions showed that patients who were 75 years or older were the most likely to die, relative to other age groups. The interpretation of the odds ratio for the gender variable differed across ICD-9 and ICD-10 regressions. For ICD-9 regressions, male patients were less likely to die than female patients, while the opposite result was found for ICD-10 regressions. Of the nine comorbidities, shock variable had the largest odds ratios in predicting in-hospital and 30-day mortality. The absolute difference in odds ratio between the two datasets was marginal for the comorbidities, differing by approximately 2%. All comorbidities were statistically significant at the 95% confidence level except for diabetes with complications in predicting 30-day mortality in ICD-10 data.

Discussion

We developed the ICD-10 coding algorithms to define nine comorbidities used to adjust risk factors in AMI outcome studies. The newly developed ICD-10 coding algorithms were comparable with previously published and widely used ICD-9 coding algorithms in detection of cases and predicting mortality. We also know that the ICD-9 and 10 data had similar validity in recording the nine comorbidities when compared to chart review data.

The similar sensitivity, specificity, PPV and NPV found for the ICD-9 and ICD-10 coding algorithms when referenced to the chart review data suggests that both are similarly accurate in recording AMI comorbidities. However, both ICD-9 and ICD-10 datasets matched poorly to the chart review data for pulmonary edema, cardiac dysrhythmias, and cerebrovascular disease. The low sensitivities for pulmonary edema and cardiac dysrhythmias were likely due to the ambiguity of their diagnoses and/or being symptoms of underlying conditions [1,28-30]. In contrast to comorbidities that are well documented, such as cancer, physicians may document non-specific conditions or symptoms poorly in charts. Therefore, it is difficult for coders to make definitive decisions on the presence of these types of conditions based on the chart information, which can result in coding errors. The low positive predictive value for cerebrovascular disease is partly due to the low prevalence. Further, Benesch et al. [31] found a third of asymptomatic patients coded in ICD-9-CM as having cerebrovascular diseases, but found no evidence of occlusion or stenosis of the precerebral arteries [31]. Kokotailo and Hill [32] found that there was a range of coding errors for cerebrovascular disease, where transient ischemic attack (TIA) was coded for acute ischemic stroke. The difficulty with coding TIA was that the symptoms were non-specific, arising from many other conditions besides a temporary disruption in blood flow to a part of the brain [33]. Nevertheless, the similarity in misclassification by ICD-9 and ICD-10 coding algorithms for these three comorbidities suggests that risk-adjustment with the AMI nine comorbidities will not be affected by the change in coding system from ICD-9 to ICD-10.

When we applied the ICD-10 coding algorithms to the hospital discharge data, we found similarities across frequencies, mortality rates, and overall model performance to ICD-9 coding algorithms. This result suggests that the ICD-10 coding algorithms for these nine comorbidities performed similarly to past ICD-9 coding algorithms. This inference was further supported by the similar results found in our study and the study conducted by Tu et al. [3] Both studies found that the two most prevalent comorbidities were congestive heart failure and cardiac dysrhythmias, and the least prevalent comorbidity was pulmonary edema [3]. This similarity between the two studies was also shown by the overall model performances. Tu et al's 0.78 and 0.79 C-statistics for their 30-day and 1-year mortality logistic regressions, respectively matched closely to the 0.81 C-statistic we found in predicting for both mortality rates for our ICD-10 data [3]. Comparing our odds ratios to Tu et al.'s findings, we both found that patients with shock and acute renal failure tended to have the highest likelihoods of dying [3].

This study had some limitations. The first limitation was low frequencies for comorbidities in the chart review data, making it difficult to draw inferences to a broader population. Secondly, having chart review data from only teaching hospitals might generate a non-random sample, as it might have fewer healthy patients than a sample that included patients from non-teaching hospitals. Evidence of this result can be seen by the higher frequencies in the comorbidities in the Alberta chart review data relative to British Columbia discharge abstract data. Thirdly, gathering chart review data from the first year ICD-10 was implemented might result in a sample with high coding error. Fourthly, possible provincial and temporal changes in the occurrence of AMI, mortality, and comorbidities were not controlled. In the 10 year period, the criteria for AMI diagnosis were revised and efficient treatment to chronic disease was produced. For example, biomarkers of cardiac troponin and creatinine kinase-MB mass were included in diagnosis of myocardial infarction to increase sensitivity and specificity [34]. The advances in disease treatment and management can partly explain the slight variation between ICD-9 and ICD-10 models that can not be accounted for in our analysis. Fifthly, we excluded patients who were discharged on the day of admission or the following day. The limitation of this exclusion is that some true AMI cases were excluded. We re-analyzed our data after including deaths within 1 day. Including the 3,049 deaths within one day produced a decrease in the C-statistics for all our models. This suggests that the C-statistics reported in our study are slightly overestimated. Nevertheless, there remains a small difference between the predictive ability of ICD-9 and ICD-10 models. Lastly, the proportion of AMI patients that could not be linked with vital death registry or had moved out of the BC province without notice to the population registry during our study period were lost to follow-up. According to Li et al. (35), the accuracy of linkage between the registry file and inpatient discharge dataset was about 98%. We also suspect that only a few AMI patients moved out of the BC province given that our longest period of observing mortality was one year. Hence, our results were less likely affected by this small proportion of AMI patients lost to follow-up.

Conclusion

The ICD-10 coding algorithms for AMI comorbidities produced in this study generated comparable results to past ICD-9 coding algorithms. This result was evident when ICD-9 and ICD-10 comorbidities were similar in frequencies and model performance. A step we took to ensure that not only did ICD-10 coding definitions matched well to past ICD-9 coding definitions, but also to a criterion standard, chart review data. The results from this step demonstrated comparable sensitivity, specificity, PPV and NPV between ICD-9 and ICD-10 coding algorithms. Evidence that the ICD-10 coding algorithms performed similar to past coding algorithms will allow future policy and quality judgements to be made on AMI outcomes with accurate ICD-10 comorbidities.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

LS contributed to the study design, statistical analysis, interpretation and writing of the manuscript. DE contributed to the study design, interpretation, and writing of the manuscript. HQ contributed to the study design, interpretation, and writing of the manuscript.

Acknowledgements

Hude Quan is supported by a Population Health Investigator Award from the Alberta Heritage Foundation for Medical Research, Alberta, and by a New Investigator Award from the Canadian Institutes of Health Research, Canada. Chart data collection was supported by an operating grant from the Canadian Institutes of Health Research. The authors thank Drs William Ghali, Tom Feasby, and Cindy Beck for their inputs to development of coding algorithms and British Columbia Ministry of Health for providing the administrative data for the analysis, particularly Jinhua Oh, John Cheung, and Dave Barr for their support in the data extraction.

References

  1. Quan H, Fong A, Cujec B, Yan J, Johnson D: Mortality in Acute Myocardial Infarction Patients Cared for by General Practice Physicians: Effect of Specialist Consultation.

    J Clin Outcomes Manage 2005, 12(6):295-305. OpenURL

  2. Quan HCB, Jin Y, Johnson D: Acute myocardial infarction in Alberta: temporal changes in outcomes, 1994 to 1999.

    Can J Cardiol 2004, 20(2):213-9. PubMed Abstract OpenURL

  3. Tu JV, Austin PC, Walld R, Roos L, Agras J, McDonald KM: Development and validation of the Ontario acute myocardial infarction mortality prediction rules.

    J Am Coll Cardiol 2001, 37(4):992-7. PubMed Abstract | Publisher Full Text OpenURL

  4. Krumholz HM, Chen J, Chen YT, Wang Y, Radford MJ: Predicting one-year mortality among elderly survivors of hospitalization for an acute myocardial infarction: results from the Cooperative Cardiovascular Project.

    J Am Coll Cardiol 2001, 38(2):453-9. PubMed Abstract | Publisher Full Text OpenURL

  5. Rasmussen JN, Rasmussen S, Gislason GH, Buch P, Abildstrom SZ, Køber L, Osler M, Diderichsen F, Torp-Pedersen C, Madsen M: Mortality after acute myocardial infarction according to income and education.

    J Epidemiol Community Health 2006, 60:351-356. Publisher Full Text OpenURL

  6. Califf RM, Pieper KS, Lee KL, Van De Werf F, Simes RJ, Armstrong PW, Topol EJ: Prediction of 1-year survival after thrombolysis for acute myocardial infarction in the global utilization of streptokinase and TPA for occluded coronary arteries trial.

    Circulation 2000, 101(19):2231-8. PubMed Abstract | Publisher Full Text OpenURL

  7. Boersma E, Pieper KS, Steyerberg EW, Wilcox RG, Chang WC, Lee KL, Akkerhuis KM, Harrington RA, Deckers JW, Armstrong PW, Lincoff AM, Califf RM, Topol EJ, Simoons ML: Predictors of outcome in patients with acute coronary syndromes without persistent ST-segment elevation. Results from an international trial of 9461 patients. The PURSUIT Investigators.

    Circulation 2000, 101(22):2557-67. PubMed Abstract | Publisher Full Text OpenURL

  8. Singh M, Reeder GS, Jacobsen SJ, Weston S, Killian J, Roger VL: Scores for post-myocardial infarction risk stratification in the community.

    Circulation 2002, 106(18):2309-14. PubMed Abstract | Publisher Full Text OpenURL

  9. Roos LL, Walld R, Uhanova J, Bond R: Physician Visits, Hospitalizations, and Socioeconomic Status: Ambulatory Care Sensitive Conditions in a Canadian Setting.

    Health Serv Res 2005, 40(4):1167-1185. PubMed Abstract | Publisher Full Text OpenURL

  10. Roos LL, Gupta S, Soodeen RA, Jebamani L: Data Quality in an Information Rich Environment: Canada as an example.

    Can J Aging 2005, 24(1):153-170. PubMed Abstract OpenURL

  11. Leslie WD, Tully SA, Yogendran MS, Ward LM, Nour KA, Metge CJ: Prognostic value of lung sestamibi uptake in myocardial perfusion imaging of patients with known or suspected coronary artery disease.

    J Am Coll Cardiol 2005, 45(10):1676-1682. PubMed Abstract | Publisher Full Text OpenURL

  12. Morrow D, Antman EM, Parsons L, de Lemos JA, Cannon CP, Giugliano RP, McCabe CH, Barron HV, Braunwald E: Application of the TIMI Risk Score for ST-Elevation MI in the National Registry of Myocardial Infarction.

    JAMA 2001, 286:1356-1359. PubMed Abstract | Publisher Full Text OpenURL

  13. Leslie WD, Yogendran MS, Ward LM, Nour KA, Metge CJ: Prognostic utility of sestamibi lung uptake does not require adjustment for stress-related variables: A retrospective cohort study.

    Biomed Central 2006, 6(2):1-7. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Jolly S, Dorian P, Alter DA: The impact of implantable cardiac defibrillators for primary prophylaxis in the community: baseline risk and clinically meaningful benefits.

    J Eval Clin Pract 2006, 12(2):190-195. PubMed Abstract | Publisher Full Text OpenURL

  15. Jollis JG: Measuring the effectiveness of medical care delivery.

    J Am Coll Cardiol 2001, 37(4):992-997. PubMed Abstract | Publisher Full Text OpenURL

  16. Rasmussen S, Zwisler AO, Abildstrom SZ, Madsen JK, Madsen M: Hospital Variation in Mortality After First Acute Myocardial Infarction in Denmark From 1995 to 2002: Lower Short-Term and 1-Year Mortality in High-Volume and Specialized Hospitals.

    Med Care 2005, 43(10):970-978. PubMed Abstract | Publisher Full Text OpenURL

  17. Reith S, Volk O, Klues HG: Use of intravascular ultrasound in evaluating coronary artery aneurysm.

    Heart 2002, 88(5):460-466. PubMed Abstract | Publisher Full Text OpenURL

  18. Alter DA, Manuel DG, Gunraj N, Anderson G, Naylor CD, Laupacis A: Age, risk-benefit trade-offs, and the projected effects of evidence-based therapies.

    Am J Med 2004, 116(8):564-565. PubMed Abstract | Publisher Full Text OpenURL

  19. Steyerberg EW, Eijkemans MJC, Boersm E, Habbema JDF: Applicability of clinical prediction models in acute myocardial infarction: A comparison of traditional and empirical Bayes adjustment methods.

    Am Heart J 2005, 150(5):920.e11-920.e17. Publisher Full Text OpenURL

  20. Grunau GL, Sheps S, Goldner EM, Ratner PA: Specific comorbidity risk adjustment was a better predictor of 5-year acute myocardial infarction mortality than general methods.

    J Clin Epidemiol 2006, 59(3):274-280. PubMed Abstract | Publisher Full Text OpenURL

  21. Canadian Institute for Health Information: Health Care in Canada. Ottawa: Statistic Canada; 2006. OpenURL

  22. World Health Organization:

    International Statistical Classification of Disease and Related Health Problems, Tenth Revision (ICD-10). 1992. OpenURL

  23. Deyo RA, Cherkin DC, Ciol MA: Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.

    J Clin Epidemiol 1992, 45(6):613-9. PubMed Abstract | Publisher Full Text OpenURL

  24. Statistics Canada: Canadian Classification of Diagnostic, Therapeutic, and Surgical Procedures – second printing. Ottawa: Statistics Canada; 1993. OpenURL

  25. Canadian Institute for Health Information: International Statistical Classification of Diseases and Related Health Problems Tenth Revision Canada/ICD-10-CA/Canadian Classification of Intervention/CCI. Ottawa: Canadian Institute for Health Information; 2003. OpenURL

  26. Park SH, Goo JM, Jo CH: Receiver operating characteristic (ROC) curve: practical review for radiologists.

    Korean J Radiol 2004, 5(1):11-8. PubMed Abstract OpenURL

  27. Harrell FE Jr: Regression modelling strategies: with application to linear models, logistic regression, and survival analysis. New York: Springer; 2001.

  28. Southern DA, Quan H, Ghali WA: Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data.

    Med Care 2004, 42(4):355-60. PubMed Abstract | Publisher Full Text OpenURL

  29. Quan H, Parsons GA, Ghali WA: Validity of procedure codes in International Classification of Diseases, 9th revision, clinical modification administrative data.

    Med Care 2004, 42(8):801-9. PubMed Abstract | Publisher Full Text OpenURL

  30. Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data.

    Med Care 2005, 43(11):1130-9. PubMed Abstract | Publisher Full Text OpenURL

  31. Benesch C, Witter DM Jr, Wilder AL, Duncan PW, Samsa GP, Matchar DB: Inaccuracy of the International Classification of Diseases (ICD-9-CM) in identifying the diagnosis of ischemic cerebrovascular disease.

    Neurology 1997, 49(3):660-4. PubMed Abstract OpenURL

  32. Kokotailo RA, Hill MD: Coding of stroke and stroke risk factors using international classification of diseases, revisions 9 and 10.

    Stroke 2005, 36(8):1776-81. PubMed Abstract | Publisher Full Text OpenURL

  33. O'Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM: Measuring diagnoses: ICD code accuracy.

    Health Serv Res 2005, 40(5 Pt 2):1620-39. PubMed Abstract | Publisher Full Text OpenURL

  34. Luepker RV, Apple FS, Christenson RH, Crow RS, Fortmann SP, Goff D, Goldberg RJ, Hand MM, Jaffe AS, Julian DG, Levy D, Manolio T, Mendis S, Mensah G, Pajak A, Prineas RJ, Reddy KS, Roger VL, Rosamond WD, Shahar E, Sharrett AR, Sorlie P, Tunstall-Pedoe H: Case Definitions for Acute Coronary Heart Disease in Epidemiology and Clinical Research Studies.

    J Am Heart Ass 2003, 108(20):2543-2549. OpenURL

  35. Li B, Quan H, Fong A, Lu M: Assessing record linkage between health care and Vital Statistics databases using deterministic methods.

    BMC Health ServRes 2006, 6:48. BioMed Central Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/6/161/prepub