Email updates

Keep up to date with the latest news and content from BMC Health Services Research and BioMed Central.

Open Access Research article

Following the money: copy-paste of lifestyle counseling documentation and provider billing

Mary Zhang1, Maria Shubina1, Fritha Morrison1 and Alexander Turchin123*

Author Affiliations

1 Division of Endocrinology, Brigham and Women’s Hospital, 221 Longwood Avenue, Boston, MA 02115, USA

2 Harvard Medical School, Boston, MA, USA

3 Quality Performance Management, Partners HealthCare System, Boston, MA, USA

For all author emails, please log on.

BMC Health Services Research 2013, 13:377  doi:10.1186/1472-6963-13-377


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1472-6963/13/377


Received:2 March 2013
Accepted:27 September 2013
Published:2 October 2013

© 2013 Zhang et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Evidence suggests that copy-pasted components of electronic notes may not reliably reflect the care delivered. Federal agencies have raised concerns that such components may be used to justify inappropriately inflated claims for reimbursement. It is not known whether copied information is used to justify higher evaluation and management (E&M) charges.

Methods

This retrospective cohort study aimed to assess the relationship between the level of evaluation and management (E&M) charges and the method of documentation (none, distinct or copied) of lifestyle counseling (diet, exercise and weight loss) for patients with diabetes mellitus. To determine the association, an ordered multinomial logistic regression model that corrected for clustering within individual providers and patients and adjusted for patient and encounter characteristics was utilized. E&M charge level served as the primary outcome variable. Patients were included if they were followed by primary care physicians affiliated with two academic hospitals for a minimum of two years between 01/01/2000 and 12/13/2009.

Results

Lifestyle counseling was documented in 65.4% of 155,168 primary care encounters of 16,164 patients. Copied counseling was identified in 12,527 encounters. In multivariable analysis higher E&M charges were associated with older patient age, longer notes, treatment with insulin, medication changes and acute complaints. However, copied lifestyle counseling was associated with a decrease of 70.5% in the odds of higher E&M charge levels when time spent on counseling (required to justify higher charges based on counseling) was recorded (p<0.0001). This finding is opposite to what would have been expected if the impetus for copied documentation of lifestyle counseling was an increase in submitted E&M charges.

Conclusion

There is no evidence that copied documentation of lifestyle counseling is used to justify higher evaluation and management charges. Higher charges were generally associated with indicators of complexity of care.

Keywords:
Electronic medical records; Copy-paste; Cloned documentation; Healthcare costs; Physician billing; Lifestyle counseling

Background

Electronic medical records (EMRs) can benefit patient care in a number of ways, including enabling timely access to patient information, supporting informed clinical decision-making, improving provider-provider and provider-patient communication and reducing health care costs [1-4]. Utilization of EMRs in the U.S. is increasing and is expected to continue to grow due to strong encouragement by recent federal legislation [5-7].

However, as any tool, EMRs are not always used optimally. In particular concerns have been raised about the inappropriate use of copy and paste to duplicate information across provider notes [8-12]. Studies have estimated that up to 50% of the content in progress notes may be copied from previous documents and found that copying commonly results in documentation errors [13-17]. On the other hand, most providers find the copy-paste feature useful, particularly to increase efficiency of electronic documentation in a time-constrained environment [15]. Errors resulting from copy-paste are therefore thought to primarily be due to negligence.

At the same time, copy-paste could conceivably be used for other purposes as well. For example, in the traditional fee-for-service payment system used by most U.S. physicians, higher charges for a provider-patient encounter can be justified if the provider documents in their note that they spent a certain amount of time with the patient and more than half of that time was spent on counseling the patient. Copy-pasted documentation of counseling could therefore potentially be used to support increased charges to the health insurance (so-called “upcoding”). In fact, in a recent letter to U.S. hospital leadership, the Federal Government expressed strong concern over “troubling indications that some providers are using this technology to game the system” and condemned “cloning of medical records in order to inflate what providers get paid” [11,12]. Under these circumstances, copy-pasted documents not only affect the integrity of the medical record, but may represent health care fraud.

Lifestyle counseling is a critical component of treatment of diabetes [18-22]. It is therefore important to know whether electronic documentation of lifestyle counseling in the records of patients with diabetes is valid. We have previously demonstrated (on a smaller dataset from the same electronic medical record) that copied documentation of lifestyle (diet, exercise and weight loss) counseling, unlike original records, was not associated with improvements in glycemic control in patients with diabetes, and therefore may not always be an accurate representation of the provider-patient encounter [23]. We now conducted a retrospective study of over 16,000 patients with diabetes to determine whether copied lifestyle counseling is being used to justify higher evaluation and management (E&M) charges.

Methods

Design

We conducted a retrospective cohort study to investigate whether documentation of lifestyle (diet, exercise and weight loss) counseling that was copied between EMR notes is associated with a higher E&M charge level compared to encounters with no documented counseling.

Study cohort

Adult patients with diabetes mellitus followed by primary care physicians affiliated with Brigham and Women’s Hospital (BWH) and Massachusetts General Hospital (MGH) for a minimum of two years between 01/01/2000 and 12/31/2009 and had at least one glycated hemoglobin (A1c) ≥ 7.0% were studied. Patients treated by an endocrinologist (identified based on having had more than one encounter with an endocrinologist during the study period) were excluded in order to ensure a single source of diabetes care for the study. The institutional review board at Partners HealthCare System approved the study and the requirement for informed consent was waived.

Study environment

The study was conducted in practices that utilized Longitudinal Medical Record (LMR) - an ONC-ATCB-certified internally developed EMR. LMR note module has a “Copy” button, which copies the entire note to a new note on the same patient with the current date. LMR also allows users to create patient-independent note templates and custom paragraphs. LMR does not include any decision support for lifestyle counseling. Specifically, LMR does not have any built in check boxes or drop down menu items that could be used to justify higher E&M charge levels based on counseling provided to the patient. All physicians in the practices included in the study are audited annually to ensure compliance with billing regulations. In most practices included in the study, physicians submit the E&M charge level at the time of the patient encounter. Some physicians in the study practices were compensated based on the E&M charges they had submitted and others received a salary. Most physicians who received a salary had an incentive bonus that was based on the E&M charges they submitted. Physician remuneration was not dependent on the their patients’ insurance / insurance payments.

Study measurements

An individual encounter with a provider in a primary care practice in the setting of an elevated (≥ 7.0%) A1c served as the unit of analysis for the evaluation of the relationship between copied counseling and the E&M charge level. Notes that were dictated (and therefore could not contain any copied documentation) and notes not likely to represent a face-to-face encounter with a physician (e.g. notes with subjects like “medication refill”, “influenza vaccine”) were excluded from consideration (Additional file 1: Table S1).

Additional file 1: Table S1. Notes excluded from the analysis. Table S2. Effects of encounter and patient characteristics on E&M charge level without length of encounter note as an explanatory variable. A1C= Glycated hemoglobin. LDL=Low-density lipoprotein. SBP= Systolic blood pressure. DBP= Diastolic blood pressure. BP= Blood pressure. CCI= Charlson comorbidity index. BMI=Body mass index.

Format: DOCX Size: 20KB Download fileOpen Data

Documentation of lifestyle counseling was computationally abstracted from the notes, including direct, (e.g. “encouraged daily walking”) and inferred (e.g. “weight has increased since last visit”) instances of lifestyle counseling, as previously described [23]. Lifestyle counseling was inferred if the subject was discussed in a way that made it likely that it was addressed with the patient (e.g. not simply weight recorded in the physical exam section). The natural language processing software used for abstraction of lifestyle counseling was previously validated and had a sensitivity and specificity that ranged between 91–97 and 88-94%, respectively [23].

Lifestyle counseling documented using a sentence that was identical to the sentence used to document the same type of lifestyle counseling in the patient’s previous note by the same provider was considered copied. Notes that had the first record of lifestyle counseling for the patient or lifestyle counseling documentation recorded using a sentence that was different from the previous notes, were considered to have distinct counseling documentation. Notes with no counseling were excluded from determination of the “copied” status.

Notes documenting time spent on direct patient care were identified by computational detection of sentences that included the keywords “spent” and “minutes”. If the sentence also included the word “counseling”, the note was classified as documenting time spent on counseling; if the sentence also included the word “coordination”, the note was classified as documenting time spent on coordination of care.

Most recent A1c and low-density lipoprotein (LDL) measurements within 6 months, and blood pressure (BP) recorded during the encounter were used in the analysis. Most recent body mass index (BMI) measurement for the patient was used in the analysis. Medication intensification was defined as initiation of a new or an increase in the dose of an existing anti-hyperglycemic medication [24]. Anti-hyperglycemic medication intensification was identified from a combination of EMR medication records and computational analysis of narrative provider notes as previously described [25]. The number of medications processed during an encounter was determined as the number of medications that were prescribed, discontinued, or updated during the encounter. Encounters with acute complaints (most commonly acute pain or infection) were identified based on the ICD9 codes associated with the encounter as previously described [24]. Charlson comorbidity index (CCI) was computed using administrative billing codes [26]. Demographic information, weight, height, BP measurements, and medication and laboratory data were obtained from the EMR at Partners HealthCare.

Study outcome

E&M charge level served as the primary outcome in the analysis. In the United States, all fee-for-service insurance payments for office visits are based on the E&M codes (insurance payments for outpatient visits to all practices in the analysis were based on the fee-for-service model). E&M codes range from level 1 (associated with the lowest payment) to 5 (highest payment). The payments for different E&M code levels vary between different insurance companies and between different localities and providers. The difference between the payments for the highest vs. lowest E&M code levels can be as high as 10-fold.

Statistical analysis

To determine the association between the presence of copied counseling documentation and the E&M charge level, we constructed an ordered cumulative mixed logistic regression model using GLIMMIX procedure to correct for clustering within individual providers and patients. This model adjusted for the patient’s demographics (age, sex, race, primary language, health insurance, and median income by zip code), most recent BMI, A1c, LDL and BP, acute complaints, treatment with insulin, documentation of anti-hyperglycemic medication intensification, number of medications processed during the encounter and the total number of active medications, length of the note, documentation of time spent on counseling and an interaction term between type of counseling documentation and documentation of time spent on counseling. Average measurements for the patient during the study period were imputed when recent A1c, LDL or BP measurements were not available and an indicator of imputation was also included in the model.

Marginal Cox proportional-hazards model for clustered data [27] was utilized to estimate the association between time to A1c target and the mean monthly number of encounters with copied, distinct or no lifestyle counseling documentation while accounting for clustering within patient-provider pairs. The model was adjusted for the patient’s demographics as well as , inpatient admission during the uncontrolled period, treatment with insulin, PCP encounter frequency, anti-hyperglycemic intensification rate, A1C measurement rate, initial A1C measurement and BMI. When BMI information was not available, mean BMI for the study patients was imputed and an indicator of imputation was included in the model. All analyses were performed with SAS statistical software, version 9.3 (SAS Institute, Inc., Cary, NC).

Results

We identified 24,097 hyperglycemic adults with diabetes mellitus who were regularly seen by BWH or MGH PCPs. We excluded 7933 patients who were treated by endocrinologists, had no medication records available, only had transient elevations in A1C or suspected A1C measurement errors, or had missing demographic information. The remaining 16,164 patients were included in the study.

The median age of study patients was 59.8 years (Table 1). On average, the patients were followed for 6.2 years during the study period. Study patients did not have their A1C under control >55% of that time, and 53.2% of patients never achieved glycemic control during the study period. On average, patients had 1 to 2 hyperglycemic periods during the study, with a mean initial A1C of 8.3%.

Table 1. Patient characteristics

Lifestyle counseling was documented on average at 65.4% of primary care encounters during hyperglycemic periods. Most (87.7%) documentations of lifestyle counseling were distinct compared to previous notes by the same provider. Copied counseling records were found much more commonly (76.1:1, p<0.0001) in the notes for the same patient compared to other patients of the same provider, consistent with copy-paste rather than use of templates as the mechanism of their generation.

Copied counseling documentation and E&M charge level

Over half of patient encounters studied (51.1%) were billed at level 4 E&M charges (Table 2). Encounters with copied documentation of counseling had the highest fraction of level 4 E&M codes at 71.9% (Table 3). Encounters with distinct documentation of counseling had the highest fraction of level 5 codes at 9.6%. In multivariable analysis adjusted for patient and encounter characteristics (Table 4), when time spent on counseling was documented (as required in order to justify the E&M code based on counseling), the cumulative odds of a higher E&M charge level were 70.5% lower for encounters with copied counseling documentation than for encounters with distinct counseling documentation, and 46.1% lower than for encounters with no counseling documentation (p < 0.0001). A sensitivity analysis that did not include note length in the model showed similar results (Additional file 1: Table S2).

Table 2. Patient-provider encounter characteristics

Table 3. E&M charge level by counseling type

Table 4. Effects of encounter and patient characteristics on E&M charge level

Discussion

As EMRs are being deployed more widely, concerns have been raised that they can also be used to obtain revenue gains through a variety of mechanisms including increased billing coding levels. In particular, a recent report cited several hospitals that increased the share of highest-paying insurance claims by 40 to 80% soon after they introduced electronic health records [11]. A particular concern has been expressed over the use of “cloned” documentation that is copy-pasted from the older records of the same patient or from records of other patients, but may not accurately reflect the care actually delivered.

Copy-pasted documentation could be used to justify higher billing charges in several ways. It may be used to describe review of systems and / or physical examination to fulfill the requirements for higher E&M codes based on the number of organ systems examined. Alternatively, it may be used to “clone” descriptions of counseling provided to the patient to enable E&M charges based on the time spent with the patient. Therefore, in the light of a recent finding that copied documentation of lifestyle counseling may not always accurately represent the care delivered [23], we sought to determine whether it could have been used to generate higher revenue.

In this large retrospective study we did not find evidence that copied documentation of lifestyle counseling was utilized to raise the level of E&M charges. Reimbursement for lifestyle counseling requires documentation of time spent on counseling. When documentation of time spent on counseling was present in EMR notes containing documentation of lifestyle counseling, distinct counseling was associated with a significant increase in the E&M charge level, as expected. On the other hand, when time spent on counseling was recorded in notes with copied lifestyle counseling, a marked decrease in E&M charge level was observed. The most likely explanation for this finding is that both documentation of lifestyle counseling and time spent on counseling were copied from a previous note, but the E&M charge level reflected the care actually delivered.

In the absence of documentation of time spent counseling, copied counseling documentation was associated with slightly higher charges. This finding may reflect the influence that other patient and treatment characteristics can have on documentation behavior and E&M charges. Copying could be more common for complex patients whose historical information has to be repeatedly documented in every note. At the same time, complex patients would also be more likely to incur higher E&M charges. Our other findings are consistent with this explanation: higher E&M charges were associated with many measures of increased patient complexity including greater patient age, primary language other than English, treatment with insulin, presence of acute complaints, anti-hyperglycemic medication intensification, number of medications processed, and longer note length. These findings offer strong evidence that, on average, E&M charge levels reflect the complexity of the care delivered.

Nevertheless, even if the copy-paste feature is not systematically used to justify higher E&M charges, this does not exclude the possibility that individual providers may use it for that purpose. A recent report found, for example, that not only have Medicare payments for E&M services increased by 48% between 2001 and 2010, but the consistent billing of higher level E&M codes by physicians representing less than 1% of 442,000 physicians nationwide cost Medicare as much as $108 million annually [28]. Therefore measures to ensure compliance with E&M coding regulations could include interventions aiming to minimize the inappropriate copy-paste of electronic documentation. These could include educational interventions for physicians. In a survey of physicians at medical centers using computerized documentation systems, over 90% of participants expressed the need for training and education on the responsible use of the copy-paste feature [15]. Another approach that has anecdotally been successful at several institutions is to present copied fragments of the notes in a different color from the rest of the text. By making the “cloned” text immediately and permanently apparent, this approach may both decrease inappropriate utilization of copy-paste and facilitate monitoring and auditing.

Our study had several limitations. Primary data were obtained from an internally developed EMR system. However, copy paste is a common feature of EMR systems and not likely to be unique to the systems utilized in the study, as evidenced by numerous studies describing the ramifications of copied electronic documentation [8,9,16,17]. Direct evidence that lifestyle counseling documented in the note was copied was not available for the analysis. However, strong indirect evidence was provided, including demonstration of much higher prevalence of copied sentences within the same patient compared to other patients of the same provider. This finding is consistent with the functionality of the Copy button in the EMR used in this study which copies the entire note within the same patient. Templates, which can be used across different patients, would have led to a more uniform distribution of copied records. To establish that lifestyle counseling documentation was copied, we required that it be exactly identical to documentation found in the previous note. Though this approach may underestimate the true prevalence of copying as the copied text is frequently subsequently altered, altering copied text requires significantly greater cognitive involvement on the part of the author and may be more likely to reflect the patient-provider encounter. Our analytical approach would not be able to detect a small number of healthcare providers that were using the copy-paste feature for documentation of lifestyle counseling to justify increased E&M charge levels. Our study was conducted in practices affiliated with two academic medical centers, thus limiting generalizability of results to private practices. This limitation may have been ameliorated by the productivity incentives implemented in many of the primary care practices in these medical centers, potentially leading to documentation behaviors similar to private practices. At the same time, some patients may have seen physicians outside of the study practices during the study period. Retrospective nature of the study does not establish causality in the associations that were found in the study. However, it is unlikely that a randomized study on copied clinical documentation would be conducted in the future.

Conclusion

In summary, we have not found evidence that that copied documentation of lifestyle counseling is used to justify higher E&M charges. Instead, higher charges were associated with a number of markers of patient and encounter complexity, indicating that most providers are compliant with the spirit of insurance regulations.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AT and FM obtained data. MZ and FM conducted data analysis. MS supervised statistical analysis. MZ drafted the manuscript. AT obtained funding and supervised the project. All authors critically reviewed the manuscript and approved the final version.

Acknowledgements

This study was supported by grants from the Agency for Healthcare Research and Quality (1R18HS017030), the National Library of Medicine (1RC1LM01046) and the Diabetes Action Research & Education Foundation The funding sources had no role in the design, analysis, or interpretation of the study or in the decision to submit the manuscript for publication.

We would like to thank Dr. Lydia Siegel for her helpful advice.

The authors have no significant primary financial arrangements with commercial companies that produce or sell products that are the subject of studies reported in the manuscript, or with competitors of such companies.

Funding

Alexander Turchin: Agency for Healthcare Research and Quality (1R18HS017030), the National Library of Medicine (1RC1LM01046) and the Diabetes Action Research & Education Foundation.

Maria Shubina: Agency for Healthcare Research and Quality (1R18HS017030) and the National Library of Medicine (1RC1LM01046).

References

  1. DesRoches C, Campbell E, Rao S, et al.: Electronic health records in ambulatory care—a national survey of physicians.

    N Engl J Med 2008, 359(1):50-60. PubMed Abstract | Publisher Full Text OpenURL

  2. Linder J, Schnipper J, Tsurikova R, et al.: Documentation-based clinical decision support to improve antibiotic prescribing for acute respiratory infections in primary care: a cluster randomised controlled trial.

    Inform Prim Care 2009, 14(4):231-240. OpenURL

  3. Seidling H, Schmitt S, Bruckner T, et al.: Patient-specific electronic decision support reduces prescription of excessive doses.

    Qual Saf Health Care 2010, 19(5):e15. PubMed Abstract | Publisher Full Text OpenURL

  4. Ryan A, Bishop T, Shis S, Casalino L: Small physician practices in new york needed sustained help to realize gains in quality from use of electronic health records.

    Health Aff 2013, 32(1):53-62. Publisher Full Text OpenURL

  5. Bauer J: ARRA and HITECH. A medical economist’s analysis.

    JHIM 2010, 24(1):4-5. PubMed Abstract OpenURL

  6. Blumenthal D: Launching HITECH.

    N Engl J Med 2010, 362(5):382-385. PubMed Abstract | Publisher Full Text OpenURL

  7. Blumenthal D, Tavenner M: The “meaningful use” regulation for electronic health records.

    N Engl J Med 2010, 363(6):501-504. PubMed Abstract | Publisher Full Text OpenURL

  8. Hartzband P, Groopman J: Off the record-avoiding the pitfalls of going electronic.

    J Healthc Risk Manag 2008, 358(16):1656-1658. OpenURL

  9. Hirschtick R: A piece of my mind: copy-and-paste.

    JAMA 2006, 295(20):2335-2336. PubMed Abstract | Publisher Full Text OpenURL

  10. Zhang R, Pakhomov S, McInnes BT, Melton GB: Evaluating measures of redundancy in clinical texts.

    AMIA Annu Symp Proc 2011, 2011:1612-1620. PubMed Abstract | PubMed Central Full Text OpenURL

  11. Abelson R, Creswell J, Paler G: Medicare bills rise as records turn electronic. New York Times; 2012.

    September 22:A1. URL http://www.nytimes.com/2012/09/22/business/medicare-billing-rises-at-hospitals-with-electronic-records.html?pagewanted=all

    OpenURL

  12. Abelson R, Creswell J: U.S. warning to hospitals on medicare bill abuses. New York Times; 2012.

    September 24:B1. URL http://www.nytimes.com/2012/09/25/business/us-warns-hospitals-on-medicare-billing.html webcite

    OpenURL

  13. Wrenn J, Stein D, Bakken S, Stetson P: Quantifying clinical narrative redundancy in an electronic health record.

    J Am Med Inform Assoc 2010, 17(1):49-53. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Weir C, Hurdle J, Felgar M, Hoffman J, Roth B, Nebeker J: Direct text entry in electronic progress notes: an evaluation of input errors.

    Methods Inf Med 2003, 42(1):61-67. PubMed Abstract | Publisher Full Text OpenURL

  15. O’Donnell H, Kaushal R, Barrón Y, Callahan M, Adelman R, Siegler E: Physicians’ attitudes towards copy and pasting in electronic note writing.

    J Gen Intern Med 2009, 24(1):63-68. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Siegler E, Adelman R: Copy and paste: a remediable hazard of electronic health records.

    Am J Med 2009, 122:495-496. PubMed Abstract | Publisher Full Text OpenURL

  17. Hammond K, Helbig S, Benson C, et al.: Are electronic medical records trustworthy? observation on copying, pasting and duplication.

    AMIA Annu Symp Proc 2003, 269-273. OpenURL

  18. Boden G, Sargrad K, Homko C, Mozzoli M, Stein T: Effect of a low-carbohydrate diet on appetite, blood glucose levels, and insulin resistance in obese patients with type 2 diabetes.

    Ann Intern Med 2005, 142:403-411. PubMed Abstract | Publisher Full Text OpenURL

  19. Anderson J, Kendall C, Jenkins D: Importance of weight management in type 2 diabetes: Review with meta-analysis of clinical studies.

    J Am Coll Nutr 2003, 22:331-339. PubMed Abstract | Publisher Full Text OpenURL

  20. Hughes T, Gwynne J, Switzer B, Herbst C, White G: Effects of caloric restriction and weight loss on glycemic control, insulin release and resistance, and atherosclerotic risk in obese patients with type II diabetes mellitus.

    Am J Med 1984, 77:7-17. PubMed Abstract | Publisher Full Text OpenURL

  21. Morrison F, Shubina M, Turchin A: Lifestyle counseling in routine care and long-term glucose, blood pressure, and cholesterol control in patients with diabetes.

    Diabetes Care 2012, 35(2):334-341. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. American Diabetes Association: Standards of medical care in Diabetes—2012.

    Diabetes Care 2012, 35:S11-S63. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Turchin A, Goldberg S, Breydo E, Shubina M, Einbinder J: Copy/paste documentation of lifestyle counseling and glycemic control in patients with diabetes: True to form?

    Arch Intern Med 2011, 171(15):1393-1394. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  24. Turchin A, Shubina M, Chodos A, Einbinder J, Pendergrass M: Effect of board certification on antihypertensive treatment intensification in patients with diabetes mellitus.

    Circulation 2008, 117(5):623-628. PubMed Abstract | Publisher Full Text OpenURL

  25. Turchin A, Shubina M, Breydo E, Pendergrass M, Einbinder J: Comparison of information content of structured and narrative text data sources on the example of medication intensification.

    J Am Med Inform Assoc 2009, 16(3):362-370. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Deyo R, Cherkin D, Ciol M: Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases.

    J Clin Epidemiol 1992, 45(6):613-619. PubMed Abstract | Publisher Full Text OpenURL

  27. Lin D: Cox regression analysis of multivariate failure time data: The marginal approach.

    Stat Med 1994, 13:2233-2247. PubMed Abstract | Publisher Full Text OpenURL

  28. Levinson DR: Coding trends of medicare evaluation and management charges. 2012:OEI-04-10-00180. This is a government report. The full citation is: United States Department of Health and Human Services. Office of Inspector General. Coding Trends of Medicare Evaluation and Management Services. Report OEI-04-10-00180. Washington: HHS OIG, May 2012. Office of Inspector General. United States Department of Health and Human Services. Web. 15 October 2012;

    URL: https://oig.hhs.gov/oei/reports/oei-04-10-00180.pdf webcite

    OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/13/377/prepub