Abstract
Background
Pharmacy databases are commonly used to assess medication usage, and a number of measures have been developed to measure patients’ adherence to medication. An extensive literature now supports these measures, although few studies have systematically compared the properties of different adherence measures.
Methods
As part of an 18month randomized clinical trial to assess the impact of automated telephone reminders on adherence to inhaled corticosteroids (ICS) among 6903 adult members of a managed care organization, we computed eight pharmacybased measures of ICS adherence using outpatient pharmacy dispensing records obtained from the health plan’s electronic medical record. We used simple descriptive statistics to compare the relative performance characteristics of these measures.
Results
Comparative analysis found a relative upward bias in adherence estimates for those measures that require at least one dispensing event to be calculated. Measurement strategies that require a second dispensing event evidence even greater upward bias. These biases are greatest with shorter observation times. Furthermore, requiring a dispensing to be calculated meant that these measures could not be defined for large numbers of individuals (1732 % of participants in this study). Measurement strategies that do not require a dispensing event to be calculated appear least vulnerable to these biases and can be calculated for everyone. However they do require additional assumptions and data (e.g., preintervention dispensing data) to support their validity.
Conclusions
Many adherence measures require one, or sometimes two, dispensings in order to be defined. Since such measures assume all dispensed medication is used as directed, they have a built in upward bias that is especially pronounced when they are calculated over relatively short timeframes (< 9 months). Less biased measurement strategies that do not require a dispensing event are available, but require additional data to support their validity.
Trial registration
The study was funded by grant R01HL83433 from the National Heart, Lung and Blood Institute (NHLBI) and is filed as study NCT00414817 in the clinicaltrials.gov database.
Keywords:
Asthma; Inhaled corticosteroids; Adult; Medication adherence; Randomized clinical trial; MethodologyBackground
Pharmacy databases are increasingly being used to assess medication usage, and a number of measures have been developed to characterize both the intensity of medication usage compared to intended use (adherence), and the extent to which such usage persists over time (persistence) [1,2]. Such measures have strong appeal, and an extensive literature now exists to support their value in clinical research [3]. In particular, comparative effectiveness research increasingly depends on pharmacybased measures to assess both practice variations in prescribing, as well as health outcomes according to therapeutic exposure in realworld, diverse patient populations. Despite their increasingly widespread use, however, relatively few studies have systematically compared the properties of competing pharmacybased measures of adherence [1,46].
One of the most widely cited pharmacybased measures of medication adherence is calculated simply as the total number of days of medication dispensed between some initial and final dispensing date divided by the length of time between these dates. Steiner and Prochazka [7] refer to this and related indices as part of a larger class of measures they call continuous multipleinterval measures of medication availability (or CMA measures for short). They also define a related class of measures they term continuous multipleinterval measures of medication gaps (or CMG measures) that attempt to quantify theoretical gaps in medication usage. CMAbased measures are easier to compute than CMGbased measures and make no assumptions about patterns of medication use, whereas CMG measures are computationally more intensive and assume that medications, once dispensed, are used as directed.
Both CMAbased and CMGbased measures were originally developed under the assumption that one has access only to dispensing data during some defined observation window and knows nothing else about the individuals under observation. Possible refinements include (1) expanding the denominator to include the entire observation window under study if it is known that the individuals under study should be taking a given medication (e.g., by clinical practice guideline recommendation) throughout the observation window and (2) accounting for medications that individuals are known to possess at the start of the observation window. The proliferation of electronic medical records (EMRs) is making access to such information increasingly more common.
We used data from an adherence trial among members of a large health maintenance organization to compare the properties and performance characteristics of a variety of CMA and CMGbased measures of medication adherence.
Methods
Study design and research setting
We report data collected as part of a randomized clinical trial of members of the Northwest (KPNW) and Hawai‘i (KPH) regions of Kaiser Permanente, a large, groupmodel health maintenance organization. The main results of the study have been presented elsewhere [8]. Participants were randomized to receive either usual care or an 18month intervention in which automated telephone calls were used to promote improved adherence to inhaled corticosteroids (ICS). The study was approved by the Institutional Review Boards (IRBs) of each region (Kaiser Permanente Northwest IRB, FWA #0000234400000405; and Kaiser Permanente Hawaii IRB, FWA #0000234400000402) and written informed consent was waived. Research was carried out in compliance with the Helsinki Declaration.
Kaiser Permanente provides comprehensive, prepaid health care services to its members, and both KPNW and KPH utilize a fully electronic medical record. An enduser database captures diagnosticspecific utilization data, procedures performed, new medication orders and outpatient pharmacy dispensings.
Study population
The target population for the trial consisted of KPNW and KPH members aged 18 and older who were members for the 12 months prior to randomization, had been seen for asthma and received at least one dispensing of a respiratory medication during that timeframe. In order to be able to study both primary and secondary ICS adherence, the target population included individuals without evidence of prior ICS use. The present analysis focuses on the subset of 6903 individuals with ICS dispensings during the baseline year.
Adherence measures
We compare eight alternative measures of adherence, which we label CMA1CMA8 (Table 1). Some of these are classical CMAtype measures and some are derived from CMGlike measures. In each case we assume an observation window, defined as the period from randomization (t_{0}) to end of followup (t_{e}). We also treat all ICS medications, including combination agents containing an ICS, as a single class of medications.
Table 1. Summary of study measures
For any given participant, let t_{1}, t_{2}, …, t_{k} be the dates of the k ICS dispensing events that occurred during the observation window, and n_{1}, n_{2}, …, n_{k} be the corresponding number of days of medication dispensed at each timepoint. For any given dispensing event, we calculated days' supply by dividing the number of puffs per canister by the doctor’s suggested daily usage instructions. Using this information, we define CMA1 as the total days’ supply of ICS dispensed between the first and last dispensing event, excluding medications dispensed at the final dispensing event, divided by the elapsed time between these events. That is, CMA1 = (n_{1}+ n_{2}+ … + n_{k1}) / (t_{k} – t_{1}).
We shall refer to the denominator in these formulas, in this case t_{k} – t_{1}, as the measurement window (i.e., the subset of the larger observation window over which adherence is actually calculated). Implicit in the use of the above definition is the assumption that we don’t know whether the participant should be taking the medication of interest until we see a dispensing for it. That is why the denominator starts with t_{1} rather than t_{0}. Similarly the dispensing at t_{k} implies that the participant was still taking the medication at time t_{k}. However since we don’t know if use of the medication was subsequently discontinued under physician directions, observation stops at t_{k} rather than at t_{e}. Thus two dispensing events are required to calculate the measure.
The first refinement to CMA1 tacitly assumes the medication should continue to be taken during the interval from t_{k} to t_{e} (a period sometimes referred to as the “terminal gap”) [9]. It is computed as the total days’ supply dispensed during the observation window, including the medication dispensed at t_{k}, divided by the time from t_{1} to end of study: CMA2 = (n_{1}+ n_{2}+ … + n_{k}) / (t_{e} – t_{1}).
In contrast to CMA1, CMA2 requires only one dispensing event to be calculated. In the case of asthma, a chronic condition for which ICS is considered first line therapy, this assumption would seem to be reasonable, especially if the observation window does not extend for several years past t_{k}. Because CMA1 and CMA2 may both be greater than 1, some researchers prefer to cap them at 1 (since nominally adherence shouldn’t be any greater than 100 %). This gives rise to two additional measures, CMA3 = minimum (CMA1, 1) and CMA4 = minimum (CMA2, 1).
The terminology used to describe these measures in the literature is not consistent. Hess et al. [1] refer to CMA1 as the Compliance Rate and CMA2 as the Continuous Measure of Medication Acquisition. CMA3 and CMA4 appear to be examples of what Hess et al. refer to as the Proportion of Days Covered, although it is not clear from their description of this measure exactly what denominator they use in this calculation, only that it is capped at 1. In practice many authors also refer to both CMA1 and CMA2 as the Medication Possession Ratio (MPR), and indeed Hess et al. [1] note that at least four different published measures have been ascribed this name. By contrast they seem to use MPR (and equivalently the Medication Refill Adherence percentage) to refer to the total days’ supply divided by the entire observation window [i.e., (n_{1}+ n_{2}+ … + n_{k}) / (t_{e} – t_{0})].
The preceding are all classical CMAtype measures in that they do not account for the timing of the dispensing events. An individual can have long gaps with no medication dispensings and yet appear fully compliant based on a large days’ supply dispensed toward the end of the measurement window. The CMGbased measures were developed to address this potential limitation. If one assumes that all medication is taken exactly as directed, then it is possible to determine those days for which an individual is theoretically taking medication and conversely those days for which no medication is available and hence gaps in coverage exist. For instance, if a participant receives a 30day supply of ICS on day 10 of an observation window and another 30day supply on day 50, then he must have had a 10day coverage gap from days 40–49 if the medication was taken as directed. In the event of overlapping dispensings, it is conventional to assume that the new dispensing is not started until the first is exhausted. Thus in the preceding example if the second dispensing occurred on day 35, it would be “banked” and not started until day 40. Traditionally, CMG measures are used to reflect the proportion of measurement window in which medication is not taken and the duration of usage gaps, but equivalently one can use 1CMG to estimate the proportion of days during a measurement window during which a participant was taking medication. Similar to the distinction between CMA1 and CMA2, we can therefore define CMA5 = (# adherent days between t_{1} and t_{k}) / (t_{k}t_{1}) and CMA6 = (# adherent days between t_{1} and t_{e}) / (t_{e}t_{1}).
That is, CMA5 ignores the last dispensing while CMA6 does not. In both cases any unused medication still available at the end of the observation window is ignored in the calculations. Thus both measures are by definition bounded above by 1 and hence along with CMA3 and CMA4 are variants of Hess et al.’s [1]Proportion of Days Covered measure, and also closely aligned with what they term the Continuous Measure Of Medication Gaps.
The definitions of CMA1CMA6 are predicated on the assumption that no other information is known about the study participants. In particular it is unknown whether they should be taking ICS at the start of the observation window (and potentially if they are bringing any unused medication into the start of the observation window). This need not be the case. For instance, in our study we had access to data from the EMR for the “baseline” year prior to randomization. Given that we knew each participant had a diagnosis of asthma and it was severe enough to have been prescribed an ICS in the baseline year, we felt it reasonable to assume that the participant should be taking an ICS throughout the entire 18month followup window. Indeed the intervention calls were intended in part to help restart ICS use in those participants who had discontinued their use. We therefore considered two additional CMGbased measures.
CMA7 extends CMA6 by measuring adherence from t_{0} rather than from t_{1} (that is, the measurement window coincides with the observation window from t_{0} to t_{e}). In addition, we adjusted the numerator to include any medication still available based on the most recent dispensing prior to randomization. Thus CMA7 = (# adherent days between t_{0} and t_{e}) / (t_{e}t_{0}). (Given the assumptions we made about ICS use, it didn’t make sense to consider an analog to CMA5 that only spanned the interval t_{0} to t_{k}.) Finally, since the initial adherence resulting from medications already on hand at the start of the intervention could not have been influenced by our intervention, we considered one further refinement to this definition, which was to start the observation window on the day this initial prescription should have been exhausted. If we label this date as t_{0}*, we have CMA8 = (# adherent days between t_{0}* and t_{e}) / (t_{e}t_{0}*).
The initial days’ supply on hand at the time of randomization is not counted in the numerator and the corresponding amount of time is also subtracted from the denominator. An important feature of CMA7 and CMA8 is that they do not require a dispensing during the observation window to be calculated and hence can be defined for all participants.
Statistical methods
We use simple descriptive statistics to compare the performance characteristics of these eight measures. For some analyses we also calculate CMA measures, and their associated statistics, for varying lengths of followup (e.g., the first 3, 6, and 9 months of followup). We limited these latter analyses to those individuals with complete followup through 15 months (n = 4790, ≈69 % of the full cohort) to assure that any differences were not attributable to patient mix. All statistical analyses were performed using SAS v9.1 (SAS Institute, Cary, NC).
Results
Summary descriptive statistics for the various adherence measures are displayed in Table 2. As shown, the number of individuals for whom we can compute valid values varies directly as a function of how these terms are defined. CMA1, CMA3, and CMA5 all require the presence of two or more dispensings to be calculated, and hence could be defined for only 68 % of the population. CMA2, CMA4, and CMA6 require only a single dispensing to trigger the calculation, and for our data could be calculated for 83 % of the population. Finally, CMA7 and CMA8 are available for everyone since they require no dispensings to calculate.
Table 2. Comparison of distributional characteristics of competing medication acquisition measures
Table 2 also shows the relative upward bias in CMA1CMA6 (and especially CMA1 and CMA2) compared to CMA7 and CMA8. Because CMA1 – CMA6 all require at least one dispensing to be calculated, they by definition guarantee some level of adherence. This is not the case for CMA7 and CMA8. The even more pronounced relative upward bias in CMA1 and CMA2, which is reflected in their means and standard deviations but not their more robust interquartile ranges, results from the extreme skewness in the righthand tail of these measures.
Although followup in these participants ranged from 1 to 18 months, the average duration of followup [mean (SD)] was 15.1 (3.9) months. As shown in Table 3, which presents data for only CMA4, CMA6, CMA7 and CMA8, the upward bias associated with CMA1CMA6 relative to CMA7 and CMA8 is even more pronounced for shorter observation windows, but still persists even when adherence is measured over a full 15 months. For the most part, the more extreme early bias associated with CMA1CMA6 (or at least CMA4 and CMA6) appears to largely disappear after 9 months. CMA7 and CMA8 do not exhibit any evidence of a time bias, presumably since they don’t require an initial dispensing (and its attendant implied adherence) to trigger the calculation.
Table 3. Impact of window length on measurement properties
Discussion
While pharmacybased dispensing records are becoming increasingly popular tools for studying patterns of medication adherence, it is important to understand the potential limitations of the resulting measures. By their very definition, some measures of adherence are more prone to an upward bias, while other potentially more accurate measures may rely on a stronger set of assumptions to be valid. In addition, such pharmacybased measures of adherence have face validity as measures of actual medication usage only when measured over long periods of time, since in this case high levels of estimated adherence can only be achieved through repeated refills (which tacitly implies ongoing medication usage).
Although our study was conducted in the context of a randomized clinical trial, we believe our findings have applicability to any pharmacoepidemiologic study that might be conducted using electronic dispensing records. One key consideration is that many of the commonly used measures require medication use during the observation window in order to be calculated. Our study suggests that this requirement will clearly bias adherence values upwards, both by excluding the least adherent patients and by building in a minimum level of adherence in those who can be assessed. Increasingly, investigators will have access to EMRs that can be used to better define the population of individuals who are known users of the medication of interest, or at least have been prescribed such medications, thus allowing more accurate assessments of adherence for a target population. Further, EMR data can be used to identify whether such medication use has been discontinued by the patient’s provider. In this context it is therefore important to understand how many individuals are excluded from your adherence estimates by various definitions, and our results show that this number can be quite large. In the context of comparative studies, where nonadherence can be differential across the groups being compared, it is even more important to account for all subjects.
Of the measures we studied, those that required an initial dispensing for their calculation, particularly if not bounded above by 1 (i.e., CMA12), were prone to exhibit an upward bias relative to the other measures we considered. The four variants on the Proportion of Days Covered, (CMA36), generally performed similarly to one another. Adherence estimates based on all six of these measures exhibited an increasingly upward bias with shorter observation windows that did not flatten out until after about 9 months of observation (Table 3). This reflects the fact that the measurement window for all of these measures begins with a dispensing, and hence a certain amount of builtin implied adherence. The fact that the measurement windows for CMA1, CMA3, and CMA5 also all end with a dispensing event leads to a further upward bias, since they effectively require that one is actively using the medication throughout the measurement window (or at least at both the beginning and end of the window). However, use of CMA2, CMA4, and CMA6 carry the implicit assumption that one should be using the medication throughout the entire interval beginning with the last dispensing event and extending through the end of the observation window (i.e., t_{k} to t_{e}). If such an assumption is valid, then these measures should yield more unbiased estimates of adherence than those from their CMA1, CMA3, and CMA5 counterparts. They have the further added advantage that they can be computed for more people since they only require a single dispensing event to be defined. This is particularly important since the missingness pattern will likely not be random (that is, nonadherent individuals will be more likely than adherent individuals to have missing data). Thus the upward bias in CMA1, CMA3, and CMA5 results both from a likely overestimation of adherence in those for whom it can be calculated, as well as from the fact that these same individuals are likely to be selectively more adherent than those for whom these indices cannot be calculated.
If viewed merely as measures of medication acquisition, rather than medication taking, some of the problems discussed above become moot and CMA1 or CMA2 may be the preferred measures to use. Indeed there may be some theoretical interest in those with very high values for CMA1 or CMA2. However, values of CMA1 or CMA2 greater than 1 can also substantially skew mean rates of adherence upwards for a population and in many if not most instances may not reflect actual adherence behavior. To the best of our knowledge based on a limited amount of data checking, the majority of these extreme values reflect actual dispensings rather than, for example, administrative errors in the data. Whether they reflect excessive use by one individual, medication sharing, vacation supplies, or medication wastage we don’t know. Presumably these extreme values reflect some combination of all of these possibilities. In the end, however, we believe that most researchers who use these measures think of and talk about them as measures of adherence, and for that reason we would argue that CMA1 and CMA2 should not be used. Nonetheless, further studies are needed to better understand patient factors associated with very high rates of dispensing, and whether such excessive dispensings are associated with adverse health outcomes. Reasons for this apparent overadherence have been attributed to changes in directions not noted in the pharmacy record, intentional variable dosing, and stockpiling [10].
In practice, at least for our dataset, we found only minimal differences between CMA3/CMA4 and their CMGbased counterparts CMA5/CMA6. Given that the latter are computationally more intensive to calculate, this might argue for the use of the former measures (which are relatively easy to calculate). The main advantage of using the CMGbased measures is their ability to describe gaps in medication use, although this requires the rather strong assumption that the medication is used exactly as directed. Nonetheless we feel that the added benefit of studying gaps in usage conceptually has a lot of appeal and is worth consideration when evaluating the use of either CMA3 or CMA4 versus CMA5 or CMA6.
Each of CMA1 through CMA6 can be calculated solely on the basis of pharmacy dispensing records available during the observation window. The use of CMA7 and CMA8 requires additional knowledge. This could simply be information about medication use prior to the start of the formal observation window of interest or, as in our case, this information supplemented by diagnostic data from an EMR. Due to the growing use of EMRs and the expectation that they will only become more prevalent over time, these requirements should not pose a serious problem to the future use of these measures. However, the availability of such information, while necessary, is not sufficient to justify the use of CMA7 or CMA8. One must further be able to justify the assumption that participants should be taking the medication throughout the observation window. The validity of this assumption is likely to be more true for some medications than for others. In the case of asthma, for instance, ICS are considered firstline therapy for patients with persistent disease. Hence the presumption that a patient, once prescribed them, should continue using them is more likely to be true than not true (although physicians may discontinue use if they are deemed ineffective for a given patient). The presence of stop orders, if available in the EMR, could be used to further refine the calculation of such measures, although our experience is that clinicians are not good about documenting them.
The fact that CMA7 and CMA8 do not require a dispensing during the observation window in order to be calculated should, if the assumptions underlying their use are met, cause them to lead to the most valid measures of adherence. However, given that the assumptions for their use are inevitably not met for some individuals, in practice populationbased estimates of adherence based on these measures are probably biased downwards from truth. These observations are consistent with the trends observed in our data, which showed both the lowest estimates of adherence and the least change in estimated adherence with varying length of the observation window. Even if the assumptions underlying CMA7 and CMA8 do lead to a downward bias in the estimates, this needs to be weighed against the fact that these measures can be calculated for everyone. Despite the fact that everyone had a preexisting diagnosis of asthma and an order or dispensing for ICS in the baseline year, CMA1/3/5 could not be calculated for 32 % of this cohort, and even the less restrictive CMA2/4/6 measures could not be calculated for 17 % of the cohort.
Although we did not evaluate them as part our analyses, under the assumptions for use of CMA7 and CMA8 one could also modify the definitions of CMA4 and CMA6 to include the entire observation window in the denominator. The modified CMA4 index in particular, which would correspond to Hess et al.’s [1] definition of the Medication Possession Ratio, could be much more easily computed than any of the CMGbased measures and it is not unreasonable to hypothesize that it might be fairly comparable in its measurement properties to CMA7 and CMA8. It would also by definition be definable for all subjects, and not just those with one or more dispensing events during the observation window.
Our motivation for defining CMA8 is probably unique to the context of randomized clinical trials, where the concept of implied initial adherence at the start of an adherence intervention that could not be related to treatment allocation is a relevant consideration for analysis.
Our results are consistent with, and extend, the results of previous investigations that have compared the performance of competing measures of adherence in the same dataset. Hess et al. [1] compared 11 measures, though per their descriptions of them it is not clear that these were all mathematically distinct measures. They concluded that the equivalent of what we term CMA1CMA6 provided essentially the same adherence values, although those measures that were capped at a maximum value of 1 (or 100 %), similar to our CMA3CMA6 measures, produced adherence estimates that were slightly lower than those that were not. Participants in their study had a mean (SD) observation window of 350 (16) days, and they did not report on the impact of using shorter observation windows. A separate review of pharmacybased measures of medication adherence, however, noted that the assessment of adherence over short intervals is likely to be imprecise and suggested that the observation window should be long enough to span the expected days’ supply from at least three dispensing events [9]. This agrees well with our own observation (Table 3) that the extreme early bias in these measures takes about 9 months to flatten out (the average ICS days’ supply for this population was 2–3 months). Of course adherence often falls naturally over time, particularly among new users [10] and that is another rationale for prolonged observation of refill behavior. Vink et al. [11] compared the equivalents of our CMA3 and CMA7 when assessed over one year and concluded that the latter had a significantly better area under the curve for classifying a measure of adherence based on chart review.
Several reports have noted the lack of standardization in terminology in the published adherence literature, noting both that the same term (e.g., Medication Possession Ratio) can mean different things in different papers and conversely that multiple distinct terms have been used to describe the same measure [1,2,7,9]. These reports also note that comparisons with published studies are further complicated by the fact that the precise methodology used for defining a given measure is not always provided. Our approach has been to explicitly define a series of measures and give their rationales and assumptions for valid use, while avoiding assigning a formal nomenclature to them. We have, however, tried to relate our terms to those used by Hess et al. [1].
In the end, the choice of which adherence measure to use for any given study must be based on the richness of data available to the investigator, the chronicity of the disease for which the medication is being used, the availability of other therapeutic options, knowledge about standards of practice, and the question being addressed by the study. No single measure is likely to be optimal for all occasions. Still, given that the assumptions for use of more sophisticated measures, such as CMA7 or CMA8, are met, we believe our findings suggest that these may be more appropriate (i.e., less biased and more universally estimable) alternatives than simpler measures such as the various derivatives of the MPR.
The study has two main limitations. First, none of the measures described here really speak to the issue of primary nonadherence (failure to obtain the first fill of a medication ordered by their clinician), and instead focus on adherence among known medication users. Thus from the perspective of overall populationbased measures of adherence to prescribed medications, all of these measures will tend to have a further upward bias. In addition, we made no attempt to adjust for hospitalization days in our adherence estimates. For populations for which this is a meaningful consideration, it is common to remove hospital days from the denominators of many of these statistics. However, for the purpose of comparing relative properties of the various measures, any bias this introduces is likely to be comparable across the measures so that relative comparisons should be largely unaffected.
Conclusions
Estimates of medication adherence can vary markedly among competing measures.
These differences are accentuated when adherence is measured over relatively short timeframes (< 9 months). Many commonly cited measures cannot be calculated for large numbers of individuals because they require one, or in some cases two, dispensings in order to be defined. This leads to falsely optimistic estimates of adherence. Less biased measurement strategies that do not require a dispensing event to be calculated are available, but require additional data to support their validity.
Abbreviations
ICS, inhaled corticosteroids; CMA, continuous multipleinterval measures of medication availability; CMG, continuous multipleinterval measures of medication gaps; CMA1CMA8, the eight alternative adherence measures evaluated in this paper (see Table 1 for definitions); SD, standard deviation; KPNW, Kaiser Permanente Northwest Region; KPH, Kaiser Permanente Hawaii Region; EMR, electronic medical record; MPR, medication possession ratio.
Competing interests
The authors declare that they have no competing interests.
Author’s contributions
WV directed the overall parent study, conceived the design of this manuscript, and assumed primary responsibility for drafting it. MX participated in the design of this manuscript, conducted the statistical analyses, and contributed actively to the preparation of the manuscript. AF, DS, AW, and CR all participated in the design and conduct of the parent study and reviewed and commented on drafts of the manuscript. All authors read and approved the final manuscript.
Acknowledgments
The study was funded by grant R01HL83433 from the National Heart, Lung and Blood Institute (NHLBI) and is filed as study NCT00414817 in the clinicaltrials.gov database. The NHLBI had no direct involvement in any aspect of the study nor in the preparation of this manuscript. The authors would also like to acknowledge Ms. Jill Pope for editorial assistance provided in the preparation of this manuscript.
References

Hess LM, Raebel MA, Conner DA, Malone DC: Measurement of adherence in pharmacy administrative databases: a proposal for standard definitions and preferred measures.
Ann Pharmacother 2006, 40:12801288. PubMed Abstract  Publisher Full Text

Caetano PA, Lam JM, Morgan SG: Toward a standard definition and measurement of persistence with drug therapy: Examples from research on statin and antihypertensive utilization.
Clin Ther 2006, 28:14111424. PubMed Abstract  Publisher Full Text

Ho PM, Bryson CL, Rumsfeld JS: Medication adherence: its importance in cardiovascular outcomes.
Circulation 2009, 119:30283035. PubMed Abstract  Publisher Full Text

Hudson M, Rahme E, Richard H, Pilote L: Comparison of measures of medication persistency using a prescription drug database.
Am Heart J 2007, 153:5965. PubMed Abstract  Publisher Full Text

Ren XS, Herz L, Qian S, Smith E, Kazis LE: Measurement of treatment adherence with antipsychotic agents in patients with schizophrenia.
Neuropsychiatr Dis Treat 2009, 5:491498. PubMed Abstract  Publisher Full Text  PubMed Central Full Text

Karve S, Cleves MA, Helm M, Hudson TJ, West DS, Martin BC: Prospective validation of eight different adherence measures for use with administrative claims data among patients with schizophrenia.
Value Health 2009, 12:989995. PubMed Abstract  Publisher Full Text

Steiner JF, Prochazka AV: The assessment of refill compliance using pharmacy records: methods, validity, and applications.
J Clin Epidemiol 1997, 50:105116. PubMed Abstract  Publisher Full Text

Vollmer WM, Feldstein A, Smith DH, Dubanoski JP, Waterbury A, Schneider JL, Clark SA, Rand C: Use of health information technology to improve medication adherence.
Am J Manag Care 2011, 17:SP79SP87. PubMed Abstract  Publisher Full Text

Andrade SE, Kahler KH, Frech F, Chan KA: Methods for evaluation of medication adherence and persistence using automated databases.
Pharmacoepidemiol Drug Saf 2006, 15:565574. PubMed Abstract  Publisher Full Text

Christensen DB, Williams B, Goldberg HI, Martin DP, Engelberg R, LoGerfo JP: Assessing compliance to antihypertensive medications using computerbased pharmacy records.
Med Care 1997, 35:11641170. PubMed Abstract  Publisher Full Text

Vink NM, Klungel OH, Stolk RP, Denig P: Comparison of various measures for assessing medication refill adherence using prescription data.
Pharmacoepidemiol Drug Saf 2009, 18:159165. PubMed Abstract  Publisher Full Text
Prepublication history
The prepublication history for this paper can be accessed here: