|
|
||||||||||
Science Officer, Arizona Cancer Center, University of Arizona, Tucson, AZ
Pharmacotherapy Research Manager, Kaiser Permanente of Colorado, Denver, CO; Clinical Associate Professor, School of Pharmacy, University of Colorado at Denver and Health Sciences Center, Denver
Senior Research Analyst, Kaiser Permanente of Colorado
Associate Professor, College of Pharmacy, University of Arizona
Reprints: Ms. Hess, Arizona Cancer Center, 1515 N. Campbell Ave., PO Box 245024, Tucson, AZ 85724-5024, fax 520/626-5350, hess{at}u.arizona.edu
| Abstract |
|---|
|
|
|---|
OBJECTIVE: To compare available refill adherence measures.
METHODS: A systematic literature review was conducted to identify current or recently used measures of calculating adherence from administrative data. A MEDLINE search (January 1990-March 2006) was undertaken using the search terms adherence or compliance in the title combined with administrative, pharmacy, or records in any field, including subheadings medical, nursing, and hospital records. Non-English articles were excluded. Seven hundred fifteen articles were available for review. Review articles and letters were excluded from measure selection, but were included in the search terms and used to identify additional research articles. Adherence measures were excluded if they were incompletely described, produced non-numeric values, or were duplicates. Eleven refill adherence measures were identified and compared using data from the LOSE Weight (Long-term Outcomes of Sibutramine Effectiveness on Weight) study. Measures compared include Continuous Measure of Medication Acquisition (CMA); Continuous Multiple Interval Measure of Oversupply (CMOS); Medication Possession Ratio (MPR); Medication Refill Adherence (MRA); Continuous Measure of Medication Gaps (CMG); Continuous, Single Interval Measure of Medication Aquisition (CSA); Proportion of Days Covered (PDC); Refill Compliance Rate (RCR); Medication Possession Ratio, modified (MPRm); Dates Between Fills Adherence Rate (DBR); and Compliance Rate (CR).
RESULTS: The results suggest that the CMA, CMOS, MPR, and MRA are identical in terms of measuring adherence to prescription refills throughout the study period, each with a value of 63.5%; CMG and PDC are slightly lower (63.0%) and are equivalent to MRA when oversupply is truncated. CR, MPRm, RCR, and CSA result in higher adherence values of 84.4%, 86.6%, 104.8%, and 109.7%, respectively.
CONCLUSIONS: Five measures produce equivalent results for measuring prescription refill adherence over the evaluation period. Of these, MRA has the fewest calculations, is easily truncated if one desires to exclude surplus medication issues, and requires the least amount of data. MRA is therefore recommended as the preferred measure of adherence using administrative data.
Key Words: adherence, administrative data, compliance, measurement
Published Online, July 25, 2006. www.theannals.com, DOI 10.1345/aph.1H018
Both direct and indirect measures can be used to assess patient medication adherence. Examples include drug assays or markers, self-report, pill counts, electronic monitoring systems, and review of pharmacy records or administrative data. Although comparisons have been made among methods of collecting data to assess adherence,7-11 no gold standard measure has been applied.10,12-17 Therefore, when presenting or interpreting adherence data, one should specify the measure used, with particular attention to the time frame evaluated and the medications included. The choice of adherence assessment measure also depends on data availability and cost. These factors additionally contribute to the accuracy of the final value.
Administrative data sets, "data files generally compiled in billing for healthcare services,"18 are often assessed in pharmacoeconomic and pharmacoepidemiologic research. The adherence value obtained from administrative data does not provide medication consumption information, but rather provides assessment of possession. Medication in-take calculations usually assume that patients consume the drug starting the day of dispensing, use the drug as prescribed, and consume all medications obtained. Administrative data can, therefore, provide the investigator only an estimate of the highest possible level of medication consumption. As described by Christensen et al.,19 in cases in which the dosage prescribed (eg, determining days' supply of medication obtained) is unavailable or unable to be determined, it is difficult to assess adherence using administrative data. The length of the assessment period may be problematic in the evaluation of adherence using administrative data, as both shorter (eg, <60 days) and longer (eg, >90 days) time periods introduce potential bias when estimating medication adherence.19 Adherence measures based on administrative data have not correlated with patient reported adherence.11,20
Despite these limitations, administrative data are convenient, noninvasive, objective, and inexpensive to obtain. In addition, adherence estimates based on administrative data appear to be associated with clinical outcomes.11,21 Therefore, administrative data are frequently used to obtain medication adherence information. Ideally, an adherence assessment from administrative data should provide an accurate reflection of the number of days the patient had the correct dose of a drug available compared with the number of days the treatment was prescribed. To our knowledge, no study has compared measures of assessing adherence with administrative data using actual patient records.
The purpose of this study was to compare measures used to assess medication adherence from administrative pharmacy data. This comparison assists in identifying a preferred measure and in moving toward standardized terminology when reporting adherence.
| Methods |
|---|
|
|
|---|
Refill data collected as part of a prospective, randomized study designed to assess the impact of sibutramine in combination with a weight management programthe LOSE Weight (Long-term Outcomes of Sibutramine Effectiveness on Weight) studywere used to test measures of adherence.15 The LOSE Weight study and the current study were both approved by the Kaiser Foundation Institutional Review Board. In the LOSE Weight study, patients were randomized to a weight management program plus sibutramine (n = 296), or to the weight management program alone (n = 292). Mean weight loss at 6 months was 6.8 kg in the sibutramine group compared with 3.1 kg in the weight management alone group (p < 0.001). Weight loss was maintained at 12 months.
LOSE Weight study patients receiving sibutramine were given prescriptions for sibutramine during study visits. Patients presented these prescriptions to Kaiser Permanente Colorado pharmacies where the prescriptions were dispensed and sold using standard pharmacy procedures. Study patients paid retail price for sibutramine and were reimbursed for 75% of the price paid.15
Refill data were available from administrative pharmacy records for 283 study participants (96%) randomized to sibutramine. Refill data included participant identification number and date, quantity dispensed, and days' supply dispensed. Each record represented one sibutramine dispensation. Dates of study enrollment and study end were determined from the study database. The time frame evaluated was from the date the participant first obtained sibutramine through the one year anniversary date of study enrollment. The end date was selected based on the intent-to-treat design of the LOSE Weight study.15
SPSS Version 12.0.1 was used to calculate means and standard deviations (described below) for the adherence measures assessed. In addition to analyses of cumulative data, individual study participant data were sampled to compare each measure in 6 scenarios: (1) excessive medication, (2) insufficient medication, (3) adequate medication, (4) same-day refill, (5) refill on study completion date, and (6) single fill.15
CONTINUOUS, SINGLE-INTERVAL MEASURE OF MEDICATION AVAILABILITY
Single-interval medication availability was calculated by obtaining an
adherence value for each sibutramine dispensation with use of Continuous,
Single-Interval Measure of Medication Availability
(CSA).17 The
days' supply of a drug was divided by the number of days in the interval from
the dispensation date up to, but not including, the next dispensation date (or
through study completion date). This provides an adherence value for each
participant between dispensationsnot for the overall study evaluation
period. The mean of all dispensation adherence values provides an overall
study adherence value.
CONTINUOUS MEASURE OF MEDICATION ACQUISITION
Continuous Measure of Medication Acquisition
(CMA)17 was
calculated for each participant. The days' supply of medication obtained
throughout the study period was divided by the number of days from the first
dispensation until the participant's study completion date (number of days of
study participation). The mean of each participant's CMA value provides an
overall study adherence value.
COMPLIANCE RATE
Compliance rate
(CR)24 was
computed by taking the sum of the days' supplies for each participant, minus
the days' supply obtained at the last dispensation and dividing this by the
number of days from first up to, but not including, the last dispensation.
This provides an overall adherence rate based on day of last refill and does
not require study completion date.
DAYS BETWEEN FILLS ADHERENCE RATE
The total days' supply was subtracted from the number of days between
dispensations using the Days Between Fills Adherence Rate
(DBR)22;
this difference was divided by the number of days between dispensations. Since
this value is a nonadherence value, the dividend was subtracted from 1 to
obtain an adherence value. The result was multiplied by 100 to provide an
adherence percentage for each participant for the overall study period.
CONTINUOUS MEASURE OF MEDICATION GAPS
The Continuous Measure of Medication Gaps
(CMG),17
which is used to determine the total days of treatment gaps (days for which a
drug was unavailable), was calculated for each participant by subtracting the
total days' supply obtained throughout the study period from total number of
days of study participation. Negative values were set to zero. The total days
of treatment gaps was then divided by number of days of study participation.
The mean of each participant's CMG value provides an overall study
nonadherence value based on lack of available medication, with 0.0 reflecting
complete adherence, and 1.0 reflecting complete nonadherence.
CONTINUOUS MULTIPLE INTERVAL MEASURE OF OVERSUPPLY
The total days of treatment gaps was calculated using Continuous Multiple
Interval Measure of Oversupply
(CMOS).13
Negative values were included to represent cases in which the participant
obtained days' supply of medication exceeding days of study participation. The
total number of days' supply or surplus was divided by days of study
participation for each participant. The mean of each participant's CMOS value
provides an overall study nonadherence value.
MEDICATION POSSESSION RATIO
The Medication Possession Ratio
(MPR)16 is a
ratio of total days' supply to number of days of study participation per
participant. The ratios alone could not be combined across participants due to
different denominators; therefore, the ratios were divided and averaged to
provide an overall study adherence value.
REFILL COMPLIANCE RATE
The total days' supply was multiplied by 100 and divided by the number of
days from first to last medication dispensation with use of the Refill
Compliance Rate
(RCR).25
Cases with only one dispensation of a drug were excluded from this calculation
because of the invalid denominator. The mean of each participant's RCR
provides an overall study adherence value.
MEDICATION POSSESSION RATIO, MODIFIED
Using the Medication Possession Ratio, modified
(MPRm),26
the total days' supply of a drug was divided by the sum of the number of days
from first dispensation up to, but not including, the date of last
dispensation and the number of days' supply obtained at the last dispensation.
This value was multiplied by 100 to provide an adherence percent value that
can be averaged to find an overall study adherence value.
MEDICATION REFILL ADHERENCE
The total days' supply was divided by number of days of study participation
and multiplied by 100 to provide a percent adherence value. The mean of each
participant's Medication Refill Adherence
(MRA)23
value provides an overall study adherence value.
PROPORTION OF DAYS COVERED
The total days' supply was divided by number of days of study participation
using the Proportion of Days Covered
(PDC).27
This value was capped at 1.0 and multiplied by 100 to obtain a percent
adherence value. The mean of each participant's PDC value provides an overall
study adherence value. This measure is the same as MRA, but adherence was
capped at 100%.
| Results |
|---|
|
|
|---|
|
Scenarios of excessive (eg, drug stockpiling),17,28 insufficient, and adequate days' supply (obtaining medication as directed) and a variety of other refill scenarios that occurred in the LOSE Weight study are presented in Tables 2, 3, 4. Exceptions to expected refill patterns occurred in approximately 10% of study participants (eg, refills the day of study completion, filling study drug only once, same-day refills).
|
|
|
| Discussion |
|---|
|
|
|---|
When participant attrition is an issue (Table 2) and in cases of single refills (Table 4), problems are encountered when using the MPRm, RCR, CR, and DBR adherence measures. These 4 measures evaluate the time period between dispensations and either cannot assess or overestimate adherence because of the smaller denominator (between fills instead of study evaluation period).
The denominator time period can contribute to overestimates of adherence. The measures with consistent results all use the total study evaluation period in the denominator. Regardless of how medication use is calculated by these measures, the final result is the same, suggesting that the choice among these 6 measures can be based on preference or data availability. Measures that require multiple analytic steps and additional data fields (eg, gap days) may result in unnecessary work.
CSA can be biased if participants obtain more than one refill per day (Table 3) and if refills occur close to the study completion date (Table 4). Use of CSA can be beneficial, however, for studies with high participant attrition. With CSA, each refill episode is calculated independently; participants who fill only one prescription do not have the same weight in a cumulative analysis as participants who have multiple refills. Although CSA takes each interval into account, the measure truncates the assessment period and does not permit carryover of medication from one refill interval to another, a practice likely to occur in most settings.
CR calculates adherence between dispensations and disregards the assessment period from last dispensation until study completion. This simplifies calculations but assumes adherence is consistent through study completion, and does not consider participants who discontinue medication prior to study completion. It assumes that the last fill is timely for all participants, which is not the case, as we see when applied to these study participant data.
The MPRm attempted to overcome the limitation of the RCR denominator (number of days in interval between first and last dispensation) by adding a number of days to the evaluation period equal to the days' supply obtained at the last dispensation. This reduced the amount of overestimation, but due to assumption of each participant being 100% adherent during the last dispensation period, consistently produced an adherence value higher than that achieved with other measures.
The gap measures (CMG and CMOS) produce similar adherence values; however, because more calculations and data fields are required, they are less attractive. To avoid misinterpretation, the gap and ratio values must be further converted to an adherence percentage.5
The greatest disadvantage with calculating an MPR is that there are at least 4 different published measures that have been termed "MPR."14,16,26,29-31 The use of different measures that carry the same terminology leads to confusion in comparing adherence across studies. When evaluating or comparing what is described as MPR, one should be clear as to what the value represents.
PDC truncates total supply to not exceed the study evaluation period (eg, overall adherence is capped at 100% by subtracting surplus medication from the total days' supply available). When PDC is used or when adherence above 100% is not permitted for MRA, CMA, CMOS, or MPR, these measures, as well as CMG, are all equivalent. PDC is also occasionally calculated for smaller intervals within the study period and averaged similar to CSA.27,32 This may underestimate adherence, as capping adherence at each refill interval does not permit carryover of excess medication from one interval to another.
Accurate calculation of the number of evaluation days is important. One should not select a measure that mandates an end date; the end date should be based on the study design and nature of data collection. In the LOSE Weight study, each participant had specified enrollment and end dates. When using claims databases in which patient-specific end dates are not available, a time frame should be established a priori so that values can be calculated consistently per the study design. One should be cautious in comparing adherence values between studies without a clear understanding of how adherence was calculated, the time frame considered, and how missing values and/or time periods were managed.
The days' supply must be carefully determined in any adherence assessment. When available, it can be calculated by dividing the prescribed dose by the number of pills obtained (eg, 30 tablets twice per day dosage equals 15 days' supply). If the prescribed dosage changes during the study, this must be noted and calculated accordingly. Alternative measures to estimate days' supply are available, such as using standard practice estimates for prescribed dosage assumptions, but these methods are less reliable than using information contained within the administrative data set.
Important features when assessing the usefulness of adherence measures go beyond those associated with the numerator or denominator to include the presentation of the final value, the complexity of the calculations, variables required to perform the calculations, and terminology used when publishing results. The footnotes in Tables 2, 3, 4 indicate the variables required to calculate each adherence measure. It is important to understand data available to researcher when selecting the appropriate adherence measure to assess adherence using administrative data sets.
| Limitations |
|---|
|
|
|---|
| Conclusions |
|---|
|
|
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. A. Chisholm-Burns and C. A. Spivey Pharmacoadherence: A new term for a significant problem Am. J. Health Syst. Pharm., April 1, 2008; 65(7): 661 - 667. [Full Text] [PDF] |
||||
![]() |
E. Mehuys, L. Van Bortel, L. De Bolle, I. Van Tongelen, L. Annemans, J. P. Remon, and G. Brusselle Effectiveness of pharmacist intervention for asthma control improvement Eur. Respir. J., April 1, 2008; 31(4): 790 - 799. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. S. Friedman, H. A. Quigley, L. Gelb, J. Tan, J. Margolis, S. N. Shah, E. E. Kim, T. Zimmerman, and S. R. Hahn Using Pharmacy Claims Data to Study Adherence to Glaucoma Medications: Methodology and Findings of the Glaucoma Adherence and Persistency Study (GAPS) Invest. Ophthalmol. Vis. Sci., November 1, 2007; 48(11): 5052 - 5057. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. P Nau, D. T Steinke, L K. Williams, R. Austin, J. E. Lafata, G. Divine, and M. Pladevall Adherence Analysis Using Visual Analog Scale Versus Claims-Based Estimation Ann. Pharmacother., November 1, 2007; 41(11): 1792 - 1797. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||