A critical evaluation of the methodology of the literature on medication compliance

OBJECTIVE: To develop a simple evaluation tool to assess methodologic rigor of the literature on patient compliance with medications, and to apply the tool to a sample of the literature. METHODS: A computerized search of the MEDLINE database (January 1980-December 1996) was performed. All English-language articles on compliance with medications were identified, using the MeSH terms patient-compliance and drug-therapy. A 10% sample was then randomly selected for review. Methodologic rigor was assessed on eight standards: study design, specification of patient sample, power analysis, specification of disease, specification of therapeutic regimen, duration of follow-up, definition of compliance, and compliance measurement. The raw scores of the eight standards were then combined in three summary scores, standardized from 0 to 100: study design, disease-related features, and compliance issues. RESULTS: Seventy-two articles from 719 identified were reviewed. The majority of the research articles were descriptive (63.9%), and patients in these studies were selected mainly from a convenience sample (41.7%). Just nine studies were multicenter studies, and three employed power analysis. The compliance definition was replicable in 41.7% of the studies. In 22 articles neither the compliance measure nor the criteria were stated. One-quarter of the studies (18) used a nonvalidated measure of compliance. Only two studies reached a score of 6 in the compliance measure, and eight studies used two different measures of compliance simultaneously. The median values in the summary scores were: study design 8.3, disease 42.9, compliance issues 50. CONCLUSIONS: The quality of the compliance research was generally poor. These low scores reflect very important shortcomings in the methodology. Such oversights make it difficult for the reader to critically assess the validity of the conclusions.

This article has been cited by other articles:

				L. Palmieri, K. Bennett, S. Giampaoli, and S. Capewell Explaining the Decrease in Coronary Heart Disease Mortality in Italy Between 1980 and 2000 Am J Public Health, April 1, 2010; 100(4): 684 - 692. [Abstract] [Full Text] [PDF]

				T. F. Boat Insights From Trends in Biomedical Research Funding JAMA, January 13, 2010; 303(2): 170 - 171. [Full Text] [PDF]

				A. L. Pai and D. Drotar Treatment Adherence Impact: The Systematic Assessment and Quantification of the Impact of Treatment Adherence on Pediatric Medical and Psychological Outcomes J. Pediatr. Psychol., August 26, 2009; (2009) jsp073v1. [Abstract] [Full Text] [PDF]

				L. Bjorck, A. Rosengren, K. Bennett, G. Lappas, and S. Capewell Modelling the decreasing coronary heart disease mortality in Sweden between 1986 and 2002 Eur. Heart J., May 1, 2009; 30(9): 1046 - 1056. [Abstract] [Full Text] [PDF]

				K. Applbaum `Consumers are Patients!' Shared Decision-making and Treatment Non-compliance as Business Opportunity Transcultural Psychiatry, March 1, 2009; 46(1): 107 - 130. [Abstract] [PDF]

				E. S. Ford, U. A. Ajani, J. B. Croft, J. A. Critchley, D. R. Labarthe, T. E. Kottke, W. H. Giles, and S. Capewell Explaining the Decrease in U.S. Deaths from Coronary Disease, 1980-2000 N. Engl. J. Med., June 7, 2007; 356(23): 2388 - 2398. [Abstract] [Full Text] [PDF]

				S. Kripalani, X. Yao, and R. B. Haynes Interventions to Enhance Medication Adherence in Chronic Medical Conditions: A Systematic Review Arch Intern Med, March 26, 2007; 167(6): 540 - 549. [Abstract] [Full Text] [PDF]

				Z. Kabir, K. Bennett, E. Shelley, B. Unal, J. Critchley, J. Feely, and S. Capewell The population mortality benefits of maximizing the number of eligible patients receiving appropriate cardiology treatments in Ireland QJM, August 1, 2006; 99(8): 523 - 530. [Abstract] [Full Text] [PDF]

				K. Andersson, A. Melander, C. Svensson, O. Lind, and J. L. G. Nilsson Repeat prescriptions: refill adherence in relation to patient and prescriber characteristics, reimbursement level and type of medication Eur J Public Health, December 1, 2005; 15(6): 621 - 626. [Abstract] [Full Text] [PDF]

				T. Laatikainen, J. Critchley, E. Vartiainen, V. Salomaa, M. Ketonen, and S. Capewell Explaining the Decline in Coronary Heart Disease Mortality in Finland between 1982 and 1997 Am. J. Epidemiol., October 15, 2005; 162(8): 764 - 773. [Abstract] [Full Text] [PDF]

				R. A Elliott, N. Barber, and R. Horne Cost-Effectiveness of Adherence-Enhancing Interventions: A Quality Assessment of the Evidence Ann. Pharmacother., March 1, 2005; 39(3): 508 - 515. [Abstract] [Full Text] [PDF]

				L. N Takiya, A. M Peterson, and R. S Finley Meta-Analysis of Interventions for Medication Adherence to Antihypertensives Ann. Pharmacother., October 1, 2004; 38(10): 1617 - 1624. [Abstract] [Full Text] [PDF]

				J. Critchley, J. Liu, D. Zhao, W. Wei, and S. Capewell Explaining the Increase in Coronary Heart Disease Mortality in Beijing Between 1984 and 1999 Circulation, September 7, 2004; 110(10): 1236 - 1244. [Abstract] [Full Text] [PDF]

				B. Unal, J. A. Critchley, and S. Capewell Explaining the Decline in Coronary Heart Disease Mortality in England and Wales Between 1981 and 2000 Circulation, March 9, 2004; 109(9): 1101 - 1107. [Abstract] [Full Text] [PDF]

				S. D. Halpern, J. H. T. Karlawish, and J. A. Berlin The Continuing Unethical Conduct of Underpowered Clinical Trials JAMA, July 17, 2002; 288(3): 358 - 362. [Abstract] [Full Text] [PDF]

				A. H. Partridge, J. Avorn, P. S. Wang, and E. P. Winer Adherence to Therapy With Oral Antineoplastic Agents J Natl Cancer Inst, May 1, 2002; 94(9): 652 - 661. [Abstract] [Full Text] [PDF]

				S. PAMPALLONA, P. BOLLINI, G. TIBALDI, B. KUPELNICK, and C. MUNIZZA Patient adherence in the treatment of depression The British Journal of Psychiatry, February 1, 2002; 180(2): 104 - 109. [Abstract] [Full Text] [PDF]

				B. J. Turner and F. M. Hecht Improving on a Coin Toss To Predict Patient Adherence to Medications Ann Intern Med, May 15, 2001; 134(10): 1004 - 1006. [Full Text] [PDF]

				S. Capewell, R. Beaglehole, M. Seddon, and J. McMurray Explanation for the Decline in Coronary Heart Disease Mortality Rates in Auckland, New Zealand, Between 1982 and 1993 Circulation, September 26, 2000; 102(13): 1511 - 1516. [Abstract] [Full Text] [PDF]

				G. L Anderson and R. L Prentice Individually randomized intervention trials for disease prevention and control Statistical Methods in Medical Research, August 1, 1999; 8(4): 287 - 309. [Abstract] [PDF]