Numbers-needed-to-treat analyses--do timing, dropouts, and outcome matter? Pooled analysis of two randomized, placebo-controlled chronic low back pain trials.
Numbers-needed-to-treat (NNT) are useful for presenting treatment response, conveying the clinical relevance of results. NNTs are typically calculated at a landmark endpoint (end of trial), but often using the last observation carried forward (LOCF), which ignores patient discontinuations. We compared NNTs in chronic low back pain (CLBP) using three separate imputation methods, using data from two identical 12-week trials comparing etoricoxib 60 mg (N=210), 90 mg (N=212), and placebo (N=217). We calculated the number of patients with improvements in pain intensity from baseline of ≥15%, ≥30%, ≥50%, and ≥70% at 2, 4, 8, and 12 weeks of treatment. For longitudinal response over time, patient discontinuations were assigned a 0% improvement from dropout forward. Landmark response at week 12 was assessed using LOCF and completer approaches, using only observed (non-missing) data. The longitudinal approach was most conservative; after 12 weeks 65% of patients taking etoricoxib had ≥15% improvement, 60% had ≥30% improvement, 45% had ≥50%, improvement, and 30% had ≥70% improvement, with placebo rates approximately 55%, 45%, 30%, and 15%, respectively. Response rates were higher with landmark analyses. Landmark NNTs at week 12 were generally similar or slightly lower (better) than those from a longitudinal approach, but results were inconsistent. Landmark analyses provide no information on response variability, as is obtained with longitudinal analysis. Outcome, imputation method, and reporting method are intimately connected and need to be considered alongside trial quality and validity to make sensible comparisons between treatments.
Moore
Andrew R
AR
Pain Research and Nuffield Department of Anaesthetics, University of Oxford, Oxford, UK Merck Research Laboratories, Rahway, NJ, USA.
Smugar
Steven S
SS
Wang
Hongwei
H
Peloso
Paul M
PM
Gammaitoni
Arnold
A
D000328:Adult; D000368:Aged; D000698:Analgesia; D002908:Chronic Disease / Q000628:therapy; D004311:Double-Blind Method; D005260:Female; D006801:Humans; D057194:Intention to Treat Analysis; D017116:Low Back Pain / Q000628:therapy*; D008297:Male; D008875:Middle Aged; D010352:Patient Dropouts / Q000706:statistics & numerical data*; D016032:Randomized Controlled Trials as Topic / Q000706:statistics & numerical data*; D016896:Treatment Outcome
Akobeng AK. Communicating the benefits and harms of treatments. Arch Dis Child. 2008;93:710-713.
Anderson JJ, Baron G, van der HD, Felson DT, Dougados M. Ankylosing spondylitis assessment group preliminary definition of short-term improvement in ankylosing spondylitis. Arthritis Rheum. 2001;44:1876-1886.
Austin PC, Mamdani MM, Juurlink DN, Hux JE. Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health. J Clin Epidemiol. 2006;59:964-969.
Bingham CO III, Smugar SS, Wang H, Tershakovec AM. Early response to COX-2 inhibitors as a predictor of overall response in osteoarthritis: pooled results from two identical trials comparing etoricoxib, celecoxib and placebo. Rheumatology. 2009;48:1122-1127.
Birbara CA, Puopolo AD, Munoz DR, Sheldon EA, Mangione A, Bohidar NR, Geba GP. Treatment of chronic low back pain with etoricoxib, a new cyclo-oxygenase-2 selective inhibitor: improvement in pain and disability – a randomized, placebo-controlled, 3-month trial. J Pain. 2003;4:307-315.
Citrome L. Compelling or irrelevant? Using number needed to treat can help decide. Acta Psychiatr Scand. 2008;117:412-419.
Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, Haythornthwaite JA, Jensen MP, Kerns RD, Ader DN, Brandenburg N, Burke LB, Cella D, Chandler J, Cowan P, Dimitrova R, Dionne R, Hertz S, Jadad AR, Katz NP, Kehlet H, Kramer LD, Manning DC, McCormick C, McDermott MP, McQuay HJ, Patel S, Porter L, Quessy S, Rappaport BA, Rauschkolb C, Revicki DA, Rothman M, Schmader KE, Stacey BR, Stauffer JW, von Stein T, White RE, Witter J, Zavisic S. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008;9:105-121.
Felson DT, Anderson JJ, Boers M, Bombardier C, Furst D, Goldsmith C, Katz LM, Lightfoot R Jr, Paulus H, Strand V. American College of Rheumatology. Preliminary definition of improvement in rheumatoid arthritis. Arthritis Rheum. 1995;38:727-735.
Furst DE. Are there differences among nonsteroidal antiinflammatory drugs? Comparing acetylated salicylates, nonacetylated salicylates, and nonacetylated nonsteroidal antiinflammatory drugs. Arthritis Rheum. 1994;37:1-9.
Grotle M, Brox JI, Vollestad NK. Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain. Spine. 2004;29:E492-E501.
Grotle M, Brox JI, Vollestad NK. Functional status and disability questionnaires: what do they assess? A systematic review of back-specific outcome questionnaires. Spine. 2005;30:130-140.
Hoffman DL, Sadosky A, Dukes EM, Alvir J. How do changes in pain severity levels correspond to changes in health status and function in patients with painful diabetic peripheral neuropathy? Pain. 2010;149:194-201.
Huskisson EC, Woolf DL, Balme HW, Scott J, Franklin S. Four new anti-inflammatory drugs: responses and variations. Brit Med J. 1976;1:1048-1049.
Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2:e124.
Kopec JA, Richardson CG, Llewellyn-Thomas H, Klinkhoff A, Carswell A, Chalmers A. Probabilistic threshold technique showed that patients’ preferences for specific trade-offs between pain relief and each side effect of treatment in osteoarthritis varied. J Clin Epidemiol. 2007;60:929-938.
Laupacis A, Sackett DL, Roberts RS. An assessment of clinically useful measures of the consequences of treatment. New Engl J Med. 1988;318:1728-1733.
Leucht S, Engel RR, Bauml J, Davis JM. Is the superior efficacy of new generation antipsychotics an artifact of LOCF? Schizophr Bull. 2007;33:183-191.
Liu-Seifert H, Zhang S, D'Souza D, Skljarevski V. A closer look at the baseline-observation-carried-forward (BOCF). Patient Prefer Adhere. 2010;4:11-16.
Machado LA, Kamper SJ, Herbert RD, Maher CG, McAuley JH. Analgesic effects of treatments for non-specific low back pain: a meta-analysis of placebo-controlled randomized trials. Rheumatology. 2009;48:520-527.
McQuay HJ, Moore RA. Using numerical results from systematic reviews in clinical practice. Ann Int Med. 1997;126:712-720.
Moore RA, Derry S, McQuay HJ. Fraud or flawed: adverse impact of fabricated or poor quality research. Anaesthesia. 2010;65:327-330.
Moore RA, Eccleston C, Derry C, Wiffen P, Bell RF, Straube S, McQuay HJ, and for the ACTINPAIN writing group of the IASP Special Interest Group (SIG) on Systematic Reviews in Pain Relief and the Cochrane Pain, Palliative and Supportive Care Systematic Review Group editors. “Evidence” in chronic pain – establishing best practice in the reporting of systematic reviews. Pain 2010;150:386-389.
Moore RA, Gavaghan D, Tramèr MR, Collins SL, McQuay HJ. Size is everything – large amounts of information are needed to overcome random effects in estimating direction and magnitude of treatment effects. Pain. 1998;78:209-216.
Moore RA, Moore OA, Derry S, Peloso PM, Gammaitoni AR, Wang H. Responder analysis for pain relief and numbers needed to treat in a meta-analysis of etoricoxib osteoarthritis trials: bridging a gap between clinical trials and clinical practice. Ann Rheum Dis. 2010;69:374-379.
Moore RA, Straube S, Derry S, McQuay HJ. Chronic low back pain analgesic studies – a methodological minefield. Pain. 2010;149:431-434.
Moore RA, Straube S, Paine J, Phillips CJ, Derry S, McQuay HJ. Fibromyalgia: moderate and substantial pain intensity reduction predicts improvement in other outcomes and substantial quality of life gain. Pain. 2010;149:360-364.
O'Brien EM, Staud RM, Hassinger AD, McCulloch RC, Craggs JG, Atchison JW, Price DD, Robinson ME. Patient-centered perspective on treatment outcomes in chronic pain. Pain Med. 2010;11:6-15.
Ostelo RW, Deyo RA, Stratford P, Waddell G, Croft P, Von Korff M, Bouter LM, de Vet HC. Interpreting change scores for pain and functional status in low back pain: towards international consensus regarding minimal important change. Spine. 2008;33:90-94.
Pallay RM, Seger W, Adler JL, Ettlinger RE, Quaidoo EA, Lipetz R, O'Brien K, Mucciola L, Skalky CS, Petruschke RA, Bohidar NR, Geba GP. Etoricoxib reduced pain and disability and improved quality of life in patients with chronic low back pain: a 3 month, randomized, controlled trial. Scand J Rheumatol. 2004;33:257-266.
Pham T, van der HD, Altman RD, Anderson JJ, Bellamy N, Hochberg M, Simon L, Strand V, Woodworth T, Dougados M. OMERACT-OARSI initiative: Osteoarthritis Research Society International set of responder criteria for osteoarthritis clinical trials revisited. Osteoarthr Cartilage. 2004;12:389-399.
Preston SJ, Arnold MH, Beller EM, Brooks PM, Buchanan WW. Variability in response to nonsteroidal anti-inflammatory analgesics: evidence from controlled clinical therapeutic trial of flurbiprofen in rheumatoid arthritis. Br J Clin Pharmacol. 1988;26:759-764.
Simon LS, Evans C, Katz N, Bombardier C, West C, Robbins J, Copley-Merriman C, Markman J, Coombs JH. Preliminary development of a responder index for chronic low back pain. J Rheumatol. 2007;34:1386-1391.
Tramer MR, Walder B. Number needed to treat (or harm). World J Surg. 2005;29:576-581.
Wen L, Badgett R, Cornell J. Number needed to treat: a descriptor for weighing therapeutic options. Am J Health Syst Pharm. 2005;62:2031-2036.