Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • ERS Guidelines
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • ERS Guidelines
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Subscriptions

Number needed to treat: enigmatic results for exacerbations in COPD

Samy Suissa
European Respiratory Journal 2016 47: 354-355; DOI: 10.1183/13993003.01449-2015
Samy Suissa
Centre for Clinical Epidemiology, Lady Davis Institute – Jewish General Hospital, and Dept of Epidemiology and Biostatistics, McGill University, Montreal, QC, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: samy.suissa@mcgill.ca
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

“Event-based” numbers needed to treat, such as those from the TORCH trial, should be used with extreme caution http://ow.ly/U31OH

From the author:

S. Lettis and O. Keene raise questions about my paper on some misleading uses of the number needed to treat (NNT) for study outcomes such as chronic obstructive pulmonary disease (COPD) exacerbations. Certainly, when dealing with recurrent events such as exacerbations, it is statistically more informative to analyse all events with tools such as incidence rates, rate ratios and rate differences. However, some critical assumptions about the rates are essential to obtain valid estimates of these measures and, consequently, a valid estimate of the NNT.

Indeed, the underlying rates, estimated by the total number of exacerbations divided by the total time of follow-up, provide a mean number of exacerbations per year, such as two exacerbations per year over, for example, the 3-year follow-up of a trial. However, the statistics behind the estimation of this rate, be it the Poisson or negative binomial distribution, require that the rate be constant over the 3-year follow-up, which entails that the rate of two per year applies equally in the first, second and third year of follow-up. If not, rate differences may differ across the follow-up time and the resulting event-based NNT, computed by inverting the overall rate differences, will simply be incorrect.

My paper used the example of the 3-year Towards a Revolution in COPD Health (TORCH) trial to show why the reported NNT of 4 to prevent one exacerbation in 1 year is misleading [1]. A reader of the TORCH paper would logically understand this statement to mean that treatment of four patients for 1 year (any 1 year: the first, the last, etc.) leads to the prevention of one exacerbation. However, this is not the case. Indeed, it was quite arbitrary that the TORCH trial was a 3-year rather than, say, a 1-year trial. My paper shows that had TORCH been conducted as a 1-year trial, it would have reported a NNT of 0.5 to prevent one exacerbation in 1 year, not the NNT of 4. Moreover, the paper shows that the NNT to prevent one exacerbation with 6 months of treatment is 0.5 patients during the first 6 months in TORCH, while it is 20 patients during the last 6 months.

S. Lettis and O. Keene agree that the exacerbation rate clearly changes over time in TORCH and in other such COPD trials. They argue that, because of differential discontinuation, the patient characteristics are no longer the same after the first year of the TORCH trial and, therefore, the NNT for years 2 and 3 are incorrect, with only the NNT for the first year being correct. This is certainly a valid point. However, this argument could have been extended to equally contend that, for the very same reasons, the overall NNT based on pooling the 3 years together must therefore also be incorrect as the patients are no longer comparable over time.

Such deliberations illustrate well the problems with the “event-based” NNT, which was precisely the point of my paper, namely to raise awareness that using this event-based approach to compute an NNT of 4 to prevent one exacerbation in 1 year can be misleading if the underlying assumptions are not satisfied. For the same reasons, the NNTs of 0.5 and 20 patients during the first and last 6 months in TORCH, respectively, are also incorrect. However, a robust solution is simply to use the time to the first exacerbation to compute the NNT for 1 year to prevent an exacerbation, a clearer and more valid approach. The NNT can be easily estimated from the Kaplan–Meier curve of the cumulative incidence of the first exacerbation and computed for any treatment duration [2, 3].

S. Lettis and O. Keene also bring up the issue of using the NNT in a benefit–risk context, such as exacerbations versus pneumonias in COPD. Besides the arguments against the lax use of the event-based NNT described above, even the proper use of the NNT in this context requires additional precaution. For example, one must be careful when using the NNT in comparing milder exacerbations mostly treated as outpatients with more severe pneumonias that generally require hospitalisation in this age group [4]. A more rigorous use of this approach would be to compare like with like, namely to compare COPD exacerbations with pneumonias that are both treated as outpatients, that both require hospitalisation or that are both fatal.

Finally, I thank the authors for noting the mislabelling of columns in the tables. In all, while the NNT can be a useful measure of impact when computed properly, it can also result in misleading values when underlying statistical assumptions are not satisfied, such as the reported NNT of 4 to prevent one exacerbation in 1 year in the 3-year TORCH trial. Use with caution.

Footnotes

  • Conflict of interest: Disclosures can be found alongside the online version of this article at erj.ersjournals.com

  • Received August 31, 2015.
  • Accepted September 3, 2015.
  • Copyright ©ERS 2016

References

  1. ↵
    1. Suissa S
    . Number needed to treat: enigmatic results for exacerbations in COPD. Eur Respir J 2015; 45: 875–878.
    OpenUrlAbstract/FREE Full Text
  2. ↵
    1. Suissa S
    . Number needed to treat in COPD: exacerbations versus pneumonias. Thorax 2013; 68: 540–543.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    1. Suissa S
    . Author's response to letter on number needed to treat in COPD: exacerbations versus pneumonias. Thorax 2013; 68: 882–883.
    OpenUrlFREE Full Text
  4. ↵
    1. Cates C
    . Inhaled corticosteroids in COPD: quantifying risks and benefits. Thorax 2013; 68: 499–500.
    OpenUrlFREE Full Text
PreviousNext
Back to top
View this article with LENS
Vol 47 Issue 1 Table of Contents
European Respiratory Journal: 47 (1)
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Number needed to treat: enigmatic results for exacerbations in COPD
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Number needed to treat: enigmatic results for exacerbations in COPD
Samy Suissa
European Respiratory Journal Jan 2016, 47 (1) 354-355; DOI: 10.1183/13993003.01449-2015

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Number needed to treat: enigmatic results for exacerbations in COPD
Samy Suissa
European Respiratory Journal Jan 2016, 47 (1) 354-355; DOI: 10.1183/13993003.01449-2015
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Subjects

  • COPD and smoking
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

Agora

  • Airway immune responses to COVID-19 vaccination in COPD patients
  • Wider access to rifapentine-based regimens is needed for TB care globally
  • Screening for PVOD in heterozygous EIF2AK4 variant carriers
Show more Agora

Correspondence

  • Clinical outcomes of bronchiectasis in India
  • Reply: Clinical outcomes of bronchiectasis in India
  • Risk factors for disease progression in fibrotic hypersensitivity pneumonitis
Show more Correspondence

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2023 by the European Respiratory Society