Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions

Statistical compared to clinical significance and the risk of misattribution

Nicholas T. Vozoris, Peter C. Austin, Paula A. Rochon
European Respiratory Journal 2018 52: 1801868; DOI: 10.1183/13993003.01868-2018
Nicholas T. Vozoris
1Division of Respirology, Dept of Medicine, St Michael's Hospital, Toronto, ON, Canada
2Keenan Research Centre in the Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, ON, Canada
3Dept of Medicine, University of Toronto, Toronto, ON, Canada
4Institute for Clinical Evaluative Sciences, Toronto, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter C. Austin
4Institute for Clinical Evaluative Sciences, Toronto, ON, Canada
5Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paula A. Rochon
3Dept of Medicine, University of Toronto, Toronto, ON, Canada
4Institute for Clinical Evaluative Sciences, Toronto, ON, Canada
5Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, ON, Canada
6Women's College Research Institute, Women's College Hospital, Toronto, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • PDF
Loading

Abstract

Propensity score matching and stratification are methods that help minimise the risk of confounding and misattribution in observational studies http://ow.ly/DY0n30mrtQF

From the authors:

We thank M. Ekström and colleagues for their interest in our study [1] and for their comments. The central concepts that M. Ekström and colleagues express in their correspondence are that our findings of increased respiratory-related morbidity and mortality in association with new serotonergic antidepressant use among older adults with chronic obstructive pulmonary disease (COPD) “likely reflect the underlying illness(es) and other unmeasured factors rather than an actual drug effect”.

Regarding the possibility of underlying COPD severity or the presence of psychiatric disease or other comorbidity accounting for the increased morbidity and mortality observed among new users of serotonergic antidepressants, it is important for M. Ekström and colleagues to recognise that we used propensity score matching methods in our study, which resulted in the balancing of multiple markers of COPD severity (including the frequency and recency of prior COPD exacerbation, duration of COPD and receipt of COPD medications) between treated and control individuals. Furthermore, balance was induced between treated and control individuals on the presence of psychotic and non-psychotic psychiatric disease and on 11 additional comorbidity categories (in addition to the Johns Hopkins Adjusted Clinical Group, which is a validated measure of patient morbidity burden). Furthermore, we undertook several sensitivity analyses, whose purpose was to help further minimise the possibility of underlying illness severity influencing findings. We evaluated our outcomes stratifying by COPD exacerbation frequency history, which is known to be the strongest predictor of COPD morbidity [2]. We found significantly elevated rates of all-cause mortality among new users of serotonergic antidepressants, who had no previous COPD exacerbation, which would be the healthiest COPD subgroup and least likely to be influenced by confounding by indication. We also evaluated our outcomes in a sensitivity analysis where new tricyclic antidepressant users formed the control group (see the online supplementary material for our article [1]), because serotonergic antidepressants and tricyclic antidepressants have similar prescribing indications. Compared to new tricyclic antidepressant users, we observed significantly increased rates of hospital admission for COPD or pneumonia, COPD or pneumonia-related mortality and all-cause mortality among new serotonergic antidepressant users. In contrast to what M. Ekström and colleagues have written, the fact that increased rates of respiratory-related morbidity and mortality were observed among the subgroup of new serotonergic antidepressant users without pre-existing psychiatric disease (which is likely to be a healthier subgroup of individuals, compared to those with established psychiatric disease) again minimises the chances that our findings are influenced by confounding by indication. Finally, the fact that we used new drug receipt (but not of a serotonergic antidepressant) to define inclusion into the control group also helped serve to decrease the likelihood of underlying unstable health potentially explaining any differences observed between the exposed and control groups.

Regarding unmeasured factors not included in our propensity score model influencing our results, we acknowledged this possibility in our article [1]. However, for our findings to be “likely” to be explained by this possibility, as M. Ekström and colleagues have written, is simply speculation on their part. M. Ekström and colleagues offer no evidence to support the premise that, had additional covariates been adjusted for in our analysis, this would have been “likely” to have rendered our positive findings nonsignificant. It is also not clear how some of the unmeasured factors they listed, like alcohol consumption and dietary status, if indeed different between the exposed and control groups, would have possibly contributed to increased COPD-related morbidity and mortality. M. Ekström and colleagues also incorrectly list socioeconomics and smoking exposure as variables uncontrolled for in our analysis. In our propensity score model, several markers of socioeconomic status were included, as was receipt of smoking cessation pharmacotherapy within the previous year (which is a proxy measure for recent cigarette smoke exposure).

M. Ekström and colleagues write that using a similar observational study design to that which we have used, one might naturally find spurious, negative associations between established treatments for COPD (e.g. inhalers) and COPD outcomes, since receipt of treatment is related to underlying illness and underlying illness influences outcomes. However, this assertion is contradicted by a number of published observational studies evaluating the real-world effectiveness of combination versus single-agent inhaler therapy among individuals with COPD, where combination inhaler therapy (which may be more likely to be given to individuals with more symptomatic or unstable COPD, compared with a single-agent inhaler) was not found to be associated with increased rates of negative respiratory outcomes compared with single-agent inhaler therapy [3–5].

We agree with the concluding comment of M. Ekström and colleagues that further research is warranted (both in the form of randomised, placebo-controlled clinical trials and real-world observational studies) to more fully understand the potential benefits and harms of serotonergic antidepressants in the COPD population. It worth noting, however, that randomised clinical trials to date have failed to demonstrate that serotonergic antidepressant drugs are beneficial for either depression and anxiety [6–8], or refractory dyspnoea [8–10], among individuals with COPD.

Footnotes

  • Conflict of interest: N.T. Vozoris has nothing to disclose.

  • Conflict of interest: P.C. Austin has nothing to disclose.

  • Conflict of interest: P.A. Rochon has nothing to disclose.

  • Received October 2, 2018.
  • Accepted October 4, 2018.
  • Copyright ©ERS 2018

References

  1. ↵
    1. Vozoris NT,
    2. Wang X,
    3. Austin PC, et al.
    Serotonergic antidepressant use and morbidity and mortality among older adults with COPD. Eur Respir J 2018; 52: 1800475.
    OpenUrlAbstract/FREE Full Text
  2. ↵
    1. Hurst JR,
    2. Vestbo J,
    3. Anzueto A, et al.
    Susceptibility to exacerbation in chronic obstructive pulmonary disease. N Engl J Med 2010; 363: 1128–1138.
    OpenUrlCrossRefPubMedWeb of Science
  3. ↵
    1. Gershon AS,
    2. Campitelli MA,
    3. Croxford R, et al.
    Combination long-acting β-agonists and inhaled corticosteroids compared with long-acting β-agonists alone in older adults with chronic obstructive pulmonary disease. JAMA 2014; 312: 1114–1121.
    OpenUrlCrossRefPubMedWeb of Science
    1. Trudo F,
    2. Kern DM,
    3. Davis JR, et al.
    Comparative effectiveness of budesonide/formoterol combination and tiotropium bromide among COPD patients new to these controller treatments. Int J Chron Obstruct Pulmon Dis 2015; 10: 2055–2066.
    OpenUrl
  4. ↵
    1. Cho KH,
    2. Kim YS,
    3. Linton JA, et al.
    Effects of inhaled corticosteroids/long-acting agonists in a single inhaler versus inhaled corticosteroids alone on all-cause mortality, pneumonia, and fracture in chronic obstructive pulmonary disease: a nationwide cohort study 2002–2013. Respir Med 2017; 130: 75–84.
    OpenUrl
  5. ↵
    1. Usmani ZA,
    2. Carson KV,
    3. Cheng JN, et al.
    Pharmacological interventions for the treatment of anxiety disorders in chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2011; 11: CD008483.
    OpenUrlPubMed
    1. Evans M,
    2. Hammond M,
    3. Wilson K, et al.
    Placebo-controlled treatment trial of depression in elderly physically ill patients. Int J Geriatr Psychiatry 1997; 12: 817–824.
    OpenUrlCrossRefPubMedWeb of Science
  6. ↵
    1. Lacasse Y,
    2. Beaudoin L,
    3. Rousseau L, et al.
    Randomized trial of paroxetine in end-stage COPD. Monaldi Arch Chest Dis 2004; 61: 140–147.
    OpenUrlPubMed
    1. Eiser N,
    2. Harte R,
    3. Spiros K, et al.
    Effect of treating depression on quality-of-life and exercise tolerance in severe COPD. COPD 2005; 2: 233–241.
    OpenUrlCrossRef
  7. ↵
    1. Yohannes AM,
    2. Connolly MJ,
    3. Baldwin RC
    . A feasibility study of antidepressant drug therapy in depressed elderly patients with chronic obstructive pulmonary disease. Int J Geriatr Psychiatry 2001; 16: 451–454.
    OpenUrlCrossRefPubMedWeb of Science
PreviousNext
Back to top
View this article with LENS
Vol 52 Issue 5 Table of Contents
European Respiratory Journal: 52 (5)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Statistical compared to clinical significance and the risk of misattribution
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Statistical compared to clinical significance and the risk of misattribution
Nicholas T. Vozoris, Peter C. Austin, Paula A. Rochon
European Respiratory Journal Nov 2018, 52 (5) 1801868; DOI: 10.1183/13993003.01868-2018

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Statistical compared to clinical significance and the risk of misattribution
Nicholas T. Vozoris, Peter C. Austin, Paula A. Rochon
European Respiratory Journal Nov 2018, 52 (5) 1801868; DOI: 10.1183/13993003.01868-2018
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Footnotes
    • References
  • Info & Metrics
  • PDF
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

Agora

  • Airway immune responses to COVID-19 vaccination in COPD patients
  • Wider access to rifapentine-based regimens is needed for TB care globally
  • Screening for PVOD in heterozygous EIF2AK4 variant carriers
Show more Agora

Correspondence

  • Reply to questions about FEV1Q and bronchodilator responsiveness
  • FEV1Q: it may be useful, but is it helpful?
  • Improving pulmonary function test interpretation
Show more Correspondence

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2023 by the European Respiratory Society