Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions

Statistical compared to clinical significance and the risk of misattribution

Magnus Ekström, Miriam J. Johnson, David C. Currow
European Respiratory Journal 2018 52: 1801723; DOI: 10.1183/13993003.01723-2018
Magnus Ekström
1Dept of Clinical Sciences, Division of Respiratory Medicine and Allergology, Lund University, Lund, Sweden
2IMPACCT, Faculty of Health, University of Technology Sydney, Ultimo, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Miriam J. Johnson
3Wolfson Palliative Care Research Centre, Hull York Medical School, University of Hull, Hull, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David C. Currow
2IMPACCT, Faculty of Health, University of Technology Sydney, Ultimo, Australia
3Wolfson Palliative Care Research Centre, Hull York Medical School, University of Hull, Hull, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • PDF
Loading

Abstract

Observational analyses of putative drug effects, including a recent on antidepressants and increased mortality in COPD, may be biased, should be interpreted sceptically and often need to be confirmed by randomised data to change practice. http://ow.ly/oh5030m9Q9I

To the Editor:

We read with interest the observational analysis by Vozoris et al. [1] of the putative association between the prescription of new antidepressants (selective serotonin reuptake inhibitors (SSRIs) or serotonin-noradrenaline reuptake inhibitors (SNRIs)), and hospitalisation and mortality in people with a diagnosis of chronic obstructive pulmonary disease (COPD). In this nonrandomised analysis of administrative health data, people who got a new prescription of these antidepressants faced a worse prognosis including a 26% increase in pneumonia-related mortality and a 20% higher risk of death from all causes [1]. This analysis used similar methodology as previous papers on benzodiazepines and opioids and shares the same important shortcomings [2, 3].

The associations between antidepressant prescription and increased hospitalisation and mortality likely reflect the underlying illness(es) and other unmeasured factors rather than an actual drug effect; the authors acknowledge the general inability of observational studies to establish causative relationships. This analysis, therefore, does not support the authors' conclusions that these findings “should prompt prescribers to consider the potential for increased respiratory-related morbidity and mortality in SSRI/SNRI prescribing decision making” [4].

People who have a clinical encounter which results in a prescription for antidepressants are likely to differ from those who do not in important ways. The severity of underlying illness, in this case both of COPD or anxiety/depression, and the indication for the drug treatment are recognised as key confounders [5], neither of which can be controlled for in this dataset. In addition, data were unavailable on other important factors such as smoking exposure, lung function, alcohol consumption, socioeconomics, symptoms, dietary status and behaviours including fitness and activity. We acknowledge that the authors did what can be done to control for the limited factors available, but excluding people with a reimbursed palliative care consultation in a health system where only 5% of all decedents from COPD have a palliative care consultation [6] is clearly insufficient. The risk of death or hospitalisation is not equal for all people included in this cohort study. The findings of the study, therefore, reflect an association between expected deaths and symptom interventions offered to people with symptomatic life-limiting disease. In light of this, the moderately higher rates of hospitalisation and death in people with treatment is no surprise.

That the findings are related to confounding is supported by the fact that the increased risks disappeared when analysed only in people with diagnosed psychiatric illness. The reason for this is more likely better adjustment for underlying illness (confounding) than a biological rationale. There was also no dose–response relationship. Of note, the large number of participants in the study increases precision but does not affect confounding, risking yielding a more precise estimate of a spurious association [7].

We are not suggesting that observational studies of potential drug effects should be avoided. However, crucial factors must be considered in the design and interpretation of these studies such as the pre-likelihood of a true effect (in line with a Baysian approach), the size of the effects, and the ability of the study to control for key confounders such as severity of the illness(es) related to the treatment and outcomes (both benefits and harms). The risk of confounding in observational studies is high when the treatment is strongly related to underlying illnesses which, in turn, have strong relationships with the studied outcomes. Using a similar design as in the present study, one may find substantial negative associations between treatment of any serious and distressing symptom and clinical outcomes, e.g. for bronchodilators for airflow limitation, for starting pulmonary rehabilitation, for use of mobility aids and even for smoking cessation. Confounding is likely for all palliative interventions given to relieve symptoms in the setting of advancing disease.

We agree with the authors' statement that “absolute adverse event rates of our positive outcomes are relatively small, and therefore may not be clinically significant or they may not have remained positive had additional covariates been controlled for.” The clinician (as well as other people) should remain sceptical, interpret the findings in the light of pre-likelihood of true effect and the risk of residual confounding, and await further evaluation of net-benefit using randomised data where possible before changing clinical practice.

Footnotes

  • Conflict of interest: M. Ekström has nothing to disclose.

  • Conflict of interest: M.J. Johnson reports institutional fees for clinical advisor role from Mayne Pharma, during the conduct of the study.

  • Conflict of interest: D.C. Currow reports an unrestricted research grant from Mundipharma, is an unpaid member of an advisory board for Helsinn Pharmaceuticals, and has consulted Specialist Therapeutics and Mayne Pharma and received intellectual property payments from Mayne Pharma.

  • Received September 10, 2018.
  • Accepted September 11, 2018.
  • Copyright ©ERS 2018

References

  1. ↵
    1. Vozoris NT,
    2. Wang X,
    3. Austin PC, et al.
    Serotonergic antidepressant use and morbidity and mortality among older adults with COPD. Eur Respir J 2018; 52: 1800475.
    OpenUrlAbstract/FREE Full Text
  2. ↵
    1. Vozoris NT,
    2. Fischer HD,
    3. Wang X, et al.
    Benzodiazepine drug use and adverse respiratory outcomes among older adults with COPD. Eur Respir J 2014; 44: 332–340.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    1. Vozoris NT,
    2. Wang X,
    3. Fischer HD, et al.
    Incident opioid drug use and adverse respiratory outcomes among older adults with COPD. Eur Respir J 2016; 8: 683–693.
    OpenUrl
  4. ↵
    1. Agoritsas T,
    2. Merglen A,
    3. Shah ND, et al.
    Adjusted analyses in studies addressing therapy and harm. Users’ guides to the medical literature. JAMA 2017; 317: 748–759.
    OpenUrl
  5. ↵
    1. Norgaard M,
    2. Ehrenstein V,
    3. Vandenbroucke JP
    . Confounding in observational studies based on large health care databases: problems and potential solutions – a primer for the clinician. Clin Epidemiol 2017; 9: 185–193.
    OpenUrl
  6. ↵
    1. Gershon AS,
    2. Maclagan LC,
    3. Luo J, et al.
    End of life strategies among patients with advanced chronic obstructive pulmonary disease (COPD). Am J Respir Crit Care Med 2018; in press [https://doi.org/10.1164/rccm.201803-0592OC].
  7. ↵
    1. Kaplan RM,
    2. Chambers DA,
    3. Glasgow RE
    . Big data and large sample size: a cautionary note on the potential for bias. Clin Transl Sci 2014; 7: 342–346.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top
View this article with LENS
Vol 52 Issue 5 Table of Contents
European Respiratory Journal: 52 (5)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Statistical compared to clinical significance and the risk of misattribution
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Statistical compared to clinical significance and the risk of misattribution
Magnus Ekström, Miriam J. Johnson, David C. Currow
European Respiratory Journal Nov 2018, 52 (5) 1801723; DOI: 10.1183/13993003.01723-2018

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Statistical compared to clinical significance and the risk of misattribution
Magnus Ekström, Miriam J. Johnson, David C. Currow
European Respiratory Journal Nov 2018, 52 (5) 1801723; DOI: 10.1183/13993003.01723-2018
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Footnotes
    • References
  • Info & Metrics
  • PDF
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

Agora

  • Airway immune responses to COVID-19 vaccination in COPD patients
  • Wider access to rifapentine-based regimens is needed for TB care globally
  • Screening for PVOD in heterozygous EIF2AK4 variant carriers
Show more Agora

Correspondence

  • Clinical outcomes of bronchiectasis in India
  • Reply: Clinical outcomes of bronchiectasis in India
  • Risk factors for disease progression in fibrotic hypersensitivity pneumonitis
Show more Correspondence

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2023 by the European Respiratory Society