Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • For authors
    • Instructions for authors
    • Submit a manuscript
    • Author FAQs
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • For authors
    • Instructions for authors
    • Submit a manuscript
    • Author FAQs
  • Alerts
  • Podcasts
  • Subscriptions

No need for pulmonologists to interpret pulmonary function tests

Christophe Delclaux
European Respiratory Journal 2019 54: 1900829; DOI: 10.1183/13993003.00829-2019
Christophe Delclaux
AP-HP, Hôpital Robert Debré, Service de Physiologie Pédiatrique – Centre Pédiatrique des Pathologies du Sommeil, Paris, FranceUniversité Paris Diderot, Sorbonne Paris Cité, Faculté de Médecine, Paris, FranceINSERM – UMR1141, Paris, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: christophe.delclaux@aphp.fr
  • Article
  • Info & Metrics
  • PDF
Loading

Abstract

The interpretation of pulmonary function tests can be easily automated, but whether artificial intelligence is warranted for diagnosis remains open to debate, even if this aid seems already available http://bit.ly/2x93kQB

The interpretation of pulmonary function tests (PFTs) is an everyday task for every pulmonologist. This interpretation relies on simple rules that were standardised in 2005 by the American Thoracic Society (ATS)/European Respiratory Society (ERS) task force [1]. This task force pointed out that the definition of abnormal patterns (obstructive, restrictive, and mixed defects) would logically be based on a statistical approach; namely, an obstructive defect is a forced expiratory volume in 1 s (FEV1)/vital capacity (VC) ratio <5th percentile (or a z-score of FEV1 <−1.645) and a restrictive defect is a total lung capacity (TLC) <5th percentile (or a z-score of TLC <−1.645). It must be emphasised that hyperinflation was not defined by the task force, probably due to the difficulty in reaching a common definition for both static and dynamic hyperinflations. Computers can easily make these functional diagnoses based on the availability of z-scores, but one may wonder if it is necessary given the simple rules of interpretation. Thus, almost 100% of pulmonologists would give a correct PFT interpretation, at least in university centres that are responsible for medical student teaching. However, it must be pointed out that a FEV1/VC ratio <5th percentile is not necessarily abnormal; it is only atypical because 5% of the normal subjects exhibit this atypical feature. It is up to the physician interpreting the functional exploration to provide this kind of nuance depending on the clinical context. These interpretation difficulties have previously been discussed by some authors [2].

To arrive at a disease diagnosis, the results of PFTs are combined with patient information, symptoms and, often, the results of other tests. A Belgian study demonstrated that expert panels could reach 77% accuracy when predicting the diagnosis based on PFTs and clinical history alone [3]. Interestingly, in the latter study, the authors also demonstrated the added value of spirometry of airway resistance, static lung volumes, and diffusing capacity of the lung for carbon monoxide measurements to obtain the final diagnosis of patients with respiratory symptoms [3]. It stresses that experts were able to distinguish subtle abnormalities or combinations of abnormalities that are probably poorly described by the simplified algorithm of assessing lung function in clinical practice given by the ATS/ERS task force [1]. This issue is an avenue for artificial intelligence. The success of deep learning has been shown mainly in problems with inputs of image data, as shown in medical image analysis, speech recognition and board game playing. In pulmonary medicine, artificial intelligence has been used to diagnose respiratory sounds, which may be useful given the large interobserver variability of auscultation diagnosis [4, 5]. More recently, in the same Belgian pulmonary function study, investigators showed that while the ATS/ERS algorithm resulted in a correct diagnostic label in 38% of their 968 subjects, an unbiased machine learning framework integrating lung function with clinical variables improved the general accuracy to 68% [6]. Nevertheless, deep learning lacks explanatory power; deep neural networks cannot explain how a diagnosis is reached and the features enabling discrimination are not easily identifiable [7]. Replacing the doctor with an intelligent medical robot is a recurring theme in science fiction; whether it adds value in the interpretation of PFTs remains open to debate.

The study by Topalovic et al. [8], reported in a recent issue of the European Respiratory Journal, demonstrates that their artificial intelligence-based software perfectly matched the PFT pattern interpretations (100%) and assigned a correct diagnosis in 82% of all cases, while pattern recognition of PFTs by pulmonologists matched the guidelines in 74.4% of the cases and correct diagnoses were made in 44.6% of the cases.

The first issue deals with PFT pattern interpretation. There is no need for artificial intelligence to ensure a 100% pattern recognition that is based on a simple algorithm. More surprisingly, pulmonologists were not able to reach such a success rate, even in university centres. It stresses that a lot of the pulmonologists do not apply the 2005 ATS/ERS recommendations, which is in accordance with their inability to apply other guidelines [9–11]. Overall, it may be an argument to support the use of the artificial intelligence system that knows that a FEV1/FVC z-score <−1.64 is obstructive and a TLC z-score <−1.64 is restrictive. When looking more precisely at the results of this study, the authors show that out of the misclassified normal patterns falsely labelled as an obstructive pattern, 76% were related to four cases having an FEV1/FVC ratio just above the normal limits but still below the 0.70 fixed cut-off for positive labelling. It emphasises that the arbitrary definition of chronic obstructive pulmonary disease (FEV1/FVC <0.70 after bronchodilation) proposed by the Global Initiative for Chronic Obstructive Lung Disease consensus is a source of confusion for many pulmonologists, which may seem expected. The study also demonstrates that the identification of a restrictive pattern was a more difficult task, which emphasises that the 2005 definition is not used by most pulmonologists. So, a software analysis may be warranted because it may seem unrealistic to assume that the rules of PFT interpretation will be correctly applied by 100% of the pulmonologists. Another complementary approach to improve compliance is by regularly disseminating information about these “new” rules through relevant journals [12, 13].

Finally, it should be interesting to assess whether the interpretation given by the software is correct in classical traps of PFTs such as the small airway obstructive pattern. This pattern, as emphasised by the ATS/ERS task force, is defined by a concomitant decrease (z-scores <−1.645) in FEV1 and VC with a normal FEV1/VC ratio (z-score ≥1.645) while static lung volumes, measured by plethysmography, are normal or even increased (z-scores >+1.645) [1]. Again, computers will be able to make this diagnosis based on z-scores, which is not uncommon in a PFT unit [14], and that is another argument to support additional software analysis for more difficult diagnoses. Moreover, software analysis might further standardise the classification of defect severities according to the ATS/ERS recommendations [1], which was not investigated in the study by Topalovic et al. [8]. One may hypothesise that pulmonologists do not comply with the recommended classification of these defect severities.

The second issue deals with the clinical diagnosis; the artificial intelligence-based software assigned a correct diagnosis in 82% of all cases, which is the rate previously obtained by experts in Belgium [3], as compared to a ∼45% success rate for pulmonologists in this study. Nevertheless, as stated by the authors “the further usefulness of the artificial intelligence software will be demonstrated if it decreases the time to final diagnosis, reduces the number of tests needed for a final diagnosis and, if by standardising PFT interpretation, a number of misdiagnoses can be avoided.” Like everyone, I wondered what this artificial intelligence software would bring me in my daily practice, knowing that most of the time, I practice PFTs in the framework of pathologies already identified and so they are rarely diagnostic. In addition, the diagnostic problem in pulmonary medicine rarely arises in the face of PFT results alone since other tests are often required for the final diagnosis.

Over the past decade, machine learning techniques have made substantial advances in many domains. There have been suggestions that machine learning will drive changes in healthcare within a few years, specifically in medical disciplines that require more accurate prognostic models and those based on pattern recognition, such as radiology and pathology. Nevertheless, a major issue related to the incorporation of artificial intelligence aids in medicine could be the overreliance on the capabilities of automation. Although the phenomenon of overreliance on technology could be tempting to users in the short term for the convenience and efficiency of automated aids, in the long term these tools can lead to the related phenomenon of de-skilling. When some or all components of a task are partly automated then there is a consequent reduction in the level of skills required to complete the task, and this may lead to serious disruptions of performance or inefficiencies whenever the technology fails or breaks down.

As a consequence, is pattern recognition by software useful? I would respond yes, because of the inability of all pulmonologists to learn the rules of interpretation. However, is clinical diagnosis aided by artificial intelligence warranted? I would respond that making a diagnosis after a single set of PFTs is not the main issue. Certainly, artificial intelligence will perform better than pulmonologists in suggesting a diagnosis, but its ability to reach the final diagnosis more rapidly or more efficiently remains to be demonstrated.

At this time, artificial intelligence commands a certain level of fascination in the medical world; there is no medical field that seems to escape it. In the field of pulmonary medicine, the future challenge for artificial intelligence is to answer complex clinical questions that are real healthcare issues.

Footnotes

  • Conflict of interest: C. Delclaux has nothing to disclose.

  • Received April 26, 2019.
  • Accepted May 29, 2019.
  • Copyright ©ERS 2019
https://www.ersjournals.com/user-licence

References

  1. ↵
    1. Pellegrino R,
    2. Viegi G,
    3. Brusasco V, et al.
    Interpretative strategies for lung function tests. Eur Respir J 2005; 26: 948–968.
    OpenUrlFREE Full Text
  2. ↵
    1. Berry CE,
    2. Wise RA
    . Interpretation of pulmonary function test: issues and controversies. Clin Rev Allergy Immunol 2009; 37: 173–180.
    OpenUrlPubMed
  3. ↵
    1. Decramer M,
    2. Janssens W,
    3. Derom E, et al.
    Contribution of four common pulmonary function tests to diagnosis of patients with respiratory symptoms: a prospective cohort study. Lancet Respir Med 2013; 1: 705–713.
    OpenUrl
  4. ↵
    1. Pasterkamp H,
    2. Kraman SS,
    3. Wodicka GR
    . Respiratory sounds: advances beyond the stethoscope. Am J Respir Crit Care Med 1997; 156: 974–987.
    OpenUrlCrossRefPubMedWeb of Science
  5. ↵
    1. Bokov P,
    2. Mahut B,
    3. Flaud P, et al.
    Wheezing recognition algorithm using recordings of respiratory sounds at the mouth in a pediatric population. Comput Biol Med 2016; 70: 40–50.
    OpenUrl
  6. ↵
    1. Topalovic M,
    2. Laval S,
    3. Aerts J-M, et al.
    Automated interpretation of pulmonary function tests in adults with respiratory complaints. Respiration 2017; 93: 170–178.
    OpenUrl
  7. ↵
    1. Tarassenko L,
    2. Watkinson P
    . Artificial intelligence in health care: enabling informed care. Lancet 2018; 391: 1260.
    OpenUrl
  8. ↵
    1. Topalovic M,
    2. Das N,
    3. Burgel P-R, et al.
    Artificial intelligence outperforms pulmonologists in the interpretation of pulmonary function tests. Eur Respir J 2019; 53: 1801660.
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Visentin E,
    2. Nieri D,
    3. Vagaggini B, et al.
    An observation of prescription behaviors and adherence to guidelines in patients with COPD: real world data from October 2012 to September 2014. Curr Med Res Opin 2016; 32: 1493–1502.
    OpenUrl
    1. Burgel P-R,
    2. Deslée G,
    3. Jebrak G, et al.
    Real-life use of inhaled corticosteroids in COPD patients versus the GOLD proposals: a paradigm shift in GOLD 2011? Eur Respir J 2014; 43: 1201–1203.
    OpenUrlFREE Full Text
  10. ↵
    1. Grimshaw JM,
    2. Thomas RE,
    3. MacLennan G, et al.
    Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004; 8: iii–iv, 1–72.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Similowski T,
    2. Straus C
    . [Pulmonary function testing: dissemination in French of the European recommendations]. Rev Mal Respir 2007; 24: 2S5–2S7.
    OpenUrlPubMed
  12. ↵
    1. Bokov P,
    2. Delclaux C
    . [Interpretation and use of routine pulmonary function tests: spirometry, static lung volumes, lung diffusion, arterial blood gas, methacholine challenge test and 6-minute walk test]. Rev Médecine Interne 2016; 37: 100–110.
    OpenUrl
  13. ↵
    1. Chevalier-Bidaud B,
    2. Gillet-Juvin K,
    3. Callens E, et al.
    Non specific pattern of lung function in a respiratory physiology unit: causes and prevalence: results of an observational cross-sectional and longitudinal study. BMC Pulm Med 2014; 14: 148.
    OpenUrlPubMed
View Abstract
PreviousNext
Back to top
View this article with LENS
Vol 54 Issue 1 Table of Contents
European Respiratory Journal: 54 (1)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
No need for pulmonologists to interpret pulmonary function tests
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
Print
Alerts
Sign In to Email Alerts with your Email Address
Citation Tools
No need for pulmonologists to interpret pulmonary function tests
Christophe Delclaux
European Respiratory Journal Jul 2019, 54 (1) 1900829; DOI: 10.1183/13993003.00829-2019

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
No need for pulmonologists to interpret pulmonary function tests
Christophe Delclaux
European Respiratory Journal Jul 2019, 54 (1) 1900829; DOI: 10.1183/13993003.00829-2019
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Footnotes
    • References
  • Info & Metrics
  • PDF
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

  • Downregulation of PRMT1 for long-lasting effects of bronchial thermoplasty
  • ERS and tobacco harm reduction
  • ARIA guidelines: digital transformation of health in rhinitis and asthma
Show more Editorials

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • CME
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Submit a manuscript
  • ERS author centre

For readers

  • Alerts
  • Subjects
  • Collections
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2019 by the European Respiratory Society