Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Open access
    • COVID-19 submission information
    • Peer reviewer login
  • Alerts
  • Podcasts
  • Subscriptions

Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs

Ju Gang Nam, Minchul Kim, Jongchan Park, Eui Jin Hwang, Jong Hyuk Lee, Jung Hee Hong, Jin Mo Goo, Chang Min Park
European Respiratory Journal 2020; DOI: 10.1183/13993003.03061-2020
Ju Gang Nam
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Minchul Kim
3Lunit Incorporated, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jongchan Park
3Lunit Incorporated, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eui Jin Hwang
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jong Hyuk Lee
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jung Hee Hong
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jin Mo Goo
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
4Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chang Min Park
1Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
2College of Medicine, Seoul, Republic of Korea
4Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: cmpark.morphius@gmail.com
  • Article
  • Info & Metrics
  • PDF
Loading

Abstract

We aimed to develop a deep-learning algorithm detecting 10 common abnormalities (DLAD-10) on chest radiographs and to evaluate its impact in diagnostic accuracy, timeliness of reporting, and workflow efficacy.

DLAD-10 was trained with 146 717 radiographs from 108 053 patients using a ResNet34-based neural network with lesion-specific channels for 10 common radiologic abnormalities (pneumothorax, mediastinal widening, pneumoperitoneum, nodule/mass, consolidation, pleural effusion, linear atelectasis, fibrosis, calcification, and cardiomegaly). For external validation, the performance of DLAD-10 on a same-day CT-confirmed dataset (normal:abnormal, 53:147) and an open-source dataset (PadChest; normal:abnormal, 339:334) was compared to that of three radiologists. Separate simulated reading tests were conducted on another dataset adjusted to real-world disease prevalence in the emergency department, consisting of four critical, 52 urgent, and 146 non-urgent cases. Six radiologists participated in the simulated reading sessions with and without DLAD-10.

DLAD-10 exhibited areas under the receiver-operating characteristic curves (AUROCs) of 0.895–1.00 in the CT-confirmed dataset and 0.913–0.997 in the PadChest dataset. DLAD-10 correctly classified significantly more critical abnormalities (95.0% [57/60]) than pooled radiologists (84.4% [152/180]; p=0.01). In simulated reading tests for emergency department patients, pooled readers detected significantly more critical (70.8% [17/24] versus 29.2% [7/24]; p=0.006) and urgent (82.7% [258/312] versus 78.2% [244/312]; p=0.04) abnormalities when aided by DLAD-10. DLAD-10 assistance shortened the mean time-to-report critical and urgent radiographs (640.5±466.3 versus 3371.0±1352.5 s and 1840.3±1141.1 versus 2127.1±1468.2, respectively; p-values<0.01) and reduced the mean interpretation time (20.5±22.8 versus 23.5±23.7 s; p<0.001).

DLAD-10 showed excellent performance, improving radiologists' performance and shortening the reporting time for critical and urgent cases.

Footnotes

This manuscript has recently been accepted for publication in the European Respiratory Journal. It is published here in its accepted form prior to copyediting and typesetting by our production team. After these production processes are complete and the authors have approved the resulting proofs, the article will move to the latest issue of the ERJ online. Please open or download the PDF to view this article.

Conflict of interest: Dr. NAM reports grants from National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (MSIT) (grant number: NRF-2018R1A5A1060031), grants from Seoul National University Hospital Research Fund (grant number: 03-2019-0190), during the conduct of the study.

Conflict of interest: Dr. Kim reports other from Employee of Lunit Incorporated, during the conduct of the study.

Conflict of interest: Dr. Park reports grants from National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (MSIT) (grant number: NRF-2018R1A5A1060031), grants from Seoul National University Hospital Research Fund (grant number: 03-2019-0190), during the conduct of the study.

Conflict of interest: Dr. Hwang has nothing to disclose.

Conflict of interest: Dr. Lee has nothing to disclose.

Conflict of interest: Dr. Hong has nothing to disclose.

Conflict of interest: Dr. Goo has nothing to disclose.

Conflict of interest: Dr. Park reports grants from National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (MSIT) (grant number: NRF-2018R1A5A1060031), grants from Seoul National University Hospital Research Fund (grant number: 03-2019-0190), during the conduct of the study.

  • Received August 7, 2020.
  • Accepted November 3, 2020.
  • Copyright ©ERS 2020
View Full Text

ERS Members

myERS - ERS members : log in with your myERS username and password.

INDIVIDUALS

Log in Login as an individual user.

Forgot your username or password?

LIBRARY USERS

Log in through your institution

If your library has a subscription, you may already be logged in via your IP address. Otherwise you may be able to log in via one of the following routes.
You may be able to gain access using your login credentials for your institution. Contact your library if you do not have a username and password.
If your organization uses OpenAthens, you can log in using your OpenAthens username and password. To check if your institution is supported, please see this list. Contact your library for more details.
If you think you should have access, please contact your librarian or email journals@ersnet.org

Purchase access

You may purchase access to this article. This will require you to create an account if you don't already have one.
PreviousNext
Back to top
View this article with LENS
Vol 59 Issue 5 Table of Contents
European Respiratory Journal: 59 (5)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs
Ju Gang Nam, Minchul Kim, Jongchan Park, Eui Jin Hwang, Jong Hyuk Lee, Jung Hee Hong, Jin Mo Goo, Chang Min Park
European Respiratory Journal Jan 2020, 2003061; DOI: 10.1183/13993003.03061-2020

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs
Ju Gang Nam, Minchul Kim, Jongchan Park, Eui Jin Hwang, Jong Hyuk Lee, Jung Hee Hong, Jin Mo Goo, Chang Min Park
European Respiratory Journal Jan 2020, 2003061; DOI: 10.1183/13993003.03061-2020
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
  • Info & Metrics
  • PDF

Subjects

  • Lung imaging
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

  • Lung volumes and survival in chronic lung allograft dysfunction
  • Prior CV disease and mortality COPD pneumonia patients
  • Factors associated with FEV1 decline in CF
Show more Original article

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2022 by the European Respiratory Society