The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia

PLoS One. 2014 Apr 4;9(4):e93757. doi: 10.1371/journal.pone.0093757. eCollection 2014.

Abstract

Objective: To determine the sensitivity and specificity of a Computer Aided Diagnosis (CAD) program for scoring chest x-rays (CXRs) of presumptive tuberculosis (TB) patients compared to Xpert MTB/RIF (Xpert).

Method: Consecutive presumptive TB patients with a cough of any duration were offered digital CXR, and opt out HIV testing. CXRs were electronically scored as normal (CAD score ≤ 60) or abnormal (CAD score > 60) using a CAD program. All patients regardless of CAD score were requested to submit a spot sputum sample for testing with Xpert and a spot and morning sample for testing with LED Fluorescence Microscopy-(FM).

Results: Of 350 patients with evaluable data, 291 (83.1%) had an abnormal CXR score by CAD. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of CXR compared to Xpert were 100% (95%CI 96.2-100), 23.2% (95%CI 18.2-28.9), 33.0% (95%CI 27.6-38.7) and 100% (95% 93.9-100), respectively. The area under the receiver operator curve (AUC) for CAD was 0.71 (95%CI 0.66-0.77). CXR abnormality correlated with smear grade (r = 0.30, p<0.0001) and with Xpert CT(r = 0.37, p<0.0001).

Conclusions: To our knowledge this is the first time that a CAD program for TB has been successfully tested in a real world setting. The study shows that the CAD program had high sensitivity but low specificity and PPV. The use of CAD with digital CXR has the potential to increase the use and availability of chest radiography in screening for TB where trained human resources are scarce.

Publication types

  • Evaluation Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Area Under Curve
  • Humans
  • Image Interpretation, Computer-Assisted / methods*
  • Mass Chest X-Ray / methods*
  • Microscopy, Fluorescence
  • Mycobacterium tuberculosis / isolation & purification
  • Predictive Value of Tests
  • ROC Curve
  • Sensitivity and Specificity
  • Sputum / microbiology
  • Tuberculosis, Pulmonary / diagnosis*
  • Tuberculosis, Pulmonary / diagnostic imaging
  • Tuberculosis, Pulmonary / epidemiology*
  • Zambia / epidemiology

Grants and funding

Funding sources: T9-370-114 World Health Organization through the stop TB partnership-TB REACH wave 2 grant. http://www.stoptb.org,/global/awards/tbreach/grantees2.asp, Sub grant- Delft Imaging systems-CAD4TBII, http://www.delftimagingsystems.com/tb-solutions/cad4tb. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.