Skip to main content

Main menu

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • For authors
    • Instructions for authors
    • Submit a manuscript
    • Author FAQs
    • Open access
    • COVID-19 submission information
  • Alerts
  • Podcasts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • ERJ Early View
  • Past issues
  • For authors
    • Instructions for authors
    • Submit a manuscript
    • Author FAQs
    • Open access
    • COVID-19 submission information
  • Alerts
  • Podcasts
  • Subscriptions

An evaluation of automated chest radiography reading software for tuberculosis screening among public- and private-sector patients

Md Toufiq Rahman, Andrew J. Codlin, Md Mahfuzur Rahman, Ayenun Nahar, Mehdi Reja, Tariqul Islam, Zhi Zhen Qin, Md Abdus Shakur Khan, Sayera Banu, Jacob Creswell
European Respiratory Journal 2017 49: 1602159; DOI: 10.1183/13993003.02159-2016
Md Toufiq Rahman
1International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b), Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew J. Codlin
2Stop TB Partnership, Geneva, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Md Mahfuzur Rahman
1International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b), Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ayenun Nahar
1International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b), Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mehdi Reja
1International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b), Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tariqul Islam
3National Institute of Neurosciences and Hospital, Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhi Zhen Qin
2Stop TB Partnership, Geneva, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Md Abdus Shakur Khan
4National Institute of Diseases of the Chest & Hospital, Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sayera Banu
1International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b), Dhaka, Bangladesh
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacob Creswell
2Stop TB Partnership, Geneva, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: jacobc@stoptb.org
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Computer-aided reading (CAR) of medical images is becoming increasingly common, but few studies exist for CAR in tuberculosis (TB). We designed a prospective study evaluating CAR for chest radiography (CXR) as a triage tool before Xpert MTB/RIF (Xpert).

Consecutively enrolled adults in Dhaka, Bangladesh, with TB symptoms received CXR and Xpert. Each image was scored by CAR and graded by a radiologist. We compared CAR with the radiologist for sensitivity and specificity, area under the receiver operating characteristic curve (AUC), and calculated the potential Xpert tests saved.

A total of 18 036 individuals were enrolled. TB prevalence by Xpert was 15%. The radiologist graded 49% of CXRs as abnormal, resulting in 91% sensitivity and 58% specificity. At a similar sensitivity, CAR had a lower specificity (41%), saving fewer (36%) Xpert tests. The AUC for CAR was 0.74 (95% CI 0.73–0.75). CAR performance declined with increasing age. The radiologist grading was superior across all sub-analyses.

Using CAR can save Xpert tests, but the radiologist's specificity was superior. Differentiated CAR thresholds may be required for different populations. Access to, and costs of, human readers must be considered when deciding to use CAR software. More studies are needed to evaluate CAR using different screening approaches.

Abstract

Automated CXR reading reduces expensive TB test use; differentiated scoring may be needed and costs must be reduced http://ow.ly/jPC8309Rx3F

Introduction

Modelling and research suggest that chest radiography (CXR) can be a good screening tool to identify people in need of further testing to diagnose tuberculosis (TB), especially when the follow-on diagnostic test is expensive [1, 2]. However, although diagnostic testing for TB in high burden settings is generally free, the cost of CXR is almost always borne by the care seeker and can be quite costly [3, 4]. In many settings there is also a dearth of trained staff who can quickly read CXR images, and there is a high degree of inter-reader variability, resulting in both over- and under-diagnosis of TB [5, 6]. These limitations have generated interest in scoring systems for chest radiography [7] as well as a growing awareness of, interest in, and use of computer-aided reading (CAR) software.

CAR software can quickly evaluate digital radiographs to recognise abnormalities in lungs fields to identify people in need of further diagnostic testing. CAR software is already commonplace in mammography services [8], but CAR for identifying TB abnormalities on chest radiographs is still in the development stage. All of the published literature for CAR for TB has evaluated CAD4TB [9], developed by Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the Netherlands. CAD4TB is currently the only commercially available CAR software for TB. Evaluations of CAD4TB in high TB burden countries have been conducted in Africa [10–14] in collaboration with the software's developers. Briefly, CAD4TB identifies shape and textural abnormalities in CXR images to produce an abnormality score ranging from 0 (normal) to 100 (highly abnormal). A cut-off score can be selected, above which people should receive a diagnostic TB test. The optimal cut-off score may depend on the prevalence of abnormal lung images in the screened population and may vary by setting. Given the lack of evidence around its use, no formal guidance from the World Health Organization (WHO) is available advising to which abnormality scores to set the cut-off. The literature evaluating CAD4TB demonstrates the software's sensitivity has improved with each version and that its performance is similar to that of human readers [15].

Smear microscopy is overwhelmingly used as the diagnostic test in most high TB burden countries and is inexpensive [16], but it is not nearly as sensitive as the Xpert MTB/RIF (Xpert) assay [17, 18]. WHO currently recommends Xpert as an initial diagnostic test for TB “where resources permit” [19]. This condition on the recommendation highlights the usefulness of a sensitive triage test (i.e. CXR) to reduce costs by minimising the number of expensive Xpert tests performed [20, 21]. The Xpert assay has a concessional price of USD9.98 for public-sector providers, with shipping and importation costs increasing the cost [22]. There has been much global interest around Xpert [23], with huge increases in procurement of the assay [22].

In many Asian settings, especially in urban areas, most people choose to first access the private healthcare market because it is more convenient and/or is perceived as having a higher standard of care than public facilities [24, 25]. However, private providers are not eligible for concessional pricing, and higher procurement costs are passed onto patients, making the test unaffordable for many people with TB in high burden countries [26]. As a result, most countries have not engaged the private sector for Xpert use [27]. Referral systems for free Xpert testing may be an attractive way to link public- and private-sector providers.

To address the lack of evidence around CAD4TB in Asian settings, and the high use of private-sector care in Asia, we designed a prospective study to link patients visiting private providers and public facilities to Xpert testing and evaluated the performance of CAD4TB software as a triage tool in Dhaka, Bangladesh.

Methods

Study sites

With support from the Stop TB Partnership's TB REACH initiative, three screening centres were established across Dhaka. The screening centres operate as a social enterprise, where any funds generated through the sale of laboratory tests are then used to fund programmatic TB care. A Delft EZ DR X-ray system linked with CAD4TB software version 3.07 was installed in each screening centre, as well as multiple four-module GeneXpert systems. A custom-built mHealth application connected to a medical record system (OpenMRS) systematically captured demographic and symptom data from all individuals visiting the screening centres. A referral network of more than 2000 private providers was established to refer clients for testing services. Any private provider could refer patients from testing to a screening centre for testing based on clinical suspicion. In addition, 133 facilities linked to the National TB Control Program (NTP) were engaged to encourage referral of smear-negative individuals for Xpert testing. The screening centres were also open to walk-in clients with no referral history.

Screening, diagnostic and treatment algorithm

Adults (>15 years) presenting at any of the screening centres were verbally screened for a cough of more than 2 weeks duration as both public- and private-sector referrals were made independently of the study based on the clinical decisions of the referring physicians. Symptomatic individuals paid approximately USD6.40 (BDT 500) for a CXR, which was immediately analysed using CAD4TB software. The cost was on the lower end of the digital CXR market in Dhaka, and Xpert testing and TB care were provided without additional charges. Regardless of the CAD4TB abnormality score, all symptomatic individuals were asked to submit a sputum sample and received a free Xpert test. If the Xpert test failed (invalid, error or no result), it was performed again to obtain a valid outcome if enough sample remained. A Bangladeshi, board-certified radiologist with 10 years of experience read all CXR images offsite at a cost of USD0.50 per image. The radiologist was blinded to both the CAD4TB score and the Xpert result. CXRs were graded as highly TB suggestive, possible signs of TB, non-TB abnormality, and normal. In addition, the radiologist provided a standard radiology report to guide clinical care. Those unable or unwilling to pay for the CXR were referred to a nearby public-sector facility.

People with positive Xpert results were actively referred to the NTP-linked health facility nearest to their home, but were also allowed to receive anti-TB treatment from their private referring physician. If a TB patient opted to receive care with his/her referring physician, treatment initiation and outcomes were reported to the NTP by the study. Individuals with rifampicin-resistant TB were referred to the National Institute of Diseases of the Chest and Hospital for additional testing, clinical evaluation and second-line treatment initiation.

All enrolled participants provided informed written consent. The study protocol was reviewed and approved by the research review committee and the ethical review committee at the International Centre for Diarrhoeal Disease Research, Bangladesh (icddr,b).

Data analysis

De-identified data were abstracted from OpenMRS and analysed using R version 3.2.4 (R Foundation for Statistical Computing, Vienna, Austria). The radiologist's grades were dichotomised with highly suggestive of TB and possible TB grading considered “abnormal”. Basic demographic data, the yields from Xpert testing, and the grading of CXRs by the radiologist and CAD4TB software were compared across age groups and referral groups for people with valid Xpert results. We calculated the sensitivity, specificity, and positive and negative predictive values (PPV and NPV) of the radiologist's grading and different CAD4TB abnormality scores using Xpert as the bacteriological standard. Receiver operating characteristic (ROC) graphs were generated using the pROC package [28]. We calculated the theoretical numbers of Xpert tests saved by using CXR as a triage tool using different CAD4TB cut-off values.

Results

Between May 2014 and February 2016, 18 746 people visited the screening centres and were verbally screened. Only 53 individuals declined to pay for the CXR. Of the remaining, 18 036 symptomatic individuals aged 15 years and over were identified, and 17 134 (95%) of them were able to provide a sputum specimen for testing with Xpert. Among the people tested, 17 066 (99.6%) had a valid Xpert result and were included in the analysis.

The final sample comprised 11 368 (67%) men and 5698 (33%) women. The greatest proportion of test results came from people who were referred by their private provider (n=12 340, 72%), while other referral groups accounted for smaller and similar proportions (table 1). Just over half of participants were aged 26–54 years, and 26% (n=4485) of the participants were aged 55 years or older.

View this table:
  • View inline
  • View popup
TABLE 1

Demographic and clinical characteristics of people screened with chest radiography (CXR) and Xpert MTB/RIF

Overall, 2623 people (15%) had Mycobacterium tuberculosis-positive (MTB+) results. The yield was lowest among walk-ins (8% versus 17% for the other referral groups). Young adults (≤25 years) had the highest rates of TB (22%), while middle age and older groups had yields of 14% and 12%, respectively. Among people with MTB+ results, 139 (5%) were resistant to rifampicin. The radiologist graded 8428 (49%) CXRs as abnormal, overall. The radiologist's CXR abnormality rate was lowest among walk-ins compared to the NTP facility and private provider referrals (27% versus 48% and 54%, respectively). The radiologist also graded a greater proportion of CXRs as abnormal among participants 55 years and older (61% versus 45%). For all participants, the median (interquartile range) CAD4TB abnormality score was 79 (48–95). Walk-ins had the lowest median score (55, interquartile range 37–82). Those 55 years and older had a median CAD4TB score of 93, whereas it was 65 among young adults.

If CXR had been used as a triage tool before Xpert testing, the radiologist's binary grading would have a sensitivity and specificity of 91% and 58% overall (table 2). The sensitivity of the radiologist was around 90% for all groups, while the specificity ranged from 53% (private providers) to 78% (walk-ins). Among older participants, specificity was 43% and among those aged less than 25 years it was 70%. The overall PPV of the radiologist was 28%, and the NPV was 97%. Using CAD4TB to approximate the radiologist's sensitivity for the whole sample, a threshold score of 63 would have been chosen (table 2), and it would have varied from 56 to 82 for the different sub-groups. However, CAD4TB specificity was inferior to the radiologist at each threshold score (for the whole sample it was 41% versus 58%). Specificity of CAD4TB was below the radiologist for all referral types and age groups when holding sensitivity similar. The trade-offs between sensitivity and specificity across the different referral and age groups can be visualised in the ROC graphs in figures 1 and 2. The graphs show that, regardless of the CAD4TB cut-off value, the radiologist performed better across all groups. The area under the curve (AUC) for all referral groups is 0.74 (95% CI 0.73–0.75). The CAD4TB software performed significantly better among walk-ins (AUC 0.84, 95% CI 0.81–0.87) compared to people referred from NTP facilities (AUC 0.77, 95% CI 0.74–0.79) and private providers (AUC 0.72, 95% CI 0.70–0.73). The software also performed significantly better among young adults (AUC 0.81, 95% CI 0.80–0.83) than the older age group (AUC 0.66, 95% CI 0.65–0.69). AUC by gender was not significantly different (data not shown).

View this table:
  • View inline
  • View popup
TABLE 2

Performance and comparison of radiologist and computer automated reading for tuberculosis diagnosis

FIGURE 1
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1

Receiver operating characteristic analysis for the detection of Mycobacterium tuberculosis stratified by referral type.

FIGURE 2
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2

Receiver operating characteristic analysis for the detection of Mycobacterium tuberculosis stratified by age group.

Table 3 presents the results of the analysis of potential Xpert tests saved using different algorithms. Compared to testing all symptomatic individuals with Xpert, using CXR with the human reader could have saved 51% of Xpert tests, with a total loss of 9% (n=249) of the MTB+ cases. To approximate the sensitivity of the radiologist, a CAD4TB threshold score of 63 would be used and it would have saved 36% of the Xpert tests. To save 50% of Xpert tests using CAD4TB, a higher threshold score of 80 would be needed, resulting in 18% (n=473) of MTB+ individuals being missed. Tables of performance of CAD4TB at each threshold and for each referral and age group are presented in the supplementary files.

View this table:
  • View inline
  • View popup
TABLE 3

Performance of different algorithms for Xpert tests saved and cases missed in Bangladesh

Discussion

To our knowledge, this is the first published study to evaluate CAD4TB software in Asia and also the first using a public–private partnership. Our evaluation's sample size was also large. We identified more people with confirmed TB than the combined enrolment of all other published CAD4TB studies to date [15]. CAD4TB software can quickly identify people who require additional diagnostic testing for TB, with small losses in TB detection, and has the potential to save using many Xpert tests. However, the usefulness of CAD4TB will be heavily dependent on the setting and will probably need further improvements in performance and cost reductions to become a useful triage tool in urban Asian settings.

Published studies using CAD4TB have been conducted in Africa, where there are relatively fewer trained radiologists than in Asia [29]. Although a number of studies have shown CAD4TB software to be comparable to a trained human reader [10–14], the radiologist in our study performed better across every referral group, and was less expensive. The use of CAD4TB software as a triage tool in passive case finding in Dhaka (to rule out unnecessary tests) may not be as beneficial as using it as a screening tool to identify people in need of TB testing in rural settings and/or active case-finding approaches where high throughput, the need for quick decisions, and shortages of highly skilled readers are more likely. More prospective studies are needed to evaluate CAD4TB in screening and active case-finding interventions, because all of the published studies have been in populations with TB prevalence ranging from 18% to 60% [7].

To our knowledge, this is also the first published evaluation of the CAD4TB software across different sub-groups. The CAD4TB software performed differently depending on the age of the patient and referral group, which should be further evaluated. It is not surprising that CAD4TB performed worse among older individuals, as they have more time to develop non-TB-related abnormalities. We expect the differences in referral type are probably explained by other factors, but could not identify them through the current analysis. Our findings suggest that, to maximise case detection and Xpert test conservation, differentiated CAD4TB threshold scores may be needed, highlighting the need for piloting the software in each setting to identify the ideal cut-off scores. For instance, a study from Zambia achieved 100% sensitivity by including 83% of the individuals for testing [12], while in our evaluation 99.9% of individuals would need testing to achieve 100% sensitivity (supplementary files).

There are several limitations of our study. We used Xpert, not culture, as the end-point of our diagnostic algorithm, meaning that people with Xpert-negative, culture-positive TB have incorrectly been labelled as TB-free. The available culture facilities could not cope with the specimen throughput, and funds were not available to systematically culture even a sample of those tested. Given the evidence for intra-reader variability [5, 13], future work should evaluate CAD4TB against multiple radiologists with varying experience in reading chest radiographs, as our results included only one reader. We did not test for HIV, but Bangladesh's TB–HIV co-infection rate is estimated to be less than 1% [30]. The entry point for our diagnostic algorithm was TB symptoms, meaning that CXR was not used to detect asymptomatic individuals with TB, who make up the majority of TB cases in recent prevalence surveys [31]. Our sample comprises only people willing to pay for CXR. Although this is certainly a different population than recruited for other CAD4TB evaluation studies, it reflects the reality of health services in many Asian settings where people choose to pay for services [32]. Just 53 people came to the screening centres and decided not to pay. Because patients pay for CXR out of their own pocket (whether attending public or private facilities) in almost every high TB burden country [3, 4], our results may be more representative of populations who receive CXR as a triage tool than studies that provide CXR for free. As with other studies evaluating CAD4TB software, we did not measure the possible beneficial effect that having the CXR results immediately available might have had on dropout in a diagnostic algorithm which otherwise would require multiple visits. This is an area, especially for active case finding/screening interventions, that requires more research, as there may be value in having an immediate decision to access a diagnostic test rather than waiting for a human reader. Finally, we used version 3.07, and the latest software version released after this evaluation (version 5) may provide better results. Future studies should compare the results in different software versions to demonstrate improvements.

There are a number of lessons for those interested in implementing CAD4TB screening and Xpert testing outside a research setting. Offering the clients of private providers the opportunity for a free Xpert test was an excellent incentive to encourage referrals and can be a useful tool for public–private partnerships. There were 39 GeneXpert systems operating in the public sector in Bangladesh during this intervention, yet none were available at a for-profit price, probably due to lack of market. Educating clinicians about the interpretation of the abnormality score is essential. It was difficult to explain to providers that only one in three people with a score of 95 would test MTB+ (supplementary file) when CAD4TB is marketed for TB. The developers of CAD4TB have produced software updates that are compatible with multiple radiography systems, which will allow for wider adoption of the technology. Developing a version for children may be of interest as well, given the low rates of TB case-finding among children globally [30]. The cost of a CAD4TB reading must be low enough to be an attractive option for screening initiatives, as a radiologist report costs around USD0.5 per image read in Bangladesh. Furthermore, if paying clients demand a radiology report and a printed film, it can add costs for implementers, making the running costs of direct digital systems with CAD4TB higher than what has been reported [14]. Finally, newer versions of CAD4TB require an internet connection, and sending CXR images to telemedicine centres for reading may be an alternative depending on costs, turnaround times and reading quality.

Conclusions

In Bangladesh, the CAD4TB software worked on a high quality, direct digital CXR system, and has the potential to quickly screen out a large number of symptomatic individuals who do not need further diagnostic TB tests. If such an algorithm had been employed, it would have resulted in a significant reduction in the number of Xpert tests used. However, the software's overall performance was inferior and more expensive than a highly trained radiologist in this setting. The software may be more useful in high throughput programmes such as active case-finding interventions where a quick decision on further testing is critical, especially if trained readers are scarce and/or costs are high. The next versions' improvements, costs of CAD4TB, and its compatibility with different radiography systems will help determine its usefulness overall.

Supplementary material

Supplementary Material

Please note: supplementary material is not edited by the Editorial Office, and is uploaded as it has been supplied by the author.

Supplementary data ERJ-02159-2016_Supplement

Disclosures

Supplementary Material

S. Banu ERJ-02159-2016_Banu

A.J. Codlin ERJ-02159-2016_Codlin

J. Creswell ERJ-02159-2016_Cresswell

T. Islam ERJ-02159-2016_Islam

M.A.S. Khan ERJ-02159-2016_Khan

A. Nahar ERJ-02159-2016_Nahar

Z.Z. Qin ERJ-02159-2016_Qin

M.M. Rahman ERJ-02159-2016_MM_Rahman

M.T. Rahman ERJ-02159-2016_MT_Rahman

M. Reja ERJ-02159-2016_Reja

Footnotes

  • This article has supplementary material available from erj.ersjournals.com

  • Support statement: This study was supported by the Stop TB Partnership’s TB REACH initiative and was funded by the Government of Canada and UNITAID. Funding information for this article has been deposited with the Crossref Funder Registry.

  • Conflict of interest: Disclosures can be found alongside this article at erj.ersjournals.com

  • Received November 3, 2016.
  • Accepted January 9, 2017.
  • Copyright ©ERS 2017

This ERJ Open article is open access and distributed under the terms of the Creative Commons Attribution Non-Commercial Licence 4.0.

References

  1. ↵
    1. van't Hoog AH,
    2. Onozaki I,
    3. Lonnroth K
    . Choosing algorithms for TB screening: a modelling study to compare yield, predictive value and diagnostic burden. BMC Infect Dis 2014; 14: 532.
    OpenUrlCrossRefPubMed
  2. ↵
    1. Somashekar N,
    2. Chadha VK,
    3. Praseeja P, et al.
    Role of pre-Xpert screening using chest X-ray in early diagnosis of smear-negative pulmonary tuberculosis. Int J Tuberc Lung Dis 2014; 18: 1243–1244.
    OpenUrl
  3. ↵
    1. Pande T,
    2. Pai M,
    3. Khan FA, et al.
    Use of chest radiography in the 22 highest tuberculosis burden countries. Eur Respir J 2015; 46: 1816–1819.
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. Pedrazzoli D,
    2. Lalli M,
    3. Boccia D, et al.
    Can tuberculosis patients in resource-constrained settings afford chest radiography? Eur Respir J 2017 47: 1601877.
    OpenUrl
  5. ↵
    WHO Expert Committee on Tuberculosis. Ninth Report. WHO Technical Report Series, No. 552. Geneva, World Health Organization, 1974.
  6. ↵
    1. Waaler HT
    . Descriptions of the study material and organization of the study. Bull Int Union Tuberc 1968; 41: 110–114.
    OpenUrlPubMed
  7. ↵
    1. Pinto LM,
    2. Pai M,
    3. Dheda K, et al.
    Scoring systems using chest radiographic features for the diagnosis of pulmonary tuberculosis in adults: a systematic review. Eur Respir J 2013; 42: 480–494.
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. Karssemeijer N,
    2. Bluekens AM,
    3. Beijerinck D, et al.
    Breast cancer screening results 5 years after introduction of digital mammography in a population-based screening program. Radiology 2009; 253: 353–358.
    OpenUrlPubMed
  9. ↵
    1. van Ginneken B,
    2. Stegmann MB,
    3. Loog M
    . Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database. Med Image Anal 2006; 10: 19–40.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Breuninger M,
    2. van Ginneken B,
    3. Philipsen RH, et al.
    Diagnostic accuracy of computer-aided detection of pulmonary tuberculosis in chest radiographs: a validation study from sub-Saharan Africa. PloS One 2014; 9: e106381.
    OpenUrlCrossRefPubMed
    1. Maduskar P,
    2. Muyoyeta M,
    3. Ayles H, et al.
    Detection of tuberculosis with digital chest radiography: automatic reading versus interpretation by clinical officers. Int J Tuberc Lung Dis 2013; 17: 1613–1620.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Muyoyeta M,
    2. Maduskar P,
    3. Moyo M, et al.
    The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia. PLoS One 2014; 9: e93757.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Steiner A,
    2. Mangu C,
    3. van den Hombergh J, et al.
    Screening for pulmonary tuberculosis in a Tanzanian prison and computer-aided interpretation of chest X-rays. Public Health Action 2015; 5: 249–254.
    OpenUrl
  13. ↵
    1. Philipsen RHHM,
    2. Sánchez CI,
    3. Maduskar P, et al.
    Automated chest-radiography as a triage for Xpert testing in resource-constrained settings: a prospective study of diagnostic accuracy and costs. Sci Rep 2015; 5: 12215.
    OpenUrl
  14. ↵
    1. Pande T,
    2. Cohen C,
    3. Pai M, et al.
    Computer aided detection of pulmonary tuberculosis on digital chest radiographs: a systematic review. Int J Tuberc Lung Dis 2016; 20: 1226–1230.
    OpenUrl
  15. ↵
    1. Pantoja A,
    2. Fitzpatrick C,
    3. Vassall A, et al.
    Xpert MTB/RIF for diagnosis of TB and drug-resistant TB: a cost and affordability analysis. Eur Respir J 2013; 42: 708–820.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Steingart KR,
    2. Schiller I,
    3. Horne DJ, et al.
    Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev 2014; 1: CD009593.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Steingart KR,
    2. Henry M,
    3. Ng V, et al.
    Fluorescence versus conventional sputum smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis 2006; 6: 570–581.
    OpenUrlCrossRefPubMedWeb of Science
  18. ↵
    World Health Organization. Automated real-time nucleic acid amplification technology for rapid and simultaneous detection of tuberculosis and rifampicin resistance: Xpert MTB/RIF assay for the diagnosis of pulmonary and extra-pulmonary TB in adults and children. Policy update. WHO/HTM/TB/2013.16. Geneva, WHO, 2013.
  19. ↵
    1. Kik SV,
    2. Denkinger CM,
    3. Casenghi M, et al.
    Tuberculosis diagnostics: which target product profiles should be prioritised? Eur Respir J 2014; 44: 537–540.
    OpenUrlFREE Full Text
  20. ↵
    1. Theron G,
    2. Pooran A,
    3. Peter J, et al.
    Do adjunct tuberculosis tests, when combined with Xpert MTB/RIF, improve accuracy and the cost of diagnosis in a resource-poor setting? Eur Respir J 2012; 40: 161–168.
    OpenUrlAbstract/FREE Full Text
  21. ↵
    1. Albert H,
    2. Nathavitharana RR,
    3. Isaacs C, et al.
    Development, roll-out and impact of Xpert MTB/RIF for tuberculosis: what lessons have we learnt and how can we do better? Eur Respir J 2016; 48: 516–525.
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Weyer K,
    2. Mirzayev F,
    3. Migliori GB, et al.
    Rapid molecular TB diagnosis: evidence, policy making and global implementation of Xpert MTB/RIF. Eur Respir J 2013; 42: 252–271.
    OpenUrlAbstract/FREE Full Text
  23. ↵
    1. Hossain S,
    2. Zaman K,
    3. Quaiyum A, et al.
    Care seeking in tuberculosis: results from a countrywide cluster randomised survey in Bangladesh. BMJ Open 2014; 4: e004766.
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Shaikh B,
    2. Hatcher J
    . Health seeking behaviour and health services utilization trends in National Health Survey of Pakistan: what needs to be done? J Pak Med Assoc 2007; 57: 411–414.
    OpenUrlPubMed
  25. ↵
    1. Puri L,
    2. Oghor C,
    3. Denkinger CM, et al.
    Xpert MTB/RIF for tuberculosis testing: access and price in highly privatised health markets. Lancet Glob Health 2016; 4: e94–e95.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Qin ZZ,
    2. Pai M,
    3. Van Gemert W, et al.
    How is Xpert MTB/RIF being implemented in 22 high tuberculosis burden countries? Eur Respir J 2015; 45: 549–554.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Robin X,
    2. Turck N,
    3. Hainard A, et al.
    pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011; 12: 77.
    OpenUrlCrossRefPubMed
  28. ↵
    WHO. The World Health Report 2006: Working Together for Health. Geneva, WHO, 2006.
  29. ↵
    World Health Organization. Global Tuberculosis Report 2015. WHO/HTM/TB/2015.22. Geneva, WHO, 2015. Available from: http://who.int/tb/publications/global_report/en/
  30. ↵
    1. Onozaki I,
    2. Law I,
    3. Sismanidis C, et al.
    National tuberculosis prevalence surveys in Asia, 1990–2012: an overview of results and lessons learned. Trop Med Int Health 2015; 20: 1128–1145.
    OpenUrlCrossRefPubMed
  31. ↵
    1. Wells WA,
    2. Ge CF,
    3. Patel N, et al.
    Size and usage patterns of private TB drug markets in the high burden countries. PLoS One 2011; 6: e18964.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top
View this article with LENS
Vol 49 Issue 5 Table of Contents
European Respiratory Journal: 49 (5)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
An evaluation of automated chest radiography reading software for tuberculosis screening among public- and private-sector patients
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Alerts
Sign In to Email Alerts with your Email Address
Citation Tools
An evaluation of automated chest radiography reading software for tuberculosis screening among public- and private-sector patients
Md Toufiq Rahman, Andrew J. Codlin, Md Mahfuzur Rahman, Ayenun Nahar, Mehdi Reja, Tariqul Islam, Zhi Zhen Qin, Md Abdus Shakur Khan, Sayera Banu, Jacob Creswell
European Respiratory Journal May 2017, 49 (5) 1602159; DOI: 10.1183/13993003.02159-2016

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Share
An evaluation of automated chest radiography reading software for tuberculosis screening among public- and private-sector patients
Md Toufiq Rahman, Andrew J. Codlin, Md Mahfuzur Rahman, Ayenun Nahar, Mehdi Reja, Tariqul Islam, Zhi Zhen Qin, Md Abdus Shakur Khan, Sayera Banu, Jacob Creswell
European Respiratory Journal May 2017, 49 (5) 1602159; DOI: 10.1183/13993003.02159-2016
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Abstract
    • Introduction
    • Methods
    • Results
    • Discussion
    • Supplementary material
    • Disclosures
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Subjects

  • Respiratory infections and tuberculosis
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

Original Articles

  • The impact of COVID-19 on patients with asthma
  • FEV1 decline and cardiovascular disease in COPD
  • HIF2α-ARNT hetero-dimerisation as a therapeutic strategy for PAH
Show more Original Articles

Tuberculosis

  • Centralised assays for detection of TB and drug resistance
  • Rifampicin-resistant TB cure rates and severe ototoxicity prevention
  • Whole genome sequencing for MTB in Europe
Show more Tuberculosis

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About the ERJ

  • Journal information
  • Editorial board
  • Reviewers
  • CME
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Submit a manuscript
  • ERS author centre

For readers

  • Alerts
  • Subjects
  • Podcasts
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Print ISSN:  0903-1936
Online ISSN: 1399-3003

Copyright © 2021 by the European Respiratory Society