Copyright ©ERS Journals Ltd 2001 Observer variation in computed tomography of pleural lesions in subjects exposed to indoor asbestos1 Laboratory of Pneumology and 2 Dept of Radiology, U.Z. Gasthuisberg, Katholieke Universiteit Leuven, leuven, Belgium, 3 Dept of Radiology, University Hospital Erasme, Université Libre de Bruxelles, Brussels, Belgium, 4 Centre de Radiologie de l'Avenue de Tervuren, Brussels, Belgium, 5 IDEWE Occupational Health Services, Leuven, Belgium and 6 Dept of Occupational Medicine, Katholieke Universiteit Leuven, Leuven, Belgium CORRESPONDENCE: B. Nemery, Laboratory of Pneumology, Katholieke Universiteit Leuven, Herestraat, 49, B-3000, Leuven, Belgium. Fax: 32 16347124 Keywords: computed tomography, observer agreement, pleural lesions, indoor asbestos exposure
Received: May 26, 2000
This study was funded by The Commission of the European Union and by IDEWE.
To assess the reliability of computed tomography (CT) in detecting discrete pleural lesions, the interobserver and intra-observer variability in reading the conventional and high-resolution CT (HRCT) scans of 100 volunteers, who had worked for 10 yrs in a building with known asbestos contamination, was evaluated. In the first session, pleural abnormalities were detected by a single radiologist (A1) in 13 subjects. In the second session, the scans were read again independently by the same radiologist (A2) and two other experienced radiologists (B, C). The final decision for the presence of pleural lesions was made in a final consensus reading.
This gave a diagnosis of pleural abnormalities in 18 subjects, of whom eight (44%) had been detected by all three readers, five (28%) by two readers and four (22%) by only one reader; one scan, rated normal by all readers during the second session, was reconsidered because pleural abnormalities had been noted at the first reading (A1). The intra-observer agreement for reader A was good (kappa ( In conclusion, when looking for the prevalence of pleural lesions in indoor asbestos exposed subjects, the potential lack of consistency in reporting the presence of small pleural abnormalities must be borne in mind and strict precautions must be taken. Pleural plaques are a marker of prior asbestos exposure 1. However, when assessing the prevalence of pleural changes due to asbestos exposure, the observer variation has been reported to be considerably high when using radiology 2, 3. This observer variation might be even more pronounced in the detection of minor pleural lesions, which can occur after low or environmental exposure 4. Inter- and intra-observer variation in disciplines such as radiology and pathology is a well-known phenomenon that complicates clinical diagnosis, epidemiological studies and medico-legal evaluation 5, 6. To the authors' knowledge, the inter- and intra-observer variability for the computed tomography (CT) evaluation of discrete pleural changes in relation to asbestos exposure has not been reported previously. Such minor pleural lesions do not produce symptoms nor will they result in an impairment of pulmonary function, but the detection of such lesions can be important from an epidemiological point of view 7, particularly in relation to the critical issue of indoor asbestos exposure in contaminated buildings.
There was particular interest in the latter. Therefore, a study was undertaken to investigate the prevalence of pleural abnormalities in subjects having worked for
Study group Present and former EU civil servants were informed, through various channels that those who had worked for 10 yrs in the Berlaymont building were entitled to a health screening examination to detect possible health effects of past asbestos exposure. The present study group includes the first 100 consecutive volunteers whowere examined at the University Hospitals Gasthuisberg in Leuven. This group consisted of 45 males and 55 females with a mean±sd age of 54±4 yrs. The subjects had worked in the Berlaymont building for 16±5 yrs with the time since first employment ranging 1332 yrs. The volunteers underwent a standardized questionnaire, clinical examination, and lung function testing including measurement of lung volumes, maximal expiratory flow rates and diffusing capacity for carbon monoxide. These results are not described in the present article. The study was carried out with the subjects' informed consent and the approval of the ethical committee of the University Hospitals Gasthuisberg, Leuven.
Imaging
Reading of the images Since not every pleural thickening is an asbestos-related pleural plaque, the combined CT-scans were rated on a five-point scale on the basis of presence, extent, distribution and appearance of the pleural changes, taking into account the reader's confidence in the diagnosis of a pleural plaque. The scoring system was as follows: 0=normal (including the presence of subcostal fat, intercostal muscles and vessels); 1=abnormal, but no pleural plaque (e.g. sequelae of tuberculosis or pleurisy; subpleural nodule); 2=abnormal with a low probability to correspond to a pleural plaque; 3=abnormal with moderate probability to correspond to a pleural plaque; 4=abnormal with high probability to correspond to pleural plaque. The readers recorded their interpretation on a form with a precise identification of the CT images showing abnormalities. The CT scans of the subjects in whom a pleural abnormality had been identified at least once were reconsidered for a consensus reading session by the three readers using the same scoring system as described.
Statistical analysis
Reading of the images No overt cases of pulmonary fibrosis, diffuse pleural thickening, bronchial cancer or mesothelioma were detected by HRCT. However, in 13 subjects, a pleural abnormality was initially detected by radiologist A. In four of these subjects other possibilities than asbestos plaques were evoked such as sequelae of (tuberculous) infections, which was confirmed by the questionnaire. In total, 12 subjects had mentioned a history of tuberculosis or pleurisy before starting employment in the Berlaymont building.
The second reading session differed from the first readings by reader A in that a grading system was incorporated for scoring the probability that the pleural irregularity corresponded to a pleural plaque. Table 1
By consensus, 82 scans were eventually considered as normal based on 64 scans (78%) rated normal by all readers, 16 scans (20%) rated abnormal by just one reader and two scans (2%) where two readers had detected pleural abnormalities. Pleural abnormalities were retained by consensus in 18 subjects of whom eight (44%) had been detected by all three readers, five (28%) by two readers and four (22%) by only one reader. One scan, rated normal by all readers during the second reading session, was reconsidered because pleural abnormalities had been noted at the first reading (A1). Thus, the first (A1) and consensus reading agreed in 95% of the cases, with the consensus reading detecting five additional cases of pleural abnormalities. These five additional cases were graded, by consensus, as follows: two grade 1, one grade 2, and two grade 3. To illustrate the type of pleural lesions found by HRCT, one example of each category score is shown in figure 1
The intra-observer agreement of reader A between the first and the second reading was good ( =0.68) concerning the detection of pleural abnormalities. The inter-reader agreement for each pair of observers in the second reading session is summarized in table 2 -values, evaluating the inter-reader agreement for the subjective scores of the second reading session, were fair to moderate.
The use of HRCT has played an increasing role in the detection of pleural lesions due to occupational and environmental exposure to asbestos 7, 1320. However, besides the pilot study 8, epidemiological studies using HRCT for assessing the prevalence of pleural plaques due to indoor asbestos exposure have not been published. Nevertheless, such epidemiological studies can be important since the prevalence of these pleural changes can be interpreted as a biomarker and early health effect of indoor asbestos exposure 21. In this epidemiological study, the authors opted to combine the readings of the spiral CT (covering the entire chest wall at the expense of resolution) and HRCT (increasing resolution, but at the expense of the amount of tissue scanned), in order to achieve an optimal detection rate for pleural lesions. Nevertheless, this approach is not recommended for pure screening purposes, since conventional CT is recognized as a relatively high-dose diagnostic procedure. HRCT (consisting of 1 mm thick slices performed every 1 cm) has, conversely, an effective radiation dose, which is much lower than that of conventional CT, even with high-dose techniques 22, 23. The participants of the present study, however, were mature adults who were fully informed about the radiation risk of the procedure and they all volunteered to have these tests performed. A major problem when undertaking epidemiological studies involving radiology is that trained observers have different thresholds for perceiving the presence or absence of abnormalities. In addition, the technical factors of CT-scanning are very critical for the detection rate of pleural lesions, especially when the extent of the pleural lesions is less pronounced, which will increasingly be the case as a result of strict asbestos legislation 24. This problem of interobserver accuracy can be tested directly when there is a "gold standard", but in the case of minor pleural plaques, accuracy cannot be tested due to the absence of a standard such as that afforded by surgical, autopsy, or other definite pathological evidence 3. In the absence of such a "gold standard", intra- and interobserver comparisons of variability can be used.
The observer variability was measured by using the However, translating this description of a pleural plaque into radiological diagnostic criteria for HRCT has been a problem. The current International Labour Office classification 27 is not adequate for diagnosing asbestos-related pleural plaques by CT, leaving us without any good criteria for distinguishing other pleural lesions from plaques 28. First, the pleural lesions must be differentiated from normal anatomic structures such as subcostal fat, intercostal muscles or veins that may cause densities that are somewhat focal 29. Secondly, other types of pleural lesions exist which are nonspecific and/or do not have any known connection with exposure to asbestos. This has led to diverging opinions about the radiological definition of plaques diagnosed by CT 15, 3032.
Furthermore, in the present study, the pleural lesions were not those that are commonly described following obvious occupational asbestos exposure. As shown in figure 1 In a number of instances, the possibility that the lesions observed were asbestos-plaques, was only evoked by the radiologist as one of many other possibilities, and with hindsight some of the pleural lesions may have been due to tuberculosis or pleurisy, making it difficult to state that the pleural lesions were asbestos-related. To achieve a higher certainty that the lesions detected on HRCT were pleural plaques, a scoring system was added to the second and consensus reading. Each reader evaluated the pleural abnormalities that were not characteristic of tuberculosis or pleurisy (i.e. score 1), and gave a score of 2, 3, or 4 according to increased probability of being induced by asbestos on the basis of their similarity with frank asbestos plaques. In case of discrepancies between the readers, the decision for the presence of pleural lesions was made in a final consensus reading. Consensus readings have previously been used in the radiological assessment of asbestos-related abnormalities 7, 34, 35. In the present study, the final consensus reading resulted in a diagnosis of pleural abnormalities in 18 subjects. Seven of the 18 pleural lesions were considered not to be related to asbestos, but more likely to past tuberculosis or pleurisy. The remaining 11 were considered to be pleural plaques with an increasing probability from low (n=2), moderate (n=4) to high (n=5) for a pleural plaque on the basis of experience and textbook descriptions. The advantage of a consensus reading is that a discussion about the disagreements averages out the differences between the readers of whom A was less "liberal" in seeing abnormalities than reader C, but less "severe" than reader B in ruling out abnormalities. A possible disadvantage of consensus readings is that they may operate much like a single-reader interpretation. Although numerous readers may be involved, the information of record is likely to reflect a single, dominant opinion 3, which, however, was not the case in the presented study. The consensus reading detected five additional cases of minor pleural lesions, meaning that a reading by three radiologists increases the detection rate of small pleural lesions compared to a single reading by one radiologist only. It is important to put so much effort into the detection of subtle pleural lesions, because the diagnostic uncertainties regarding minor asbestos-related pleural changes and the possibly substantial degree of misclassification render it difficult to evaluate the prevalence of these minor pleural changes as an adverse health effect of indoor asbestos exposure 21. In cases with only "passive exposure" to asbestos, the lesions were found to be extremely small and the consensus reading definitely increased the accuracy of detection. The authors are aware that the detected pleural lesions do not all necessarily correspond to the classical definition of pleural plaques. Therefore, a similar high-resolution computed tomography study has been carried out in 100 control subjects without known or suspected asbestos exposure. The data from this control group is being analysed to verify whether the lesions found here are asbestos-related or not. The present study does not answer this question, but shows the importance of diagnostic accuracy.
The authors thank V. De Maertelaer, F. Clottens, G. Nackaerts and W. Desmet for their much-appreciated collaboration.
This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||