To the Editor:
We read with interest the article by Pifferi et al. [1] in the April issue of the European Respiratory Journal, describing a technique of soft computing analysis to increase the diagnostic accuracy of air liquid interface cultures for the diagnosis of primary ciliary dyskinesia (PCD).
The diagnosis of PCD is indeed difficult, time-consuming and expensive [2, 3]. Extensive efforts have been made to increase the diagnostic accuracy of the available tests.
We worry that the authors miscalculated the statistical parameters sensitivity and specificity. Sensitivity reflects the accuracy of a new test to detect an abnormal result in a disease state (true positives), compared to the results of the gold standard to diagnose the disease state [4]. It is calculated by the formula a/a+b, in which a is the number of true positives and b the number of false positives (table 1). Specificity, on the other hand, reflects the accuracy of the new test to diagnose a normal value, compared to the gold standard (true negatives) [4]; it is calculated by the formula d/c+d, in which d is the number of true negatives and c the number of false negatives (table 1). In this study, the gold standard for diagnosis of PCD is defined as absence of coordinated ciliary motility after ciliogenesis, and thus the newly evaluated parameters should be presented as absence of rotation of spheroids, absence of migration, etc. For the parameter absence of rotation of the spheroids, a=35, b=1, c=17, d=64; sensitivity amounts to 35/35+1=97.2% and specificity 64/64+17=79.0%, rather than the reverse. Sensitivity and specificity, similarly, PPV and NPV have to be exchanged for all the parameters in table 2 of the mentioned article.
With this new technique of soft computing analysis, the authors thus reach a high sensitivity (97–100%) and a poor to acceptable specificity (7–79%) for the diagnosis of PCD.
Generally, the main reason to perform cell culture is to exclude a false diagnosis of PCD due to secondary changes and thus to increase the specificity [5]. However, it is proven in the mentioned paper that ciliary motility before ciliogenesis was completely normal in one PCD patient. Therefore, the diagnosis would have been missed without cell culture. This means that cell culture can increase sensitivity as well as specificity. This finding is especially important for patients with PCD and normal ultrastructure, because in these cases transmission electron microscopy (TEM) has no added value.
Since 1990, we have systematically performed ciliogenesis in all biopsy samples with a sequential monolayer-suspension culture, as described previously [6]. The success rate of the culture was 75%, which is higher than the aforementioned 50% of the air liquid interface culture technique [1]. Based on the absence of ciliary coordination (with or without absence of ciliary motility) after ciliogenesis in culture, we detected 206 patients with PCD. However, initial evaluation of the ciliary coordination and ciliary beat frequency in the biopsy was normal in 21 persons (10.2%) with a final diagnosis of PCD. 10 of them had specific abnormalities on TEM (three outer dynein arm deficiency, four absence of the central pair, two eccentric central pair and inner dynein arm deficiency, and one excessive absence of a peripheral microtubular pair), which confirmed PCD. Normal ultrastructure was seen in 11 patients. These patients all had typical clinical signs and symptoms of PCD (upper and lower respiratory tract infections, neonatal respiratory symptoms, ear problems and random situs) and the diagnosis was confirmed in a repeat biopsy with ciliogenesis in nine out of 11 patients, which makes abnormalities due to the culture technique or due to misinterpretation unlikely. Moreover, biallelic mutations in DNAH11 were detected in four out of nine examined patients with normal ultrastructure, which is even more than the reported 22% of detected DNAH11 mutations in a PCD population with normal ultrastructure in the literature [7]. Nasal nitric oxide values were abnormal in these 11 patients, the median value was 62 ppb (range 11–337 ppb). In this way, the diagnosis of PCD in these patients is robust, although it would have been missed when only evaluation of ciliary motility was performed on the biopsy. In conclusion, we would like to state that the sensitivity of the evaluation of ciliary motility in the biopsy to detect PCD in our cohort was only 89% (and only 84% for those with normal ultrastructure) and this is not acceptable for a rare disease. It suggests that evaluation of ciliary motility in the biopsy specimen only can lead to a considerable amount of missed PCD diagnoses.
Although we have made extensive efforts to publish the data on our large cohort of PCD patients with normal ultrastructure, we have not succeeded yet. The paper of Pifferi et al. [1] gives us the ideal opportunity to emphasise that ciliogenesis in culture remains the best technique (concerning specificity and sensitivity) to make the diagnosis of PCD with normal ultrastructure.
Footnotes
Conflict of interest: Disclosures can be found alongside the online version of this article at www.erj.ersjournals.com
- Received May 6, 2013.
- Accepted June 3, 2013.
- ©ERS 2013