Abstract
Health status is increasingly used in clinical practice to quantify symptom burden and as a clinical trial end-point in patients with interstitial lung disease (ILD). The King's Brief Interstitial Lung Disease (KBILD) questionnaire is a brief, validated 15-item, disease-specific, health-related quality of life questionnaire that is increasingly used in clinical trials, but little data exist regarding the minimum clinically important difference (MCID). Using pulmonary rehabilitation as a model, we aimed to determine the responsiveness of KBILD and provide estimates of the MCID.
KBILD scores, Chronic Respiratory Questionnaire (CRQ) scores, Medical Research Council (MRC) Dyspnoea score and incremental shuttle walk test (ISWT) distance were measured in 209 patients with ILD (105 with idiopathic pulmonary fibrosis (IPF)) before and after an outpatient pulmonary rehabilitation programme. Changes with intervention and Cohen's effect size were calculated. Anchor-based (linear regression and receiver operating characteristic plots) or distribution-based approaches (0.5 sd and standard error of measurement) were used to estimate the MCID of KBILD domain and total scores.
KBILD, CRQ, MRC Dyspnoea and ISWT improved with intervention, and the effect sizes of KBILD domain and total scores ranged from 0.28 to 0.38. Using anchor-based estimates, the MCID estimates for KBILD-Psychological, KBILD-Breathlessness and activities, and KBILD-Total were 5.4, 4.4 and 3.9 points, respectively. Using distribution-based methods, the MCID estimate for KBILD-Chest symptoms was 9.8 points. The MCID estimates for KBILD in IPF patients were similar.
In patients with ILD and IPF, KBILD is responsive to intervention with an estimated MCID of 3.9 points for the total score.
Abstract
The King's Brief Interstitial Lung Disease (KBILD) questionnaire is responsive to pulmonary rehabilitation in patients with ILD, including those with IPF, with a mean minimum clinically important difference of 3.9 points for KBILD-Total score http://bit.ly/2HXxBIe
Introduction
Health status is an important patient-reported outcome measure (PROM) that is increasingly used in clinical practice to quantify symptom burden [1, 2] and as a clinical trial end-point in patients with interstitial lung disease (ILD) [1–3]. Pulmonary rehabilitation, a multidisciplinary programme incorporating exercise training and education, is recommended for the management of ILD patients [2, 4] as it improves, among other outcomes, health status [5]. However, there is a paucity of data on the responsiveness of ILD-specific health status questionnaires to pulmonary rehabilitation. Currently, ILD patients undergoing pulmonary rehabilitation in research studies and clinical practice are often assessed using generic or disease-specific health status measures for chronic obstructive pulmonary disease (COPD), such as the Short-Form 36 (SF-36) [6, 7], St George's Respiratory Questionnaire (SGRQ) [3, 8–11] or Chronic Respiratory Questionnaire (CRQ) [10, 12, 13].
The King's Brief Interstitial Lung Disease (KBILD) questionnaire is a self-administered, ILD-specific measure of health-related quality of life, comprising 15 items with three domains (Psychological (KBILD-P), Breathlessness and activities (KBILD-B), and Chest symptoms (KBILD-C)) combined in a total score (KBILD-T). Each domain score and the total score ranges from 0 to 100, with higher scores indicating better health-related quality of life. KBILD takes 5–7 min to complete [14], and has been shown to be valid [14, 15], reproducible [14] and responsive to natural longitudinal change [15]. The minimum clinically important difference (MCID) of longitudinal change in KBILD-T in ILD patients (including those with idiopathic pulmonary fibrosis (IPF)) has been estimated at 8 points [15]. Two generations of the questionnaire have been developed, one using Rasch analysis methodology (KBILD-R) [14] and the other using an impact factor technique (KBILD-I) [16], in order to determine whether the clinical properties of the two questionnaires developed using different methodologies were similar. The questionnaires have slightly different content but yield similar results [16]. KBILD-R was used in this study as KBILD-I has not been released for use.
Responsiveness of KBILD to pulmonary rehabilitation has not been previously reported. Furthermore, although it is increasingly used as a trial end-point in ILD patients [3], the MCID in response to intervention is unknown. Accordingly, the aims of this study were to determine the responsiveness of KBILD domain and total scores to pulmonary rehabilitation, and to provide estimates of the MCID to intervention. We hypothesised that KBILD would improve with pulmonary rehabilitation and that estimates of MCID response to intervention would be similar to estimates of the MCID of KBILD to longitudinal change.
Materials and methods
Study subjects
Participants were prospectively recruited from two cohorts undergoing pulmonary rehabilitation to determine the responsiveness of physical performance measures (ClinicalTrials.gov identifiers NCT02530736 and NCT01649193) between March 2012 and July 2016. Inclusion criteria for this study were: 1) a primary diagnosis of an ILD, according to a specialist respiratory physician and a positive radiological diagnosis by high-resolution computed tomography scan following multidisciplinary input, 2) ability to walk 5 m, 3) ability to provide informed consent and 4) sufficient understanding of English to complete a health status questionnaire. Exclusion criteria were significant comorbidities that would limit walking ability (e.g. lower limb amputation) or make exercise unsafe (e.g. unstable ischaemic heart disease).
All participants provided informed consent. The study was approved by the London-Riverside (14/LO/2247) and London-Camberwell St Giles (11/LO/1780) Research Ethics Committees.
Study design
The objective of this prospective cohort study was to determine the responsiveness of KBILD domain and total scores to pulmonary rehabilitation in patients with ILD, and to provide estimates of the MCID to intervention. Regarding the sample size calculation, for anchor-based approaches of determining the MCID, a minimum correlation r>0.3 between the outcome of interest and external anchor is required [17]. To show a correlation of r>0.3 between change in KBILD and change in CRQ or ISWT with 95% power at the 0.05 significance level would require a minimum of 138 patients completing pulmonary rehabilitation. Assuming 30% of patients would not complete pulmonary rehabilitation [18], we aimed to recruit 200 patients.
Methods
Pulmonary rehabilitation was delivered by the Harefield Pulmonary Rehabilitation Unit (Harefield, UK), and comprised an 8-week outpatient exercise and multidisciplinary education programme, organised and delivered according to the British Thoracic Society Quality Standards for Pulmonary Rehabilitation [19]. Each week involved two supervised sessions of exercise and education, and at least one additional home-based unsupervised exercise session. Details of the exercise and education components have been previously described [20]. The following outcome measures were assessed before and after pulmonary rehabilitation: anthropometry, spirometry [21], Medical Research Council (MRC) Dyspnoea score [22], incremental shuttle walk test (ISWT) distance [23], KBILD scores [14] and self-reported CRQ scores [24].
Statistical analysis
Baseline characteristics are presented as mean with standard deviation and percentage for continuous and categorical data, respectively. Paired t-tests were used to compare outcomes before and after pulmonary rehabilitation, and effect sizes were calculated using Cohen's d effect size. The association between change in KBILD with change in other outcomes (CRQ, MRC Dyspnoea and ISWT) was determined using Pearson's correlation or Spearman rank correlation.
MCID analysis
Multiple anchor-based approaches were used to estimate the MCID of KBILD domain and total scores. The a priori criteria for establishing the validity of external anchors were: statistically significant correlation at the 5% level and r>0.3 [17]. For external anchors fulfilling these criteria, linear regression was used to estimate change in KBILD corresponding to the established MCID for the anchors [25]: CRQ-Dyspnoea 2.5 points, CRQ-Fatigue 2 points, CRQ-Emotion 3.5 points, CRQ-Mastery 2 points, CRQ-Total 10 points [26] and ISWT 44 m [23]. Additionally, receiver operating characteristic (ROC) curves were used to determine change in KBILD cut-off with equal sensitivity and specificity to discriminate between those who improved their external anchor by the established MCID and those who did not [27]. If a potential anchor did not meet the a priori criteria for establishing validity of an external anchor, distribution-based methods were used to estimate the MCID. These included 0.5 sd and standard error of measurement (sd of KBILD×√(1−test–retest reliability of KBILD)). In pre-specified sensitivity analyses, the response of KBILD to pulmonary rehabilitation was evaluated in the subgroup of IPF patients. Data analyses were performed using Prism version 7 (GraphPad, La Jolla, CA, USA) and SPSS version 24 (IBM, Armonk, NY, USA). Statistical significance was considered at p<0.05.
Results
Baseline characteristics and response to pulmonary rehabilitation in patients with ILD
A total of 297 consecutive patients referred to the Harefield Pulmonary Rehabilitation Unit were invited to participate in the study: 20 declined, 10 did not meet the inclusion criteria (n=4 chose an unsupervised home exercise programme, n=2 unstable cardiac condition, n=2 foot-drop and n=2 unable to walk 5 m) with 267 agreeing to participate. A total of 209 (78%) completed pulmonary rehabilitation. The reasons for noncompletion were: n=28 unable to contact, n=7 admitted to hospital, n=3 converted to a home exercise programme, n=2 cardiac symptoms and n=18 other reason.
Table 1 lists the ILD diagnosis categories and the number of patients in each category; the most common diagnosis was IPF (50%). The baseline characteristics and the response to pulmonary rehabilitation of the 209 patients who completed the programme are shown in table 2. The majority of patients were male (61%) with mean±sd age 70±10 years, forced vital capacity (FVC) 71.9±21.5% predicted, MRC Dyspnoea score 3.2±1.1 and KBILD-T score 54.3±10.8.
Breakdown of interstitial lung disease diagnoses and number of patients in each category#
Baseline characteristics and response to pulmonary rehabilitation in patients with interstitial lung disease#
MRC Dyspnoea, ISWT and CRQ all significantly improved with pulmonary rehabilitation, as did KBILD domain and total scores. Mean change in score: KBILD-P 5.9 (95% CI 4.1–7.8), KBILD-B 5.7 (95% CI 4.0–7.4), KBILD-C 6.0 (95% CI 3.5–8.4) and KBILD-T 4.2 (95% CI 3.0–5.3) (table 2). Effect sizes for KBILD-P, KBILD-B, KBILD-C and KBILD-T with pulmonary rehabilitation were 0.34, 0.36, 0.28 and 0.38, respectively.
Estimation of the MCID of KBILD in patients with ILD
Table 3 shows the correlations between KBILD change and change in CRQ, MRC Dyspnoea and ISWT. The CRQ-Total score correlated best with all KBILD domain and total scores.
Correlations between change (Δ) in King's Brief Interstitial Lung Disease (KBILD) and change in other variables with pulmonary rehabilitation in patients with interstitial lung disease
Using linear regression and ROC plots, the mean MCID estimates for KBILD in patients with ILD were: KBILD-P 5.4 points, KBILD-B 4.4 points and KBILD-T 3.9 points. It was not possible to calculate an anchor-based MCID estimate for KBILD-C as it did not meet the a priori criteria for establishing a valid external anchor (i.e. statistically significant correlation with r>0.30 between KBILD-C and an external anchor). Using distribution-based methods, the mean MCID estimate for this domain was 9.8 points. The ranges of MCID estimates for KBILD domain and total scores are shown in table 4.
Range and mean minimum clinically important difference (MCID) estimates of King's Brief Interstitial Lung Disease (KBILD) domain and total scores in patients with interstitial lung disease
Responsiveness of KBILD and estimation of the MCID in patients with IPF
A sensitivity analysis was performed to determine the responsiveness of KBILD domain and total scores and estimate an MCID in patients with IPF (n=104). The baseline characteristics and response to pulmonary rehabilitation are shown in supplementary table S1. In summary, 69% of patients were male with mean±sd age 73±8 years, FVC 74.4±21.4% predicted, MRC Dyspnoea score 3.1±1.1 and KBILD-T score 55.9±10.7. Significant improvements in traditional pulmonary rehabilitation outcome measures and KBILD domain and total scores (KBILD-T mean score change 4.0 (95% CI 2.3–5.7); p<0.01) were observed following pulmonary rehabilitation. Effect sizes for KBILD-P, KBILD-B, KBILD-C and KBILD-T with pulmonary rehabilitation were 0.37, 0.34, 0.28 and 0.39, respectively.
The correlations between KBILD, ISWT and CRQ are reported in table 5. Similar to the ILD cohort, there were no significant correlations with r>0.3 between KBILD-C and any of the external anchors, and as such it was not possible to calculate an anchor-based MCID estimate for this domain.
Correlations between change (Δ) in King's Brief Interstitial Lung Disease (KBILD) and change in other variables with pulmonary rehabilitation in patients with idiopathic pulmonary fibrosis
Using linear regression and ROC plots, mean MCID estimates for KBILD in patients with IPF were: KBILD-P 5.7 points, KBILD-B 4.3 points and KBILD-T 3.9 points. Using distribution-based methods, the mean MCID estimate for KBILD-C was 9.0 points. The ranges of MCID estimates for KBILD domain and total scores are reported in table 6.
Range and mean minimum clinically important difference (MCID) estimates of King's Brief Interstitial Lung Disease (KBILD) domain and total scores in patients with idiopathic pulmonary fibrosis
Discussion
To the best of our knowledge, this is the first study to demonstrate that KBILD is responsive to pulmonary rehabilitation in patients with ILD, including those with IPF, and to provide estimates of the MCID to intervention. Mean MCID estimates of KBILD-P, KBILD-B, KBILD-C and KBILD-T were similar for patients with ILD and IPF (ILD and IPF: KBILD-P 5.4 and 5.7 points, KBILD-B 4.4 and 4.3 points, KBILD-C 9.8 and 9.0 points, and KBILD-T 3.9 and 3.9 points, respectively). This study suggests that KBILD can be used as part of pulmonary rehabilitation assessments where it may have a role in the monitoring of disease-specific health-related quality of life, designing individually tailored pulmonary rehabilitation programmes, and measuring the impact of this intervention on health status in patients with ILD and IPF. Furthermore, it may be useful in clinical trials of pulmonary rehabilitation where a disease-specific health status pulmonary PROM is being used as an end-point.
KBILD: previous studies
KBILD was developed in response to a paucity of easy-to-use, disease-specific health status questionnaires for ILD patients [14]. It was originally developed using Rasch analysis methodology (KBILD-R) [14] and re-examined using an impact factor approach (KBILD-I) [16]. Although the content of the two questionnaires varies slightly, both consist of 15 items with three domains and a total score, and both yield similar results [14, 16]. KBILD-R was used in this study as KBILD-I has not been released for use.
KBILD has been shown to correlate with lung function indices and health-related quality of life questionnaires (FVC % pred r=0.38–0.51, diffusing capacity of the lung for carbon monoxide % pred r=0.42–0.52, SGRQ r= −0.59– −0.89 and SF-36 r=0.33–0.70) [14], to be reproducible (intraclass correlation coefficient 0.86–0.92) [14], and to be responsive to ambulatory oxygen [3] and longitudinal change [15].
KBILD was the primary end-point in a crossover randomised controlled trial examining the effects of 2 weeks of ambulatory oxygen on health-related quality of life in 76 patients with fibrotic ILD (58% IPF, 69% male with mean±sd age 68±10 years, FVC 73±19% predicted and KBILD-T score 50.5±11.2) [3]. Following the intervention, there was a significant improvement in KBILD domain and total scores with ambulatory oxygen compared with placebo air (mean score change in KBILD-T 3.7 (95% CI 1.8–5.6); p<0.0001) [3]. This cohort had similar baseline characteristics and response to intervention as the patients in our study.
Similarly, Patel et al. [15] evaluated the responsiveness of KBILD over a mean of 9 months in 57 patients with ILD (17% IPF, 23% male with mean±sd age 62±11 years, FVC 80±25% predicted and KBILD-T score 60±23) and provided MCID estimates. Regarding change in KBILD-T, a total of 38% of patients deteriorated, 25% improved and 37% remained the same, but the mean (95% CI) change in KBILD-T was not reported [15]. Using anchor- and distribution-based methods the mean (range) MCID estimate for KBILD-T was 8 (6–10) points [15].
The MCID estimates of our study, excluding those of KBILD-C, contrast with those of Patel et al. [15]. Regarding KBILD-C, the MCID estimates in our study were comparable to those reported by Patel et al. [15] and may be explained by the use of distribution-based approaches. In contrast, the MCID estimates of the other domain and total scores were lower in our study. Several reasons may explain this variation. First, there were differences in the cohort characteristics and proportion of disease types between the studies, which may have influenced the MCID estimates. Our cohort had a greater proportion of male and IPF patients, who were older with greater lung function deficit. Second, our study had a larger sample size (n=209 in our study versus n=57 in Patel et al. [15]), which would have increased the statistical power to provide a more precise MCID estimate. Third, whereas Patel et al. [15] looked at longitudinal change over 9 months, our study examined the response of KBILD to an intervention, i.e. pulmonary rehabilitation. Finally, whereas we used a health-related quality of life questionnaire with similar construct to KBILD as our external anchor, the previous study utilised FVC and a global rating scale. FVC was not used as an external anchor in our study because it does not change with pulmonary rehabilitation, whereas health status was expected to improve. As such, change in FVC % pred would most likely not meet our criteria for a valid external anchor. In addition, we did not use a global rating scale to determine the MCID because it lacks objectivity. The presence of an intervention, timescale, the choice of external anchor and the direction of change are all plausible factors that might influence the MCID estimate.
Significance of findings
PROMs aim to “directly report the status of a patient's health condition without the interpretation of a patient's response by a clinician or anybody else” [28]. PROMs are particularly relevant in clinical care as they can highlight the impact of the disease on the patient, enabling the monitoring of health-related quality of life and tailoring of patient care. Additionally, in clinical trials PROMs may capture perceived treatment effects not detected by other outcome measures, e.g. biomarkers of disease [29]. They are also likely to become established as important secondary end-points in future trials [30] to ensure patients' perspectives are considered [31] and because research funding organisations have started to place a stronger emphasis on meaningful impact for patients [30].
The PROMs most frequently used to measure health-related quality of life in ILD include a mixture of generic, respiratory and IPF-specific tools, many of which have been designed for or adapted from other chronic respiratory diseases. Additionally, the validity, responsiveness, MCID and predictive capacity of these questionnaires in ILD patients remain unknown in the majority of cases. Furthermore, pulmonary rehabilitation programmes are typically designed for COPD patients, are largely generic and are not designed specifically for ILD patients. Accordingly, PROMS that are not ILD-specific, such as CRQ [13], COPD Assessment Test [25] or Clinical COPD Questionnaire [27], are currently being used in clinical practice.
Strengths
This study, the largest pulmonary rehabilitation study involving ILD patients, provides new knowledge on the psychometric properties of KBILD in ILD and IPF by demonstrating its responsiveness to an intervention and providing MCID estimates. The capacity of an outcome measure to detect improvement is an important aspect of concurrent validity and is necessary for data interpretation in both clinical and research settings [17]. This is facilitated by the MCID, which enables the assessor to understand the clinical significance of response data and forms an important part of the evidence required by regulatory agencies for approval for use in clinical trials [32]. These properties are essential traits in an outcome tool and accordingly KBILD has potential as a measure of disease-specific health-related quality of life in the pulmonary rehabilitation setting in ILD and IPF. We used CRQ, a measure of health-related quality of life, as an external anchor. Although it was not developed specifically for ILD patients, it measures a similar construct to KBILD which may influence the accuracy of the KBILD MCID estimates. Furthermore, this study provides 22 and 26 consistent MCID estimates of KBILD domain and total scores in patients with ILD and IPF, respectively. We used multiple anchor- or distribution-based methods to calculate MCID estimates as there is no consensus on the methodology on how to perform this type of analysis [17]. Distribution-based techniques are an indirect way of estimating MCID that do not consider patients' experiences. Instead, the change in the outcome of interest is based on a form of statistical variability, e.g. standard deviation [17], which may vary depending on patient ability or baseline measurements [33]. Anchor-based approaches account for the clinical significance of the intervention, and are considered clinically robust and meaningful, but a suitable external anchor that correlates significantly with the outcome measure of interest is required [17]. Revicki et al. [17] recommended that a correlation coefficient of r>0.3 is sufficient. As KBILD is a measure of health-related quality of life and accordingly captures multisystem properties, it is unlikely that a single anchor would be sufficient to estimate the MCID [34]. Therefore, use of multiple external anchors as well as different anchor- or distribution-based approaches used in this study provides a degree of reassurance on its validity.
Limitations
There are some limitations to this study. First, the study participants were symptomatic outpatients recruited from a pulmonary rehabilitation programme at the Royal Brompton and Harefield NHS Foundation Trust, a specialist, cardiorespiratory, tertiary care centre. Therefore, the data need to be corroborated in other settings and ILD populations (e.g. more symptomatic patients managed in the acute hospital setting). Second, the CRQ-Dyspnoea domain requires patients to rate how breathless they become doing five activities of their choice. A criticism of CRQ is that patients' activity choice may change over time. In this study, we ensured the activities selected in the CRQ-Dyspnoea domain in the pre-pulmonary rehabilitation assessment were kept the same for the post-pulmonary rehabilitation assessment. Third, despite demonstrating significant improvements with pulmonary rehabilitation, it was not possible to provide anchor-based MCID estimates for KBILD-C. This may have occurred because the external anchors did not capture the construct tested by this domain. Furthermore, the KBILD MCID may have been overestimated because it was calculated using distribution-based methods. These methods can produce estimates higher than the considered MCID [17]. Finally, few patients reported that they deteriorated with pulmonary rehabilitation; accordingly, these data estimate the MCID for improvement only. Further studies are required to assess whether patients perceive deterioration differently to the size of improvement in this context.
In summary, KBILD is responsive to pulmonary rehabilitation in patients with ILD, including those with IPF, with a mean MCID estimate of 3.9 points for KBILD-T.
Supplementary material
Supplementary Material
Please note: supplementary material is not edited by the Editorial Office, and is uploaded as it has been supplied by the author.
Supplementary material ERJ-00281-2019.Supplement
Shareable PDF
Supplementary Material
This one-page PDF can be shared freely online.
Shareable PDF ERJ-00281-2019.Shareable
Acknowledgements
We would like to express our gratitude to the patients who participated in this research and to the staff of Harefield Pulmonary Rehabilitation Unit (Harefield, UK) for their role in delivering the interventions and help with data collection.
Footnotes
This article has supplementary material available from erj.ersjournals.com
Author contributions: Concept and design of study: W.D-C. Man, M. Maddocks, T.M. Maher and C.M. Nolan. Acquisition of data: C.M. Nolan, S.E. Jones, S. Patel and R.E. Barker. Analysis of data: C.M. Nolan, M. Maddocks and W.D-C. Man. Drafting of manuscript: C.M. Nolan, M. Maddocks, S.S. Birring, T.M. Maher and W.D-C. Man. Revision of manuscript critically for important intellectual content: all authors. Approval of final manuscript: all authors.
Conflict of interest: C.M. Nolan has nothing to disclose.
Conflict of interest: S.S. Birring reports fees paid to King's College Hospital for use of KBILD from Roche, Boehringer Ingelheim and Galapagos, outside the submitted work.
Conflict of interest: M. Maddocks reports grants (CDF-2017-10-009 and HSDR 16/02/18) from NIHR, outside the submitted work.
Conflict of interest: T.M. Maher has, via his institution, received industry-academic funding from GlaxoSmithKline R&D and UCB, and has received consultancy or speakers fees from Apellis, AstraZeneca, aTyr Pharma, Bayer, Biogen Idec, Boehringer Ingelheim, Celgene, Galapagos, GlaxoSmithKline R&D, Indalo, Pliant, ProMetic, Roche, Samumed and UCB.
Conflict of interest: S. Patel has nothing to disclose.
Conflict of interest: R.E. Barker has nothing to disclose.
Conflict of interest: S.E. Jones has nothing to disclose.
Conflict of interest: J.A. Walsh has nothing to disclose.
Conflict of interest: S.C. Wynne has nothing to disclose.
Conflict of interest: P.M. George reports personal fees for lecturing and nonfinancial support for meeting attendance from Boehringer Ingelheim and Roche Pharmaceuticals, personal fees for lecturing from Teva, outside the submitted work.
Conflict of interest: W.D-C. Man reports grants from National Institute for Health Research, during the conduct of the study; grants from Pfizer, nonfinancial support from GlaxoSmithKline, personal fees from Mundipharma and Novartis, outside the submitted work.
Support statement: C.M. Nolan is funded by a National Institute for Health Research (NIHR) Doctoral Research Fellowship (DRF-2014-084) for this research project. This publication presents independent research. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Dept of Health and Social Care. Funding information for this article has been deposited with the Crossref Funder Registry.
- Received February 8, 2019.
- Accepted May 29, 2019.
- Copyright ©ERS 2019
This article is open access and distributed under the terms of the Creative Commons Attribution Licence 4.0.