Abstract
Assessment of health-related quality of life in patients with respiratory failure on home ventilation requires appropriate and highly specific measurement tools. We attempt to validate the English version of the Severe Respiratory Insufficiency Questionnaire (SRI).
Psychometric properties of the SRI in 152 patients established on home ventilation were assessed.
Cronbach’s alpha ranged between 0.77 and 0.89 for the seven subscales and and was 0.93 for the summary scale. Principal components analysis revealed a one-factor solution for four and two factors for three subscales. Confirmatory factor analysis revealed a two-factor solution for six subscales, but these factors were dependent on each other. One factor was extracted out of the subscales confirming one summary scale accounting for 70% of the total variance. Correlation analysis between scales of the SRI and the Medical Outcome Study 36-item short-form health survey demonstrated highest correlations between comparable subscales. Chronic obstructive pulmonary disease patients had lower summary scale scores than patients with restrictive chest wall diseases, neuromuscular disorders and obesity hypoventilation syndrome.
The English SRI has high internal consistency reliability, clearly established construct and concurrent validity, and is capable of differentiating between different diseases. It is now validated for use in research involving patients receiving home ventilation.
- Assisted ventilation
- noninvasive ventilation
- quality of life
- reliability and validity
- respiratory insufficiency
Health-related quality of life (HRQL) questionnaires have become an essential part of managing patients with chronic conditions to assess the impact of these conditions and the effect of interventions on daily life [1, 2]. Over the past few decades several generic and disease-specific questionnaires have been developed. These are multidimensional tools to assess several aspects of patients' lives that are otherwise not objectively studied during clinical care. Generic questionnaires include the Sickness Impact Profile and the Medical Outcome Study (MOS) 36-item Short-form Health Survey (SF-36), which are not specific to any particular disease and are therefore most commonly used for general survey research, and allow comparisons between different diseases [3, 4]. In contrast, disease-specific questionnaires focus on domains most relevant to a particular disease; for patients with chronic respiratory disease the Chronic Respiratory Disease Questionnaire (CRQ) and the St George's Respiratory Questionnaire (SGRQ) are often used. These questionnaires are well validated for patients suffering from chronic obstructive pulmonary disease (COPD) [5, 6]. However, until recently, no specific questionnaires have been available for patients with chronic respiratory failure, particularly those requiring chronic ventilatory support and receiving home mechanical ventilation (HMV). Although these patients may have a variety of diseases and comorbidities, chronic severe respiratory failure is common to all [7]. Many important aspects of these patients' lives are not covered by generic or COPD-specific questionnaires, and this results in an incomplete assessment of HRQL [8–10]. Therefore, a questionnaire specifically designed for this patient group would be desirable.
The Severe Respiratory Insufficiency Questionnaire (SRI) is a recently developed multidimensional HRQL questionnaire found to have good psychometric properties when used in the population it was specifically designed for, namely patients receiving HMV, and has been shown to be sensitive to change [11–16]. This questionnaire, originally developed in German, has recently been professionally translated into several languages, including Danish, Dutch, French, Greek, Hebrew, Japanese, Norwegian, Polish, Spanish and Swedish. Data on the translations process, validation and clinical application have already been published for the Dutch and Spanish versions [17–20]. A French validation is under progress. However, an English version has not yet been provided. Therefore, the aim of the present study was to create and validate an English version of the SRI. Preliminary data of this study has been published as an abstract [21].
METHODS
Study design and population
This cross-sectional study was conducted in the Dept of Respiratory Medicine at St James' University Hospital, Leeds, UK, a tertiary care teaching hospital. Ethical approval was obtained from the local National Health Service ethics committee. Patients with chronic hypercapnic respiratory failure from a wide variety of causes established on HMV for at least 1 month were eligible for the study. They had to be in a clinically stable state, without any changes of medication during the previous 4 weeks. Patients with evidence of acute respiratory failure, i.e. patients with worsening of symptoms during the previous 2 weeks, a pH <7.35, or with signs of respiratory infection (two of the following: coloured sputum, fever, infiltration on chest radiography, white blood cell count >10,000 μL−1) were excluded. Patients received noninvasive ventilation (NIV) or invasive ventilation via tracheostomy. Arterial blood gas samples were taken during visits to the outpatient clinic and not when on ventilation, unless patients were ventilator-dependent (e.g. tracheostomised).
Each patient completed the SRI and the MOS SF-36 in their own time [4, 11]. Both questionnaires were provided at the same time. The underlying diagnoses leading to respiratory failure were recorded; in cases in which there was more than one condition contributing to respiratory failure the one deemed to be contributing most was used for categorisation purposes. Patients were categorised into five categories: COPD, restrictive chest wall disorders (RCWD), neuromuscular disorders (NMD), obesity hypoventilation syndrome (OHS) and "miscellaneous".
The SRI questionnaire and the MOS SF-36
The English SRI is the result of transcultural adaptation [1, 2]. This includes translation and back-translation of the original German SRI by two independent professional translators. Items with incongruence or discrepancies between the original and back-translated version have been accordingly modified in the definitive UK English version. The details of the adaptation process are described in the online supplement.
The SRI consists of seven subscales covering 49 items: respiratory complaints (SRI-RC), physical functioning (SRI-PF), attendant symptoms and sleep (SRI-AS), social relationships (SRI-SR), anxiety (SRI-AX), psychological well-being (SRI-WB) and social functioning (SRI-SF). These seven subscales can be summarised to one summary scale (SRI-SS). Rating for each item provided by a five-point Likert scale with scores ranging between 0 and 100 for every scale is possible following transformation of raw values, as previously described [11]. Higher scores for this tool are attributed to better HRQL.
The SF-36 consists of eight subscales measuring different aspects of health status with lower scores (0–100) indicating poorer health or higher disability: SF-36-PF: physical functioning; SF-36-RP: role-physical; SF-36-BP: bodily pain; SF-36-GH: general health; SF-36-VT: vitality; SF-36-SF: social functioning; SF-36-RE: role-emotional; SF-36-MH: mental health [4, 22].
Statistical analysis
Reliability of each subscale was calculated as internal consistency of response among the items assigned to each scale by Cronbach's alpha [23]. Values above 0.8 indicate high and above 0.9 very high correlations among the items of a scale and thus may be interpreted as measuring the same construct. Construct validity was assessed by both explorative factor analysis using principal components analysis (PCA) and confirmatory factor analysis (CFA). For PCA, only factors with eigenvalues higher than unity (1) have been extracted, i.e. the standardised variance of at least one item variable of the scale is accounted for by the common factor. In simple terms, factors with eigenvalue >1 are considered to be significant, explaining an important amount of variability in the data.
In applying CFA we hypothesised in the first step that the observed correlations among specific items are the result of the effect of one common (latent) factor or construct for each of the eight SRI scales (e.g. the six items for scale SRI-PF), and that therefore these items can be combined to a common scale. Whether each of these postulated one-factor models hold analysing the data was evaluated by several model-fit indexes described below. If the one-factor solution was rejected a two-common-factor model was estimated with items reassigned to two (potentially correlated) factors informed by the substantial meaning of the items and by so-called modification indexes (MI) of the software programme, indicating potential improvements of fit when respecifying the CFA model accordingly [24]. The fit for a model with pre-specified common factors was evaluated by the comparative fit index (CFI) and by testing that root mean square error of approximation (RMSEA) is <0.05. CFI values ≥0.95 and RMSEA p-values >0.05 indicate a good overall fit of the factor model. A visual illustration of the final two-factor CFA model of the SRI-RC scale is depicted in figure 1 and for all other scales in the online supplement.
Visual illustration of final two-factor model of scale respiratory complaints reported in table 6. Ovals indicate latent factors F1 and F2, which are regressed on the observed variables (items) indicated by boxes (with the respective item number) in the confirmatory factor analysis model (CFA). The value near the double-headed arrow is the correlation between the two factors F1 and F2. The values near the single-headed arrows are the factor loadings (or regression coefficients) standardised to both the latent factor and observed variables' variances of the CFA model.
Group comparisons on the SRI between patients of different underlying diagnosis were performed using ANOVA with Tukey–Kramer corrections for multiple comparisons. A p-value of <0.05 was considered to be statistically significant.
Further information on methodology, detailed statistical analysis and the English SRI is provided in the online data supplement.
RESULTS
A total of 152 patients (75 females) completed the questionnaires (table 1) with 142 and 10 patients receiving NIV and invasive (tracheostomy) ventilation, respectively. Patients with NMD were younger (p<0.0001) and had the highest overnight NIV use (p<0.0001) when compared to COPD, RCWD and OHS patients. There were no differences amongst the other three groups (COPD, RCWD and OHS).
Table 2 shows the distribution of the different conditions leading to chronic respiratory failure. Of the 29 patients with OHS, five patients had lone OHS; seven patients also had COPD; 15 patients had combined obstructive sleep apnoea and OHS; one patient also had scoliosis and one patient had Prader–Willi syndrome. 31 patients were receiving long-term oxygen therapy in addition to HMV; 10 patients each in the COPD, RCWD and OHS groups, and one patient with cystic fibrosis.
Descriptive data of both the SRI and the SF-36 questionnaires are provided in table 3. Five of the eight scales (subscales and summary scale) were normally distributed; in three subscales (SRI-SR, SRI-AX and SRI-SF) normality was formally not achieved. However, the distribution of all SRI scales was rather homogenous as shown by the percentiles given in table 3. Thereby the SRI covered a broad range of the questionnaire's scaling range. The mean score of the SRI-SS (55.9±18.9) was roughly in the middle of the questionnaire’s scaling range, which was also true for most of the subscales (table 3). In contrast, none of the SF-36 scales was normally distributed, and the distribution was severely heterogeneous. This was particularly true for SF-36-PF, SF-36-RP and SF-36-GH, where most patients demonstrated the most severely reduced scores (median ranging between 0 and 30).
Reliability
Cronbach's alpha reliability ranged between 0.77 and 0.89 for the seven subscales (table 4). Compared to the reliability of the subscales, the reliability of the summary scale was even higher (0.93; table 4).
Validity
PCA of the subscale-related items revealed that by applying the eigenvalue criterion of ≥1 for factor extraction a one-factor solution is sufficient for four subscales (uni-dimensional construct), but that a two-factor solution (two-dimensional construct) is required for three subscales (table 5). In addition, only one factor with an eigenvalue higher than unity could be extracted out of the seven subscales for the summary scale (uni-dimensional construct). This factor accounted for 70% of the total variance, thus confirming one single summary scale pooling of the seven subscales.
Further analysis of the seven subscales using the CFA demonstrated a consistent two-factor solution for six of the seven subscales (all but SRI-SF; table 6). As an example, one factor of the subscale SRI-AS covered non-respiratory daytime symptoms (F1; table 6) and the other factor covered nocturnal symptoms (F2; table 6). The model fit as estimated from the CFI was excellent (≥0.95) for all subscales. The model fit as evaluated by the p-value of the RMSEA test, that the RMESA is less than 0.05, was also sufficient for all but one scale (SRI-AX). However, both factors in the six subscales with a two-factor solution were substantially correlated (r range 0.45–0.92) indicating that both factors were not independent from each other (table 6 and fig. 1).
In addition, a significant concurrent validity was confirmed by the correlation analysis between scales of the SRI and scales of the SF-36 (table 7). The highest correlations were found between SRI-SF and SF-36-SF (r=0.8, p<0.001) and SRI-WB and SF-36-MH (r=0.78, p<0.001). The lowest correlation was found between SRI-SR and SF-36-PF (r=0.14; p=0.09). Overall, correlations were high when subscales of the SRI and SF-36 focused on comparables aspects of HRQL (e.g. both subscales addressing physical, emotional or social aspects), but was lower when subscales targeting different aspects were correlated (table 7).
Disease comparisons
Overall, there were significant (p=0.0008) differences between different diagnostic groups (COPD, RCWD, NMD, OHS and miscellaneous) for the SRI-SS (table 1). When comparing single diagnostic groups, COPD patients had lower SRI-SS scores than patients with RCWD (p<0.0001), NMD (p=0.0016) and OHS (p=0.0387) after adjustment for multiple comparisons, but there were no significant differences when comparing non-COPD patients.
COPD patients also had significantly lower sores (p<0.05) compared to RCWD patients in all SRI-subscales except SRI-SR, which was, however, close to statistical significance (p=0.06). In addition, COPD patients also had lower scores (p<0.05) compared to NMD patients in three of the seven subscales (SRI-RC, SRI-AX and SRI-SF).
DISCUSSION
The SRI is a disease-specific questionnaire with established psychometric properties, which is currently becoming an international standard tool to assess HRQL in patients with severe chronic respiratory failure. The current study establishes that the English SRI, which resulted from professional translation and back-translation of the original German version, has high psychometric properties. Therefore, the English SRI qualifies for being used in clinical studies assessing HRQL in patients with severe chronic respiratory failure. The main findings gained by the present study can be summarised as follows.
The internal consistency as shown by Cronbach's alpha was higher than 0.8 for all subscales except for one (SRI-PF), which, however, was 0.77 and therefore considerably higher than the value of 0.7 considered to be sufficiently reliable for use in group comparisons [23]. Moreover, Cronbach's alpha was 0.93 for the summary scale of the SRI. In the original German version, Cronbach's alpha ranged between 0.73 and 0.79 in three subscales and between 0.80 and 0.89 in four subscales, while it reached 0.89 for the summary scale [11]. This indicates that the reliability of the English SRI is even stronger than the original German version, which, however, is doubtlessly sufficient for use in group comparisons in the research setting [23].
The construct validity of the tool was obtained by factor analytical studies. Explorative factor analysis on the seven subscales using PCA revealed that three subscales loaded on two factors, while one factor could be extracted for the remaining four subscales. Therefore, two subscales could have been theoretically built out of one subscale for the three subscales loading on two factors. In addition, CFA revealed six subscales with two factor loadings; thus 12 subscales could have been theoretically built out of these six scales with the SRI consisting of 13 subscales when adding the remaining subscale with one factor loading according to CFA. As an example SRI-AS, covered both daytime and nocturnal symptoms as reflected by two factors, and this is similar to the recent validation study on the SRI in COPD patients [12]. However, all factors were considerably correlated comparable to the recent validation in COPD patients. Therefore, the original seven-subscale structure was retained, as it was for the recent COPD validation.
Only one factor could be extracted out of the seven subscales for the summary scale of the English SRI, and this is comparable to the two validation studies on the original German SRI [10, 12]. Of note, this factor accounted for 70% of the total variance, but accounted for 59.8% (mixed cohort) and for 58.5% (COPD) of the total variance of the two German validation studies, respectively [10, 12]. For this reason, although high psychometric properties have been established for the original German SRI, the English SRI appears to be even superior. As a consequence, the presence of one summary scale has been established for the English SRI. Since the structure of the SRI contains social, psychological and physical components, this implies that these components cannot be reflected by independent summary scales in patients with severe chronic respiratory failure. This is in contrast to the SF-36, where both physical and mental health factors could be confirmed by factor analysis [4, 21].
The significant concurrent validity between the subscales of the SRI and the SF-36 highlighted the importance of a specific HRQL tool for patients with chronic respiratory failure. The highest correlation was found between the subscales focusing on comparable aspects of HRQL and the least correlation between the subscales which did not. This was comparable to the original validation [25, 26]. SRI-SF strongly correlated with SF-36-VT. Similarly, SRI-WB correlated with SF-36-MH. There was a weak correlation between SRI-AS and SRI-RC with SF-36 scales. This was expected as the SF-36 was not designed to measure sleep disturbances or respiratory complaints, which are reportedly frequent in patients with chronic respiratory failure [25, 26]. SRI-SF showed a moderate-to-strong correlation with several SF-36 scales, indicating that a patient's ability to be involved in social activities is influenced by both physical and mental health factors.
Despite the given validity mentioned above, it has to be pointed out that the translation is formally valid for UK English only. In addition, the SRI is the result of professional forward and backward translation, but a weakness of this study is that this process was not formalised. Nevertheless, British and German researchers serving as authors of this study in addition to two independent native English translators have provided the UK English version of the SRI following a stepwise approach; thus a professional translation has been validated in the current trial. Furthermore, the authors would like to emphasise that for providing further validated translations of other languages, translators need to refer to the original German version and not to the translated English one.
Disease-associated anxiety is an important factor in HRQL in patients on long-term HMV. This is reflected by the scale SRI-AX correlating moderately with SF-36-GH, SF-36-VT, SF-36-MH and SF-36-RE. During the development and validation of psychometric properties of SGRQ and the CRQ anxiety was attributed to psychological disturbances in patients with COPD [6, 27]. Higher degree of anxiety has been shown to be related to higher degree of pulmonary impairment in patients with COPD [28]. Anxieties have been shown to improve after institution of HMV in patients with restrictive lung conditions, COPD and neuromuscular diseases [16, 24]. Duiverman et al. [19] showed that in COPD the SRI total score strongly related to anxiety and depression as assessed by HADS (Hospital Anxiety and Depression Scale).
HRQL in patients with chronic respiratory failure is known to be significantly influenced by the underlying condition [11]. The construct validity is reinforced by the fact that COPD and non-COPD groups could be differentiated by administering SRI. The COPD patients had the worst score for SRI-SS and RCWD patients had the best HRQL, which is in keeping with previous studies with SRI [11, 18].
Previous prospective studies on impact of HMV in chronic hypercapnic COPD have shown conflicting results. Studies by Elliott et al. [29] and Sivasothy et al. [30] did not show significant change in HRQL. However, Meecham Jones et al. [26] and Perrin et al. [31] showed significant HRQL improvement. This difference might be attributed to the fact that different HRQL tools were used in these studies. Neither of these HRQL tools was specifically designed for patients on HMV. Recently, Windisch [16] has shown that specific HRQL as recorded by SRI significantly improved after instituting HMV and this was sustained at 1 yr. It was also shown that overall improvements were similar between COPD, restrictive chest wall diseases and neuromuscular diseases with hypercapnic respiratory failure [16]. Moreover, HRQL changes as assessed by the SRI have even been shown to be dependent on ventilatory strategy in COPD patients, with high-intensity NIV aimed at maximally improving blood gases being superior to the conventional approach of low-intensity NIV, which fails to improve blood gases [13]. This indicates that such a specific tool is better suited to studying this population and it is highly sensitive to change. This validation study paves the way for further studies in this area, especially in the large English-speaking populations using this disease-specific HRQL tool. Given the high psychometric properties of this version there is no reason to believe that this version would not be sensitive to change.
In conclusion, the English SRI is the result of a professional translation and back-translation of the well-validated original German SRI. The present validation study on the English SRI establishes high psychometric properties, which were even higher than in the original German validation study. Other adaptations of the SRI have shown similar high psychometric properties. Thereby, high internal consistency reliability as assessed by Cronbach's alpha coefficient, high construct validity as assessed by both explorative and confirmatory factor analysis, and high concurrent validity as assessed by the correlation analysis between SRI and SF-36 scales have been established. In addition, the English SRI is capable of differentiating between different conditions causing chronic respiratory failure. Other disease-specific questionnaires like CRQ or the SGRQ have not been validated in patients on HMV with varied underlying causes. They do not address all the aspects of daily life that might be affected by HMV and chronic respiratory failure [32]. The English SRI qualifies for being used in researches assessing health-related quality of life in patients with chronic respiratory failure on home ventilation.
Footnotes
This article has supplementary material available from www.erj.ersjournals.com
Statement of Interest
A statement of interest for W. Windisch can be found at www.erj.ersjournals.com/site/misc/statements.xhtml
- Received September 5, 2011.
- Accepted November 28, 2011.
- ©ERS 2012