|
|
||||||||
1 Peninsula Medical School, Exeter, 2 MEDTAP International, and 3 Imperial College of Science, Technology and Medicine, National Heart and Lung Institute Division, Charing Cross Hospital, London, UK
CORRESPONDENCE: J.L. Campbell, Peninsula Medical School, Exeter,, EX2 5DW,, UK. Fax: 44 1392432223. E-mail: john.campbell@pms.ac.uk
Keywords: clinical data, drug administration, patient reports, respiratory, survey
Received: October 24, 2002
Accepted February 21, 2003
Research and development was financially supported by AstraZeneca, Lund, Sweden.
| Abstract |
|---|
|
|
|---|
As no comprehensive instrument to measure patient satisfaction with inhaled asthma medication existed, the Satisfaction with Asthma Treatment Questionnaire was developed. The procedures that were used are described, and the initial validation and reliability tests are reported. The study involved focus group meetings, development, testing and modification of a preliminary instrument, and testing of the revised instrument using different samples of patients with asthma.
Factor analysis of the 26-item questionnaire identified four domains reflecting four aspects of satisfaction: effectiveness of treatment, ease of use, medication burden, and side-effects and worries. Cronbach's alpha showed evidence of internal consistency reliability. Test/retest reliability ranged from 0.660.74. Interscale correlations were moderate-to-high. Significant correlations were found between domain and overall scale scores and patients' overall level of satisfaction.
The Satisfaction with Asthma Treatment Questionnaire is potentially a useful instrument for gaining insight into patient satisfaction with inhaled treatment for asthma.
For many patients, asthma is a long-term condition requiring prolonged treatment. It is important that patients feel confident with the medication they are using, that the treatment is adequate in controlling symptoms and that side-effects of treatment are minimal and well tolerated 1. If these conditions are not met, it is likely that patients will not comply with the prescribed treatment regimen. In turn, this noncompliance can have a negative impact on the effectiveness of treatment, and may lead to increased morbidity 2, 3 and even mortality 4.
Improving compliance in asthma may involve simplification of the treatment regimen. To assess the potential benefit in terms of compliance enhancement, it is important to know how patients feel about treatment regimens actually adopted. Such information may assist the definition of optimal medical care for the individual patient. Although the past two decades have witnessed increasing interest in the issue of patient satisfaction with treatments 5, 6, more work has involved patient satisfaction with the structures and processes of medical care. There appears to be a consensus that patient satisfaction is an important measure that should be included in healthcare evaluations 6, 7. Although certain information can be derived from the medical care-satisfaction literature, studies are often too broadly focused to be of value in the assessment of satisfaction with specific regimens or therapies.
An initial literature review (19902000) focused on studies investigating treatment satisfaction and preferences and compliance with asthma medication. The few studies that were identified focused on the patients' satisfaction with the physical characteristics of inhalers and their preferences for various presentations of inhaled drugs (such as dry powder versus aerosol) 813 or dosing regimens 14.
In a cross-sectional survey of primary-care patients, Balsbaugh et al. 15 investigated what features of asthma medications were of importance to patients. Avoidance of blood-test monitoring was the strongest of any attribute. Patients' views were also highly affected by the frequency of dosing, but not by the route of drug administration.
While several instruments exist that are useful in assessing quality of life 16, the presence of symptoms 17 or subject self-efficacy 18 in asthma, the authors were not able to identify an existing comprehensive instrument to measure patient satisfaction with inhaled asthma medication that would be suitable as an outcome measure in the context of a clinical trial. The authors concluded that it was necessary to develop such an instrument themselves, and here they report on the development and initial validation and reliability testing of the Satisfaction with Asthma Treatment Questionnaire (SATQ). Further work is planned examining the performance of the instrument in clinical settings. The study was conducted in two different centres in London, UK. The approval of the local research ethics committee was obtained for this study.
| Methods |
|---|
|
|
|---|
Preliminary instrument
The preliminary instrument was based on the findings from existing literature and the focus groups and from expert opinion. Predefined basic requirements were that the written format should be suitable for self-completion by the patient, and that it should be simple, brief, and easy to understand and administer. The preliminary instrument was tested in two samples of patients familiar with the use of asthma inhalers in order to assess the comprehensiveness, comprehensibility and relevance of items. Over a period of 2 weeks, those with asthma attending either a hospital- or primary care-based chest clinic were asked to complete the questionnaire whilst waiting to be seen. The preliminary instrument was modified to reflect patients' responses.
Psychometric testing
The validity, reliability and responsiveness of the revised instrument were tested in a larger group of patients with varying severity of asthma, all of whom were familiar with the use of asthma inhalers. Patients were identified and recruited from the patient databases in the same two centres as for the pilot test. Eligibility criteria were the same as for the focus group. Additional criteria included the use of a minimum of two asthma inhalers and capability of reading and understanding English at a level allowing them to complete the questionnaire. A questionnaire and prepaid response envelope were mailed to all of these patients and a reminder was sent to nonresponders after 2 weeks. Patients who agreed to complete the questionnaire again were sent the same instrument by mail
2 weeks after the first questionnaire.
The questionnaire incorporated additional questions relating to age, sex, employment status, time since diagnosis of asthma and the inhalers currently used, and a number of debriefing questions enquiring about the time required for completion, the degree of difficulty of questions, clarity of formulation and appropriateness and comprehensiveness of the items. The retest questionnaire also incorporated a question asking the patient's perception of change of asthma status since first completion.
Data analysis
Data from the preliminary and revised questionnaires were analysed using descriptive statistics to verify that there was variability of response categories to each question and to verify the number of missing data for each item. Tabulation of patient characteristics, as well as missing data and consistency checks were performed. Scores of the negatively phrased items were reversed, so that for all items a higher score indicated greater satisfaction. All items that were subject to a ceiling effect were eliminated.
Factor analysis (principal components with varimax rotation) assessed the data for evidence of a domain structure consistent with domains considered part of the satisfaction construct. Domain scores were constructed by summing the intrascale item ratings and dividing this by the number of items in the domain. An overall score was calculated by adding the scores of each item and dividing this by the number of items. It was not the authors' intention to explore the detailed performance of the instrument among asthma population subgroups, but to describe overall performance in samples of subjects drawn from clinical practice.
Internal consistency reliability was measured using Cronbach's alpha 19. Test/retest reliability (reproducibility 20) was assessed using intraclass correlation coefficients. Paired t-tests were used to compare the scores of first and second assessments from patients who completed the questionnaire twice and who had indicated no change in their asthma condition since completion of the first questionnaire. Paired samples t-tests were conducted for the individual items as well as the four factors and the global satisfaction item to test that the average of differences between both assessments differed from zero.
Construct validity was evaluated by examining Spearman's rank correlation coefficient between items and domains and between domain and overall scale scores and a global evaluation of patient satisfaction with medication. Results of the factor analysis were also used as an indicator of the construct validity of the measure. For the measures of construct validity (factor analysis and correlation coefficients) and internal consistency reliability, data from the first (n=131) and second (n=59) assessments were pooled (combined n=190).
| Results |
|---|
|
|
|---|
The general pattern that emerged from the focus groups was that patients had enough knowledge of their medication to allow its proper use and that the majority of patients reported having set times of the day at which they took their prescribed medication. Most patients said that they tended to adhere to the dose of maintenance medication prescribed. However, among the most experienced users there was a consensus that they had enough knowledge and experience to vary the dose of maintenance medication according to their individual needs, decreasing the dose when they were feeling stable and well, increasing the dose when they were feeling worse or susceptible to attacks.
With respect to rescue medication, patients expressed that they disliked using this medication and tried to avoid it, because they believed it to be harmful in large doses and/or "addictive". Patients were asked about ease of use and convenience and the importance of having the appropriate inhaler available at the right time. The majority of patients reported that they rarely left home without taking rescue medication with them, even for short-term activities, such as going to local shops or to the cinema. A common fear was that inhalers may run out unexpectedly. Inhalers with an indicator showing the number of remaining doses were thought to be very convenient and were preferred by patients.
With regards to patients' preference for a specific type of inhaler, many patients had experience of different types of inhaler. For those who had, there was no consensus on the preferred type. Undesirable features of inhalers were reported to be a risk of side-effects, such as bad taste, dry throat and hoarseness.
Pilot testing
The preliminary questionnaire comprised 12 items focusing on convenience and ease of use for each inhaler used, effectiveness and potential side-effects, and patients' confidence in and satisfaction with inhalers. Two additional questions related to the degree of difficulty and comprehensiveness of the questionnaire.
Forty-seven patients (40% male, 60% female, average age 56 yrs (range 2578 yrs) who had asthma for an average of 17 yrs (range 160 yrs)) completed this questionnaire. This pretesting phase revealed a number of problems with the construction of the questionnaire. Although the majority of patients indicated that the questions were easy to answer (65%) or at an average level of difficulty (33%), the amount of missing data was substantial. The instruction to answer the questions separately for each inhaler used was not understood by one-half of the sample. This problem, as well as other comments from patients, led to significant revision of the instrument. All questions were changed into a statement mode, with response categories for all items revised into a 7-point scale (1 "strongly disagree" to 7 "strongly agree"). A number of items were added, based on the feedback received from the patients, to make the questionnaire more comprehensive. To minimise the chance of acquiesce bias, some statements were phrased positively and others negatively in a random order. For the formatting of the questionnaire, design principles were applied as outlined by Mullin et al. 21. The revised SATQ consisted of 35 items.
Psychometric testing
A total of 131 patients with asthma participated in the psychometric evaluation of the revised instrument representing a response rate of 60% (219 were approached to participate), a response rate in line with similar postal surveys in primary care 22, 23. The demographic and other patient characteristics of responders are shown in Appendix 1, table 4
. Responders were of a similar sex distribution but older than nonresponders (females 68% response, males 57%, p>0.05; responders (mean±sem) 45.4±1.3 yrs versus nonresponders 36.5±1.6 yrs, p<0.001; 54% were in employment). Of those who were unemployed, 10% indicated that their unemployment was related to their asthma. The average age was 45 yrs (range 1870 yrs) and the majority of respondents (91%) had been using asthma inhalers for >1 yr. After 2 weeks, 95 (73%) patients indicated a willingness to fill out the questionnaire again, and 59 (62%) retest questionnaires were completed and returned. The 35-item questionnaire showed few missing data: 59 of a potential total of 6,650 responses (0.9%).
|
|
Internal consistency and test/retest reliability
The results of the internal consistency and test/retest reliability analyses are presented in table 1
. Cronbach's alpha values ranged 0.710.88 (exceeding the 0.70 criterion proposed in the literature 24, 25) for the four scales, indicating evidence of reliability of the scales and no redundancy of the items. Intraclass correlation coefficients were used as a measure of test/retest reliability (reproducibility). The four scales ranged 0.660.74. Paired samples t-tests for the individual items, as well as the four factors and the global satisfaction item, showed no significant differences for any of the comparisons (data not shown).
|
|
|
|
| Discussion |
|---|
|
|
|---|
The questionnaire can now be used in a wider variety of clinical settings and further validation of the discriminatory power and the sensitivity of the instrument can be undertaken, for example, against objective measures of lung function. The performance of the questionnaire also needs to be compared with the performance of other instruments measuring similar constructs and against other measurement of asthma care (e.g. treatment compliance), and among subgroups of asthma patients defined by degree of disease control and sociodemographic profile.
Among the patients included in this study, generally there was high satisfaction with their asthma treatment. This is in line with another recent, larger UK survey 27 of patients with asthma who had seen their general practitioner in the past 3 yrs; 56% were very satisfied and a further 31% were fairly satisfied with primary care, and 85.3% stated that their asthma was well controlled or completely controlled. The majority of patients in this study had had asthma for a long period of time and were accustomed to asthma medication in general and to the use of inhalers in particular. Apart from adequate disease management and appropriate medication use, it is likely that the patients' adaptation to the illness and familiarity with the appropriate use of medication all contribute to a greater level of satisfaction. As the formulation and delivery of new asthma treatments becomes more sophisticated, it is important to have robust instruments with known psychometric properties available for the routine evaluation of new therapies. The authors believe the Satisfaction with Asthma Treatment Questionnaire may fill that role.
|
|
Appendix 1
Patient evaluation of measure
Twenty-seven patients provided feedback regarding the formulation of questions. Some comments referred to general issues such as "I would be happy not to have asthma" in response to the item "I would feel happy to continue my current asthma medication" or "I recommend they see their doctor" in response to those who reported difficulties with the ease of inhaler use. Of the three patients who reported they found some questions upsetting, two referred to the item "I am concerned that the amount of medicines I am taking is/will be harmful or addictive". One patient was afraid that this could lead to discontinuation of treatment and one patient found this question provoking "because I haven't questioned my medication for years". This question was removed in the factor analysis as the item loaded high on three factors. Although 52 patients indicated that aspects of asthma medication had not been addressed in the questionnaire, the majority of their suggestions referred to aspects that the authors were not attempting to assess, such as the impact of asthma on patients' lives, seasonal influences or the use of other medication.
Appendix 2: Satisfaction with Asthma Treatment Questionnaire final version
This questionnaire asks for your opinions about your current asthma medication. This information will help us to know how you feel about your current medication and how effective it is in controlling your asthma symptoms.
The questionnaire contains 26 questions. Please read and answer all the questions by circling the number that best reflects your opinion today.
For example: circling the figure 7 below means that you strongly agree with the statement: "My asthma medication provides fast relief of my asthma symptoms".![]()
| Acknowledgements |
|---|
|
|
|---|
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |