Abstract
The American Thoracic Society (ATS) published guidelines for the treatment and management of community-acquired pneumonia in 2001, but the impact of adherence on outcomes such as mortality and length of stay is not well defined.
A study of 780 patients with community-acquired pneumonia consecutively admitted to hospital over 1 yr was carried out. Nursing home patients were excluded.
Overall adherence to antibiotics recommended in the ATS guidelines was 84%. The lowest adherence was found in patients admitted to an intensive care unit (52%), especially those at risk of infection with Pseudomonas aeruginosa (ATS group IVb). However, very few patients from this group were indeed infected with P. aeruginosa. This could be explained by the exclusion of the nursing home patients. There was a difference in mortality between patients that received adherent and nonadherent regimens (3 versus 10.6%). There was a difference in length of stay between patients receiving adherent and nonadherent regimens (7.6 versus 10.4 days). This result was confirmed on multivariate analysis.
Adherence to the 2001 American Thoracic Society guidelines was high except in community-acquired pneumonia patients admitted to an intensive care unit. Length of stay was shorter in patients who received adherent rather than nonadherent antibiotic regimens.
Community-acquired pneumonia (CAP) is an infectious disease that is not routinely reported, making its prevalence difficult to determine. Currently, its reported annual prevalence is 3–5 adults per 1,000 population 1–5. In the USA, CAP is the sixth leading cause of death and the number one cause of death of infectious origin 3. In Spain, population studies have shown an annual incidence of 1.62 cases per 1,000 inhabitants 4. In nonhospitalied patients, CAP mortality is <5%. Among hospitalised patients, CAP mortality ranges 5–15%, and rises to 30% in patients admitted to an intensive care unit (ICU) 6. Inadequate initial antibiotic treatment is a poor prognostic factor 7–9.
The lack of an aetiological diagnosis when antibiotic treatment needs to be administered, the broad variety of antibiotics available and increasing resistance to antibiotics among the common aetiological pathogens have led different scientific societies to publish clinical guidelines to assist in the selection of the appropriate initial antibiotic regimen, taking into account various risk factors 10–14.
Menendez et al. 15 validated the 1993 American Thoracic Society (ATS) guidelines and the 1998 joint guidelines from the Spanish Society of Chemotherapy (SEQ) and the Spanish Society of Pulmonology And Thoracic Surgery (SEPAR) for CAP in a prospective study in Spain, finding a higher adherence to ATS guidelines than to SEQ/SEPAR guidelines, and a higher mortality rate in patients with severe pneumonia in whom one of these guidelines was not followed. Hauck et al. 16 validated a clinical pathway based on the 2000 Infectious Diseases Society of America (IDSA) guidelines 14. Mortensen et al. 17 determined that adherence to either the 2001 ATS or 2000 IDSA guidelines may reduce 30-day mortality among patients hospitalised with pneumonia. Two recent retrospective studies, focused on hospitalised patients with CAP, found decreased 48-h 18 and 30-day mortality 19 when initial antibiotic therapy was concordant with ATS 12 or IDSA 14 recommendations for these patients. The aim of the present study was to determine the influence of adherence to initial antibiotic recommendations in the 2001 ATS guidelines on mortality and length of stay (LOS). These outcomes were analysed taking into account the risk groups defined in the same guidelines and the initial mortality risk in each patient, as described by the pneumonia severity index (PSI) developed by Fine et al. 20. In addition, patients who were admitted directly from a nursing home were identified and excluded. This was carried out as these patients were considered to have healthcare-associated pneumonia (HCAP), an entity that has been excluded from the CAP patients group, according to the newly published ATS/IDSA guidelines for hospital-acquired pneumonia 21.
It was hypothesised that adherence to empirical antibiotic recommendations of the 2001 ATS guidelines in CAP is associated with a reduction in 30-day mortality and LOS.
MATERIALS AND METHODS
Study population and design
From July 1, 2001 to June 30, 2004, a prospective observational study was conducted at the 800-bed Hospital Clinic of Barcelona (Institut d’Investigacions Biomèdiques August Pi i Sunyer, University of Barcelona, Barcelona, Spain). The study included all consecutive patients admitted to the emergency department (aged >16 yrs) who showed clinical symptoms of pneumonia accompanied by the appearance of a new pulmonary infiltrate on chest radiography. However, the following patients were excluded: 1) those who had been hospitalised during the previous 21 days; 2) those exhibiting immunosuppression (AIDS or receiving chemotherapy or other immunosuppressive drugs); 3) those who had tuberculosis; 4) those resident in a nursing home; and 5) those with a confirmed alternative diagnosis at the end of follow-up.
Antimicrobial treatment regimen and data collection
The choice of empirical antibiotic therapy was determined entirely by the attending physician. Investigators did not interfere with the decision or enquire about the antibiotic choice. The 2001 ATS guidelines were not publicised among the physicians. All demographic and clinical data, as well as those regarding patient outcome (death and LOS), were recorded using a data collection tool. These data included the following variables: age, sex, residence in a nursing home, any comorbid condition (diabetes mellitus, chronic heart failure, chronic obstructive pulmonary disease, cerebrovascular disease, cancer, liver disease and adrenal disease), physical examination findings on admission (respiratory and cardiac frequency, body temperature, blood pressure and presence of obtundation on arrival), results of initial biochemical analyses (haematocrit, white blood cell count, renal function, electrolyte levels and arterial blood gas levels), chest radiographic findings and antibiotic regimen prescribed.
All surviving patients were visited or contacted by telephone ≥30 days after discharge. The ethics committee of the Hospital Clinic of Barcelona approved the present project, and waived the requirement for individual patient consent, since this was a purely observational study.
Definitions
All patients were classified retrospectively into ATS risk groups, according to the 2001 ATS guidelines (table 1⇓) 12, as well as into PSI classes I–V, using the mortality risk scale described by Fine et al. 20.
The treatment prescribed during the first 24 h of hospitalisation was considered to be the initial treatment. All initial empirical antimicrobial therapy, whether or not adhering to guidelines, was recorded.
An antibiotic regimen was defined as ATS adherent when the antibiotics chosen by the attending physician followed the recommendations included in the 2001 ATS guidelines, regardless of any additional antibiotic received 12.
Prior antimicrobial treatment received for the current infection in the outpatient setting was also recorded. Prolonged LOS was defined as any stay longer than the 75th percentile of the entire population 16, 22. Mortality was defined as death during the first 30 days following admission to the emergency department. Confusion was defined as a decreased consciousness or new disorientation regarding person, place or time.
Risk factors for Pseudomonas aeruginosa were considered to be the presence of any of the following: structural lung disease such as bronchiectasis; corticosteroid therapy (10 mg·day−1 prednisone); broad-spectrum antibiotic therapy for 7 days in the past month; malnutrition; and leukopenic immune suppression (corticosteroid therapy with >10 mg·day−1 prednisone and leukopenic immune suppression were also excluding factors) 12.
Microbiological evaluation
Samples considered valid for microbiological evaluation included: 1) sputum, 2) blood culture, 3) pleural fluid culture, 4) urinary Streptococcus pneumoniae and Legionella pneumophila antigen detection, 5) quantitative culture of tracheobronchial aspirates, 6) protected specimen brush samples, and 7) bronchoalvelolar lavage fluid. Diagnosis of the following microorganisms was performed by means of paired serology at admission and during the third and sixth week thereafter. 1) Respiratory viruses: influenza virus (A and B), parainfluenza virus (1, 2 and 3), respiratory syncytial virus, and adenovirus. 2) Atypical microorganisms, including Chlamydophila pneumoniae and Mycoplasma pneumoniae, as well as L. pneumophila serogroup 1 and Coxiella burnetii. Urine samples were obtained for detection of S. pneumoniae antigen (Binax NOW Streptococcus pneumoniae urinary antigen test; Binax, Inc., Portland, ME, USA) and L. pneumophila serogroup 1 antigen (Biotest Legionella urine antigen EIA; Biotest, Dreieich, Germany). Processing of samples and diagnostic criteria for a bacterial aetiology have been described elsewhere 23–25.
Statistical analysis
Quantitative variables were compared using an unpaired t-test, and the Mann–Whitney U-test was used for variables that did not follow a normal distribution. Qualitative variables were compared using the Chi-squared test. Two-tailed p-values of <0.05 were considered significant.
Multivariate statistical analyses were performed by logistic regression, with the criteria largest p-value for entering variables (0.05) and smallest p-value for removing variables (0.1). Variables remaining in the multivariate analysis model that showed a p-value of ≤0.05 were considered significant. Sample size estimates were performed with an α risk of 0.05 and β risk of 0.20.
RESULTS
Patients
A total of 829 patients were studied, 49 of whom came from a nursing home and so were excluded from the subsequent analysis. Of the resultant 780 patients, 138 were treated as outpatients and the rest as in-patients. There were 477 (61.2%) males and 303 (38.8%) females with a mean±sd age of 64.4±19.2 yrs (range 16–102 yrs). Their distribution by PSI and ATS risk group are shown in tables 2⇓ and 3⇓. A detailed description of the baseline characteristics of both groups are shown in table 4⇓.
Microbial aetiology by ATS and PSI risk group
In 39.2% of the group as a whole, an aetiological diagnosis was established. The most common pathogen identified was S. pneumoniae (19.2%), followed by atypical bacteria (C. pneumoniae and M. pneumoniae, as well as L. pneumophila and Coxiella burnetii) as a group (6.4%). When analysed by ATS risk group (table 5⇓), the most common pathogen determined was S. pneumoniae in all risk groups, except in ATS risk group I, in which atypical bacteria were most common. Nonfermenting Gram-negative bacteria were uncommon isolates in the present series. P. aeruginosa was isolated from only 10 patients (from four as part of mixed infections): six in group IIIa, two in group IIIb, one in group IVa, and one in group IVb. Only two patients died, one in group IIIb and one in group IVa. When analysed by PSI score, the most common pathogen determined was S. pneumoniae in all risk groups. Atypical bacteria as a group were second in frequency in all risk groups except PSI V, in which mixed infections were second.
Antibiotics administered
Antibiotic treatment in patients admitted to hospital included: a combination of a β-lactam (amoxicillin/clavulanic acid, third-generation cephalosporin or carbapenem) and a macrolide (64.2%); quinolones, alone or in combination with macrolides (13.6%); a β-lactam (amoxicillin/clavulanic acid, third-generation cephalosporin or carbapenem) alone (10.4%); a β-lactam and a quinolone (7.8%); macrolides alone (0.6%); other antibiotic combination regimens not including a macrolide or a quinolone (3.3%); and other single-antibiotic regimens (0.2%).
Adherence
In 657 (84.2%) out of 780 patients, and 531 (82.7%) out of 642 patients admitted to a hospital ward or ICU, the initial antibiotic regimen was prescribed in agreement with the guidelines issued by the ATS 12. Prior ambulatory antimicrobial treatment had been prescribed in 120 (18.7%) out of 642 admitted patients; in these patients, empirical in-patient treatment adhered to ATS guidelines in 93 (77.5%) out of 120 patients, compared with 438 (83.9%) out of 522 in the group without prior treatment (p = 0.094).
Nonadherent treatments are shown in table 6⇓. In general, it was observed that the nonadherent regimens in ATS groups I–IVa most commonly did not provide for atypical pathogen coverage, whereas most of the nonadherent therapy for ICU-admitted patients in group IVb did not provide coverage for P. aeruginosa.
Length of stay
The mean±sd duration of hospital stay was 8.1±7.7 days. In the group adhering to the ATS guidelines, mean duration of hospital stay was 7.6 days, compared with 10.4 days in those receiving treatment nonadherent to the ATS guidelines (table 7⇓). Again, the difference (2.8 days; 95% confidence interval (CI) 0.93–4.66) was significant (p = 0.004). LOS was shorter for patients’ adherent to the guidelines, except those admitted to the ICU. Stratified by PSI score (table 7⇓), only group IV showed a significant difference in LOS when comparing ATS-adherent and -nonadherent groups (p = 0.038).
The cut-off for considering LOS as prolonged in the present study was chosen as 9 days 16, 22. Prolonged LOS was significantly and independently associated with ATS nonadherence on multivariate analysis (odds ratio (OR) 0.60; p = 0.049). Other variables showing significance (table 8⇓) were: respiratory frequency of >40 breaths·min−1 at time of arrival (OR 2.51; p = 0.035); presence of pleural effusion (OR 3.32; p<0.001); requirement for mechanical ventilation in the first 24 h (OR 5.55; p = 0.001); and active alcohol intake (OR 1.95; p = 0.04).
Mortality
The overall mortality rate was 4.1% (33 out of 780). The specific mortality rates among patients receiving adherent and nonadherent regimens were 3.0% (20 out of 657) and 10.6% (13 out of 123), respectively (p<0.001).
The in-patient mortality rate was 5.1% (33 out of 642 admitted patients). The specific mortality rates among admitted patients receiving adherent and nonadherent regimens were 3.8% (20 out of 531) and 11.7% (13 out of 111), respectively (p = 0.001). The mortality differences applied to ATS risk group III, but not to risk group IV (table 9⇓), although the number of ICU-admitted patients was small (37 adherent versus 34 nonadherent).
When patients were stratified according to PSI score (table 9⇑), mortality was found to be higher in patients receiving treatment that did not adhere to ATS guidelines in PSI classes III–V, but this did not reach significance.
Logistic regression analysis for the prediction of mortality in admitted patients (table 9⇑) did not confirm ATS adherence as a protective factor. Significant variables were: obtundation (OR 7.04; p = 0.001), shock (OR 5.89; p = 0.011), and increased risk of aspiration (OR 2.69; p = 0.046).
DISCUSSION
Clinical guidelines recommended by professional societies have been broadly published, and have entered into widespread use in almost every medical field since the 1990s. Until recently there was little evidence of their influence on patient prognosis, or their impact on relevant social and economic variables, such as healthcare-related costs or duration of hospitalisation. Gleason et al. 27 were unable to show significant differences in medical outcomes in CAP outpatients treated according to, or not according to, the 1993 ATS guidelines. Menendez et al. 15 only found significant differences in PSI class V patients, whereas two studies from the University of Texas evaluated a combination of the ATS and IDSA guidelines and found a significant difference in both 30-day mortality and LOS 17, 19. However, these studies were totally retrospective and did not stratify patients according to ATS or IDSA risk group. Dean et al. 28 found decreased mortality and LOS after the implementation of local guidelines based on a combination of local practices and IDSA and ATS guidelines. In the present study, the relationship between antibiotic adherence to the 2001 ATS guidelines for CAP and two important outcomes, mortality and LOS, was examined.
The most important findings of the present study were that adherence to ATS guidelines was high (84.2%), and that there was a significant difference in mortality (3.0 versus 10.6%; p<0.001) and LOS (7.6 versus 10.4 days; p = 0.004) between patients receiving adherent and nonadherent regimens, respectively, in the crude analysis. Multivariate analysis confirmed that adherence to ATS guidelines is a protective factor for prolonged LOS, but not for mortality.
The PSI score 20, which estimates the role of 20 clinical factors, is a valid and useful tool for the prediction of mortality in hospitalised patients with CAP. It was observed that mortality in patients admitted to hospital, but not the ICU, increased when the treatment administered was not in accordance with the guidelines. In addition, LOS was shorter for patients treated adherent to the guidelines, except those admitted to the ICU, as reflected in table 7⇑. Stratified by PSI score, only group IV showed a significant difference in LOS, but, using Bonferroni correction, p-values of >0.01 may not indicate a real effect but rather a chance finding due to a multiple-testing effect.
Interestingly, the lowest adherence rate to guideline therapy was in those admitted to the ICU (ATS classes IVa and IVb), for whom adherence was 52.1%. In the present study, the number of patients admitted to the ICU was small, but guideline adherence was not associated with a reduction in mortality or LOS compared with nonadherence to guidelines. Most of the nonadherence for ICU-admitted patients was in group IVb, as no antipseudomonal therapy was provided for those with risk factors. However, very few of the patients were infected with P. aeruginosa, and so this nonadherent therapy may in reality have been appropriate therapy, thus explaining the absence of adverse consequences of nonadherence. One reason for such a low rate of P. aeruginosa may have been the exclusion of nursing home patients, identifying a need for the re-evaluation of recommendations for group IVb patients when this population excludes those with HCAP.
The mortality rates obtained in the present study were similar to those reported by other researchers 29, 30. However, it was found that nonadherence to ATS guidelines was associated with a more than doubling of mortality, although this was not significant on multivariate analysis. Three other studies 31–33 investigating initial empirical treatment according to the ATS guidelines 31, 32 or British Thoracic Society guidelines 33 found no difference in overall mortality between adherence and nonadherence to the three guidelines. Interestingly, differences were specifically found in mortality in ATS group IIIa (p = 0.02), which represents the majority of patients admitted to a conventional ward (PSI classes III–V). This finding could be related to the lack of coverage for atypicals in some patients belonging to this group (table 6⇑). Recent data from the Community-Acquired Pneumonia Organization project 34 strongly suggest that there is increased mortality in this population when antibiotic treatment does not cover atypical microorganisms.
Multiple regression analysis confirmed that nonadherence to the ATS guidelines is associated with an adverse effect as regards LOS, which supports the utility of implementing these guidelines.
The present lack of mortality benefit on multiple regression analysis may be due to lack of power. With the present findings, a sample size of 1,178 patients was required. However, for LOS, a sample size of only 613 admitted patients was required.
The present conclusions apply to CAP patients in general, but maybe not to those with pseudomonal risks (group IVb), once patients with HCAP have been excluded.
The present study has several potential limitations that should be addressed. First, it is an observational nonrandomised study. This reduces the level of confidence as regards its main finding, i.e. in patients with CAP, nonadherence to guidelines increases LOS. Nevertheless, the present authors consider that well-designed observational studies are suited for guideline validation and that randomised controlled trials may not be the best means of performing this type of study, due to ethical issues, overflow from intervention to nonintervention patients, learning abilities, etc. Some of these issues have been raised previously by Fishbane et al. 35.
Secondly, since only one process (antibiotic adherence) was being analysed and not composite processes, it was not possible to determine whether or not major adherence is associated with better overall care and how this affected the present results. In addition, the study design does not permit the possibility that treatments not adhering to guidelines may have been chosen for a group of patients with more severe initial disease to be ruled out, despite their belonging to the same risk class as other patients. This is suggested by the finding that patients receiving nonadherent as opposed to adherent treatments, as reflected in table 4⇑, more frequently required ICU admission during the first 24 h (27.6 versus 5.6%; p<0.001) and mechanical ventilation (16.3.6 versus 3.2%; p<0.001). They also presented with more aspiration risk (14.6 versus 2.0%; p<0.001), obtundation (18.7 versus 8.1%; p<0.001), shock (13.0 versus 4.4%; p<0.001) and low arterial oxygen tension/inspiratory oxygen fraction ratio at time of arrival (34.1 versus 16.9%; p<0.001), but the associations with tachypnoea, multilobar infiltrates, blood pressure, arterial oxygen saturation and pH, and pleural effusion are not strong and should be interpreted with caution in order to avoid interpreting chance findings due to a multiple-testing effect as significant, since their p-values are >0.0015. In addition, predefined discharge criteria are lacking. Nevertheless the results of the multivariate analysis suggest an independent impact of guideline adherence as favourably affecting LOS. It can be assumed that the lack of predefined discharge criteria could not lead to a bias that produced a longer LOS in one of the groups since those different discharge criteria should be distributed evenly between the two groups. Comparing the group with a LOS of <9 days and a LOS of >9 days, a higher rate of pneumonia complications was found in the latter group (115 out of 499 versus 88 out of 143; OR 5.343 (95% CI 3.595–7.939); p<0.001), which could explain the difference in LOS.
Thirdly, the therapeutic changes introduced after the initial antibiotic treatment had been prescribed were not investigated; however, using multivariate analysis, Gleason et al. 36 showed that such changes did not influence final outcome. It is also probable that these changes were not dependent upon initial adherence, being homogeneously distributed in the present study group.
Fourthly, the time from admission to first antibiotic administration has been suggested as a key predictor of outcome, but this information was not recorded in the present study. Finally, since the present study was carried out in only one hospital, it may not necessarily be possible to extend its results to other settings.
Since the present study was conducted, new CAP guidelines have been published by the ATS and IDSA 37; however, the therapeutic recommendations are sufficiently similar to those evaluated that it is unlikely that the present findings would have been different had adherence to the new guidelines been evaluated. In addition, the regimens that were nonadherent to the 2001 guidelines would also have been nonadherent to the new guidelines.
In summary, the results of the present study show that adherence to the initial antibiotic recommendations for the empirical treatment of CAP of the 2001 ATS guidelines may contribute to shorter LOS, especially in patients not admitted to the ICU. Therefore, the present data support the recommendations of these guidelines; however, it was found that, once patients with HCAP were omitted, there were very few individuals with P. aeruginosa infection, and those with pseudomonal risks who were admitted to the ICU received no benefit from therapy with antipseudomonal agents. These findings suggest a need for the re-evaluation of therapeutic recommendations for ICU-admitted CAP patients with pseudomonal risks, now that patients from nursing homes are not included in this group.
It is also true that the American Thoracic Society/Infectious Diseases Society of America guidelines may not be applicable in many European countries, and correlation of adherence with aetiology is difficult, since an aetiological diagnosis was only obtained in 39.2% of the present patients, 241 of whom exhibited a bacterial aetiology. Of these, 63 (27.5%) out of 229 patients receiving concordant treatment had a length of stay of >9 days compared with eight (66.7%) out of 12 patients receiving discordant treatment (odds ratio 0.190; p = 0.004). As regards patients not admitted to the intensive care unit, nonadherence most commonly meant no atypical pathogen coverage, and it was this nonadherent group that exhibited an increased length of stay, which indirectly implies that the American Thoracic Society suggestion that these organisms be covered might be correct, even in Europe.
Support statement
This study was supported by Ciber Enfermedades Respiratorias (Bunyola, Spain; CB06/06/0028) and SGR 00822 and IDIBAPS and FIS PI 020616. This article was presented at the American Thoracic Society 2005 International Conference.
Statement of interest
None declared.
Acknowledgments
The authors would like to thank I. Aldabo (Institut d’Investigacions Biomèdiques August Pi i Sunyer, University of Barcelona, Barcelona, Spain) for help in data collection and review.
Footnotes
-
For editorial comments see page 823.
- Received December 4, 2007.
- Accepted May 24, 2008.
- © ERS Journals Ltd