Abstract
Question Is broad-spectrum antibiotic use associated with poor outcomes in community-onset pneumonia after adjusting for confounders?
Methods We performed a retrospective, observational cohort study of 1995 adults with pneumonia admitted from four US hospital emergency departments. We used multivariable regressions to investigate the effect of broad-spectrum antibiotics on 30-day mortality, length of stay, cost and Clostridioides difficile infection (CDI). To address indication bias, we developed a propensity score using multilevel (individual provider) generalised linear mixed models to perform inverse-probability of treatment weighting (IPTW) to estimate the average treatment effect in the treated. We also manually reviewed a sample of mortality cases for antibiotic-associated adverse events.
Results 39.7% of patients received broad-spectrum antibiotics, but drug-resistant pathogens were recovered in only 3%. Broad-spectrum antibiotics were associated with increased mortality in both the unweighted multivariable model (OR 3.8, 95% CI 2.5–5.9; p<0.001) and IPTW analysis (OR 4.6, 95% CI 2.9–7.5; p<0.001). Broad-spectrum antibiotic use by either analysis was also associated with longer hospital stay, greater cost and increased CDI. Healthcare-associated pneumonia was not associated with mortality independent of broad-spectrum antibiotic use. In manual review we identified antibiotic-associated events in 17.5% of mortality cases.
Conclusion Broad-spectrum antibiotics appear to be associated with increased mortality and other poor outcomes in community-onset pneumonia.
Abstract
Despite propensity-based, weighted balancing including providers and adjustment for multiple patient-level confounders, broad-spectrum antibiotics appear to be associated with increased mortality and other poor outcomes in community-onset pneumonia http://bit.ly/2DafBax
Introduction
Antibiotic selection is an important contributor to outcomes in community-onset pneumonia. In patients without risk factors for drug-resistant pathogens (DRPs), treatment with a narrow-spectrum β-lactam plus a macrolide is associated with decreased mortality [1]. However, it is less clear how best to identify and treat patients at high risk of DRPs. Since publication of the American Thoracic Society/Infectious Diseases Society of America healthcare-associated pneumonia (HCAP) guidelines [2] and the Surviving Sepsis Campaign guidelines [3], utilisation of broad-spectrum antibiotics such as vancomycin and piperacillin–tazobactam has doubled, yet the incidence of DRPs and overall outcomes remain stable [4, 5]. Higher mortality has been observed in patients meeting at least one HCAP criterion [6, 7], although it remains unclear whether this effect is due to severity, comorbidities or poor functional reserve [7, 8]. Two large propensity-adjusted studies have associated broad-spectrum antibiotic use with increased mortality in HCAP [9, 10]. Here, we sought to clarify two important clinical questions. 1) Is broad-spectrum antibiotic use associated with poor outcomes in community-onset pneumonia after controlling for known contributors of mortality? 2) After adjusting for antibiotic selection, does HCAP remain associated with mortality risk?
Methods
Design and population
We performed a retrospective observational cohort analysis of patients >18 years of age admitted to the hospital with community-onset pneumonia from four emergency departments in Utah, USA from December 2011 through November 2012 [6] and from November 2014 through September 2015 [11]. Data were gathered through queries of Intermountain Healthcare's enterprise data warehouse (Salt Lake City, UT, USA). Cases were identified using International Classification of Diseases, Ninth Revision pneumonia codes and/or emergency department physician completion of an electronic pneumonia clinical decision support tool and then radiographically confirmed manually through review of emergency department chest imaging reports by study investigators. Except for Charlson Comorbidity Index (CCI), rare missing data (e.g. mental status in the emergency department not recorded during initial nurse exam) were located by manual review of provider notes. We excluded patients with more than one episode of pneumonia within 12 months and immunocompromised patients with HIV or active solid and haematological cancers. As the regression analyses adjusted for provider variability, we also excluded patients seen by providers who saw less than six patients. We also excluded patients with missing CCI data.
All antibiotics administered within the first 12 h after emergency department registration were included for analysis, thereby capturing empiric antibiotics administered in the emergency department as well as during the initial hospital admission. Broad-spectrum antibiotics were defined as receipt of any agent during that window with activity against either methicillin-resistant Staphylococcus aureus, such as vancomycin or linezolid, or Pseudomonas aeruginosa, such as piperacillin–tazobactam, imipenem–cilastatin, meropenem, cefepime, ceftazidime or aztreonam, but excluding fluoroquinolones as they are recommended monotherapy for community-acquired pneumonia (CAP) [12]. Inadequate spectrum was defined as any initial antibiotic regimen not active against the pathogen ultimately identified.
All microbiology results were reviewed manually by the infectious disease physician investigator (B.J.W.). Positive results included organisms compatible with respiratory pathogens [13] recovered from cultures of blood, sputum, tracheal aspirate, bronchoalveolar lavage or pleural fluid, as well as urine antigens for Streptococcus pneumoniae and Legionella pneumophila and PCR assays for Mycoplasma pneumoniae and Chlamydophilia pneumoniae. DRPs were defined as organisms falling outside the spectrum of antibiotics recommended for treatment of CAP, e.g. ceftriaxone and azithromycin or respiratory fluoroquinolones, and included MRSA, P. aeruginosa, extended-spectrum β-lactamase-producing Enterobacteriaceae and other Gram-negative bacilli resistant to third-generation cephalosporins or fluoroquinolones. Clostridioides difficile infection (CDI) was defined by diagnosis >72 h after admission and within 30 days of hospital discharge.
Cost (USD) was calculated as total variable costs, excluding indirect facility costs.
Approval for the study was granted by the Intermountain Healthcare institutional review board.
Statistical analysis
Simple, two-way comparisons used the Chi-squared test or Fisher's exact test for categorical variables and the unpaired t-test or Mann–Whitney U-test for continuous variables depending on distributional assumption. Hypothesis tests were two-tailed and considered statistically significant if p<0.05.
The primary outcome was 30-day all-cause mortality and we chose the following covariate adjusters: age, sex, HCAP, CCI, electronic CURB-65 (eCURB: confusion, urea >7 mmol·L−1, respiratory rate ≥30 breaths·min−1, blood pressure <90 mmHg (systolic) or ≤60 mmHg (diastolic), age ≥65 years) [14], arterial oxygen tension (PaO2)/inspiratory oxygen fraction (FIO2) ratio [15], intubation status, receipt of vasopressors, number of severe CAP (sCAP) minor criteria [12], bacteraemia, length of stay, inadequate antibiotic spectrum and admitting provider. Secondary outcomes included length of stay, cost and 30-day incidence of CDI. Covariate adjusters for length of stay and cost were age, HCAP, CCI, eCURB, intubation status, receipt of vasopressors, number of sCAP criteria and provider. As we observed only 27 cases of CDI (1.4%), we adjusted only for length of stay to avoid overfitting.
To measure the effect of broad-spectrum antibiotic use on binary outcomes (30-day mortality and CDI), we fitted unweighted multivariable regressions with logit-link functions. For Γ-distributed outcomes (length of stay and cost), we fitted unweighted multivariable regressions with log-link functions. Effect estimates are reported as exponentiated β coefficients (eβ), interpreted as odds ratios for binary outcomes and as multipliers for Γ-distributed outcomes.
As the decision to prescribe broad-spectrum antibiotics varies by an individual provider's assessment of both severity of illness and likelihood of a DRP, we recognised the possibility of indication bias in estimating the causal effect of broad-spectrum antibiotics on outcomes. To mitigate this bias, we conducted sensitivity analyses to measure the average treatment effect on the treated (ATT) by inverse-probability of treatment weighting (IPTW) [16–18]. To do this, we developed a propensity score using multilevel generalised linear mixed models with provider-level random intercepts and the following covariates: age, sex, eCURB, PaO2/FIO2 ratio, number of sCAP criteria, intubation status, receipt of vasopressors, CCI, HCAP, diabetes mellitus, moderate-to-severe liver disease, paraplegia and hemiplegia, congestive heart failure, and cancer. Lastly, to address the possibility that some patients may not have received care commensurate with severity due to goals of care decisions, we also conducted identical subgroup analysis in a cohort restricted only to patients admitted to the intensive care unit (ICU).
We conducted statistical model diagnostics using calibration plots and discrimination via receiver operator characteristic curves for all binary outcome models and de-trended quantile–quantile plots for continuous outcome variables [19]. Refer to the supplementary material for a detailed summary of model diagnostics. To assess the impact of IPTW on balancing variables between the broad-spectrum and non-broad-spectrum groups, we plotted the unweighted and the IPTW standardised differences and variance ratio between treatment groups for each covariate in the primary model [18]. Statistical analyses were conducted using R version 3.5.1 (R Foundation for Statistical Computing, Vienna, Austria) and SPSS version 22.1 (IBM, Armonk, NY, USA).
Finally, to investigate unmeasured variables and real-world biological plausibility of observations noted during analysis, the infectious disease physician investigator (B.J.W.) performed a standardised manual review of 20% of randomly selected mortality cases. Cases were annotated when any of the following were considered to directly contribute to demise: 1) comorbidities and in-hospital complications, including acute kidney injury, blood disorders, cardiac events, chronic pulmonary disease, falls/injury, hypersensitivity, metastatic malignancy, neurological/cognitive and thrombosis; 2) change of goals of care leading to palliative management or withdrawal of care; 3) advanced age (>75 years); 4) severity (referring to haemodynamic and/or respiratory compromise attributable to pneumonia); 5) adverse events attributable to broad-spectrum antibiotic and not to any other more obvious cause, including acute kidney injury, anaphylaxis, CDI, cytopenia, encephalopathy, hepatotoxicity, hypersensitivity (non-anaphylactic) and skin/mucosal reaction (e.g. Stevens–Johnson or similar disorders).
Results
We identified 2198 patients who met our eligibility criteria. We excluded 37 patients cared for by low-volume providers (see Methods) and another 166 patients with missing CCI data. The final cohort for analysis included 1995 patients.
Median age of patients was 67 years and 51.5% were female (table 1). Median CCI was 3 and mean eCURB predicted 30-day mortality was 6.1%. A bacterial pathogen was identified in 14.2% of cases; the incidence of identified DRPs was 3%, but 39.7% of cases received initial empiric broad-spectrum antibiotics. Clinical and demographic data by broad-spectrum antibiotic use are shown in table 1. Patients in the broad-spectrum group more frequently met HCAP criteria (36.4% versus 7.4%). The broad-spectrum group also had higher eCURB predicted 30-day mortality (8.1% versus 5.0%), lower PaO2/FIO2 ratio (248.2 versus 269.5) and more sCAP criteria (2 versus 1). Intubation (13.3% versus 2.8%) and vasopressor use (13% versus 1.7%) were more common in the broad-spectrum group. Bacterial pathogens were recovered more often in this group (21.2% versus 9.9%), as were DRPs (7.3% versus 0.6%). Inadequate empiric antibiotic spectrum was not significantly different in the broad-spectrum group (1.4% versus 0.6%; p=0.1). Observed 30-day mortality was 18.3% versus 4.4%.
Baseline characteristics stratified by receipt of any broad-spectrum antibiotic
Unweighted multivariable regressions
In the unweighted multivariable regressions (table 2), broad-spectrum antibiotic use was associated with increased mortality risk (OR 3.8, 95% CI 2.5–5.9; p<0.001). HCAP was not associated with mortality (OR 1.2, 95% CI 0.8–1.9). We also observed significant increases in length of stay (eβ 1.7, 95% CI 1.5–1.8; p<0.001), cost (eβ 1.8, 95% CI 1.7–2.0; p<0.001) and CDI (OR 3.9, 95% CI 1.6–10.9; p=0.008) associated with broad-spectrum antibiotic use (table 3). In the ICU subgroup, broad-spectrum antibiotic use remained associated with increased mortality risk (OR 3.4, 95% CI 1.8–6.3; p<0.001).
Unweighted and inverse-probability treatment weighting (IPTW) multivariable regression effects of broad-spectrum antibiotics on 30-day mortality
Unweighted and inverse-probability treatment weighting (IPTW) multivariable regression effects of broad-spectrum antibiotics on secondary outcomes
ATT using IPTW multivariable regressions
In sensitivity analyses using IPTW, the ATT for broad-spectrum antibiotic use was associated with increased mortality (OR 4.6, 95% CI 2.92–7.45; p<0.001) (table 2), length of stay (eβ 1.52, 95% CI 1.4–1.6; p<0.001), cost (eβ 1.7, 95% CI 1.6–2.8; p<0.001) and CDI (OR 5.8, 95% CI 1.9–27.5; p=0.008) (table 3). By IPTW-ATT, HCAP remained without mortality association (OR 1.3, 95% CI 0.8–1.9). As depicted in figure 1, IPTW improved the covariate balance between treatment groups. In the IPTW-ATT analysis for the ICU subgroup, the ATT for broad-spectrum antibiotic use was associated with increased mortality (OR 4.0, 95% CI 2.2–7.7; p<0.001).
Balance diagnostics for inverse-probability of treatment weighting (IPTW). eCURB: electronic CURB-65 (confusion, urea >7 mmol·L−1, respiratory rate ≥30 breaths·min−1, blood pressure <90 mmHg (systolic) or ≤60 mmHg (diastolic), age ≥65 years) predicted 30-day mortality; PaO2: arterial oxygen tension; FIO2: inspiratory oxygen fraction; sCAP: severe community-acquired pneumonia [12]; HCAP: healthcare-associated pneumonia; CCI: Charlson Comorbidity Index; ATT: average treatment effects on the treated. In principle, IPTW should shrink a) the standardised difference (of the first central moment) toward 0 and b) the variance ratio (of the second central moment) toward 1. Observing both panels, we see that the IPTW tended to improve the balance between broad-spectrum antibiotic use across all covariates.
In the manual review of mortality cases (n=40), 26 (65%) received broad-spectrum antibiotics. Mortality occurred prior to hospital discharge in 21 cases (53%). Comorbidities and complications were major contributors to mortality in 37 patients (92.5%); of these, the most common were neurological/cognitive (n=9 (22.5%)), chronic pulmonary (n=9 (22.5%)), metastatic malignancy (n=8 (20%)), acute kidney injury (n=8 (20%)) and cardiac events (n=4 (10%)). Palliative goals of care led to withdrawal of care or discharge to hospice in 21 cases (52.5%). Advanced age (>75 years) contributed to mortality in 18 cases (45%) and severity of illness in 18 cases (45%). Consequences of broad-spectrum antibiotics contributed to mortality in seven cases (17.5%); of these, acute kidney injury attributable to concomitant vancomycin and piperacillin–tazobactam was identified in three cases (7.5%), vancomycin alone in two cases (5%), CDI in two cases (5%) and there was one case of cefepime-associated encephalopathy (2.5%). One patient treated with ceftriaxone–azithromycin developed CDI associated with mortality.
Discussion
This is the first study to simultaneously evaluate the relative effects of broad-spectrum antibiotic use and HCAP status on outcomes in a community-onset pneumonia cohort that includes both CAP and HCAP patients and patient-level microbiology data. Demographics and comorbidities were generally similar between patients receiving broad-spectrum antibiotics and those who did not. Interestingly, we observed only modest differences between groups in objective severity measures such as PaO2/FIO2 ratio, eCURB predicted 30-day mortality and sCAP criteria, but more pronounced differences in process measures, including vasopressor use or mechanical ventilation. This supported our a priori hypothesis that both outcomes and antibiotic prescribing are influenced by provider, and our consequent choice to adjust for baseline provider variability in our primary analysis. In both the primary and the IPTW multivariable regression models, broad-spectrum antibiotic use remained associated with mortality, while HCAP status did not.
The finding that HCAP status itself contributes less to overall mortality than do severity of illness, comorbidities, antibiotic selection and goals of care aligns with the conclusion of a meta-analysis by Chalmers et al. [8]. In a large healthcare database study, Rothberg et al. [7] reported persistently increased case fatality rate in HCAP compared with CAP despite adjustment for demographic, comorbidity and severity data. However, neither of these studies included adjustment for broad-spectrum or inadequate initial antibiotic spectrum.
One strength of this study was the use of a multilevel propensity score model to account for some provider variability and confounders, as well as IPTW, which, in principle, balances treatment and non-treatment groups to theoretically simulate results from a randomised controlled trial [18]. After IPTW adjustment, the average effect on mortality and other outcomes in patients treated with broad-spectrum antibiotics not only persisted, but was amplified, suggesting that the association is robust.
This observation that empiric broad-spectrum antibiotics may be associated with worsened outcomes is intriguing and merits further investigation. Previously, Attridge et al. [10] showed that guideline-concordant broad-spectrum antibiotics were associated with increased 30-day mortality (OR 2.1, 95% CI 1.86–2.55) after propensity score adjustment in a US Veterans Affairs cohort of 15 071 non-critically ill HCAP patients. Similarly, Rothberg et al. [9] found that broad-spectrum antibiotic use remained associated with increased odds (OR 1.39, 95% CI 1.32–1.47) of inpatient mortality after adjustment for a large set of clinical/demographic features and propensity adjustment in 85 097 patients in an administrative database. Neither study adjusted for microbiology and both studies acknowledged that their observations may have been influenced by unmeasured confounders unavailable in administrative databases.
Antibiotics are associated with multiple consequences that could potentially impact outcomes, including hypersensitivity, gastrointestinal disturbances, encephalopathy, cytopenias, disruption of the microbiome and CDI [20–24]. Broad-spectrum regimens are also associated with increased length of stay, which could also increase cumulative exposure to other nosocomial insults that impact outcomes. Adverse drug events complicate up to 15% of hospital admissions [25] and antibiotics are among the most common culprits [23]. In pneumonia, antibiotic-associated adverse drug events are associated with longer length of stay [26]. Among adverse drug effects, acute kidney injury is most relevant to broad-spectrum agents. Recently, it has been identified that the most common broad-spectrum regimen used in pneumonia, i.e. vancomycin plus piperacillin–tazobactam, is associated with significant risk of nephrotoxicity [27–32]. A meta-analysis including nearly 25 000 patients indicated that the rate of acute kidney injury with this regimen is >21% and more than twice as likely compared with vancomycin alone or in combination with other β-lactams, with a number needed to harm of only 11 [33]. Acute kidney injury is a known contributor to mortality in pneumonia [34]. Considering that vancomycin and piperacillin–tazobactam use has doubled in the last decade [4, 35], this observation is important.
CDI is more likely with broad-spectrum regimens that include more than one antibiotic class [20]. Indeed, in our study, odds of CDI were four-fold greater for those receiving broad-spectrum regimens. Like acute kidney injury, CDI is also associated with increased mortality in pneumonia [36]. Similarly, impact of antibiotics on the microbiome could worsen outcomes in ways more difficult to identify. Secondary or subsequent infections are more common in patients exposed to antibiotics, especially those with the greatest activity against components of the microbiome [37]. Baggs et al. [21] recently showed that the risk of 90-day readmission with sepsis or septic shock was 65% higher in patients who had received broad-spectrum antibiotics.
In that context, results from our manual review of mortality cases are particularly interesting. While comorbidities and complications, palliative goals of care, advanced age, and severity were the most commonly identified contributors to demise, antibiotic side-effects, including encephalopathy, acute kidney injury and CDI, were identified as having a plausible contribution to mortality in 17.5% of cases. This suggests that outcomes noted in our statistical analyses may have a real-world basis.
Prescription of broad-spectrum antibiotics far exceeds rates of DRP recovery in pneumonia. The lack of improved outcomes with widespread use of broad-spectrum regimens supports the notion that most culture-negative pneumonia is not due to occult DRPs, even in patients with epidemiological risk of resistance [5]. Clinical decision support tools to guide appropriate selection of broad-spectrum regimens in patients with risk factors for drug-resistant bacteria are important [38], as are rapid methods of excluding the presence of resistant pathogens [39]. The pendulum may now be swinging back toward more narrow empiric antibiotic prescribing for community-onset pneumonia.
This study is limited by its observational design. Despite the inclusion of a large set of well-recognised confounder variables and use of IPTW to balance treatment groups in an effort to mitigate indication bias, it is possible that the propensity model was not well specified, due perhaps to poor model assumptions or unmeasured variables. Two such variables identified in our manual review include complications of hospitalisation and palliative goals of care, which are known predictors of mortality. However, these variables could only introduce bias if they are associated with the decision to prescribe initial empiric broad-spectrum antibiotics, which seems unlikely for these variables. Another possible limitation was the inability to accurately capture “do not intubate/do not resuscitate” status. While goals of care certainly contribute to mortality, code status does not uniformly determine the level of care provided and reflects a dynamic decision that may change during the course of a hospital admission. For example, in our hospitals, patients with “do not resuscitate” status are regularly admitted for aggressive care in the ICU, while some patients with no code status on admission change to “do not intubate” or palliative status later in their course. For this reason, we conducted the ICU subgroup analysis. We were unable to accurately report the cause of mortality in all cases and, in this cohort, vasopressor use was used as a surrogate for septic shock. It is also possible that the manual chart review was prone to some bias because it was conducted by a single, non-blinded investigator. A strength of this study was the pragmatic real-world design that permitted the inclusion of severely ill patients and those with decreased level of consciousness, yielding a study population more representative of emergency department pneumonia patients than prospective cohorts that require individual consent.
Conclusion
Whether analysed by unweighted multivariable regression or by IPTW, use of broad-spectrum antibiotics in community-onset pneumonia was associated with higher mortality, longer hospital stay, higher cost and increased risk of CDI. These results lend additional support for more judicious use of broad-spectrum antibiotics in community-onset pneumonia. Accurate methods to better identify the small proportion of pneumonia patients who require broad-spectrum antibiotics are needed.
Supplementary material
Supplementary Material
Please note: supplementary material is not edited by the Editorial Office, and is uploaded as it has been supplied by the author.
Supplementary material ERJ-00057-2019.Supplement
Acknowledgements
Some of the data were presented at the European Respiratory Society International Congress, Paris, September 17, 2018.
Footnotes
This article has supplementary material available from erj.ersjournals.com
Author contributions: B.J. Webb had full access to all the data in the study, and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: B.J. Webb and N.C. Dean. Acquisition, analysis or interpretation of data: all authors. Drafting of the manuscript: B.J. Webb, J. Sorensen and N.C. Dean. Critical review of the manuscript for important intellectual content: all authors. Statistical analysis: J. Sorensen and B.J. Webb.
Conflict of interest: B.J. Webb reports research support from Astellas Pharma, Inc. unrelated to this study and speaking honorarium from BioFire Diagnostics.
Conflict of interest: J. Sorensen has nothing to disclose.
Conflict of interest: A. Jephson has nothing to disclose.
Conflict of interest: I. Mecham has nothing to disclose.
Conflict of interest: N.C. Dean has nothing to disclose.
Support statement: A portion of this study was funded by a grant from the Intermountain Research and Medical Foundation. The Intermountain Research and Medical Foundation provided internal funding to support study coordinator salary and statistical analysis. No investigator salary support was provided. The funding body had no role in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; and decision to submit the manuscript for publication. Funding information for this article has been deposited with the Crossref Funder Registry.
- Received January 8, 2019.
- Accepted April 1, 2019.
- Copyright ©ERS 2019