Impact of risk adjustment using clinical vs administrative data on hospital sepsis mortality comparisons

Chanu Rhee, Zhonghe Li, Rui Wang, Yue Song, Sameer S. Kadri, Edward J. Septimus, Huai Chun Chen, David Fram, Robert Jin, Russell Poland, Kenneth Sands, Michael Klompas

Research output: Contribution to journalArticlepeer-review

Abstract

Background. A reliable risk-adjusted sepsis outcome measure could complement current national process metrics by identifying outlier hospitals and catalyzing additional improvements in care. However, it is unclear whether integrating clinical data into risk adjustment models identifies similar high- and low-performing hospitals compared with administrative data alone, which are simpler to acquire and analyze. Methods. We ranked 200 US hospitals by their Centers for Disease Control and Prevention Adult Sepsis Event (ASE) mortality rates and assessed how rankings changed after applying (1) an administrative risk adjustment model incorporating demographics, comorbidities, and codes for severe illness and (2) an integrated clinical and administrative model replacing severity-of-illness codes with laboratory results, vasopressors, and mechanical ventilation. We assessed agreement between hospitals' risk-adjusted ASE mortality rates when ranked into quartiles using weighted kappa statistics (κ). Results. The cohort included 4 009 631 hospitalizations, of which 245 808 met ASE criteria. Risk-adjustment had a large effect on rankings: 22/50 hospitals (44%) in the worst quartile using crude mortality rates shifted into better quartiles after administrative risk adjustment, and a further 21/50 (42%) of hospitals in the worst quartile using administrative risk adjustment shifted to better quartiles after incorporating clinical data. Conversely, 14/50 (28%) hospitals in the best quartile using administrative risk adjustment shifted to worse quartiles with clinical data. Overall agreement between hospital quartile rankings when risk-adjusted using administrative vs clinical data was moderate (κ = 0.55). Conclusions. Incorporating clinical data into risk adjustment substantially changes rankings of hospitals' sepsis mortality rates compared with using administrative data alone. Comprehensive risk adjustment using both administrative and clinical data is necessary before comparing hospitals by sepsis mortality rates.

Original languageEnglish (US)
Article numberofaa213
JournalOpen Forum Infectious Diseases
Volume7
Issue number6
DOIs
StatePublished - 2020

Keywords

  • Adult Sepsis Event
  • Hospital comparisons
  • Outcome measure
  • Risk adjustment
  • Sepsis

ASJC Scopus subject areas

  • Oncology
  • Clinical Neurology

Fingerprint

Dive into the research topics of 'Impact of risk adjustment using clinical vs administrative data on hospital sepsis mortality comparisons'. Together they form a unique fingerprint.

Cite this