Monitoring of process and risk-adjusted medical outcomes using a multi-stage MEWMA chart

Abstract: Most statistical process control programmes in healthcare focus on surveillance of outcomes at the final stage of a procedure, such as mortality or failure rates. Such an approach ignores the multi-stage nature of these procedures, in which a patient progresses through several stages prior to the final stage. In this paper, we develop a multi-stage control chart based on a multivariate exponentially weighted moving average (EWMA) test statistic derived from score equations. This allows simultaneous monitoring of all intermediate and final stage outcomes of a healthcare process, with adjustment for underlying patient risk factors and dependence between outcome variables. Use of the EWMA test statistics allows quick detection of small gradual changes in any part of the process. Three advantages of the approach are: better understanding of how outcomes at different stages relate to each other, explicit monitoring of upstream stage outcomes may help curtail trends that lead to poorer end-stage outcomes and understanding the impact of each stage can help determine the most effective allocation of quality improvement resources. Simulations are performed to test the control charts under various types of hypothesised shifts, and the results are summarised using out-of-control average run lengths.