Reinforcement learning for optimizing responses in care processes

Publication date

2025-05

Authors

Hundogan, OlusanmiISNI 0000000523803591
Verhoef, Bart J.
Theeven, Patrick
Reijers, Hajo A.ORCID 0000-0001-9634-5852ISNI 0000000037238136
Lu, XixiISNI 0000000492910684

Editors

Advisors

Supervisors

Document Type

Article
Open Access logo

License

cc_by

Abstract

Prescriptive process monitoring aims to derive recommendations for optimizing complex processes. While previous studies have successfully used reinforcement learning techniques to derive actionable policies in business processes, care processes present unique challenges due to their dynamic and multifaceted nature. For example, at any stage of a care process, a multitude of actions is possible. In this study, we follow the Reinforcement Learning (RL) approach and present a general approach that uses event data to build and train Markov decision processes. We proposed three algorithms including one that takes the elapsed time into account when transforming an event log into a semi-Markov decision process. We evaluated the RL approach using an aggression incident data set. Specifically, the goal is to optimize staff member actions when clients are displaying different types of aggressive behavior. The Q-learning and SARSA are used to find optimal policies. Our results showed that the derived policies align closely with current practices while offering alternative options in specific situations. By employing RL in the context of care processes, we contribute to the ongoing efforts to enhance decision-making and efficiency in dynamic and complex environments.

Keywords

Markov decision process, Prescriptive process monitoring, Process mining, Process optimization, Reinforcement learning, Semi-Markov decision process, Information Systems and Management

Citation

Hundogan, O A, Verhoef, B J, Theeven, P, Reijers, H A & Lu, X 2025, 'Reinforcement learning for optimizing responses in care processes', Data and Knowledge Engineering, vol. 157, 102412, pp. 1-21. https://doi.org/10.1016/j.datak.2025.102412