Deep Reinforcement Learning with Safety Shielding for Personalized Anticoagulation Management in Atrial Fibrillation Patients at High Bleeding Risk Using INR Measurements

cirpublications.com-Pe3n-1790880681-c542633390 1790880681 Clinical Intelligence Research Press info@cirpublications.com Clinical Intelligence Research Press Journal of Artificial Intelligence for Healthcare Systems J. Artif. Intell. Healthc. Syst. 3149-8981 2025 4 2 Deep Reinforcement Learning with Safety Shielding for Personalized Anticoagulation Management in Atrial Fibrillation Patients at High Bleeding Risk Using INR Measurements Andrei Popescu Mihai Ionescu Elena Stan Sorin Dumitrescu Irina Pavel 2025 10.68159/c542633390 https://cirpublications.com/pub/journal/1/article/c542633390 Hindricks G, Potpara T, Dagres N, Arbelo E, Bax JJ, Blomström-Lundqvist C, et al. 2020 ESC Guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS). Eur Heart J. 2021;42(5):373-498. Armbruster AL, Benjamin EJ, Chyou JY, Goldberger ZD, Gopinathannair R, Gorenek B, et al. 2023 ACC/AHA/ACCP/HRS guideline for the diagnosis and management of atrial fibrillation: a report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. Circulation. 2023;148(1):e00-e00. Petch J, Nelson W, Wu M, Ghassemi M, Benz A, Fatemi M, et al. Optimizing warfarin dosing for patients with atrial fibrillation using machine learning. Sci Rep. 2024;14(1):4516. Maciorowska M, Uziębło-Życzkowska B, Gorczyca-Głowacka I, Wożakowska-Kapłon B, Jelonek O, Wójcik M, et al. Oral anticoagulation therapy in atrial fibrillation patients at high risk of bleeding: clinical characteristics and treatment strategies based on data from the Polish multicenter register of atrial fibrillation (POL-AF). Pol Heart J (Kardiol Pol). 2024;82(1):37-45. Gorog DA, Gue YX, Chao TF, Fauchier L, Ferreiro JL, Huber K, et al. Assessment and mitigation of bleeding risk in atrial fibrillation and venous thromboembolism: executive summary of a European and Asia-Pacific expert consensus paper. Thromb Haemost. 2022;122(10):1625-52. Aggarwal R, Ruff CT, Virdone S, Perreault S, Kakkar AK, Palazzolo MG, et al. Development and validation of the DOAC score: a novel bleeding risk prediction tool for patients with atrial fibrillation on direct-acting oral anticoagulants. Circulation. 2023;148(12):936-46. Ravvaz K, Weissert JA, Ruff CT, Chi CL, Tonellato PJ. Personalized anticoagulation: optimizing warfarin management using genetics and simulated clinical trials. Circ Cardiovasc Genet. 2017;10(6):e001804. Yu C, Liu J, Nemati S, Yin G. Reinforcement learning in healthcare: a survey. ACM Comput Surv. 2021;55(1):1-36. Liu S, See KC, Ngiam KY, Celi LA, Sun X, Feng M. Reinforcement learning for clinical decision support in critical care: comprehensive review. J Med Internet Res. 2020;22(7):e18477. Coronato A, Naeem M, De Pietro G, Paragliola G. Reinforcement learning for intelligent healthcare applications: a survey. Artif Intell Med. 2020;109:101964. Gottesman O, Johansson F, Komorowski M, Faisal A, Sontag D, Doshi-Velez F, et al. Guidelines for reinforcement learning in healthcare. Nat Med. 2019;25(1):16-8. Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med. 2018;24(11):1716-20. Zadeh SA, Street WN, Thomas BW. Optimizing warfarin dosing using deep reinforcement learning. J Biomed Inform. 2023;137:104267. Li X, Li D, Wu JC, Liu ZQ, Zhou HH, Yin JY. Precision dosing of warfarin: open questions and strategies. Pharmacogenomics J. 2019;19(3):219-29. Roche-Lima A, Roman-Santiago A, Feliu-Maldonado R, Rodriguez-Maldonado J, Nieves-Rodriguez BG, Carrasquillo-Carrion K, et al. Machine learning algorithm for predicting warfarin dose in Caribbean Hispanics using pharmacogenetic data. Front Pharmacol. 2020;10:1550. Steiner HE, Giles JB, Patterson HK, Feng J, El Rouby N, Claudio K, et al. Machine learning for prediction of stable warfarin dose in US Latinos and Latin Americans. Front Pharmacol. 2021;12:749786. Lee H, Kim HJ, Chang HW, Kim DJ, Mo J, Kim JE, et al. Development of a system to support warfarin dose decisions using deep neural networks. Sci Rep. 2021;11(1):14745. Nguyen HD, Cho YS, Kim HS, Han IY, Kim DK, Ahn S, et al. Comparison of multivariate linear regression and a machine learning algorithm developed for prediction of precision warfarin dosing in a Korean population. J Thromb Haemost. 2021;19(7):1676-86. Choi H, Kang HJ, Ahn I, Gwon H, Kim Y, Seo H, et al. Machine learning models to predict the warfarin discharge dosage using clinical information of inpatients from South Korea. Sci Rep. 2023;13(1):22461. Fülöp P, Tóth Š, Porubän T, Fülöpová Z, Borovská A, Dvorožňáková M. Machine learning for warfarin therapy: a systematic review. Pharmaceuticals. 2025;18(10):1544. Roggeveen L, El Hassouni A, Ahrendt J, Guo T, Fleuren L, Thoral P, et al. Transatlantic transferability of a new reinforcement learning model for optimizing haemodynamic treatment for critically ill patients with sepsis. Artif Intell Med. 2021;112:102003. Wani AA, Abeer F. Application of machine learning techniques for warfarin dosage prediction: a case study on the MIMIC-III dataset. PeerJ Comput Sci. 2025;11:e2612. Tu R, Luo Z, Pan C, Wang Z, Su J, Zhang Y, et al. Offline safe reinforcement learning for sepsis treatment: tackling variable-length episodes with sparse rewards. Hum Centric Intell Syst. 2025;5(1):63-76. Raghu A, Komorowski M, Celi LA, Szolovits P, Ghassemi M. Continuous state-space models for optimal sepsis treatment: a deep reinforcement learning approach. In: Machine Learning for Healthcare Conference. PMLR; 2017. p. 147-63. Zeng J, Shao J, Lin S, Zhang H, Su X, Lian X, et al. Optimizing the dynamic treatment regime of in-hospital warfarin anticoagulation in patients after surgical valve replacement using reinforcement learning. J Am Med Inform Assoc. 2022;29(10):1722-32. Ji H, Gill M, Draper EW, Liedl DA, Hodge DO, Houghton DE, et al. Warfarin dose management using offline deep reinforcement learning. IEEE J Biomed Health Inform. 2025 Feb 24. [Epub ahead of print]. Wang Y, Liu A, Yang J, Wang L, Xiong N, Cheng Y, et al. Clinical knowledge-guided deep reinforcement learning for sepsis antibiotic dosing recommendations. Artif Intell Med. 2024;150:102811. Achiam J, Held D, Tamar A, Abbeel P. Constrained policy optimization. In: International Conference on Machine Learning. PMLR; 2017. p. 22-31. Alshiekh M, Bloem R, Ehlers R, Könighofer B, Niekum S, Topcu U. Safe reinforcement learning via shielding. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2018;32(1). Asiimwe IG, Zhang EJ, Osanlou R, Jorgensen AL, Pirmohamed M. Warfarin dosing algorithms: a systematic review. Br J Clin Pharmacol. 2021;87(4):1717-29. Dhippayom T, Boonpattharatthiti K, Kategeaw W, Hong H, Chaiyakunapruk N, Barnes GD, et al. Comparative effectiveness of warfarin management strategies: a systematic review and network meta-analysis. EClinicalMedicine. 2024;74:102614.