Clinical Intelligence Research Press Clinical Intelligence Research Press

Search

Search results:
Federated Reinforcement Learning for Coordinated Bed Allocation and Nurse Staffing During Pandemic Surges
Pandemic surges can rapidly overwhelm hospital capacity, where shortages of beds and nurse fatigue contribute directly to increased excess mortality, making coordinated decision-making across emergency departments, intensive care units, and general wards essential yet difficult to achieve under centralized control systems. Centralized approaches to bed allocation and nurse staffing optimization are limited because each hospital unit holds critical local information—such as real-time patient acuity, staff availability, and infection control status—that cannot be easily shared due to privacy constraints and communication delays during crisis conditions. To address these challenges, we propose a federated multi-agent reinforcement learning framework that enables coordinated decision-making for bed distribution and nurse staffing across hospital units without requiring centralization of sensitive clinical or workforce data. The system consists of local reinforcement learning agents deployed in each unit that participate in federated aggregation, a coordination mechanism that aligns inter-unit policies, and a surge detection module that dynamically switches operational strategies during pandemic escalation periods. This distributed architecture maintains data privacy while supporting adaptive, system-wide coordination under surge conditions, overcoming the limitations of both centralized optimization models and rule-based heuristic approaches.
Journal of Artificial Intelligence for Healthcare Systems
Original Research | Open access | 20 July 2025 | Article: 104

Deep Reinforcement Learning with Safety Shielding for Personalized Anticoagulation Management in Atrial Fibrillation Patients at High Bleeding Risk Using INR Measurements
Atrial fibrillation affects over 30 million people worldwide and requires long-term anticoagulation, with warfarin still widely used due to its efficacy and reversibility, but its narrow therapeutic window (INR 2.0–3.0) makes dosing particularly challenging, especially in high bleeding-risk patients where both under- and over-anticoagulation can lead to serious complications. Conventional dosing approaches rely on population-based nomograms and clinician judgment, failing to capture individual variability driven by genetics, diet, comorbidities, and drug interactions. To address this limitation, this article proposes a conceptual framework that integrates deep reinforcement learning with a safety-shield mechanism for personalized warfarin dosing. The system uses a deep Q-network trained on historical patient trajectories within an offline Markov Decision Process to recommend dose adjustments based on INR history and clinical risk factors, while a deterministic rule-based safety layer blocks unsafe actions, such as dose increases when INR exceeds 3.5 or extreme adjustments requiring clinician review. Conservative offline reinforcement learning further reduces the risk of unsafe policy extrapolation by limiting overestimation of out-of-distribution actions. Together, this hybrid architecture aims to improve time in therapeutic range while minimizing bleeding risk, providing a structured and clinically constrained approach for safer, individualized anticoagulation management in high-risk atrial fibrillation patients.
Journal of Artificial Intelligence for Healthcare Systems
Original Research | Open access | 20 July 2025 | Article: 111

Hierarchical Reinforcement Learning Framework for Personalized Perioperative Antibiotic Prophylaxis Timing and Intraoperative Redosing
Surgical site infections (SSIs) remain a significant source of postoperative morbidity despite established guidelines for perioperative antibiotic prophylaxis. Current protocols emphasize fixed preoperative timing and interval-based intraoperative redosing, yet fail to account for patient heterogeneity, pharmacokinetic variability, and uncertainty in procedure duration. This study proposes a hierarchical reinforcement learning (HRL) framework for personalized optimization of antibiotic prophylaxis across the perioperative timeline. The framework decomposes decision-making into two coordinated levels: a high-level policy that determines optimal preoperative antibiotic timing based on predicted procedure duration and patient-specific infection risk, and a low-level policy that adaptively manages intraoperative redosing using real-time updates on elapsed time, remaining duration, and cumulative drug exposure. Procedure duration is estimated using machine learning models that provide both point predictions and uncertainty intervals, enabling risk-sensitive decision-making. The problem is formalized as a Markov decision process with a reward structure balancing SSI prevention against antibiotic stewardship, incorporating penalties for unnecessary dosing and suboptimal timing. Off-policy evaluation using historical surgical data is proposed to assess performance relative to guideline-based and clinician-driven strategies. By integrating predictive modeling with multi-timescale decision optimization, the framework aims to reduce SSI incidence while minimizing antibiotic overuse. This approach highlights the potential of reinforcement learning to advance precision perioperative care and improve clinical outcomes through adaptive, data-driven prophylaxis strategies.
Journal of Artificial Intelligence for Healthcare Systems
Original Research | Open access | 20 January 2026 | Article: 119

Reinforcement Learning Framework for Dynamic Optimization of Extracorporeal Membrane Oxygenation Settings Using Real-Time Blood Gas, Hemodynamic, and Pump Flow Measurements
Extracorporeal membrane oxygenation (ECMO) is used to support patients with severe cardiac or respiratory failure, requiring constant manual adjustments of pump flow, sweep gas flow, and oxygen fraction. However, current ECMO management lacks a real-time optimization system tailored to individual patient needs. This manuscript proposes an offline reinforcement learning framework for dynamic ECMO optimization, utilizing real-time measurements of blood gases, hemodynamics, and pump flow. The framework includes a state encoder for various patient data, an action space for adjustments to ECMO settings, and a reward function that balances oxygenation, hemodynamic support, and complication avoidance. A safety shield filters unsafe recommendations before clinician review. The system aims to provide personalized, proactive, and safety-constrained ECMO management, with the goal of guiding future research validation rather than claiming experimental results.
Journal of Artificial Intelligence for Healthcare Systems
Original Research | Open access | 20 July 2026 | Article: 132

Deep Reinforcement Learning with Inverse Reinforcement Learning for Learning Optimal Personalized Rehabilitation Exercise Prescriptions from Physical Therapist Demonstrations
Personalized rehabilitation exercise prescriptions are essential for recovery after neurological injury, orthopedic surgery, and chronic decline. While physical therapists have valuable expertise, translating it into scalable computational systems is challenging. Standard deep reinforcement learning relies on manually defined reward functions, but in rehabilitation, clinically significant goals like movement quality, fatigue, pain, safety, motivation, and adherence are difficult to quantify. This paper introduces a framework combining inverse reinforcement learning (IRL) and deep reinforcement learning (DRL) to learn personalized rehabilitation prescriptions from therapist demonstrations. IRL would derive expert-aligned rewards, and DRL would use these to create adaptive exercise plans. The framework encompasses therapist demonstration collection, movement trajectory representation, reward inference, policy learning, safety constraints, and clinical oversight. Demonstrations would include exercise selection, progression decisions, and therapist responses to patient fatigue, pain, or adherence issues. IRL could capture implicit clinical priorities, while DRL would adjust prescriptions based on patient conditions such as fatigue, progress, and engagement. The framework aims to create scalable, personalized rehabilitation prescriptions, offering a conceptual model for future rehabilitation robotics, exergaming, and home-based digital rehabilitation systems.
Journal of Artificial Intelligence for Healthcare Systems
Original Research | Open access | 20 July 2026 | Article: 139
Filters
Clear All

Subject
AI-driven Diagnostics Artificial Intelligence in Health Informatics Artificial Intelligence in Healthcare Big Data in Healthcare Clinical Data Mining Clinical Decision Support Systems Clinical Informatics Computer Vision Connected Health Systems Deep Learning Digital Health Digital Healthcare Innovation Digital Transformation in Healthcare Electronic Health Records Ethical AI in Healthcare Explainable AI Health Data Analytics Health Data Privacy Health Informatics Health Information Management Health Information Systems Health System Optimization Health Technology Assessment Healthcare Data Science Healthcare Informatics Healthcare Information Security Healthcare Management Healthcare Management Information Systems Intelligent Medical Systems Internet of Medical Things (IoMT) Interoperability in Healthcare Systems Machine Learning Medical Data Analytics Medical Data Management Medical Imaging Mobile Health (mHealth) Natural Language Processing Precision Medicine Predictive Analytics Remote Patient Monitoring Smart Healthcare Systems Telemedicine Wearable Health Technologies e-Health




Access type