Clinical Intelligence Research Press Clinical Intelligence Research Press

Search

Search results:
Explainable Artificial Intelligence Model for Real-Time Monitoring of Algorithmic Bias in Clinical Triage Systems Using Demographic Drift, Outcome Disparities, Prediction Confidence, and Referral Decision Patterns
Clinical triage algorithms increasingly influence access to emergency care, specialty referral, admission, and follow-up. As patient populations and clinical practice patterns change, these systems can silently drift toward biased performance. Current fairness assessments are often retrospective, episodic, and disconnected from operational triage workflows. They may identify inequity after harm has already accumulated rather than detecting emerging bias as it develops. This article proposes an explainable AI model for continuous monitoring of algorithmic bias in clinical triage systems. The model focuses on demographic drift, outcome disparities, prediction confidence, and referral decision patterns as complementary bias signals. The proposed model uses operational triage logs, demographic distributions, prediction outputs, outcome indicators, and referral decisions to generate a conceptual fairness risk signal. SHAP-based explanation modules decompose the signal into interpretable contributors for clinical governance teams. Conceptually, the model would detect divergence in referral patterns across demographic groups, identify whether the divergence coincides with demographic drift, flag subgroup-specific prediction confidence concerns, and explain the likely drivers of the alert. The output would support timely review rather than automated punitive action. The model could transform algorithmic fairness from a periodic retrospective report into a continuous, transparent, and operationally actionable surveillance system. It is designed as a governance-oriented framework rather than an experimental performance claim.
Journal of Health Informatics and Digital Systems
Original Research | Open access | 25 February 2026 | Article: 128
Filters
Clear All

Subject
AI-driven Diagnostics Artificial Intelligence in Health Informatics Artificial Intelligence in Healthcare Big Data in Healthcare Clinical Data Mining Clinical Decision Support Systems Clinical Informatics Computer Vision Connected Health Systems Deep Learning Digital Health Digital Healthcare Innovation Digital Transformation in Healthcare Electronic Health Records Ethical AI in Healthcare Explainable AI Health Data Analytics Health Data Privacy Health Informatics Health Information Management Health Information Systems Health System Optimization Health Technology Assessment Healthcare Data Science Healthcare Informatics Healthcare Information Security Healthcare Management Healthcare Management Information Systems Intelligent Medical Systems Internet of Medical Things (IoMT) Interoperability in Healthcare Systems Machine Learning Medical Data Analytics Medical Data Management Medical Imaging Mobile Health (mHealth) Natural Language Processing Precision Medicine Predictive Analytics Remote Patient Monitoring Smart Healthcare Systems Telemedicine Wearable Health Technologies e-Health




Access type