Search

Large language models (LLMs) have rapidly advanced since the transformer architecture was introduced in 2017, with systems such as GPT-3, GPT-4, Med-PaLM, and Claude increasingly explored for applications in medical education, clinical documentation, decision support, and patient communication, raising both optimism and concerns regarding safety and reliability. This systematic review synthesizes evidence across studies retrieved from PubMed, arXiv, ACL Anthology, IEEE Xplore, and Google Scholar that empirically evaluated LLMs in clinical settings using quantitative performance metrics, with risk of bias assessed using an adapted PROBAST framework for machine learning research. Findings show that LLMs achieve 60–90% accuracy on USMLE-style examinations, with leading models such as GPT-4 and Med-PaLM 2 reaching or surpassing passing thresholds, while in clinical documentation tasks they can reduce physician workload by approximately 30–50% in generating outputs such as discharge summaries, though human review remains consistently required. Performance in clinical decision support is more variable and specialty-dependent, and hallucination rates ranging from 5–30% have been reported, alongside persistent issues of bias and overconfidence in incorrect outputs. Overall, while LLMs demonstrate strong capabilities in structured medical knowledge tasks and documentation support, current limitations including hallucinations, bias, and lack of prospective clinical validation prevent safe autonomous deployment, making clinician oversight and robust safety safeguards essential for any clinical use.

Anticoagulation management requires balancing multiple factors such as bleeding risk, thromboembolic risk, drug interactions, and renal function. Deep learning can assist in risk prediction, but its effectiveness relies on clinicians' ability to understand and verify the recommendations. Black-box models may recommend actions without providing clear explanations. In contrast, clinical guidelines are rule-based but not directly executable by neural models. This article introduces a neuro-symbolic XAI framework that combines deep learning predictions with explicit clinical guidelines. It includes a neural prediction module, a symbolic reasoning engine, and an integration layer for traceable justifications. The neuro-symbolic approach connects data-driven predictions to clinical rules, improving auditability and trustworthiness in decision support. This framework aims to enhance anticoagulation management by providing verifiable, clinician-understandable decision support, focusing on explainability-by-design.