cirpublications.com-PzUP-1790880682-g968708531 1790880682 Clinical Intelligence Research Press info@cirpublications.com Clinical Intelligence Research Press Journal of Artificial Intelligence for Healthcare Systems J. Artif. Intell. Healthc. Syst. 3149-8981 2025 4 1 Hassan Ali Mariam Farooq Usman Shah 2025 10.68159/g968708531 https://cirpublications.com/pub/journal/1/article/g968708531 Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proc IEEE Int Conf Comput Vis (ICCV); 2017; Venice, Italy. IEEE; 2017. p. 618-626. Lucieri A, Bajwa MN, Braun SA, Malik MI, Dengel A, Ahmed S. On interpretability of deep learning based skin lesion classifiers using concept activation vectors. In: 2020 Int Joint Conf Neural Netw (IJCNN); 2020 Jul 19-24; Glasgow, UK. IEEE; 2020. p. 1-10. Kim ST, Lee JH, Lee H, Ro YM. Visually interpretable deep network for diagnosis of breast masses on mammograms. Phys Med Biol. 2018;63(23):235025. Amann J, Blasimme A, Vayena E, Frey D, Madai VI, et al. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):310. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health. 2021;3(11):e745-50. Bienefeld N, Boss JM, Lüthy R, Brodbeck D, Azzati J, et al. Solving the explainable AI conundrum by bridging clinicians’ needs and developers’ goals. NPJ Digit Med. 2023;6(1):94. Lundberg SM, Lee SI. A unified approach to interpreting model predictions. In: Adv Neural Inf Process Syst (NeurIPS); 2017 Dec 4-9; Long Beach, CA, USA. Curran Associates; 2017;30. Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. In: Proc 34th Int Conf Mach Learn (ICML); 2017; Sydney, Australia. PMLR; 2017;3319-28. Ribeiro MT, Singh S, Guestrin C. Anchors: high-precision model-agnostic explanations. In: Proc AAAI Conf Artif Intell; 2018;New Orleans, LA, USA. AAAI Press; 2018;32(1). Kim B, Wattenberg M, Gilmer J, Cai C, Wexler J, Viégas F, et al. Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV). In: Proc 35th Int Conf Mach Learn (ICML); 2018; Stockholm, Sweden. PMLR; 2018. p. 2668-77. Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, et al. From Local Explanations to Global Understanding with Explainable AI for Trees. Nat Mach Intell. 2020;2(1):56-67. 10.1038/s42256-019-0138-9 Koh PW, Nguyen T, Tang YS, Mussmann S, Pierson E, Kim B, Liang P, et al. Concept bottleneck models. In: Proc 37th Int Conf Mach Learn (ICML); 2020; Virtual. PMLR; 2020. p. 5338-48. Linardatos P, Papastefanopoulos V, Kotsiantis S. Explainable AI: a review of machine learning interpretability methods. Entropy (Basel). 2020;23(1):18. Cai CJ, Reif E, Hegde N, Hipp J, Kim B, Smilkov D, et al. Human-centered tools for coping with imperfect algorithms during medical decision-making. In: Proc 2019 CHI Conf Hum Factors Comput Syst; 2019; Glasgow, UK. ACM; 2019. p. 1-14. Tonekaboni S, Joshi S, McCradden MD, Goldenberg A. What clinicians want: contextualizing explainable machine learning for clinical end use. In: Proc Mach Learn Healthc Conf (MLHC); 2019; Ann Arbor, MI, USA. PMLR; 2019. p. 359-80. Lin Y, Wei L, Han SX, Aberle DR, Hsu W. EDICNet: an end-to-end detection and interpretable malignancy classification network for pulmonary nodules in computed tomography. In: Proc SPIE Med Imaging; 2020; Houston, TX, USA. SPIE; 2020. Vol. 11314. p. 113141H. Woodcock C, Mittelstadt B, Busbridge D, Blank G. The impact of explanations on layperson trust in artificial intelligence-driven symptom checker apps: experimental study. J Med Internet Res. 2021;23(11):e29386. Rudin C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell. 2019;1(5):206-15. Kundu S. AI in medicine must be explainable. Nat Med. 2021;27(8):1328. Chen H, Gomez C, Huang CM, Unberath M. Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review. NPJ Digit Med. 2022;5(1):156. Hauser K, Kurz A, Haggenmueller S, Maron RC, von Kalle C, et al. Explainable artificial intelligence in skin cancer recognition: a systematic review. Eur J Cancer. 2022;167:54-69. Xu Q, Xie W, Liao B, Hu C, Qin L, Yang Z, et al. Interpretability of Clinical Decision Support Systems Based on Artificial Intelligence from Technological and Medical Perspective: A Systematic Review. J Healthc Eng. 2023;2023:9919269. Rosenbacke R, Melhus Å, McKee M, Stuckler D. How explainable artificial intelligence can increase or decrease clinicians’ trust in AI applications in health care: systematic review. JMIR AI. 2024;3:e53207. Stevens AF, Stetson P. Theory of trust and acceptance of artificial intelligence technology (TrAAIT): an instrument to assess clinician trust and acceptance of artificial intelligence. J Biomed Inform. 2023;148:104550. Du Y, Antoniadi AM, McNestry C, McAuliffe FM, Mooney C. The role of XAI in advice-taking from a clinical decision support system: a comparative user study of feature contribution-based and example-based explanations. Appl Sci (Basel). 2022;12(20):10323. Borys K, Schmitt YA, Nauta M, Seifert C, Krämer N, et al. Explainable AI in medical imaging: an overview for clinical practitioners – saliency-based XAI approaches. Eur J Radiol. 2023;162:110787. Krakowski I, Kim J, Cai ZR, Daneshjou R, Lapins J, et al. Human-AI interaction in skin cancer diagnosis: a systematic review and meta-analysis. NPJ Digit Med. 2024;7(1):78. Gomez C, Smith BL, Zayas A, Unberath M, Canares T. Explainable AI decision support improves accuracy during telehealth strep throat screening. Commun Med (Lond). 2024;4(1):149. Schoonderwoerd TA, Jorritsma W, Neerincx MA, Van Den Bosch K. Human-centered XAI: developing design patterns for explanations of clinical decision support systems. Int J Hum Comput Stud. 2021;154:102684. Kim SY, Kim DH, Kim MJ, Ko HJ, Jeong OR. XAI-based clinical decision support systems: a systematic review. Appl Sci (Basel). 2024;14(15):6638. Sadeghi Z, Alizadehsani R, Cifci MA, Kausar S, Rehman R, Mahanta P, et al. A review of explainable artificial intelligence in healthcare. Comput Electr Eng. 2024;118:109370.