cirpublications.com-UmEE-1790880686-h148878550 1790880686 Clinical Intelligence Research Press info@cirpublications.com Clinical Intelligence Research Press Journal of Artificial Intelligence for Healthcare Systems J. Artif. Intell. Healthc. Syst. 3149-8981 2024 3 2 Mona Saad Ahmed El-Kholy Nour Abdelrahman Karim Hassan 2024 10.68159/h148878550 https://cirpublications.com/pub/journal/1/article/h148878550 Acosta JF, Falcone GJ, Rajpurkar P, Topol EJ. Multimodal biomedical AI. Nat Med. 2022;28(9):1773-84. 10.1038/s41591-022-01981-2 Soenksen LR, Ma Y, Zeng C, Boussioux L, Villalobos Carballo K, Na LJ, et al. Integrated multimodal artificial intelligence framework for healthcare applications. NPJ Digit Med. 2022;5(1):149. 10.1038/s41746-022-00689-4 Kline A, Wang H, Li Y, Dennis S, Hutch M, Xu Z, et al. Multimodal machine learning in precision health: a scoping review. NPJ Digit Med. 2022;5(1):171. 10.1038/s41746-022-00712-8 Topol EJ. As artificial intelligence goes multimodal, medical applications multiply. Science. 2023;381(6663):adk6139. 10.1126/science.adk6139 Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2(2):e0000198. 10.1371/journal.pdig.0000198 Finlayson SG, Subbaswamy A, Singh K, Bowers J, Kupke A, McCaw J, et al. The clinician and dataset shift in artificial intelligence. N Engl J Med. 2021;385(3):283-6. 10.1056/NEJMc2104626 Rodriguez JA, Clark CR, Bates DW. Digital inclusion as health care—supporting health care equity with digital-infrastructure initiatives. N Engl J Med. 2022;386(11):1101-3. 10.1056/NEJMp2115646 Hügle T. The wide range of opportunities for large language models such as ChatGPT in rheumatology. RMD Open. 2023;9(2):e003105. 10.1136/rmdopen-2023-003105 Kobayashi M, Ito M, Iwata A, Honda H, Mitsuzuka Y, Sugimura A, et al. Effect of multimodal comprehensive communication skills training with video analysis by artificial intelligence for physicians on acute geriatric care: a mixed-methods study. BMJ Open. 2023;13(3):e065477. 10.1136/bmjopen-2022-065477 Abid MH, Al-Gawwam S, Abid ZH, Al-Obaidi A, Al-Noori A. Multi-modal medical image classification using deep residual network and genetic algorithm. PLOS One. 2023;18(6):e0287786. 10.1371/journal.pone.0287786 Rele M, Garimella S, Farhadloo M. Multimodal healthcare using artificial intelligence. IEEE Trans Artif Intell. 2023;4(5):1093-102. 10.1109/TAI.2023.3235420 Abedi A, Khan SS, Stolee P, Azarpazhooh MR, Heckman GAW. MAISON - multimodal AI-based sensor platform for older individuals. IEEE Trans Multimed. 2022;25:782-94. 10.1109/TMM.2022.3147704 Cremonesi F, Chapman B, Gouthamchand VS, Gagliano Taliun S, Zito A, Booth BW, et al. The need for multimodal health data modeling: a practical approach for a federated-learning healthcare platform. J Biomed Inform. 2023;141:104343. 10.1016/j.jbi.2023.104343 Khader F, Müller-Franzes G, Wang L, Han T, Arasteh ST, Haarburger C, et al. Multimodal deep learning for integrating chest radiographs and clinical parameters: a case for transformers. Radiology. 2023;309(3):e230806. 10.1148/radiol.230806 Barros V, Gogin N, Kessler K, Dubuisson M, Pennec X, Arbel J, et al. Virtual biopsy by using artificial intelligence–based multimodal modeling of binational mammography data. Radiology. 2023;306(1):100-9. 10.1148/radiol.220027 Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. 2023;29(8):1930-40. 10.1038/s41591-023-02448-8 Chen RJ, Lu MY, Chen B, Williamson DFK, Mahmood F. Synthetic data in machine learning for medicine and healthcare. Nat Biomed Eng. 2021;5(6):493-7. 10.1038/s41551-021-00751-8 Boehm KM, Khosravi P, Vanguri R, Gao J, Shah SP. Harnessing multimodal data integration to advance precision oncology. Nat Rev Cancer. 2022;22(2):114-26. 10.1038/s41568-021-00408-3 Huang SC, Parekh VS, Zamanian B, Banerjee I, Lungren MP. Multimodal fusion with deep neural networks for leveraging CT imaging and electronic health record: a case-study in pulmonary hypertension. Sci Rep. 2020;10(1):8584. 10.1038/s41598-020-65925-3 Steyaert S, Pizurica M, Nagaraj D, Khandelwal P, Hernandez-Boussard T, Gentles AJ, et al. Multimodal data fusion for cancer biomarker discovery with deep learning. Nat Mach Intell. 2023;5(4):351-62. Li Y, Efatmaneshnik M, Dempster AG. A fast fusion approach for integrating time-series and punctual multisensor data for enhanced throughput in healthcare. Artif Intell Med. 2022;128:102303. 10.1016/j.artmed.2022.102303 Maadjhou M, Chaari L, Besbes S. Multimodal medical image fusion based on multiple latent variable models. Med Image Anal. 2021;74:102220. 10.1016/j.media.2021.102220 Li Z, Wu X, Li J, Zheng J. Multi-modal multi-task learning for joint prediction of clinical scores in Alzheimer’s disease. J Biomed Inform. 2020;107:103459. 10.1016/j.jbi.2020.103459 Wang X, Peng Y, Lu L, Bagheri M, Lu Z, Summers RM. ChestX-Ray8: hospital-scale chest X-ray database and benchmarks on weakly supervised classification and localization of common thorax diseases. IEEE J Biomed Health Inform. 2019;23(3):1197-206. 10.1109/JBHI.2018.2819322 Shi Y, Cheng K, Li C, Zhang J, Lu G, Zhang Y. A deep learning-based multimodal data fusion approach for atrial fibrillation risk prediction. J Biomed Inform. 2022;126:103770. 10.1016/j.jbi.2021.103770 Zhang P, Wang F, Hu J, Sorrentino R. Towards personalized medicine: leveraging patient similarity and drug similarity analytics. Artif Intell Med. 2019;100:101708. 10.1016/j.artmed.2019.101708 Zhang D, Yin C, Zeng J, Yuan X, Li Y. Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer’s disease. J Biomed Inform. 2018;80:1-10. 10.1016/j.jbi.2018.02.010 Ma L, Zhang Y. Using multinomial logistic regression for prediction of disease type based on multimodal data. J Biomed Inform. 2020;102:103375. 10.1016/j.jbi.2019.103375 Yan C, Duan G, Zhang Y, Wu F, Yan X, Tang Y, et al. Predicting progression from mild cognitive impairment to Alzheimer’s disease on an individual subject basis by combining multiple features. J Biomed Inform. 2019;95:103222. 10.1016/j.jbi.2019.103222