TERTIAN: Clinical Endpoint Prediction in ICU via Time-Aware Transformer-Based Hierarchical Attention Network

cirpublications.com-4BKP-1790880685-r859477647 1790880685 Clinical Intelligence Research Press info@cirpublications.com Clinical Intelligence Research Press Journal of Artificial Intelligence for Healthcare Systems J. Artif. Intell. Healthc. Syst. 3149-8981 2023 2 1 TERTIAN: Clinical Endpoint Prediction in ICU via Time-Aware Transformer-Based Hierarchical Attention Network Sanjay Kulkarni Meenal Joshi Rohan Patil Aniket Deshmukh 2023 10.68159/r859477647 https://cirpublications.com/pub/journal/1/article/r859477647 Che Z, Purushotham S, Cho K, Sontag D, Liu Y. Recurrent neural networks for multivariate time series with missing values. Sci Rep. 2018;8(1):6085. Zhang X, Zeman M, Tsiligkaridis T, Zitnik M. Graph-guided network for irregularly sampled multivariate time series. arXiv [Preprint]. 2021:arXiv:2110.05357. Zhu E, Wang S, Liu C, Wang J. Adaptive tokenization transformer: enhancing irregularly sampled multivariate time series analysis. IEEE Internet Things J. 2025;1(1):1-14. Jiang H, Liu L, Lian C. Multi-modal fusion transformer for multivariate time series classification. In: 2022 14th Int Conf Adv Comput Intell (ICACI); 2022 Jul 15-17; Nanjing, China. Piscataway (NJ): IEEE; 2022. p. 284-8. Kong G, Lin K, Hu Y. Using machine learning methods to predict in-hospital mortality of sepsis patients in the ICU. BMC Med Inform Decis Mak. 2020;20(1):251. Nie W, Yu Y, Zhang C, Song D, Zhao L, Bai Y, et al. Temporal-spatial correlation attention network for clinical data analysis in intensive care unit. IEEE Trans Biomed Eng. 2024;71(2):583-95. Wang Y, Zhao Y, Callcut R, Petzold L. Integrating physiological time series and clinical notes with transformer for early prediction of sepsis. arXiv [Preprint]. 2022:arXiv:2203.14469. Moor M, Rieck B, Horn M, Jutzeler CR, Borgwardt K. Early prediction of sepsis in the ICU using machine learning: a systematic review. Front Med. 2021;8:607952. Su L, Xu Z, Chang F, Ma Y, Liu S, Jiang H, et al. Early prediction of mortality, severity, and length of stay in the intensive care unit of sepsis patients based on sepsis 3.0 by machine learning models. Front Med. 2021;8:664966. Xu Y, Xu S, Ramprasad M, Tumanov A, Zhang C. TransEHR: self-supervised transformer for clinical time series data. In: Mach Learn Health (ML4H); 2023 Dec 4-9; New Orleans, USA. PMLR; 2023. p. 623-35. Oh J, Wang J, Wiens J. Learning to exploit invariances in clinical time-series data using sequence transformer networks. In: Mach Learn Healthc Conf; 2018 Nov 29-30; Palo Alto, USA. PMLR; 2018. p. 332-47. Chai S, Zhuang L, Yan F. LayoutDM: transformer-based diffusion model for layout generation. In: Proc IEEE/CVF Conf Comput Vis Pattern Recognit (CVPR); 2023 Jun 18-22; Vancouver, Canada. IEEE; 2023. p. 18349-58. Pang K, Li L, Ouyang W, Liu X, Tang Y. Establishment of ICU mortality risk prediction models with machine learning algorithm using MIMIC-IV database. Diagnostics (Basel). 2022;12(5):1068. Lyu W, Dong X, Wong R, Zheng S, Abell-Hart K, Wang F, et al. A multimodal transformer: fusing clinical notes with structured EHR data for interpretable in-hospital mortality prediction. AMIA Annu Symp Proc. 2022;2022:719-28. Bhavani SV, Semler M, Qian ET, Verhoef PA, Robichaux C, Churpek MM, et al. Development and validation of novel sepsis subphenotypes using trajectories of vital signs. Intensive Care Med. 2022;48(11):1582-92. Chen Y, Peng G, Zhu Z, Li S. A novel deep learning method based on attention mechanism for bearing remaining useful life prediction. Appl Soft Comput. 2020;86:105919. Alaa AM, Yoon J, Hu S, Van der Schaar M. Personalized risk scoring for critical care prognosis using mixtures of Gaussian processes. IEEE Trans Biomed Eng. 2018;65(1):207-18. Johnson AE, Mark RG. Real-time mortality prediction in the Intensive Care Unit. AMIA Annu Symp Proc. 2017;2017:994-1003. El-Rashidy N, El-Sappagh S, Abuhmed T, Abdelrazek S, El-Bakry HM. Intensive care unit mortality prediction: an improved patient-specific stacking ensemble model. IEEE Access. 2020;8:133541-64. Awad A, Bader-El-Den M, McNicholas J, Briggs J, El-Sonbaty Y. Predicting hospital mortality for intensive care unit patients: time-series analysis. Health Informatics J. 2020;26(2):1043-59. Liu X, Gong T, Li Y, Li N, Ding S. Medical irregular multivariate time series forecasting based on multi-scale temporal-frequency domain patch fusion and dynamic graph. Front Physiol. 2023;14:1767037. Li Z, Li S, Yan X. Time series as images: vision transformer for irregularly sampled time series. Adv Neural Inf Process Syst. 2023;36:49187-204. Sun C, Song M, Cai D, Zhang B, Li H, Hong S. A review of deep learning methods for irregularly sampled medical time series data. Health Data Sci. 2020;2020:1-15. An Y, Liu Y, Chen X, Sheng Y. TERTIAN: clinical endpoint prediction in ICU via time-aware transformer-based hierarchical attention network. Comput Intell Neurosci. 2022;2022:4207940. Tipirneni S, Reddy CK. Self-supervised transformer for sparse and irregularly sampled multivariate clinical time-series. ACM Trans Knowl Discov Data. 2022;16(6):1-17. Khader F, Kather JN, Müller-Franzes G, Wang T, Han T, Tayebi Arasteh S, et al. Medical transformer for multimodal survival prediction in intensive care: integration of imaging and non-imaging data. Sci Rep. 2023;13(1):10666. Shukla SN, Marlin BM. Modeling irregularly sampled clinical time series. arXiv [Preprint]. 2018:arXiv:1812.00000.