Automatic pituitary adenoma segmentation and identification of cavernous sinus invasion via multitask learning

W Rui; W Gao; N Qiao; X Chen; M Han; Y Wu; T Xin; J Yang; Y Zhao; Z Yao

doi:10.1016/j.crad.2024.106756

Automatic pituitary adenoma segmentation and identification of cavernous sinus invasion via multitask learning

Clin Radiol. 2024 Nov 21:80:106756. doi: 10.1016/j.crad.2024.106756. Online ahead of print.

Authors

W Rui¹, W Gao², N Qiao³, X Chen⁴, M Han⁵, Y Wu⁶, T Xin⁷, J Yang⁸, Y Zhao⁹, Z Yao¹⁰

Affiliations

¹ Department of Radiology, Huashan Hospital, Fudan University, Mid Wulumuqi Road, Shanghai, 200040, China. Electronic address: wennyrui@126.com.
² Department of Neurosurgery, Peking University Third Hospital, Beijing, 100191, China. Electronic address: gaowenyuan@bjmu.edu.cn.
³ Department of Neurosurgery, Huashan Hospital, Fudan University, Mid Wulumuqi Road, Shanghai, 200040, China; Neurosurgical Institute of Fudan University, Shanghai, China; Shanghai Clinical Medical Center of Neurosurgery, Shanghai, China; Shanghai Key Laboratory of Brain Function and Restoration and Neural Regeneration, Shanghai, China. Electronic address: norikaisa@qq.com.
⁴ Department of Neurosurgery, Peking University Third Hospital, Beijing, 100191, China. Electronic address: neurochen@bjmu.edu.cn.
⁵ Department of Neurosurgery, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, 250014, China; Medical Science and Technology Innovation Center, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, 250117, China. Electronic address: hanmin@sdfmu.edu.cn.
⁶ Department of Radiology, Huashan Hospital, Fudan University, Mid Wulumuqi Road, Shanghai, 200040, China. Electronic address: wuyue0115@foxmail.com.
⁷ Department of Neurosurgery, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, 250014, China; Medical Science and Technology Innovation Center, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, 250117, China. Electronic address: drxintao@yeah.net.
⁸ Department of Neurosurgery, Peking University Third Hospital, Beijing, 100191, China. Electronic address: yangjbysy@bjmu.edu.cn.
⁹ Department of Neurosurgery, Huashan Hospital, Fudan University, Mid Wulumuqi Road, Shanghai, 200040, China; Neurosurgical Institute of Fudan University, Shanghai, China; Shanghai Clinical Medical Center of Neurosurgery, Shanghai, China; Shanghai Key Laboratory of Brain Function and Restoration and Neural Regeneration, Shanghai, China. Electronic address: zhaoyaohs@qq.com.
¹⁰ Department of Radiology, Huashan Hospital, Fudan University, Mid Wulumuqi Road, Shanghai, 200040, China. Electronic address: zwyao@fudan.edu.cn.

PMID: 39689622
DOI: 10.1016/j.crad.2024.106756

Abstract

Aim: This study aimed to develop a multitask deep learning model for pituitary macroadenoma (PMA) segmentation and identification of cavernous sinus (CS) invasion.

Materials and methods: A total of 926 patients with PMAs (n=816 from Institution 1 for model training and n=110 from Institution 2 for model validation) were included. Manual segmentation for tumor and bilateral internal carotid arteries was conducted on coronal contrast-enhanced T1-weighted imaging images using ITK-SNAP. Two performing neurosurgeons evaluated the CS invasion during the operation. A Multi-Task Multiaxis-Attention UNet (MTMAU-Net) framework that combined segmentation and CS invasion classification tasks was proposed. Dice similarity coefficient and 95% Hausdorff distance (HD95) were used to evaluate the segmentation performance. Accuracy and area under the curve (AUC) were used to assess the classification performance.

Results: Compared with several single-task models, MTMAU-Net model achieved higher Dice coefficient (90.84±0.55%) and lower HD95 values (2.13±0.37 mm) in segmentation tasks and performed better in the classification task (accuracy: 88.05±2.84%, AUC: 0.89±0.08). Compared with the Knosp grading system, this model showed overall consistent performance (accuracy: 88.05% vs 87.68%) and outperformed human grading evaluation at Knosp grade 3 (83.33% vs 57.62%). MTMAU-Net showed great capability of generalization in both segmentation (Dice coefficient: 83.71±5.93%) and classification tasks (accuracy: 84.55%, AUC: 0.87) in the validation cohort.

Conclusion: MTMAU-Net outperformed single-task models in PMA segmentation and CS invasion classification and showed advantages over the Knosp grading system in identifying CS invasion, which might guide clinicians to make appropriate surgical strategies.

Clinical trial registration: This study is registered at the Chinese Clinical Trial Registration Center with registration number ChiCTR210047614.