pp. 4683-4694
S&M3824 Technical Paper of Special Issue https://doi.org/10.18494/SAM5189 Published: November 12, 2024 Medical Image Segmentation on Attention-based Gaussian Blurring [PDF] Yue-Tian Mao, Qing-Song Liu, Yin-Feng Fang, Guo-Zhang Jiang, and Du Jiang (Received July 5, 2024; Accepted August 30, 2024) Keywords: eye-gaze, attention, eye-tracking sensor, segmentation, deep learning
In this study, we explore the integration of eye-gaze (EG) information obtained via eye-tracking sensors to enhance medical image segmentation. EG is additional information on an image, and to incorporate EG information in medical image segmentation, we apply Gaussian blurring masked by the collected attention maps generated by eye tracking. The variance of distribution on each pixel is adjusted in a certain way by EG information. After applying Gaussian blurring, classic models including UNet, FCN, and other models were trained and compared. The results indicate that incorporating EG information in addition to preprocessing data yields superior performance on certain metrics, demonstrating notable advantages in accurately identifying isolated polyps that grow on the surface of a human tissue. This innovative approach highlights the potential of combining sensor-derived data with advanced image processing techniques to improve medical diagnostics.
Corresponding author: Yin-Feng FangThis work is licensed under a Creative Commons Attribution 4.0 International License. Cite this article Yue-Tian Mao, Qing-Song Liu, Yin-Feng Fang, Guo-Zhang Jiang, and Du Jiang, Medical Image Segmentation on Attention-based Gaussian Blurring, Sens. Mater., Vol. 36, No. 11, 2024, p. 4683-4694. |