MugenNet: A Novel Combined Convolution Neural Network and Transformer Network with Application in Colonic Polyp Image Segmentation
Date
2024-11
Authors
Peng, Chen
Qian, Zhiqin
Wang, Kunyu
Zhang, Lanzhu
Luo, Qi
Bi, Zhuming
Zhang, Wenjun
Journal Title
Journal ISSN
Volume Title
Publisher
Sensors
ORCID
Type
Article
Degree Level
Abstract
Accurate polyp image segmentation is of great significance, because it can help in the detection of polyps. Convolutional neural network (CNN) is a common automatic segmentation method, but its main disadvantage is the long training time. Transformer is another method that can be adapted to the automatic segmentation method by employing a self-attention mechanism, which essentially assigns different importance weights to each piece of information, thus achieving high computational efficiency during segmentation. However, a potential drawback with Transformer is the risk of information loss. The study reported in this paper employed the well-known hybridization principle to propose a method to combine CNN and Transformer to retain the strengths of both. Specifically, this study applied this method to the early detection of colonic polyps and to implement a model called MugenNet for colonic polyp image segmentation. We conducted a comprehensive experiment to compare MugenNet with other CNN models on five publicly available datasets. An ablation experiment on MugenNet was conducted as well. The experimental results showed that MugenNet can achieve a mean Dice of 0.714 on the ETIS dataset, which is the optimal performance on this dataset compared to other models, with an inference speed of 56 FPS. The overall outcome of this study is a method to optimally combine two methods of machine learning which are complementary to each other.
Description
Keywords
transformer, convolutional neural network, polyp detection, image segmentation
Citation
Peng, C., Qian, Z., Wang, K., Zhang, L., Luo, Q., Bi, Z., & Zhang, W. (2024). MugenNet: A Novel Combined Convolution Neural Network and Transformer Network with Application in Colonic Polyp Image Segmentation. Sensors, 24(23), 7473. https://doi.org/10.3390/s24237473
Degree
Department
Program
Advisor
Committee
Part Of
item.page.relation.ispartofseries
DOI
https://doi.org/10.3390/s24237473