基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割

刘金平; 吴娟娟; 张荣; 徐鹏飞

doi:10.12263/DZXB.20220368

您当前的位置：

首页 >

文章列表页 >

基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割

学术论文 | 更新时间：2025-12-08

- 基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割
- Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision
- 电子学报 2023年51卷第5期页码：1163-1171
- 作者机构：
  
  湖南师范大学信息科学与工程学院，湖南长沙 410006
- 作者简介：
  
  [ "刘金平　男，1983年9月出生于湖南省邵阳市.现为湖南师范大学信息科学与工程学院教授、博士生导师，主要从事智能信息处理、过程检测、故障诊断等相关研究.E-mail: ljp202518@163.com" ]
  [ "吴娟娟　女，1996年5月出生于湖南省株洲市.目前在湖南师范大学信息科学与工程学院攻读硕士学位.研究方向为生物医学图像处理. E-mail: Ajuan0527@hunnu.edu.cn" ]
  [ "张荣　女，1999年12月出生于湖南省长沙市.目前在湖南师范大学信息科学与工程学院攻读硕士学位.研究方向为生物医学图像处理. E-mail: cpstzr@163.com" ]
  [ "徐鹏飞（通讯作者）　男，1977年9月出生于湖南省岳阳市.现为湖南师范大学信息科学与工程学院副教授，主要从事智能信息处理方面的研究." ]
- 基金信息：
  
  国家自然科学基金(61971188)
- DOI：10.12263/DZXB.20220368
  中图分类号： TP391.41
- 收稿：2022-04-07，
  
  修回：2022-11-22，
  
  纸质出版：2023-05-25
- 稿件说明：
移动端阅览
刘金平,吴娟娟,张荣等.基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割[J].电子学报,2023,51(05):1163-1171.

LIU Jin-ping,WU Juan-juan,ZHANG Rong,et al.Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision[J].ACTA ELECTRONICA SINICA,2023,51(05):1163-1171.
刘金平,吴娟娟,张荣等.基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割[J].电子学报,2023,51(05):1163-1171. DOI： 10.12263/DZXB.20220368.

LIU Jin-ping,WU Juan-juan,ZHANG Rong,et al.Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision[J].ACTA ELECTRONICA SINICA,2023,51(05):1163-1171. DOI： 10.12263/DZXB.20220368.

摘要

基于深度学习模型的胸部CT（Computed Tomography）图像自动分割有助于辅助医生诊疗.但随着网络宽度与深度的加深，网络训练困难且推理减慢.为提高隐藏层的学习能力，深度监督机制被用于网络训练.但以往的深度监督方法没有考虑模型中多尺度特征图的分层表示以及上采样对参与损失计算的特征图质量的影响.为加强隐藏层学习过程的直接性同时加快网络推理，本文提出一种结构重参数化与多尺度深度监督分割网络（Structural Reparameterization and Multi-scale Deep Supervision Network，SR&MDS-Net），以实现COVID-19（COrona VIrus Disease 2019）胸部CT图像的高效准确分割.首先构建一种结构重参数化特征变异（Structure Reparameterized Featurev ariation，SRFV）模块将网络的训练与推理进行解耦，在提高模型表达能力的同时加快推理速度；然后，提出一种新颖的多尺度深度监督机制，以加强网络监督效果，提高网络性能.在公开的COVID-19胸部CT图像数据集上进行实验，SR&MDS-Net的灵敏度、特异性、准确率、Dice分别达到了91.5%、99.5%、72.8%、80.1%，与同类其他方法比较，具有更优的性能.

Abstract

Automatic segmentation of chest CT (Computed Tomography) images based on deep learning models is helpful to assist doctors in diagnosis and treatment. However

with the deepening of the network width and depth

the network training is difficult and the inference slows down. In order to improve the learning ability of the hidden layer

the deep supervision mechanism is used in network training. However

previous deep supervision methods did not considerthe layered representation of multi-scale feature maps in the segmentation model and the influence of upsampling on the quality of feature maps involved in loss calculation. In order to improve the directness of the hidden layer learning process and speed up the reasoning. This article proposes a structural reparameterization and multi-scale deep supervision network (SR&MDS-Net) for the purpose of achieving the efficient and accurate segmentation results of lesions in COVID-19 (COrona VIrus Disease 2019) pneumonia chest CT images. Structure reparameterized featurev ariation (SRFV) module was constructed to decoupage the network training and reasoning

which improved the model expression ability and accelerated the reasoning speed. In order to strengthen the effect of network supervision and improve the performance of network

a novel multi-scale deep supervision mechanism is proposed. The experiment was carried out on the public COVID-19 pneumonia chest CT image dataset. The sensitivity

specificity

accuracy

and Dice of SR&MDS-Net reached 91.5%

99.5%

72.8%

and 80.1%

respectively

which had better performance compared with other similar methods.

关键词

Keywords

references

孙捷 , 张永梅 . 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法 [J]. 电子学报 , 2023 , 51 ( 1 ): 202 - 212 .

SUN Jie , ZHANG Yong-mei . A dynamic-static dual input deep neural network algorithm for diagnosing COVID-19 by cough [J]. Acta Electronica Sinica , 2023 , 51 ( 1 ): 202 - 212 . (in Chinese)

SHI F , WANG J , SHI J , et al . Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-19 [J]. IEEE Reviews in Biomedical Engineering , 2021 , 14 : 4 - 15 .

RONNEBERGER O , FISCHER P , BROX T . U-Net: Convolutional networks for biomedical image segmentation [C]// International Conference on Medical Image Computing and Computer-Assisted Intervention . Cham : Springer , 2015 : 234 - 241 .

FAN D P , ZHOU T , JI G P , et al . Inf-Net: Automatic COVID-19 lung infection segmentation from CT images [J]. IEEE Transactions on Medical Imaging , 2020 , 39 ( 8 ): 2626 - 2637 .

PALURU N , DAYAL A , JENSSEN H B , et al . Anam-Net: Anamorphicdepth embedding-based lightweight CNN for segmentation of anomalies in COVID-19 chest CT images [J]. IEEE Transactions on Neural Networks and Learning Systems , 2021 , 32 ( 3 ): 932 - 946 .

GAO K , SU J , JIANG Z , et al . Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images [J]. Medical Image Analysis , 2021 , 67 : 101836 .

WANG X , YUAN Y , GUO D , et al . SSA-Net: Spatial self-attention network for COVID-19 pneumonia infection segmentation with semi-supervised few-shot learning [J]. Medical Image Analysis , 2022 , 79 : 102459 .

LIU J , DONG B , WANG S , et al . COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework [J]. Medical Image Analysis , 2021 , 74 : 102205 .

ZHU Q , DU B , TURKBEY B , et al . Deeply-supervised CNN for prostate segmentation [C]// 2017 International Joint Conference on Neural Networks (IJCNN) . Anchorage : IEEE , 2017 : 178 - 184 .

陆倩杰 , 柏正尧 , 樊圣澜 , 等 . COVID-19肺部CT 图像多尺度编解码分割 [J]. 中国图象图形学报 , 2022 , 27 ( 3 ): 827 - 837 .

LU Qian-jie , BAI Zheng-yao , FANG Sheng-lan , et al . Multiscalecodec network based CT image segmentation for human lung disease derived of COVID-19 [J]. Journal of Image and Graphics , 2022 , 27 ( 3 ): 827 - 837 . (in Chinese)

MAJI D , SIGEDAR P , SINGH M . Attention Res-UNet with guided decoder for semantic segmentation of brain tumors [J]. Biomedical Signal Processing and Control , 2022 , 71 : 103077 .

SHELHAMER E , LONG J , DARRELL T . Fully convolutionalnetworks for semantic segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 4 ): 640 - 651 .

DING X , ZHANG X , MA N , et al . RepVGG: Making VGG-style convnets great again [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville : IEEE , 2021 : 13733 - 13742 .

HOU Q , ZHOU D , FENG J . Coordinate attention for efficient mobile network design [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville : IEEE , 2021 : 13713 - 13722 .

CAO J , LIY , SUN M , et al . DO-Conv: Depthwise over-parameterized convolutional layer [J]. IEEE Transactions on Image Processing , 2022 , 31 : 3726 - 3736 .

DING X , GUO Y , DING G , et al . ACNET: Strengthening the kernel skeletons for powerful cnn via asymmetric convolution blocks [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 1911 - 1920 .

MOROZOV S , ANDREYCHENKO A , PAVLOV N , et al . Mosmeddata: Chest CT scans with COVID-19 related findings dataset [EB/OL]. ( 2020-05-13 )[ 2022-04-07 ]. https://arxiv.org/abs/2005.06465 https://arxiv.org/abs/2005.06465 .

JUN M , CHENG G , YIXIN W , et al . COVID-19 CT lung andinfection segmentation dataset (Verson 1 .0)[DS/OL] . ( 2020-04-20 )[ 2022-04-07 ]. https://zenodo.org/record/3757476#.Y3wvnnZBxPY https://zenodo.org/record/3757476#.Y3wvnnZBxPY .

HUJ , SHEN L , ALBANIE S , et al . Squeeze-and-excitation networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2020 , 42 ( 8 ): 2011 - 2023 .

LI X , HU X , YANG J . Spatial group-wise enhance: Improving semantic feature learning in convolutional networks [EB/OL]. ( 2019-05-25 )[ 2022-04-07 ]. http://arxiv.org/abs/1905.09646 http://arxiv.org/abs/1905.09646 .

WOO S , PARK J , LEE J , et al . CBAM: Convolutional block attention module [C]// Proceedings of the European Conference on Computer Vision(ECCV) . Cham : Springer , 2018 : 3 - 19 .

LIU H , LIU F , FAN X , et al . Polarized self-attention: Towards high-quality pixel-wise regression [EB/OL]. ( 2021-07-08 )[ 2022-04-07 ]. https://arxiv.org/abs/2107.00782 https://arxiv.org/abs/2107.00782 .

QIU Y , LIU Y , LI S , et al . MiniSeg: An extremely minimum network for efficient COVID-19 segmentation [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2021 , 35 ( 6 ): 4846 - 4854 .

XIAO H , RAN Z , MABU S , et al . SAUNet++: An automatic segmentation model of COVID-19 lesion from CT slices [J/OL]. The Visual Computer , 2022 : 1 - 14 . DOI: https://doi.org/10.1007/s00371-022-02414-4 https://doi.org/10.1007/s00371-022-02414-4 .

ZHAO X , ZHANG P , SONG F , et al . D2A U-Net: Automatic segmentation of COVID-19 CT slices based on dual attention and hybrid dilated convolution [J]. Computers in Biology and Medicine , 2021 , 135 : 104526 .

LI Z , LI D , XU C , et al . TFCNs: A CNN-Transformer hybrid network for medical image segmentation [C]// Artificial Neural Networks and Machine Learning-ICANN 2022 . Cham : Springer , 2022 : 781 - 792 .

BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet:A deep convolutional encoder-decoder architecture for image segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 12 ): 2481 - 2495 .

ZHAO H , SHI J , QI X , et al . Pyramid scene parsing network [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu : IEEE , 2017 : 6230 - 6239 .

OKTAY O , SCHLEMPER J , FOLGOC L , et al . Attention U-Net: Learning where to look for the pancreas [EB/OL]. ( 2018-05-20 )[ 2022-04-07 ]. http://arxiv.org/abs/1804. 03999 http://arxiv.org/abs/1804.03999 .

ALOM M Z , HASAN M , YAKOPCIC C , et al . Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation [EB/OL]. ( 2018-05-29 )[ 2022-04-07 ]. https://arxiv.org/abs/1802. 06955 https://arxiv.org/abs/1802.06955 .

HUANG H , LIN L , TONG R , et al . Unet 3+: A full-scale connected unet for medical image segmentation [C]// ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Barcelona : IEEE , 2020 : 1055 - 1059 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

SAU-Net：基于U-Net和自注意力机制的医学图像分割方法

面向时序异常检测的可变视距多向扫描方法

基于稀疏平滑自蒸馏的差分隐私深度学习方法