Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision

LIU Jin-ping; WU Juan-juan; ZHANG Rong; XU Peng-fei

doi:10.12263/DZXB.20220368

您当前的位置：

首页 >

文章列表页 >

Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision

PAPERS | 更新时间：2025-12-08

- Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision
- ACTA ELECTRONICA SINICA Vol. 51, Issue 5, Pages: 1163-1171(2023)
- 作者机构：
  
  湖南师范大学信息科学与工程学院，湖南长沙 410006
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(61971188)
- DOI：10.12263/DZXB.20220368
  CLC： TP391.41
- Received：07 April 2022，
  
  Revised：2022-11-22，
  
  Published：25 May 2023
- 稿件说明：
移动端阅览
刘金平,吴娟娟,张荣等.基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割[J].电子学报,2023,51(05):1163-1171.

LIU Jin-ping,WU Juan-juan,ZHANG Rong,et al.Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision[J].ACTA ELECTRONICA SINICA,2023,51(05):1163-1171.
刘金平,吴娟娟,张荣等.基于结构重参数化与多尺度深度监督的COVID-19胸部CT图像自动分割[J].电子学报,2023,51(05):1163-1171. DOI： 10.12263/DZXB.20220368.

LIU Jin-ping,WU Juan-juan,ZHANG Rong,et al.Toward Automated Segmentation of COVID‑19 Chest CT Images Based on Structural Reparameterization and Multi-Scale Deep Supervision[J].ACTA ELECTRONICA SINICA,2023,51(05):1163-1171. DOI： 10.12263/DZXB.20220368.

摘要

基于深度学习模型的胸部CT（Computed Tomography）图像自动分割有助于辅助医生诊疗.但随着网络宽度与深度的加深，网络训练困难且推理减慢.为提高隐藏层的学习能力，深度监督机制被用于网络训练.但以往的深度监督方法没有考虑模型中多尺度特征图的分层表示以及上采样对参与损失计算的特征图质量的影响.为加强隐藏层学习过程的直接性同时加快网络推理，本文提出一种结构重参数化与多尺度深度监督分割网络（Structural Reparameterization and Multi-scale Deep Supervision Network，SR&MDS-Net），以实现COVID-19（COrona VIrus Disease 2019）胸部CT图像的高效准确分割.首先构建一种结构重参数化特征变异（Structure Reparameterized Featurev ariation，SRFV）模块将网络的训练与推理进行解耦，在提高模型表达能力的同时加快推理速度；然后，提出一种新颖的多尺度深度监督机制，以加强网络监督效果，提高网络性能.在公开的COVID-19胸部CT图像数据集上进行实验，SR&MDS-Net的灵敏度、特异性、准确率、Dice分别达到了91.5%、99.5%、72.8%、80.1%，与同类其他方法比较，具有更优的性能.

Abstract

Automatic segmentation of chest CT (Computed Tomography) images based on deep learning models is helpful to assist doctors in diagnosis and treatment. However

with the deepening of the network width and depth

the network training is difficult and the inference slows down. In order to improve the learning ability of the hidden layer

the deep supervision mechanism is used in network training. However

previous deep supervision methods did not considerthe layered representation of multi-scale feature maps in the segmentation model and the influence of upsampling on the quality of feature maps involved in loss calculation. In order to improve the directness of the hidden layer learning process and speed up the reasoning. This article proposes a structural reparameterization and multi-scale deep supervision network (SR&MDS-Net) for the purpose of achieving the efficient and accurate segmentation results of lesions in COVID-19 (COrona VIrus Disease 2019) pneumonia chest CT images. Structure reparameterized featurev ariation (SRFV) module was constructed to decoupage the network training and reasoning

which improved the model expression ability and accelerated the reasoning speed. In order to strengthen the effect of network supervision and improve the performance of network

a novel multi-scale deep supervision mechanism is proposed. The experiment was carried out on the public COVID-19 pneumonia chest CT image dataset. The sensitivity

specificity

accuracy

and Dice of SR&MDS-Net reached 91.5%

99.5%

72.8%

and 80.1%

respectively

which had better performance compared with other similar methods.

关键词

Keywords

references

孙捷 , 张永梅 . 基于动静态特征双输入神经网络的咳嗽声诊断COVID-19算法 [J]. 电子学报 , 2023 , 51 ( 1 ): 202 - 212 .

SUN Jie , ZHANG Yong-mei . A dynamic-static dual input deep neural network algorithm for diagnosing COVID-19 by cough [J]. Acta Electronica Sinica , 2023 , 51 ( 1 ): 202 - 212 . (in Chinese)

SHI F , WANG J , SHI J , et al . Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-19 [J]. IEEE Reviews in Biomedical Engineering , 2021 , 14 : 4 - 15 .

RONNEBERGER O , FISCHER P , BROX T . U-Net: Convolutional networks for biomedical image segmentation [C]// International Conference on Medical Image Computing and Computer-Assisted Intervention . Cham : Springer , 2015 : 234 - 241 .

FAN D P , ZHOU T , JI G P , et al . Inf-Net: Automatic COVID-19 lung infection segmentation from CT images [J]. IEEE Transactions on Medical Imaging , 2020 , 39 ( 8 ): 2626 - 2637 .

PALURU N , DAYAL A , JENSSEN H B , et al . Anam-Net: Anamorphicdepth embedding-based lightweight CNN for segmentation of anomalies in COVID-19 chest CT images [J]. IEEE Transactions on Neural Networks and Learning Systems , 2021 , 32 ( 3 ): 932 - 946 .

GAO K , SU J , JIANG Z , et al . Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images [J]. Medical Image Analysis , 2021 , 67 : 101836 .

WANG X , YUAN Y , GUO D , et al . SSA-Net: Spatial self-attention network for COVID-19 pneumonia infection segmentation with semi-supervised few-shot learning [J]. Medical Image Analysis , 2022 , 79 : 102459 .

LIU J , DONG B , WANG S , et al . COVID-19 lung infection segmentation with a novel two-stage cross-domain transfer learning framework [J]. Medical Image Analysis , 2021 , 74 : 102205 .

ZHU Q , DU B , TURKBEY B , et al . Deeply-supervised CNN for prostate segmentation [C]// 2017 International Joint Conference on Neural Networks (IJCNN) . Anchorage : IEEE , 2017 : 178 - 184 .

陆倩杰 , 柏正尧 , 樊圣澜 , 等 . COVID-19肺部CT 图像多尺度编解码分割 [J]. 中国图象图形学报 , 2022 , 27 ( 3 ): 827 - 837 .

LU Qian-jie , BAI Zheng-yao , FANG Sheng-lan , et al . Multiscalecodec network based CT image segmentation for human lung disease derived of COVID-19 [J]. Journal of Image and Graphics , 2022 , 27 ( 3 ): 827 - 837 . (in Chinese)

MAJI D , SIGEDAR P , SINGH M . Attention Res-UNet with guided decoder for semantic segmentation of brain tumors [J]. Biomedical Signal Processing and Control , 2022 , 71 : 103077 .

SHELHAMER E , LONG J , DARRELL T . Fully convolutionalnetworks for semantic segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 4 ): 640 - 651 .

DING X , ZHANG X , MA N , et al . RepVGG: Making VGG-style convnets great again [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville : IEEE , 2021 : 13733 - 13742 .

HOU Q , ZHOU D , FENG J . Coordinate attention for efficient mobile network design [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville : IEEE , 2021 : 13713 - 13722 .

CAO J , LIY , SUN M , et al . DO-Conv: Depthwise over-parameterized convolutional layer [J]. IEEE Transactions on Image Processing , 2022 , 31 : 3726 - 3736 .

DING X , GUO Y , DING G , et al . ACNET: Strengthening the kernel skeletons for powerful cnn via asymmetric convolution blocks [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision . Seoul : IEEE , 2019 : 1911 - 1920 .

MOROZOV S , ANDREYCHENKO A , PAVLOV N , et al . Mosmeddata: Chest CT scans with COVID-19 related findings dataset [EB/OL]. ( 2020-05-13 )[ 2022-04-07 ]. https://arxiv.org/abs/2005.06465 https://arxiv.org/abs/2005.06465 .

JUN M , CHENG G , YIXIN W , et al . COVID-19 CT lung andinfection segmentation dataset (Verson 1 .0)[DS/OL] . ( 2020-04-20 )[ 2022-04-07 ]. https://zenodo.org/record/3757476#.Y3wvnnZBxPY https://zenodo.org/record/3757476#.Y3wvnnZBxPY .

HUJ , SHEN L , ALBANIE S , et al . Squeeze-and-excitation networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2020 , 42 ( 8 ): 2011 - 2023 .

LI X , HU X , YANG J . Spatial group-wise enhance: Improving semantic feature learning in convolutional networks [EB/OL]. ( 2019-05-25 )[ 2022-04-07 ]. http://arxiv.org/abs/1905.09646 http://arxiv.org/abs/1905.09646 .

WOO S , PARK J , LEE J , et al . CBAM: Convolutional block attention module [C]// Proceedings of the European Conference on Computer Vision(ECCV) . Cham : Springer , 2018 : 3 - 19 .

LIU H , LIU F , FAN X , et al . Polarized self-attention: Towards high-quality pixel-wise regression [EB/OL]. ( 2021-07-08 )[ 2022-04-07 ]. https://arxiv.org/abs/2107.00782 https://arxiv.org/abs/2107.00782 .

QIU Y , LIU Y , LI S , et al . MiniSeg: An extremely minimum network for efficient COVID-19 segmentation [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2021 , 35 ( 6 ): 4846 - 4854 .

XIAO H , RAN Z , MABU S , et al . SAUNet++: An automatic segmentation model of COVID-19 lesion from CT slices [J/OL]. The Visual Computer , 2022 : 1 - 14 . DOI: https://doi.org/10.1007/s00371-022-02414-4 https://doi.org/10.1007/s00371-022-02414-4 .

ZHAO X , ZHANG P , SONG F , et al . D2A U-Net: Automatic segmentation of COVID-19 CT slices based on dual attention and hybrid dilated convolution [J]. Computers in Biology and Medicine , 2021 , 135 : 104526 .

LI Z , LI D , XU C , et al . TFCNs: A CNN-Transformer hybrid network for medical image segmentation [C]// Artificial Neural Networks and Machine Learning-ICANN 2022 . Cham : Springer , 2022 : 781 - 792 .

BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet:A deep convolutional encoder-decoder architecture for image segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 12 ): 2481 - 2495 .

ZHAO H , SHI J , QI X , et al . Pyramid scene parsing network [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu : IEEE , 2017 : 6230 - 6239 .

OKTAY O , SCHLEMPER J , FOLGOC L , et al . Attention U-Net: Learning where to look for the pancreas [EB/OL]. ( 2018-05-20 )[ 2022-04-07 ]. http://arxiv.org/abs/1804. 03999 http://arxiv.org/abs/1804.03999 .

ALOM M Z , HASAN M , YAKOPCIC C , et al . Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation [EB/OL]. ( 2018-05-29 )[ 2022-04-07 ]. https://arxiv.org/abs/1802. 06955 https://arxiv.org/abs/1802.06955 .

HUANG H , LIN L , TONG R , et al . Unet 3+: A full-scale connected unet for medical image segmentation [C]// ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Barcelona : IEEE , 2020 : 1055 - 1059 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

SAU-Net: Medical Image Segmentation Method Based on U-Net and Self-Attention

Variable Horizon Multi-Directional Scanning Method for Time Series Anomaly Detection

Differentially Private with Sparse and Smooth Self-Distillation

Related Author

XU Peng-fei

ZHANG Shu-jun

PENG Zhong

LI Hui

Shu-jun ZHANG

Zhong PENG

Hui LI

HUANG Yu-zhe

Related Institution

School of Information Science and Technology, Qingdao University of Science and Technology

School of Information Science and Technology， Qingdao University of Science and Technology

School of Computer Science and Engineering, School of Cyber Science and Engineering, Nanjing University of Science and Technology

School of Information, Renmin University of China

College of Information Engineering, Capital Normal University

⁰