An Unsupervised Person Re-Identification Method Based on Heterogeneous Convolutional Neural Networks Ensemble

PENG Jin-jia; WANG Hui-bing

doi:10.12263/DZXB.20220467

您当前的位置：

首页 >

文章列表页 >

An Unsupervised Person Re-Identification Method Based on Heterogeneous Convolutional Neural Networks Ensemble

PAPERS | 更新时间：2025-12-08

- An Unsupervised Person Re-Identification Method Based on Heterogeneous Convolutional Neural Networks Ensemble
- ACTA ELECTRONICA SINICA Vol. 51, Issue 10, Pages: 2902-2914(2023)
- 作者机构：
  
  1.河北大学网络空间安全与计算机学院，河北保定 071000
  2.大连海事大学信息科学技术学院，辽宁大连 116026
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China(62002041);Hebei University High-level Scientific Research Foundation for the Introduction of Talent(521100221029)
- DOI：10.12263/DZXB.20220467
  CLC： TP391.4;
- Received：27 April 2022，
  
  Revised：2022-09-18，
  
  Published：25 October 2023
- 稿件说明：
移动端阅览
彭锦佳,王辉兵.基于异构卷积神经网络集成的无监督行人重识别方法[J].电子学报,2023,51(10):2902-2914.

PENG Jin-jia,WANG Hui-bing.An Unsupervised Person Re-Identification Method Based on Heterogeneous Convolutional Neural Networks Ensemble[J].ACTA ELECTRONICA SINICA,2023,51(10):2902-2914.
彭锦佳,王辉兵.基于异构卷积神经网络集成的无监督行人重识别方法[J].电子学报,2023,51(10):2902-2914. DOI： 10.12263/DZXB.20220467.

PENG Jin-jia,WANG Hui-bing.An Unsupervised Person Re-Identification Method Based on Heterogeneous Convolutional Neural Networks Ensemble[J].ACTA ELECTRONICA SINICA,2023,51(10):2902-2914. DOI： 10.12263/DZXB.20220467.

摘要

行人重识别旨在从不同的摄像头中识别目标行人的图像.由于不同场景之间存在域偏差，在一个场景中训练好的重识别模型无法直接应用在另一个场景中.为克服该问题，现有的无监督行人重识别方法倾向通过使用聚类算法获得伪标签，再利用伪标签训练重识别模型.但是，由于聚类结果是不准确的，这类方法会引入大量噪声标签，从而限制了模型的泛化能力.因此，为减轻噪声伪标签的影响，本文提出了一种基于异构卷积神经网络集成的无监督行人重识别方法.该框架不使用任何人工标记信息，自动推测目标域中行人图像之间的关系，并构建协作可信实例选择机制，选择可信度高的伪标签用于模型的训练.通过设计双分支异构卷积神经网络学习判别能力强的多种行人特征，并利用记忆单元存储训练过程中的全局特征，减少因噪声标签在训练过程中产生的波动，提高模型的鲁棒性.本文方法在多个公开行人数据集上进行了验证并得到了良好的实验结果.在Market1501和DukeMTMC-reID数据集上，mAP分别达到了85.4%和74.8%.

Abstract

Person re-identification (re-ID) aims to identify a person's images across different cameras. However

the domain bias between different datasets makes it a challenge for re-ID models trained on one dataset to be adapted to another. A variety of unsupervised domain adaptation methods tend to transfer learned knowledge from one domain to another by optimizing with pseudo-labels. However

these methods introduce a large number of noisy labels through one-shot clustering

which hinders the retraining process and limits generalization. To mitigate the impact of noisy pseudo-labels

this paper proposes an unsupervised person re-identification method based on an ensemble of heterogeneous convolutional neural networks. The framework does not apply any manual labeling information

automatically infers the relationship between pedestrian images in the target domain

and a cooperative trusted instance selection mechanism is established to select pseudo-labels with high credibility. By constructing a dual-branch heterogeneous network

a variety of different pedestrian features are learned

and memory structures are designed to store the life-long features during the training stage

which could reduce the fluctuation of noise labels

and improve the robustness of the model. Comprehensive experimental results have demonstrated that our proposed method can achieve excellent performances on benchmark datasets. And mAP is increased to 85.4% and 74.8% on Market1501 and DukeMTMC-reID

respectively.

关键词

Keywords

references

TANG Z M , HUANG J . Harmonious multi-branch network for person re-identification with harder triplet loss [J]. ACM Transactions on Multimedia Computing, Communications, and Applications , 2022 , 18 ( 4 ): 98 .

AHMED E , JONES M , MARKS T K . An improved deep learning architecture for person re-identification [C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2015 : 3908 - 3916 .

匡澄 , 陈莹 . 基于多粒度特征融合网络的行人重识别 [J]. 电子学报 , 2021 , 49 ( 8 ): 1541 - 1550 .

KUANG C , CHEN Y . Multi-granularity feature fusion network for person re-identification [J]. Acta Electronica Sinica , 2021 , 49 ( 8 ): 1541 - 1550 . (in Chinese)

ZHANG G Q , ZHANG H W , CHEN Y H , et al . Close-set camera style distribution alignment for single camera person re-identification [J]. Neurocomputing , 2022 , 486 : 93 - 103 .

ZHONG Z , ZHENG L , LUO Z M , et al . Invariance matters: Exemplar memory for domain adaptive person re-identification [C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 598 - 607 .

ZHONG Z , ZHENG L , LI S Z , et al . Generalizing a person retrieval model hetero- and homogeneously [C]// European Conference on Computer Vision . Cham : Springer , 2018 : 176 - 192 .

GE Y X , ZHU F , CHEN D P , et al . Self-paced contrastive learning with hybrid memory for domain adaptive object re-ID [C]// Proceedings of the 34th International Conference on Neural Information Processing Systems . New York : Curran Associates Inc. , 2020 : 11309 - 11321 .

WANG Z D , ZHANG J W , ZHENG L , et al . CycAs: Self-supervised cycle association for learning re-identifiable descriptions [C]// European Conference on Computer Vision . Cham : Springer , 2020 : 72 - 88 .

FAN H H , ZHENG L , YAN C G , et al . Unsupervised person re-identification: Clustering and fine-tuning [J]. ACM Transactions on Multimedia Computing, Communications, and Applications , 2018 , 14 ( 4 ): 83 .

LIN Y T , DONG X Y , ZHENG L A , et al . A bottom-up clustering approach to unsupervised person re-identification [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2019 , 33 ( 1 ): 8738 - 8745 .

WANG D K , ZHANG S L . Unsupervised person re-identification via multi-label classification [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 10978 - 10987 .

CHEN H , LAGADEC B , BREMOND F . ICE: Inter-instance contrastive encoding for unsupervised person re-identification [C]// 2021 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway : IEEE , 2022 : 14940 - 14949 .

LI M K , SUN H , LIN C Q , et al . The devil in the tail: Cluster consolidation plus cluster adaptive balancing loss for unsupervised person re-identification [J]. Pattern Recognition , 2022 , 129 : 108763 .

LI M K , LI C G , GUO J . Cluster-guided asymmetric contrastive learning for unsupervised person re-identification [J]. IEEE Transactions on Image Processing , 2022 , 31 : 3606 - 3617 .

CHO Y , KIM W J , HONG S , et al . Part-based pseudo label refinement for unsupervised person re-identification [C]// 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2022 : 7298 - 7308 .

ZHANG X , GE Y X , QIAO Y , et al . Refining pseudo labels with clustering consensus over generations for unsupervised object re-identification [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2021 : 3435 - 3444 .

XUAN S Y , ZHANG S L . Intra-inter camera similarity for unsupervised person re-identification [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2021 : 11921 - 11930 .

YANG F X , ZHONG Z , LUO Z M , et al . Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2021 : 4853 - 4862 .

WANG M L , LAI B S , HUANG J Q , et al . Camera-aware proxies for unsupervised person re-identification [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2021 , 35 ( 4 ): 2764 - 2772 .

ZHUANG W M , WEN Y G , ZHANG S . Joint optimization in edge-cloud continuum for federated unsupervised person re-identification [C]// Proceedings of the 29th ACM International Conference on Multimedia . New York : ACM , 2021 : 433 - 441 .

WU G L , GONG S G . Decentralised learning from independent multi-domain labels for person re-identification [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2021 , 35 ( 4 ): 2898 - 2906 .

CHEN H , WANG Y H , LAGADEC B , et al . Joint generative and contrastive learning for unsupervised person re-identification [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2021 : 2004 - 2013 .

BACHMAN P , HJELM R D , BUCHWALTER W . Learning representations by maximizing mutual information across views [C]// Proceedings of the 33rd International Conference on Neural Information Processing System . New York : Curran Associates Inc. , 2019 : 15535 - 15545 .

HE K M , FAN H Q , WU Y X , et al . Momentum contrast for unsupervised visual representation learning [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 9726 - 9735 .

HÉNAFF O J , SRINIVAS A , DE FAUW J , et al . Data-efficient image recognition with contrastive predictive coding [C]// Proceedings of the 37th International Conference on Machine Learning . New York : ACM , 2020 : 4182 - 4192 .

XIAO T , LI S , WANG B C , et al . Joint detection and identification feature learning for person search [C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2017 : 3376 - 3385 .

DAI Z Z , WANG G Y , YUAN W H , et al . Cluster contrast for unsupervised person re-identification [EB/OL]. ( 2021-03-22 )[ 2022-04 ]. https://arxiv.org/abs/2103.11568 https://arxiv.org/abs/2103.11568 .

ZHENG L , SHEN L Y , TIAN L , et al . Scalable person re-identification: A benchmark [C]// 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway : IEEE , 2016 : 1116 - 1124 .

RISTANI E , SOLERA F , ZOU R , et al . Performance measures and a data set for multi-target, multi-camera tracking [C]// European Conference on Computer Vision . Cham : Springer , 2016 : 17 - 35 .

WEI L H , ZHANG S L , GAO W , et al . Person transfer GAN to bridge domain gap for person re-identification [C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway : IEEE , 2018 : 79 - 88 .

PASZKE A , GROSS S , CHINTALA S , et al . Automatic differentiation in PyTorch [C]// NIPS 2017 Autodiff Workshop . Long Beach : NIPS , 2017 : 1 - 4 .

LIN Y T , XIE L X , WU Y , et al . Unsupervised person re-identification via softened similarity learning [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 3387 - 3396 .

WU J L , LIU H , YANG Y , et al . Unsupervised graph association for person re-identification [C]// 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway : IEEE , 2020 : 8320 - 8329 .

ZENG K W , NING M N , WANG Y H , et al . Hierarchical clustering with hard-batch triplet loss for person re-identification [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 13654 - 13662 .

ZHAI Y P , LU S J , YE Q X , et al . AD-cluster: Augmented discriminative clustering for domain adaptive person re-identification [C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2020 : 9018 - 9027 .

ZHAO F , LIAO S C , XIE G S , et al . Unsupervised domain adaptation with noise resistible mutual-training for person re-identification [C]// European Conference on Computer Vision . Cham : Springer , 2020 : 526 - 544 .

GE Y X , CHEN D P , LI H S . Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification [C]// 2020 International Conference on Learning Representations . Addis Ababa : ICLR , 2020 : 1 - 15 .

LI J N , ZHANG S L . Joint visual and temporal consistency for unsupervised domain adaptive person re-identification [C]// European Conference on Computer Vision . Cham : Springer , 2020 : 483 - 499 .

ZHENG K C , LIU W , HE L X , et al . Group-aware label transfer for domain adaptive person re-identification [C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2021 : 5306 - 5315 .

DAI Y X , LIU J , BAI Y , et al . Dual-refinement: Joint label and feature refinement for unsupervised domain adaptive person re-identification [J]. IEEE Transactions on Image Processing , 2021 , 30 : 7815 - 7829 .

LI M X , ZHU X T , GONG S G . Unsupervised person re-identification by deep learning tracklet association [C]// European Conference on Computer Vision . Cham : Springer , 2018 : 772 - 788 .

LI M X , ZHU X T , GONG S G . Unsupervised tracklet person re-identification [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2019 , 42 ( 7 ): 1770 - 1782 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Unsupervised Person Re-Identification with Pseudo Label Regularization Loss

Cross-Modal Person Re-Identification Based on Generative Adversarial Network Coordinated with Angle Based Heterogeneous Center Triplet Loss

Cross-Modality Person Re-identification Based on Locally Heterogeneous Polymerization Graph Convolutional Network

Multi-granularity Feature Fusion Network for Person Re-Identification

Related Author

RUAN Qiu-qi

QIAN Yu-hua

ZHANG Shuo-rui

JIA Jie-ru

SHU Hao-feng

WANG Jin-hua

BAI Meng-lin

ZHOU Fei

Related Institution

Institute of Information Science, Beijing Jiaotong University

Engineering Research Center for Machine Vision and Data Mining of Shanxi; Province

School of Information and Technology, Shanxi University

Institute of Big Data Science and Industry, Shanxi University

School of Communication and Information Engineering， Chongqing University of Posts and Telecommunications

⁰