A Few-Shot Image Classification Method by Pairwise-Based Meta Learning

LI Wei-gang; GAN Ping; XIE Lu; LI Song-tao

doi:10.12263/DZXB.20210453

您当前的位置：

首页 >

文章列表页 >

A Few-Shot Image Classification Method by Pairwise-Based Meta Learning

PAPERS | 更新时间：2025-12-08

- A Few-Shot Image Classification Method by Pairwise-Based Meta Learning
- ACTA ELECTRONICA SINICA Vol. 50, Issue 2, Pages: 295-304(2022)
- 作者机构：
  
  武汉科技大学冶金自动化与检测技术教育部工程研究中心，湖北武汉 430081
- 作者简介：
- 基金信息：
- DOI：10.12263/DZXB.20210453
  CLC： TP391.4
- Received：09 April 2021，
  
  Revised：2021-10-31，
  
  Published：25 February 2022
- 稿件说明：
移动端阅览
李维刚,甘平,谢璐等.基于样本对元学习的小样本图像分类方法[J].电子学报,2022,50(02):295-304.

LI Wei-gang,GAN Ping,XIE Lu,et al.A Few-Shot Image Classification Method by Pairwise-Based Meta Learning[J].ACTA ELECTRONICA SINICA,2022,50(02):295-304.
李维刚,甘平,谢璐等.基于样本对元学习的小样本图像分类方法[J].电子学报,2022,50(02):295-304. DOI： 10.12263/DZXB.20210453.

LI Wei-gang,GAN Ping,XIE Lu,et al.A Few-Shot Image Classification Method by Pairwise-Based Meta Learning[J].ACTA ELECTRONICA SINICA,2022,50(02):295-304. DOI： 10.12263/DZXB.20210453.

摘要

本文针对小样本图像分类问题，提出一种基于样本对的元学习（Pairwise-based Meta Learning，PML）方法.利用传递迁移学习对预训练好的Resnet50模型进行微调，得到一个更适应小样本任务的特征编码器，将该特征编码器作为元学习模型的初始特征编码器来训练模型，进一步增强了元学习模型的泛化能力；同时，本文还基于支持集与查询集样本之间的相似性提出元损失函数（Meta Loss，ML），其考虑了特征空间中查询集所有样本的相互关系，以此来缩小正样本类内距离，增加正负样本类间距离，从而提高分类精度.实验结果表明，本文的方法在1-shot、5-shot任务上分别达到了77.65%、89.65%的分类精度，较最新的元学习方法Meta-baseline分别提高7.38%、5.65%.

Abstract

In this paper

a pairwise-based meta learning(PML) method is proposed for few-shot image classification. Transitive transfer learning is used to fine tune the pre-trained Resnet50 model to get a feature encoder that is more suitable for few shot task. The feature encoder is used as the initial feature encoder of the meta-learning model to train the model

which further enhances the generalization ability of the meta-learning model. Based on the similarity between the support set and the query set samples

a meta loss(ML) function is proposed

which considers the relationship between all the samples of the query set in the feature space

so as to reduce the within-class distance of positive samples and increase the between-class distance of positive and negative samples

thus improving the classification accuracy.The experimental results show that the classification accuracy of the methods in this paper is 77.65% and 89.65% on 1-shot and 5-shot tasks

respectively

and it is 7.38% and 5.65% higher than the latest meta-learning method

Meta-baseline.

关键词

Keywords

references

VINYALS O , BLUNDELL C , LILLICRAP T , et al . Matching networks for one shot learning [C]// Proceedings of the 30th International Conference on Neural Information Processing Systems . Barcelona, Spain : MIT Press , 2016 : 3630 - 3638 .

季鼎承 , 蒋亦樟 , 王士同 . 基于域与样例平衡的多源迁移学习方法 [J]. 电子学报 , 2019 , 47 ( 3 ): 692 - 699 .

JI Ding-cheng , JIANG Yi-zhang , WANG Shi-tong . Multi-source transfer learning method by balancing both the domains and instances [J]. Acta Electronica Sinica , 2019 , 47 ( 3 ): 692 - 699 . (in Chinese)

PAN S J , YANG Q . A survey on transfer learning [J]. IEEE Transactions on Knowledge & Data Engineering , 2010 , 22 ( 10 ): 1345 - 1359 .

李凡长 , 刘洋 , 吴鹏翔 , 等 . 元学习研究综述 [J]. 计算机学报 , 2021 , 44 ( 2 ): 422 - 446 .

LI Fan-chang , LIU Yang , WU Peng-xiang , et al . A surveyon recent advancesin meta-learning [J]. Chinese Journal of Computers , 2021 , 44 ( 2 ): 422 - 446 . (in Chinese)

LAKE B , SALAKHUTDINOV R , GROSS J , et al . One shot learning of simple visual concepts [C]// Proceedings of the Annual Meeting of the Cognitive Science Society . California : eScholarship , 2011 : 33(33) .

SNELL J , SWERSKY K , ZEMEL R . Prototypical networks for few-shot learning [C]// Proceedings of the International Conference on Neural Information Processing Systems . Massachusetts, USA : MIT Press , 2017 : 4077 - 4087 .

TAN B , SONG Y , ZHONG E , et al . Transitive transfer learning [C]// Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . New York, NY, USA : ACM , 2015 : 1155 - 1164 .

SUN Q , LIU Y , CHUA T S , et al . Meta-transfer learning for few-shot learning [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach, CA, USA : IEEE , 2019 : 403 - 412 .

CHEN Y , WANG X , LIU Z , et al . A new meta-baseline for few-shot learning [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle, WA, USA : IEEE , 2020 : 04390 .

LUBBERS N , LOOKMAN T , BARROS K . Inferring low-dimensional microstructure representations using convolutional neural networks [J]. Physical Review E , 2017 , 96 ( 5 ): 052111 .

DECOST B L , FRANCIS T , HOLM E A . Exploring the microstructure manifold: Image texture representations applied to ultrahigh carbon steel microstructures [J]. Acta Materialia , 2017 , 133 : 30 - 40 .

AZIMI S M , BRITZ D , ENGSTLER M , et al . Advanced steel microstructural classification by deep learning methods [J]. Scientific Reports , 2018 , 8 ( 1 ): 2128 .

LEE K , MAJI S , RAVICHANDRAN A , SOATTO S . Meta-learning with differentiable convex optimization [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach, CA, USA : IEEE , 2019 : 10657 - 10665 .

REN M , TRIANTAFILLOU E , RAVI S , et al . Meta-learning for semi-supervised few-shot classification [C]// Proceedings of the International Conference on Learning Representations . https://openreview.net , 2018 : 1803.00676.

HE K , ZHANG X , REN S , et al . Deep residual learning for image recognition [C]// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition . Las Vegas, NV, USA : IEEE , 2016 : 770 - 778 .

WANG X , HAN X , HUANG W , et al . Multi-similarity loss with general pair weighting for deep metric learning [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach, CA, USA : IEEE , 2019 : 5022 - 5030 .

WEINBERGER K Q , SAUL L K . Distance metric learning for large margin nearest neighbor classification [J]. Journal of Machine Learning Research , 2009 , 10 ( 2 ): 207 - 244 .

LOSHCHILOV I , HUTTER F . Decoupled weight decay regularization [C]// Proceedings of the European International Conference on Learning Representations(ICLR) . https://openreview.net , 2017 : 1711.05101.

ZEILERM D , TAYLOR G W , FERGUS R . Adaptive deconvolutional networks for mid and high level feature learning [C]// Proceedings of the International Conference on Computer Vision . Barcelona, Spain : IEEE , 2011 : 2018 - 2025 .

FINN C , ABBEEL P , LEVINE S . Model-agnostic meta-learning for fast adaptation of deep networks [C]// Proceedings of the International Conference on Machine Learning . New York, USA : ACM , 2017 : 1126 - 1135 .

SUNG F , YANG Y , ZHANG L , et al . Learning to compare: Relation network for few-shot learning [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Salt Lake City, UT, USA : IEEE , 2018 : 1199 - 1208 .

GHIASI G , LIN TY , LE Q V . Dropblock: A regularization method for convolutional networks [C]// Proceedings of the Advances in Neural Information Processing Systems(NIPS) . Massachusetts, USA : MIT Press , 2018 : 10727 - 10737 .

LIU Y , SCHIELE B , SUN Q . An ensemble of epoch-wise empirical Bayes for few-shot learning [C]// Proceedings of the European Conference on Computer Vision . Berlin : Springer, Cham , 2020 : 404 - 421 .

CHEN Z , GE J , ZHAN H , et al . Pareto self-supervised training for few-shot learning [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville, TN, USA : IEEE , 2021 : 13663 - 13672 .

QIAO S , LIU C , SHEN W , et al . Few-shot image recognition by predicting parameters from activations [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Salt Lake City, UT, USA : IEEE , 2018 : 7229 - 7238 .

RUSU A A , RAO D , SYGNOWSKI J , et al . Meta-learning with latent embedding optimization [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach, CA, USA : IEEE , 2019 : 1807. 05960.

CHEN WY , LIU YC , KIRA Z , et al . A closer look at few-shot classification [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach, CA, USA : IEEE , 2019 : 1904. 04232.

MISHRA N , ROHANINEJAD M , et al . A simple neural attentive meta-learner [C]// Proceedings of the 6th International Conference on Learning Representations . https://openreview.net , 2018 : 1707.03141.

MUNKHDALAI T , YUAN X , MEHRI S , et al . Rapid adaptation with conditionally shifted neurons [C]// Proceedings of the International Conference on Machine Learning . Stockholm, Sweden : PMLR , 2018 : 3664 - 3673 .

ORESHKIN B , L'OPEZ P R , LACOSTE A . Tadam: Task dependent adaptive metric for improved few-shot learning [C]// Proceedings of the Advances in Neural Information Processing Systems . USA Massachusetts : MIT Press , 2018 : 721 - 731 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Few-Shot Learning on Graph Convolutional Network Based on Meta learning

Related Author

LIU Xin-lei

FENG Lin

LIAO Ling-xiang

GONG Xun

SU Han

WANG Jun

LIU Xin-Lei

FENG Lin

Related Institution

College of Computer Science， Sichuan Normal University

School of Computer and Artificial Intelligence， Southwest Jiao tong University

School of Business， Sichuan Normal University

Network Security Detachment， Ziyang Public Security Bureau

Network Security Detachment， Ziyang Public Security Bureau， City

⁰