基于FMCW雷达的双流融合神经网络手势识别方法

王勇; 王沙沙; 田增山; 周牧; 吴金君

doi:10.3969/j.issn.0372-2112.2019.07.003

您当前的位置：

首页 >

文章列表页 >

基于FMCW雷达的双流融合神经网络手势识别方法

学术论文 | 更新时间：2025-07-16

- 基于FMCW雷达的双流融合神经网络手势识别方法
- Two-Stream Fusion Neural Network Approach for Hand Gesture Recognition Based on FMCW Radar
- 电子学报 2019年47卷第7期页码：1408-1415
- 作者机构：
  
  重庆邮电大学通信与信息工程学院,重庆,400065
- 作者简介：
- 基金信息：
  
  国家自然科学基金 (No.61771083，No.61704015）;长江学者和创新团队发展计划 (No.IRT1299）;重庆市科委重点实验室专项经费-重庆市基础科学与前沿技术研究项目 (No.cstc2017jcyjAX0380，No.cstc2015jcyjBX0065）;重庆市高校优秀成果转化资助项目 (No.KJZH17117）
- DOI：10.3969/j.issn.0372-2112.2019.07.003
  中图分类号： TN961
- 网络出版：2019-07-25，
  
  纸质出版：2019
- 稿件说明：
移动端阅览
王勇, 王沙沙, 田增山, 等. 基于FMCW雷达的双流融合神经网络手势识别方法[J]. 电子学报, 2019,47(7):1408-1415.

WANG Yong, WANG Sha-sha, TIAN Zeng-shan, et al. Two-Stream Fusion Neural Network Approach for Hand Gesture Recognition Based on FMCW Radar[J]. Acta Electronica Sinica, 2019, 47(7): 1408-1415.
王勇, 王沙沙, 田增山, 等. 基于FMCW雷达的双流融合神经网络手势识别方法[J]. 电子学报, 2019,47(7):1408-1415. DOI： 10.3969/j.issn.0372-2112.2019.07.003.

WANG Yong, WANG Sha-sha, TIAN Zeng-shan, et al. Two-Stream Fusion Neural Network Approach for Hand Gesture Recognition Based on FMCW Radar[J]. Acta Electronica Sinica, 2019, 47(7): 1408-1415. DOI： 10.3969/j.issn.0372-2112.2019.07.003.

摘要

针对传统光学摄像头和无线技术的手势识别方法受光照环境影响和空间纵向、横向特征不全的问题，该文提出一种基于调频连续波（Frequency Modulated Continuous Wave，FMCW）雷达信号的双流融合神经网络（Two-Stream Fusion Neural Network，TS-FNN）手势识别方法.首先，利用二维快速傅立叶变换（Fast Fourier Transform，FFT）求取中频信号的频谱，估计手势的距离和速度，并利用多重信号分类（Multiple Signal Classification，MUSIC）方法计算角度.其次，利用这三维参数在时间上的累积，将一个手势动作映射为32帧距离-速度矩阵图和角度时间图.最后，建立TS-FNN进行手势特征提取和特征融合.实验结果表明，TS-FNN方法与传统卷积神经网络相比，手势的平均识别准确率提升了约5%.

Abstract

To deal with the problem of easily being affected by illumination environment of the traditional optical camera based hand gesture recognition method and the incomplete spatial and lateral characteristics of the wireless based hand gesture recognition method

this paper proposes a frequency modulated continuous wave (FMCW) radar signal based two-stream fusion neural network (TS-FNN) for hand gesture recognition. Firstly

the spectrum of the IF signal is obtained by two-dimensional Fast Fourier Transform (2D-FFT)

the range and speed of the gesture are estimated

and the angle is calculated by the Multiple Signal Classification (MUSIC) method. Secondly

using the accumulation of three-dimensional parameters in time

a gesture action is mapped to a 32-frame range-speed matrix diagram and an angular-time map. Finally

TS-FNN is established for gesture feature extraction and classification. The experimental results show that compared with the existing methods

the TS-FNN method improves the average recognition accuracy by about 5%.

关键词

Keywords

references

浏览量

383

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

一种基于双维度滤波和自适应定长化的FMCW雷达手势识别算法研究

面向时序异常检测的可变视距多向扫描方法

基于稀疏平滑自蒸馏的差分隐私深度学习方法

基于非一般类算子融合方法及硬件架构设计