Multimodal Visual Features Based Natural Human-Computer Interaction

GUAN Ye-peng

doi:10.3969/j.issn.0372-2112.2013.11.017

您当前的位置：

首页 >

文章列表页 >

Multimodal Visual Features Based Natural Human-Computer Interaction

更新时间：2025-07-16

- Multimodal Visual Features Based Natural Human-Computer Interaction
- Acta Electronica Sinica Vol. 41, Issue 11, Pages: 2223-2229(2013)
- 作者机构：
  
  1. 上海大学通信与信息工程学院,上海,200072
  2. 新型显示技术及应用集成教育部重点实验室,上海,200072
  3. 上海大学通信与信息工程学院,上海,200072
  4. 新型显示技术及应用集成教育部重点实验室,上海,200072
- 作者简介：
- 基金信息：
  
  National Natural Science Foundation of China (No.11176016, No.60872117);Research Fund for the Doctoral Program of Higher Education of China (No.20123108110014)
- DOI：10.3969/j.issn.0372-2112.2013.11.017
  CLC： TP391.4
- Published：2013
- 稿件说明：
移动端阅览
GUAN Ye-peng. Multimodal Visual Features Based Natural Human-Computer Interaction[J]. Acta Electronica Sinica, 2013, 41(11): 2223-2229.
DOI：

GUAN Ye-peng. Multimodal Visual Features Based Natural Human-Computer Interaction[J]. Acta Electronica Sinica, 2013, 41(11): 2223-2229. DOI： 10.3969/j.issn.0372-2112.2013.11.017.

摘要

针对目前人机交互中存在的问题与不足，提出了一种基于多模态视觉特征的人机交互新方法.采用二维Gabor小波提取全局人脸朝向视觉特征，克服人脸显著特征提取困难，以及不同人脸朝向特征区分的难度性；基于人脸几何分布特征，快速定位人眼中心，无需考虑人脸图像分辨率和人眼闭合及其配戴情况；通过对视觉特征的重要性评价，选取分类特性显著的多模态视觉特征进行机器学习与训练，确定用户所指目标，实现非穿戴自然人机交互，用户无需佩戴任何标记，且其活动不受约束，便于充分发挥其日常技能.通过实验对比，验证了文中所提方法有效、可行，可应用于实时非穿戴自然人机交互中.

Abstract

A novel human-computer interaction(HCI)is developed based on multimodal visual features aiming at some limits at present.Two-dimensional Gabor wavelet is adopted to extract some visual features of global face orientation

which overcomes some difficulties including extraction of some facial distinct features

discrimination among some different facial orientations.An efficient and fast approach to locating center of eyes is proposed based on facial geometric distributions without considering facial resolution

eyes closing or opening and user's wearing.Some prominent multimodal visual features for classification are selected to machine learning and training to determine the pointing target after evaluating performance of some extracted visual features.Non-wearable and natural HCI modal can be realized in which user can move freely without wearing any markers when he points at some targets.Their daily skills can be exerted fully during HCI.Experiment results indicate that the developed approach is efficient and can be used to natural non-wearable HCI.

关键词

Keywords

references

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Human Face Orientation Based Non-Wearable and Natural Human-Computer Interaction

A Detection Method for Android Repackaged Malware Based on Sensitive Component Function Call Graph

Research on High-Efficiency Integrated Circuit DFT Technology Based on Machine Learning

DRHA-UIE: An Underwater Image Enhancement Method Based on Dual Residual Hybrid Attention Block

Cognitive Learning: A New Paradigm for Machine Learning in Electromagnetic Spectrum Environment

Related Author

LI Yu-long

GUAN Ye-peng

DU Rui-ying

CHEN Jing

WU Cong

YAN Xi-yu

CAI Zhi-kuang

ZHAO Ze-yu

Related Institution

School of Computer and Information Engineering, Henan Normal University

School of Cyber Science and Engineering, Wuhan University

Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, Wuhan University

Rizhao Institute of Information Technology, Wuhan University

Department of Electrical and Electronic Engineering, Faculty of Engineering, The University of Hong Kong

⁰