电子学报 ›› 2019, Vol. 47 ›› Issue (8): 1612-1617.DOI: 10.3969/j.issn.0372-2112.2019.08.002

• 学术论文 • 上一篇    下一篇

多种手势对应同一语义的柔性映射交互算法的研究

冯志全1, 乔宇1, 冯仕昌2, 周晓燕1, 徐涛1, 杨晓晖1, 范雪1, 毕建平3   

  1. 1. 济南大学信息科学与工程学院, 山东济南 250022;
    2. 厦门大学信息学院智能科学与技术系, 福建厦门 361005;
    3. 山东中医药大学附属医院, 山东济南 250011
  • 收稿日期:2018-03-03 修回日期:2019-02-28 出版日期:2019-08-25
    • 通讯作者:
    • 冯志全
    • 作者简介:
    • 乔宇 男,1993年出生于河北辛集人.济南大学硕士学位.主要从事人机交互相关技术的研究.
    • 基金资助:
    • 国家重点研发计划 (No.2018YFB1004901); 国家自然科学基金 (No.61472163,No.61603151); 山东省重点研发计划 (No.2017GGX10146)

Research on Flexible Mapping Algorithm of Multi-gestures to One Semantic

FENG Zhi-quan1, QIAO Yu1, FENG Shi-chang2, ZHOU Xiao-yan1, XU Tao1, YANG Xiao-hui1, FAN Xue1, BI Jian-ping3   

  1. 1. College of Information Science and Engineering, University of Jinan, Jinan, Shandong 250022, China;
    2. School of Information Science and Engineering, Xiamen University, Xiamen, Fujian 361005, China;
    3. Affiliated Hospital of Shandong Universityof Traditional Chinese Medicine, Jinan, Shandong 250011, China
  • Received:2018-03-03 Revised:2019-02-28 Online:2019-08-25 Published:2019-08-25

摘要: 针对智能交互界面中手势识别错误导致交互界面变化错误和手势不识别两个基本问题,本文设计并实现了基于手势交互的智能教学界面,该系统可以通过获取教师的手势信息与教师进行交互.主要创新点在于提出了多种手势对应同一语义的柔性映射交互算法.本文选取了14种自然交互手势,分析了对应同一语义的多种手势之间的共同特征.实验结果显示,该算法能够有效降低用户负荷.该算法已经用于一个基于手势交互的智能教学系统界面中.

关键词: 交互模型, 自然用户界面, 认知负担, 基于手势的交互, 人机交互

Abstract: Aiming at the two basic problems,the error of interface interaction caused by hand gesture recognition errors and gesture non-recognition error,the intelligent teaching interface based on gesture interaction is designed and implemented.And the system can interact with the teacher by obtaining the gesture information of the teacher.The main innovation of this paper is to propose a flexible mapping interaction algorithm with multiple gestures mapping to the one semantic.The paper selects fourteen kinds of natural interactive gesture,and analyzes the common characteristics of various gestures mapping to the one semantic.The experimental results show that the proposed algorithm can effectively reduce the users' burden.The algorithm has been used in an intelligent teaching system interface based on gesture interaction.

Key words: interactive mode, natural user interface, cognitive load, gesture interaction, human computer interaction

中图分类号: