Research on Flexible Mapping Algorithm of Multi-gestures to One Semantic
FENG Zhi-quan1, QIAO Yu1, FENG Shi-chang2, ZHOU Xiao-yan1, XU Tao1, YANG Xiao-hui1, FAN Xue1, BI Jian-ping3
1. College of Information Science and Engineering, University of Jinan, Jinan, Shandong 250022, China;
2. School of Information Science and Engineering, Xiamen University, Xiamen, Fujian 361005, China;
3. Affiliated Hospital of Shandong Universityof Traditional Chinese Medicine, Jinan, Shandong 250011, China
Abstract：Aiming at the two basic problems,the error of interface interaction caused by hand gesture recognition errors and gesture non-recognition error,the intelligent teaching interface based on gesture interaction is designed and implemented.And the system can interact with the teacher by obtaining the gesture information of the teacher.The main innovation of this paper is to propose a flexible mapping interaction algorithm with multiple gestures mapping to the one semantic.The paper selects fourteen kinds of natural interactive gesture,and analyzes the common characteristics of various gestures mapping to the one semantic.The experimental results show that the proposed algorithm can effectively reduce the users' burden.The algorithm has been used in an intelligent teaching system interface based on gesture interaction.
[1] Yin X,Xie M.Finger identification and hand posture recognition for human-robot interaction[J].Image and Vision Computing,2007,25(8):1291-1300.
[2] Nguyen,Viet T.Enhancing Touchless Interaction with the Leap Motion Uusing a Haptic Glove[D].Joensuu,Kuopio,Finland:University of Eastern Finland,2014.1-67.
[3] Riener A,Ferscha A,Bachmair F,et al.Standardization of the in-car gesture interaction space[A].Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications[C].New York,USA:ACM,2013.14-21.
[4] 齐静,徐坤,丁希仑.机器人视觉手势交互技术研究进展[J].机器人,2017,39(4):565-584.
[5] Ahn J,Kim K.Investigating smart TV gesture interaction based on gesture types and styles[J].Journal of the Ergonomics Society of Korea,2017,36(2):109-121.
[6] 徐治鹏,冯志全,刘慧,等.面向智能电视的隐式手势交互建模与算法[J].计算机辅助设计与图形学学报,2017,29(2):344-353. Xu Z,Feng Z,Liu H,et al.Implicitgesture interaction modeling and algorithm for smart TV[J].Journal of Computer-Aided Design & Computer Graphics,2017,29(2):344-353.(in Chinese)
[7] Cui J,Kuijper A,Sourin A.Exploration of natural free-hand interaction for shape modeling using leap motion controller[A].Proceedings of the International Conference on Cyberworlds(CW)[C].Chongqing,China:IEEE,2016.41-48.
[8] 张玉军,孟晓军,王刚.基于手势交互的三维电子沙盘系统设计与实现[J].指挥控制与仿真,2016,38(2):110-114.
[9] Carter M,Newn J,Velloso E,et al.Remote Gaze and Gesture Tracking on the microsoft kinect:investigating the role of feedback[A].Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction[C].New York,US:ACM,2015.167-176.
[10] Ren Z,Yuan J,Meng J,et al.Robust part-based hand gesture recognition using Kinect sensor[J].IEEE Transactions on Multimedia,2013,15(5):1110-1120.
[11] Camastra F,De Felice D.LVQ-based hand gesture recognition using a data glove[A].Neural Nets and Surroundings[M].Berlin Heidelberg:Springer,2013,159-168.
[12] 张莹莹,郭星.基于Kinect动态手势识别算法的研究与实现[J].计算机技术与发展,2017,27(12):11-15.
[13] Hu Z F,Wang Y K,Luo Y,et al.An Improved camshift-based particle filter algorithm for real-time hand gesture tracking[J].Sensors & Transducers,2014,177(8):307-312.
[14] Sanchez-Riera J,Hsiao Y S,Lim T,et al.A robust tracking algorithm for 3d hand gesture with rapid hand motion through deep learning[A].Proceedings of the 2014 IEEE International Conference on Multimedia and Expo Workshops(ICMEW)[C].Cheng Du,China:IEEE,2014.1-6.
[15] Ju Z,Wang Y,Zeng W,et al.A modified EM algorithm for hand gesture segmentation in RGB-D data[A].Proceedings of the 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)[C].Beijing,China:IEEE,2014.1736-1742.
[16] Huang L P,Wu Q X,Zhang G R,et al.Gesture segmentation using spiking neural networks inspired by the visual system[A].Proceedings of 2015 International Conference on Artificial Intelligence and Industrial Engineering[C].Thailand,Phuket:Atlantis Press,2015.184-187.
[17] Zhang Q,Lu J,Zhang M,et al.Hand gesture segmentation based on mixed skin-color model and FCM algorithm[J].Journal of Information &Computational Science,2015,12(9):3527-3536.
[18] Song Y,Davis R.Continuous body and hand gesture recognition for natural human-computer interaction[A].Proceedings of the 24th International Conference on Artificial Intelligence[C].Buenos Aires,Argentina:AAAI Press,2015.4212-4216.
[19] 刘杰,黄进,韩冬奇,等.模板匹配的三维手势识别算法[J].计算机辅助设计与图形学报,2016,28(8):1365-1372. Liu J,Huang J,Han D,et al.Templatematching algorithm for 3D gesture recognition[J].Journal of Computer-Aided Design & Computer Graphics,2016,28(8):1365-1372.(in Chinese).
[20] Wang K R,Xiao B J,Xia J Y,et al.A real-time vision-based hand gesture interaction system for virtual EAST[J].Fusion Engineering and Design,2016,112:829-834.
[21] Qian K,Niu J,Yang H.Developing a gesture based remote human-robot interaction system using Kinect[J].International Journal of Smart Home,2013,7(4):203-208.
[22] 李文瀚,郑新,金宁,等.基于手势识别的智能机器人系统设计[J].中国科技信息,2018,575(2):76-77.
[23] Kumar P,Verma J,Prasad S.Hand data glove:a wearable real-time device for human-computer interaction[J].International Journal of Advanced Science and Technology,2012,43:15-26.
[24] 李东洁,李洋洋,杨柳.GL-RBF优化的数据手套手势识别算法[J].哈尔滨理工大学学报,2017,22(4):7-12.
[25] Yang X W,Feng Z Q,Huang Z Z,et al.Gesture recognition based on combining main direction of gesture and hausdorff-like distance[J].Journal of Computer-Aided Design & Computer Graphocs.2016,28(1):75-81.
[26] Zhang Y,Wu S H,Luo Y.Applications and recognition of gesture trajectory using HMM[J].Semiconductor Optoelectronics,2015,36(4):650-656.
[27] Xiaoyan Z,Zhiquan F,Yu Q,et al.The Man-machine finger-guessing game based on cooperation mechanism[J].Theoretical Computer Science,2017,6:92-109.
2019, Vol. 47 
