电子学报 ›› 2015, Vol. 43 ›› Issue (8): 1583-1588.DOI: 10.3969/j.issn.0372-2112.2015.08.017

• 学术论文 • 上一篇    下一篇

基于人脸朝向的非穿戴自然人机交互

李雨龙1, 管业鹏1,2   

  1. 1. 上海大学通信与信息工程学院, 上海 200444;
    2. 新型显示技术及应用集成教育部重点实验室, 上海 200072
  • 收稿日期:2014-02-13 修回日期:2014-07-29 出版日期:2015-08-25
    • 通讯作者:
    • 管业鹏
    • 作者简介:
    • 李雨龙 男,1988年生于湖南岳阳,上海大学通信与信息工程学院硕士研究生.主要研究方向为人机交互、智能信息感知与处理、计算机视觉与模式识别. E-mail:lylshu@163.com
    • 基金资助:
    • 国家自然科学基金 (No.11176016,No.60872117); 高等学校博士学科点专项科研基金 (No.20123108110014)

Human Face Orientation Based Non-Wearable and Natural Human-Computer Interaction

LI Yu-long1, GUAN Ye-peng1,2   

  1. 1. School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China;
    2. Key Laboratory of Advanced Displays and System Application, Ministry of Education, Shanghai 200072, China
  • Received:2014-02-13 Revised:2014-07-29 Online:2015-08-25 Published:2015-08-25
    • Supported by:
    • National Natural Science Foundation of China (No.11176016, No.60872117); Research Fund for the Doctoral Program of Higher Education of China (No.20123108110014)

摘要:

提出了一种新颖的基于人脸朝向的非穿戴人机交互新方法.采用主动形状模型确定人脸面部轮廓特征点,克服光照和人脸姿态变化影响,在简化冗余信息的同时,降低计算复杂度.基于最大三角化划分面部轮廓特征,在此基础上,基于Kinect摄像机将构建的二维人脸模型映射至三维空间,动态求解面部朝向的法向量,通过图像帧间的均值滤波确定空间交互目标.用户无需佩带任何标记,且其活动不受约束,满足人机交互舒适性、多元性要求,实现非穿戴自然人机交互.通过实验对比,验证了本文方法有效、可行.

关键词: 人机交互, 人脸朝向, 非穿戴, 面部几何模型

Abstract:

A novel non-wearable human-computer interaction (HCI) method has been proposed based on facial orientation.An active shape model is employed to locate some feature points in the facial contour which can be able to overcome the effects of illumination and facial posture variation.Some redundant information can be simplified.Moreover, HCI can be made in a real time.After a 2D facial geometric model being built based on the maximal triangulation of facial contour features, a calibrated Kinect sensor is used to map the geometric model into 3D coordinate.In order to determine the interacting target, the normal direction of facial orientation is calculated dynamically by a temporal median filter.Non-wearable and natural HCI modal can be realized in which the user can move freely without wearing any equipment or auxiliary markers.Besides, the need of comfort and diversity can be met simultaneously during HCI.Experiment results indicate that the developed approach is efficient and can be used to natural non-wearable HCI.

Key words: human-computer interaction, facial orientation, non-wearable, facial geometric model

中图分类号: