This paper presents a novel vision-based method for finger-screen interaction which achieves natural interactions through moving and clicking a single finger on a computer screen.The method uses two cameras at different viewpoints to capture video images covering the computer screen in real time.We integrate two cues of skin color and contour information to track finger’s motions in the framework of particle filter.The clicking actions on the screen surface are detected with the obtained fingertip positions and the geometry parameters of cameras.Experimental results demonstrate that the interactive method can realize robust tracking of finger motion
against complex background and varying illumination conditions
as well as the instant detection of finger clicking actions.This method achieves robust and natural human-computer interaction
and can be widely used in many applications
such as intelligent interaction
digital entertainment and wearable computing environment.