This thesis focuses on computer vision and gesture-based human-computer interaction. In examining computer vision, the project covers existing computer vision systems, including OpenNI/NITE and libfreenect. It explores topics such as identifying humans and objects in scenes, recognizing gestures and context-specific movement, and more general scene analysis. The results of the computer vision work are applied to human-computer interaction. The project examines different types of user interfaces and the applicability of gesture-based interaction to those interfaces. One goal is a generic system for controlling user interfaces using a vision-based gesture system. The included software, consisting of three separate projects, covers both high-level HCI and low-level interaction with vision sensor device drivers. HighNI is a set of Java modules for OpenNI and NITE 1.5. It abstracts the existing Java classes to a higher level and provides some skeleton examples for gesture callbacks. OpenNI2-FreenectDriver is a bridge driver that connects OpenNI2's driver interface to libfreenect's API. It allows OpenNI2 to use Kinect hardware on non-Windows platforms where Microsoft's SDK is not available. FreeNUI is a new framework for natural user interaction, based around libfreenect and OpenCV. It is an experimental project that explores interface design and C++11 language features.
Snyder, Benn, "Computer Vision: Object Recognition and Human-Computer Interaction" (2013). Senior Independent Study Theses. Paper 709.
Graphics and Human Computer Interfaces
computer vision, kinect, openni, libfreenect, gesture recognition
Bachelor of Arts
Senior Independent Study Thesis
© Copyright 2013 Benn Snyder