Eelke Folmer
Human Computer Interaction Research
University of Nevada, Reno

GIST: Wearable Gestural Interface for Remote Spatial Perception

Spatial perception is a challenging task for people who are blind due to the limited functionality and sensing range of hands. We present GIST, a wearable gestural interface that offers spatial perception functionality through the novel appropriation of the user's hands into versatile sensing rods.

How it works

Using a wearable depth-sensing camera (Kinect), GIST analyzes the visible physical space and allows blind users to access spatial information about this space using different hand gestures. GIST supports four different spatial perception functions:

Media

the user wears a depth-sensing camera
Using a wearable depth-sensing camera, spatial information is provided depending on where the user's arm is pointed at.

Publications

Vinitha Khambadkar and Eelke Folmer. GIST: A Gestural Interface for Remote Spatial Perception. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'13), pages 301-310, St. Andrews, October 2013. [bibtex] [20% acceptance rate].

Share