Development of a Hand Gestures SDK for NUI-Based Applications

Abstract

Concomitant with the advent of the ubiquitous era, research into better human computer interaction (HCI) for human-focused interfaces has intensified. Natural user interface (NUI), in particular, is being actively investigated with the objective of more intuitive and simpler interaction between humans and computers. However, developing NUI-based applications without special NUI-related knowledge is difficult. This paper proposes a NUI-specific SDK, called "Gesture SDK," for development of NUI-based applications. Gesture SDK provides a gesture generator with which developers can directly define gestures. Further, a "Gesture Recognition Component" is provided that enables defined gestures to be recognized by applications. We generated gestures using the proposed SDK and developed a "Smart Interior," NUI-based application using the Gesture Recognition Component. The results of experiments conducted indicate that the recognition rate of the generated gestures was 96% on average.