The Voight-Kampff Machine for Automatic Custom Gesture Rejection Threshold Selection
Image credit ACM CHIAbstract
Gesture recognition systems using nearest neighbor pattern matching are able to distinguish gesture from non-gesture actions by rejecting input whose recognition scores are poor. However, in the context of gesture customization, where training data is sparse, learning a tight rejection threshold that maximizes accuracy in the presence of continuous high activity (HA) data is a challenging problem. To this end, we present the Voight-Kampff Machine (VKM), a novel approach for rejection threshold selection. VKM uses new synthetic data techniques to select an initial threshold that the system thereafter adjusts based on the training set size and expected gesture production variability. We pair VKM with a state-of-the-art custom gesture segmenter and recognizer to evaluate our system across several HA datasets, where gestures are interleaved with non-gesture actions. Compared to alternative rejection threshold selection techniques, we show that our approach is the only one that consistently achieves high performance.
Short Summary
Some gestural input is accidental or malformed. For such cases, a score similarity threshold must be set, and all input that scores below that threshold will be rejected. We provide a technique for automatically selecting such a threshold for custom gestures.
Mykola Maslych
Computer Science PhD Candidate
My research interests include machine learning applied to 3D User interfaces and HCI in general.