Seungjae Oh

Finger Identification

Identifying Contact Fingers on Touch Sensitive Surfaces by Ring-Based Vibratory Communication
(ACM UIST 2021)

Teasor

Abstract

As computing paradigms shift toward mobile and ubiquitous interaction, there is an increasing demand for wearable interfaces supporting multifaceted input in smart living environments. In this regard, we introduce a system that identifies contact fingers using vibration as a modality of communication.

We investigate the vibration characteristics of the communication channels involved and simulate the transmission of vibration sequences. In the simulation, we test and refine modulation and demodulation methods to design vibratory communication protocols that are robust to environmental noises and can detect multiple simultaneous contact fingers. As a result, we encode an on-off keying sequence with a unique carrier frequency to each finger and demodulate the sequences by applying cross-correlation.

The main contribution of our study include the proposal of a system and protocol for contact finger identification with special purpose vibratory communication. The use of vibration enables cost-effective communication between a user and a device.

Grants & Contracts

  • MSRA Collaborative Research (PI: Seungmoon Choi), Microsoft Research Lab Asia. 2019
    Vibration-Mediated Recognition of Hand Contact State for Tangible/Surface Interaction
  • Postdoctoral Fellowship Program (PI: Seungjae Oh), National Research Foundation Korea. 2020
    Mutual Identification between User-Device toward Seamless Cross-Device Computing

Publication

Figure

System Our ring-type transmitters and microphone recievers tested

Simulation Schematic description of vibratory signal transmission simulation

Scenario Potential scenarios and applications

Contribution

  • Seungjae Oh: Idea, Implementation, Simulation, Experiment, Application, and Graphics
  • Yo-Seb Jeon: Communication Protocol
  • Chaeyong Park: Experiment, Application, and Graphics
  • Jinhyuk Yoon: Ring Design
  • Seungmoon Choi: Director