Type of Publication: Article in Collected Edition

Spatial Haptics: A Sensory Substitution Method for Distal Object Detection Using Tactile Cues

Author(s):

Wald, Iddo Yehoshua; Degraen⁎, Donald; Maimon⁎, Amber; Keppel, Jonas; Schneegass, Stefan; Malaka, Rainer

Title of Anthology:

Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

Publisher:

Association for Computing Machinery

Location(s):

New York, NY, USA

Publication Date:

2025

ISBN:

9798400713941

Keywords:

Haptic, Tactile, Sensory substitution, Spatial perception, Localization

Digital Object Identifier (DOI):

doi:10.1145/3706598.3714083

Citation:

Download BibTeX

Abstract

We present a sensory substitution-based method for representing locations of remote objects in 3D space via haptics. By imitating auditory localization processes, we enable vibrotactile localization abilities similar to those of some spiders, elephants, and other species. We evaluated this concept in virtual reality by modulating the vibration amplitude of two controllers depending on relative locations to a target. We developed two implementations applying this method using either ear or hand locations. A proof-of-concept study assessed localization performance and user experience, achieving under 30° differentiation between horizontal targets with no prior training. This unique approach enables localization by using only two actuators, requires low computational power, and could potentially assist users in gaining spatial awareness in challenging environments. We compare the implementations and discuss the use of hands as ears in motion, a novel technique not previously explored in the sensory substitution literature.