Body-Coupled-Driven Object-Oriented Natural Interactive Interface.

Abstract

The metaverse progressively demands heightened sophistication in human-multi-machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human-multi-machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body-coupled electromagnetic coupling. Its bi-modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer-scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy-grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non-contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object-oriented human-machine interaction (HMI) framework is developed to enable single-interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross-domain augmented reality applications.