A Visual Inertia-Inspired Multimode Sensor Based on Pb-S Strongly Coupled Heterostructures for Information Fusion Positioning and Monitoring.

Abstract

The visual-inertial odometry (VIO) system enables continuous and accurate tracking of high-speed moving objects, offering distinct advantages for unmanned vehicles and mobile robots, but spatiotemporal inconsistency between components data often degrades overall performance. Here, we demonstrate a visual inertia-inspired multimode sensor (VIMS) based on FAPbI₃ (FA/PbI₂ = 4:1) organic-inorganic hybrid perovskite quantum dots (OIHPQDs) sensitized MoS₂ heterostructure, featuring reconfigurable photodetector (PD) and photosynaptic (PS) functions, successfully demonstrating single-device functional integration for VIO. The heterostructure exhibits light-power-selective, Pb-S coupled-mediated charge transport, enabling distinct light response speeds for PD and PS mode switching while overcoming the need for lattice matching in heterostructure coupling. Moreover, uniform-sized FAPbI₃ is obtained using a self-designed microfluidic technique, ensuring excellent reproducibility in the fabricated heterointerface. The developed devices exhibit a high specific detectivity (D^*) gain of ≈ 1000 under 0.039 mW/cm² dim light, excellent synaptic plasticity with 90% recognition accuracy and 40% noise tolerance, and optical secure communication capability with response times over 10 times faster than in PS mode. More importantly, the dual-mode VIMS array enables real-time tracking of dynamic grayscale and static attitude information from high-speed Newton's cradle and billiards, demonstrating dynamic/static information fusion for positioning and monitoring.