Material Classification from Time-of-Flight Distortions.

Tanaka, Kenichiro; Mukaigawa, Yasuhiro; Funatomi, Takuya; Kubo, Hiroyuki; Matsushita, Yasuyuki; Yagi, Yasushi · IEEE Trans Pattern Anal Mach Intell · 2019

basic_science · Level V

Where this comes from

Abstract

This paper presents a material classification method using an off-the-shelf Time-of-Flight (ToF) camera. The proposed method is built upon a key observation that the depth measurement by a ToF camera is distorted for objects with certain materials, especially with translucent materials. We show that this distortion is due to the variation of time domain impulse responses across materials and also due to the measurement mechanism of the ToF cameras. Specifically, we reveal that the amount of distortion varies according to the modulation frequency of the ToF camera, the object material, and the distance between the camera and object. Our method uses the depth distortion of ToF measurements as a feature for classification and achieves material classification of a scene. Effectiveness of the proposed method is demonstrated by numerical evaluations and real-world experiments, showing its capability of material classification, even for visually indistinguishable objects.