Robot vision is a fundamental device for human–robot interaction and robot complex tasks. In this paper, the authors aim to use Kinect and propose a feature graph fusion (FGF) for robot recognition.
The feature fusion utilizes red green blue (RGB) and depth information to construct fused feature from Kinect. FGF involves multi-Jaccard similarity to compute a robust graph and word embedding method to enhance the recognition results.
The authors also collect DUT RGB-Depth (RGB-D) face data set and a benchmark data set to evaluate the effectiveness and efficiency of this method. The experimental results illustrate that FGF is robust and effective to face and object data sets in robot applications.
The authors first utilize Jaccard similarity to construct a graph of RGB and depth images, which indicates the similarity of pair-wise images. Then, fusion feature of RGB and depth images can be computed by the Extended Jaccard Graph using word embedding method. The FGF can get better performance and efficiency in RGB-D sensor for robots.
This work was supported by National Natural Science Foundation of P.R. China (61370200, 61210009, 61602082, 61672130) and the Open Program of State Key Laboratory of Software Architecture (Item number SKLSAOP1701).
Liu, S., Sun, M., Huang, X., Wang, W. and Wang, F. (2017), "Feature fusion using Extended Jaccard Graph and word embedding for robot", Assembly Automation, Vol. 37 No. 3, pp. 278-284. https://doi.org/10.1108/AA-01-2017-005
Emerald Publishing Limited
Copyright © 2017, Emerald Publishing Limited