To read the full version of this content please select one of the options below:

Feature fusion using Extended Jaccard Graph and word embedding for robot

Shenglan Liu (School of Innovation and Entrepreneurship, Dalian University of Technology, Dalian, China)
Muxin Sun (State Key Laboratory of Software Architecture (Neusoft Corporation), Shen Yang, China)
Xiaodong Huang (The People’s Liberation Army Unit 91550, Dalian, China)
Wei Wang (Dalian University of Technology, Dalian, China)
Feilong Wang (Dalian University of Technology, Dalian, China)

Assembly Automation

ISSN: 0144-5154

Article publication date: 7 August 2017

Abstract

Purpose

Robot vision is a fundamental device for human–robot interaction and robot complex tasks. In this paper, the authors aim to use Kinect and propose a feature graph fusion (FGF) for robot recognition.

Design/methodology/approach

The feature fusion utilizes red green blue (RGB) and depth information to construct fused feature from Kinect. FGF involves multi-Jaccard similarity to compute a robust graph and word embedding method to enhance the recognition results.

Findings

The authors also collect DUT RGB-Depth (RGB-D) face data set and a benchmark data set to evaluate the effectiveness and efficiency of this method. The experimental results illustrate that FGF is robust and effective to face and object data sets in robot applications.

Originality/value

The authors first utilize Jaccard similarity to construct a graph of RGB and depth images, which indicates the similarity of pair-wise images. Then, fusion feature of RGB and depth images can be computed by the Extended Jaccard Graph using word embedding method. The FGF can get better performance and efficiency in RGB-D sensor for robots.

Keywords

Acknowledgements

This work was supported by National Natural Science Foundation of P.R. China (61370200, 61210009, 61602082, 61672130) and the Open Program of State Key Laboratory of Software Architecture (Item number SKLSAOP1701).

Citation

Liu, S., Sun, M., Huang, X., Wang, W. and Wang, F. (2017), "Feature fusion using Extended Jaccard Graph and word embedding for robot", Assembly Automation, Vol. 37 No. 3, pp. 278-284. https://doi.org/10.1108/AA-01-2017-005

Publisher

:

Emerald Publishing Limited

Copyright © 2017, Emerald Publishing Limited