Search results

Because of the increased use of robots in the industry, it has become inevitable for humans and robots to be able to work together. Therefore, human security has become the primary noncompromising factor of joint human and robot operations. For this reason, the purpose of this study was to develop a safe human-robot interaction software based on vision and touch.

The software consists of three modules. Firstly, the vision module has two tasks: to determine whether there is a human presence and to measure the distance between the robot and the human within the robot’s working space using convolutional neural networks (CNNs) and depth sensors. Secondly, the touch detection module perceives whether or not a human physically touches the robot within the same work environment using robot axis torques, wavelet packet decomposition algorithm and CNN. Lastly, the robot’s operating speed is adjusted according to hazard levels came from vision and touch module using the robot’s control module.

The developed software was tested with an industrial robot manipulator and successful results were obtained with minimal error.

The success of the developed algorithm was demonstrated in the current study and the algorithm can be used in other industrial robots for safety.

In this study, a new and practical safety algorithm is proposed and the health of people working with industrial robots is guaranteed.

The purpose of this paper is the research of a novel gesture-based dual-robot collaborative interaction interface, which achieves the gesture recognition when both hands overlap. This paper designs a hybrid-sensor gesture recognition platform to detect the both-hand data for dual-robot control.

This paper uses a combination of Leap Motion and PrimeSense in the vertical direction, which detects both-hand data in real time. When there is occlusion between hands, each hand is detected by one of the sensors, and a quaternion-based algorithm is used to realize the conversion of two sensors corresponding to different coordinate systems. When there is no occlusion, the data are fused by a self-adaptive weight fusion algorithm. Then the collision detection algorithm is used to detect the collision between robots to ensure safety. Finally, the data are transmitted to the dual robots.

This interface is implemented on a dual-robot system consisting of two 6-DOF robots. The dual-robot cooperative experiment indicates that the proposed interface is feasible and effective, and it takes less time to operate and has higher interaction efficiency.

A novel gesture-based dual-robot collaborative interface is proposed. It overcomes the problem of gesture occlusion in two-hand interaction with low computational complexity and low equipment cost. The proposed interface can perform a long-term stable tracking of the two-hand gestures even if there is occlusion between the hands. Meanwhile, it reduces the number of hand reset to reduce the operation time. The proposed interface achieves a natural and safe interaction between the human and the dual robot.

The purpose of this paper is to develop a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation. Hands-on control and teleoperation are two main procedures switched frequently in teleoperated minimally invasive surgery (MIS). The detailed human activity in the procedures can be defined and recognized using the sensor information. In this paper, a novel continuous adaptive shared control method is proposed for manipulators with Cartesian impedance control in the surgical scenario.

A human activity-aware shared control solution by adjusting the weight function is introduced to achieve smooth transition among different human activities, including hands-on control and teleoperation. Instead of introducing various controllers and switching among them during the surgical procedures, the proposed solution integrated all the human activity-based controllers into a single controller and the transition among the procedures is smooth and stable. The effectiveness of the proposed control approach was verified in a lab setup environment. The results prove that the robot behavior is stable and smooth. The algorithm is feasible and can achieve a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation.

Based on the experiment, the results confirm that the proposed human activity-aware adaptive shared control solution can switch the device behavior automatically using the real-time sensor information. The transition between different activities is smooth and stable.

For teleoperated surgical applications, the proposed method integrated different controllers for various human activities into a single controller by recognizing the activities using the real-time sensor information and the transition between different procedures is smooth and stable. It eases the surgical work for the surgeon and enhances the safety during the transition of control modes. The presented scheme provides a general solution to address the switching of working procedures in teleoperated MIS.

To the best of the authors’ knowledge, this paper is the first to propose human activity-aware adaptive shared control solution for human–robot interaction in surgical operations.

To follow and maintain an appropriate distance to the selected target person (STP), the mobile robot is required to have capabilities: the human detection and tracking and an efficient following strategy with a smooth manner that does not appear threatening to the STP and surroundings. The efficient following strategy must integrate the STP position and the obstacle information to achieve smooth and safe human-following behaviors, especially in unknown environments where robot does not have understandings in advance. The purpose of this study is to propose a robust-adaptive-behavior strategy for mobile robots.

This paper presents a robust-adaptive-behavior strategy (RABS) based on the fuzzy inference mechanism to help the robot follow the STP effectively in various unknown environments with the real-time obstacle avoidance, both indoor and outdoor and on different robot platforms. In which, the traversability of robots’ unknown surrounding environments is analyzed by using the STP position and the obstacle information obtained from the two dimensional laser scan, whose purpose is to choose the highest-traversability-score direction (HTSD) and an adaptive-safe-following distance (ASFD). Then, the HTSD, the ASFD and the current velocity of the robot are considered as inputs of the fuzzy system to adjust its velocity smoothly.

The proposed RABS is verified by a set of experiments using a real big-heavy autonomous mobile robot (BH-AMR), with the dimension 0.8 × 1.2 (m), weight 150 (kg), full-load 500 (kg), aiding smart factories. The obtained results have shown that the proposed RABS equips the BH-AMR with the ability to follow the STP smoothly and safely even when the robot is moving at the maximum speed 1.5 (m/s).

In this paper, the autonomous mobile robot considers all environments as unknown even when it is working in mapped environments. This limitation is presented clearly in the future works section.

This proposed method can be used to help the autonomous mobile robot support persons in factories, hospitals, restaurants, supermarkets or at the airports.

This paper presents a RABS, including three new features: a fuzzy-based solution to help human-following robots maintain an appropriate distance to the STP safely and smoothly with the maximum velocity 1.5 (m/s); the proposed fuzzy-based solution, an adaptive vector field histogram and a new approach for the STP tracking is combined to follow the STP and avoid the collision simultaneously in unknown indoor and outdoor environments; the proposed RABS is considered for BH-AMRs (with the dimension 0.8 × 1.2 (m), weight 150 (kg), full-load 500 (kg)) to serve real tasks in smart factories.

In the present era of Industry 4.0, the manufacturing automation is moving toward mass production and mass customization through human–robot collaboration. The purpose of this paper is to describe various human–robot collaborative (HRC) techniques and their applicability for various manufacturing methods along with key challenges.

Numerous recent relevant research literature has been analyzed, and various human–robot interaction methods have been identified, and detailed discussions are made on one- and two-way human–robot collaboration.

The challenges in implementing human–robot collaboration for various manufacturing process and the challenges in one- and two-way collaboration between human and robot are found and discussed.

The authors have attempted to classify the HRC techniques and demonstrated the challenges in different modes.

This paper aims to provide a European perspective on the collaborative robot business and to consider the factors governing future market development.

Following an introduction, this first describes the collaborative robots launched recently by European manufacturers and their applications. It then discusses major European research activities and finally considers the factors stimulating the market.

This article shows that collaborative robots are being commercialised by the major European robot manufacturers as well as by several smaller specialists. Although most have low payload capacities they are inexpensive and offer a number of operational benefits, making them well suited to a range of existing and emerging applications. Europe has a strong research base and several EU-funded programmes aim to stimulate collaborative robot development and use. Rapid market development is anticipated, driven in the main by applications in electronic product manufacture and assembly; new applications in the automotive industry; uses by small to medium-sized manufacturers; and companies seeking robots to support agile production methods.

This paper provides a timely review of the rapidly developing European collaborative robot industry.

The purpose of this paper is to enable robots to intelligently adapt their damping characteristics and motions in a reactive fashion toward human inputs and task requirements during physical human–robot interaction.

This paper exploits a combination of the dynamical system and the admittance model to create robot behaviors. The reference trajectories are generated by dynamical systems while the admittance control enables robots to compliantly follow the reference trajectories. To determine how control is divided between the two models, a collaborative arbitration algorithm is presented to change their contributions to the robot motion based on the contact forces. In addition, the authors investigate to model the robot’s impedance characteristics as a function of the task requirements and build a novel artificial damping field (ADF) to represent the virtual damping at arbitrary robot states.

The authors evaluate their methods through experiments on an UR10 robot. The result shows promising performances for the robot to achieve complex tasks in collaboration with human partners.

The proposed method extends the dynamical system approach with an admittance control law to allow a robot motion being adjusted in real time. Besides, the authors propose a novel ADF method to model the robot’s impedance characteristics as a function of the task requirements.

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

This paper aims to deal with the problem of programming robots in industrial contexts, where the need of easy programming is increasing, while robustness and safety remain fundamental aspects.

A novel approach of robot programming can be identified with the manual guidance that permits to the operator to freely move the robot through its task; the task can then be taught using Programming by Demonstration methods or simple reproduction.

In this work, the different ways to achieve manual guidance are discussed and an implementation using a force/torque sensor is provided. Experimental results and a use case are also presented.

The use case shows how this methodology can be used with an industrial robot. An implementation in industrial contexts should be adjusted accordingly to ISO safety standards as described in the paper.

This paper presents a complete state-of-the-art of the problem and shows a real practical use case where the approach presented could be used to speed up the teaching process.

The purpose of this paper is to provide a novel methodology based on two-level protection for ensuring safety of the moving human who enters the robot’s workspace, which is significant for dealing with the problem of human security in a human-robot coexisting environment.

In this system, anyone who enters the robot’s working space is detected by using the Kinect and their skeletons are calculated by the interval Kalman filter in real time. The first-level protection is mainly based on the prediction of the human motion, which used Gaussian mixture model and Gaussian Mixture Regression. However, even in cases where the prediction of human motion is incorrect, the system can still safeguard the human by enlarging the initial bounding volume of the human as the second-level early warning areas. Finally, an artificial potential field with some additional avoidance strategies is used to plan a path for a robot manipulator.

Experimental studies on the GOOGOL GRB3016 robot show that the robot manipulator can accomplish the predetermined tasks by circumventing the human, and the human does not feel dangerous.

This study presented a new framework for ensuring human security in a human-robot coexisting environment, and thus can improve the reliability of human-robot cooperation.