Search results

1 – 10 of 38
Article
Publication date: 20 April 2023

Xinyang Fan, Xin Shu, Baoxu Tu, Changyuan Liu, Fenglei Ni and Zainan Jiang

In the current teleoperation system of humanoid robots, the control between arms and the control between the waist and arms are individual and lack coordinated motion. This paper…

Abstract

Purpose

In the current teleoperation system of humanoid robots, the control between arms and the control between the waist and arms are individual and lack coordinated motion. This paper aims to solve the above problem and proposes a teleoperation control approach for a humanoid robot based on waist–arm coordination (WAC).

Design/methodology/approach

The teleoperation approach based on WAC comprises dual-arm coordination (DAC) and WAC. The DAC method realizes the coordinated motion of both arms through one hand by establishing a mapping relationship between a single hand controller and the manipulated object; the WAC method realizes the coordinated motion of both arms and waist by calculating the inverse kinematic input of robotic arms based on the desired velocity of the waist and the end of both arms. An integrated teleoperation control framework provides interfaces for the above methods, and users can switch control modes online to adapt to different tasks.

Findings

After conducting experiments on the dual-arm humanoid robot through the teleoperation control framework, it was found that the DAC method can save 27.2% of the operation time and reduce 99.9% of the posture change of the manipulated object compared with the commonly used individual control. The WAC method can accomplish a task that cannot be done by individual control. The experiments proved the improvement of both methods in terms of operation efficiency, operation stability and operation capability compared with individual control.

Originality/value

The DAC method better maintains the constraints of both arms and the manipulated object. The WAC method better maintains the constraints of the manipulated object itself. Meanwhile, the teleoperation framework integrates the proposed methods and enriches the teleoperation modes and control means.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 5
Type: Research Article
ISSN: 0143-991X

Keywords

Article
Publication date: 22 December 2022

Hang Gao and Chao Ma

The purpose of this paper is to propose a novel event-triggered aperiodic intermittent sliding-mode control (ETAI-SMC) algorithm for master–slave bilateral teleoperation robotic…

Abstract

Purpose

The purpose of this paper is to propose a novel event-triggered aperiodic intermittent sliding-mode control (ETAI-SMC) algorithm for master–slave bilateral teleoperation robotic systems to further save communication resources while maintaining synchronization precision.

Design/methodology/approach

By using the Lyapunov theory, a new event-triggered aperiodic intermittent sliding-mode controller is designed to synchronize master–slave robots in a discontinuous method. Unlike traditional periodic time-triggered continuous control strategy, a new ETAI condition is discussed for less communication pressure. Then, the exponential reaching law is adopted to accelerate sliding-mode variables convergence, which has a significant effect on synchronization performance. In addition, the authors use quantizers to make their algorithm have obvious progress in saving communication resources.

Findings

The proposed control algorithm performance is validated by an experiment developed on a practical bilateral teleoperation system with two PHANToM Omni robotic devices. As a result, the synchronization error is limited within a small range and the control frequency is evidently reduced. Compared with a conventional control algorithm, the experimental results illustrate that the proposed control algorithm is more sensitive to system states changes and it can further save communication resources while guaranteeing the system synchronization accuracy, which is more practical for real bilateral teleoperation robotic systems.

Originality/value

A novel ETAI-SMC for bilateral teleoperation robotic systems is proposed to find a balance between reducing the control frequency and synchronization control precision. Combining the traditional sliding-mode control algorithm with the periodic intermittent control strategy and the event-triggered control strategy has produced obvious effect on our control performance. The proposed ETAI-SMC algorithm helps the controller be more sensitive to system states changes, which makes it possible to achieve precise control with lower control frequency. Moreover, we design an environment contact force feedback algorithm for operators to improve the perception of the slave robot working environment. In addition, quantizers and the exponential convergence law are adopted to help the proposed algorithm perform better in saving communication resources and improving synchronization precision.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 3
Type: Research Article
ISSN: 0143-991X

Keywords

Article
Publication date: 14 September 2022

Jing Zhao, Xin Wang, Biyun Xie and Ziqiang Zhang

This paper aims to present a new kinematics mapping method based on dynamic equivalent points. In teleoperation, this method enables a robotic (follower) arm to mimic human…

Abstract

Purpose

This paper aims to present a new kinematics mapping method based on dynamic equivalent points. In teleoperation, this method enables a robotic (follower) arm to mimic human (leader) arm postures and avoid obstacles in a human-like manner.

Design/methodology/approach

The information of the human arm is extracted based on the characteristics of human arm motion, and the concept of equivalent points is introduced. Then, an equivalent point is determined to transform the robotic arm with a nonhuman-like kinematic structure into an anthropomorphic robotic arm. Based on this equivalent point, a mapping method is developed to ensure that the two arms are similar. Finally, the similarity between the human elbow angle and robot elbow angle is further improved by using this method and an augmented Jacobian matrix with a compensation coefficient.

Findings

Numerical simulations and physical prototype experiments are conducted to verify the effectiveness and feasibility of the proposed method. In environments with obstacles, this method can adjust the position of the equivalent point in real time to avoid obstacles. In environments without obstacles, the similarity between the human elbow angle and robot elbow angle is further improved at the expense of the end-effector accuracy.

Originality/value

This study presents a new kinematics mapping method, which can realize the complete mapping between the human arm and heterogeneous robotic arm in teleoperation. This method is versatile and can be applied to various mechanical arms with different structures.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 2
Type: Research Article
ISSN: 0143-991X

Keywords

Article
Publication date: 13 February 2024

Yanghong Li, Yahao Wang, Yutao Chen, X.W. Rong, Yuliang Zhao, Shaolei Wu and Erbao Dong

The current difficulties of distribution network working robots are mainly in the performance and operation mode. On the one hand, high-altitude power operation tasks require high…

Abstract

Purpose

The current difficulties of distribution network working robots are mainly in the performance and operation mode. On the one hand, high-altitude power operation tasks require high load-carrying capacity and dexterity of the robot; on the other hand, the fully autonomous mode is uncontrollable and the teleoperation mode has a high failure rate. Therefore, this study aims to design a distribution network operation robot named Sky-Worker to solve the above two problems.

Design/methodology/approach

The heterogeneous arms of Sky-Worker are driven by hydraulics and electric motors to solve the contradiction between high load-carrying capacity and high flexibility. A human–robot collaborative shared control architecture is built to realize real-time human intervention during autonomous operation, and control weights are dynamically assigned based on energy optimization.

Findings

Simulations and tests show that Sky-Worker has good dexterity while having a high load capacity. Based on Sky-Worker, multiuser tests and practical application experiments show that the designed shared-control mode effectively improves the success rate and efficiency of operations compared with other current operation modes.

Practical implications

The designed heterogeneous dual-arm distribution robot aims to better serve distribution line operation tasks.

Originality/value

For the first time, the integration of hydraulic and motor drives into a distribution network operation robot has achieved better overall performance. A human–robot cooperative shared control framework is proposed for remote live-line working robots, which provides better operation results than other current operation modes.

Details

Industrial Robot: the international journal of robotics research and application, vol. 51 no. 2
Type: Research Article
ISSN: 0143-991X

Keywords

Open Access
Article
Publication date: 16 October 2023

Baris Cogan and Birgit Milius

Increasing demand on rail transport speeds up the introduction of new technical systems to optimize the rail traffic and increase competitiveness. Remote control of trains is seen…

Abstract

Purpose

Increasing demand on rail transport speeds up the introduction of new technical systems to optimize the rail traffic and increase competitiveness. Remote control of trains is seen as a potential layer of resilience in railway operations. It allows for operating and controlling automated trains and communicating and coordinating with other stakeholders of the railway system. This paper aims to present the first results of a multi-phased simulator study on the development and optimization of remote train driving concepts from the operators’ point of view.

Design/methodology/approach

The presented concept was developed by benchmarking good practices. Two phases of iterative user tests were conducted to evaluate the user experience and preferences of the developed human-machine-interface concept. Basic training requirements were identified and evaluated.

Findings

Results indicate positive feedback on the overall system as a fallback solution. HMI elicited positive emotions regarding pleasure and dominance, but low arousal levels. Train drivers had more conservative views on the system compared to signalers and students. The training activities achieved increased awareness and understanding of the system for future operators. Inclusion of potential users in the development of future systems has the potential to improve user acceptance. The iterative user experiments were useful in obtaining some of the needs and preferences of different user groups.

Originality/value

Multi-phase user tests were conducted to identify and to evaluate the requirements and preferences of remote operators using a simplified HMI. Training analysis provides important aspects to consider for the training of future users.

Details

Smart and Resilient Transportation, vol. 5 no. 2
Type: Research Article
ISSN: 2632-0487

Keywords

Article
Publication date: 2 February 2023

Ahmed Eslam Salman and Magdy Raouf Roman

The study proposed a human–robot interaction (HRI) framework to enable operators to communicate remotely with robots in a simple and intuitive way. The study focused on the…

Abstract

Purpose

The study proposed a human–robot interaction (HRI) framework to enable operators to communicate remotely with robots in a simple and intuitive way. The study focused on the situation when operators with no programming skills have to accomplish teleoperated tasks dealing with randomly localized different-sized objects in an unstructured environment. The purpose of this study is to reduce stress on operators, increase accuracy and reduce the time of task accomplishment. The special application of the proposed system is in the radioactive isotope production factories. The following approach combined the reactivity of the operator’s direct control with the powerful tools of vision-based object classification and localization.

Design/methodology/approach

Perceptive real-time gesture control predicated on a Kinect sensor is formulated by information fusion between human intuitiveness and an augmented reality-based vision algorithm. Objects are localized using a developed feature-based vision algorithm, where the homography is estimated and Perspective-n-Point problem is solved. The 3D object position and orientation are stored in the robot end-effector memory for the last mission adjusting and waiting for a gesture control signal to autonomously pick/place an object. Object classification process is done using a one-shot Siamese neural network (NN) to train a proposed deep NN; other well-known models are also used in a comparison. The system was contextualized in one of the nuclear industry applications: radioactive isotope production and its validation were performed through a user study where 10 participants of different backgrounds are involved.

Findings

The system was contextualized in one of the nuclear industry applications: radioactive isotope production and its validation were performed through a user study where 10 participants of different backgrounds are involved. The results revealed the effectiveness of the proposed teleoperation system and demonstrate its potential for use by robotics non-experienced users to effectively accomplish remote robot tasks.

Social implications

The proposed system reduces risk and increases level of safety when applied in hazardous environment such as the nuclear one.

Originality/value

The contribution and uniqueness of the presented study are represented in the development of a well-integrated HRI system that can tackle the four aforementioned circumstances in an effective and user-friendly way. High operator–robot reactivity is kept by using the direct control method, while a lot of cognitive stress is removed using elective/flapped autonomous mode to manipulate randomly localized different configuration objects. This necessitates building an effective deep learning algorithm (in comparison to well-known methods) to recognize objects in different conditions: illumination levels, shadows and different postures.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 5
Type: Research Article
ISSN: 0143-991X

Keywords

Content available
Article
Publication date: 13 November 2023

Sheuli Paul

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this…

Abstract

Purpose

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

Design/methodology/approach

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Findings

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Research limitations/implications

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

Practical implications

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Social implications

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

Originality/value

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Article
Publication date: 4 December 2023

Feifei Zhong, Guoping Liu, Zhenyu Lu, Lingyan Hu, Yangyang Han, Yusong Xiao and Xinrui Zhang

Robotic arms’ interactions with the external environment are growing more intricate, demanding higher control precision. This study aims to enhance control precision by…

Abstract

Purpose

Robotic arms’ interactions with the external environment are growing more intricate, demanding higher control precision. This study aims to enhance control precision by establishing a dynamic model through the identification of the dynamic parameters of a self-designed robotic arm.

Design/methodology/approach

This study proposes an improved particle swarm optimization (IPSO) method for parameter identification, which comprehensively improves particle initialization diversity, dynamic adjustment of inertia weight, dynamic adjustment of local and global learning factors and global search capabilities. To reduce the number of particles and improve identification accuracy, a step-by-step dynamic parameter identification method was also proposed. Simultaneously, to fully unleash the dynamic characteristics of a robotic arm, and satisfy boundary conditions, a combination of high-order differentiable natural exponential functions and traditional Fourier series is used to develop an excitation trajectory. Finally, an arbitrary verification trajectory was planned using the IPSO to verify the accuracy of the dynamical parameter identification.

Findings

Experiments conducted on a self-designed robotic arm validate the proposed parameter identification method. By comparing it with IPSO1, IPSO2, IPSOd and least-square algorithms using the criteria of torque error and root mean square for each joint, the superiority of the IPSO algorithm in parameter identification becomes evident. In this case, the dynamic parameter results of each link are significantly improved.

Originality/value

A new parameter identification model was proposed and validated. Based on the experimental results, the stability of the identification results was improved, providing more accurate parameter identification for further applications.

Details

Industrial Robot: the international journal of robotics research and application, vol. 51 no. 1
Type: Research Article
ISSN: 0143-991X

Keywords

Article
Publication date: 28 March 2023

Xinwei Guo and Yang Chen

Currently, the vision and depth information obtained from the eye-to-hand RGB-D camera can apply to the reconstruction of the three-dimensional (3D) environment for a robotic…

Abstract

Purpose

Currently, the vision and depth information obtained from the eye-to-hand RGB-D camera can apply to the reconstruction of the three-dimensional (3D) environment for a robotic operation workspace. The reconstructed 3D space contributes to a symmetrical and equal observation view for robots and humans, which can be considered a digital twin (DT) environment. The purpose of this study is to enhance the robot skill in the physical workspace, although the artificial intelligence (AI) technique has high performance of the robotic operation in the known environments.

Design/methodology/approach

A multimodal interaction framework is proposed in DT operation environments.

Findings

A fast image-based target segmentation technique is combined in the 3D reconstruction of the robotic operation environment from the eye-to-hand camera, thus expediting the 3D DT environment generation without accuracy loss. A multimodal interaction interface is integrated into the DT environment.

Originality/value

The users are supported to operate the virtual objects in the DT environment using speech, mouse and keyboard simultaneously. The humans’ operations in 3D DT virtual space are recorded, and cues are provided for the robot’s operations in practice.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 4
Type: Research Article
ISSN: 0143-991X

Keywords

Article
Publication date: 16 June 2023

Mohamed Tahir Shoani, Mohamed Najib Ribuan and Ahmad 'Athif Mohd Faudzi

The current methods for inspecting tall or deep structures such as towers, chimneys, silos, and wells suffer from certain constraints. Manual and assisted inspection methods…

125

Abstract

Purpose

The current methods for inspecting tall or deep structures such as towers, chimneys, silos, and wells suffer from certain constraints. Manual and assisted inspection methods including humans, drones, wall climbing robots, and others are either costly, have a limited operation time, or affected by field conditions, such as temperature and radiation. This study aims to overcome the presented challenges through a teleoperated soft continuum manipulator capable of inspecting tall or deep structures with high resolution, an unlimited operation time and the ability to use different arms of the manipulator for different environments and structure sizes.

Design/methodology/approach

The teleoperated manipulator uses one rotary and two tendon actuators to reach and inspect the interior of a tall (or deep) structure. A sliding part along the manipulator’s body (arm constrainer and tendon router) induces a variable-length bending segment, allowing an inspection camera to be placed at different distances from the desired location.

Findings

The experiments confirmed the manipulator’s ability to inspect different locations in the structure’s interior. The manipulator also demonstrated a submillimeter motion resolution vertically and a 2.5 mm per step horizontally. The inspection time of the full structure was 48.53 min in the step-by-step mode and was calculated to be 4.23 min in the continuous mode.

Originality/value

The presented manipulator offers several design novelties: the arm’s thin-wide cross-section, the variable-length bending segment in a fixed-length body, the external rolling tendon routing and the ability to easily replace the arm with another of different material or dimensions to suite different structures and environments.

Details

Industrial Robot: the international journal of robotics research and application, vol. 50 no. 6
Type: Research Article
ISSN: 0143-991X

Keywords

1 – 10 of 38