Search results

The mechanization of the meat cutting companies has become essential due to the lack of skilled workers and to working conditions. This paper deals with the analysis of human gestures in order to improve the performance of a redundant robotic cell. The aim is to define optimization criteria linked to the process and the human gesture analysis to improve the cutting process with a redundant robotic cell.

This paper deals with an optimized path planning of complex tasks based on the human arm analysis. The first part details the operator's manual work. The robotized cutting strategy using bones as a guide associated with an industrial force control leads to the tasks redefinition. Thus, the analysis of the arm during the tasks is presented. With a robotic model, the authors evaluate the relevance of two criteria (kinematic and mechanical) that the operator naturally manages. These criteria are used to improve the robotized cutting process by using redundancy. Simulation work and experimentation are presented to show the enhanced performance.

The paper explains how to define optimization criteria based on human arm analysis to realize cutting operations which require force or dexterity performance. It presents a study on the criteria weighting on a robotic arm model established through human arm analysis. The optimized cutting process clearly shows improvement.

The scalability of the ham implied the definition of iterative trajectories to follow the curvature of the bone. Due to the use of an industrial force control, no online optimization can be achieved. The off-line optimization implies that the boundary of the trajectory space is technically feasible. Nevertheless, more information has to be extracted from the deboning process such as vision data in order to improve cutting quality.

This study was carried out within the framework of several national and European projects (FUI SRDViand, ANR ARMS, FP7 Echord Dexdeb) in collaboration with ADIV (Meat Institute Development Agency). The redundant robotic cell was developed and implemented at ADIV and used for feasibility studies in connection with SME/SMI French sector.

The paper deals with the cutting of soft bodies such as meat and complex human gesture analysis, which constitute an innovative challenge for the coming years in order to help or replace humans in industrial meat companies with difficult working conditions.

The aim of the study is to conduct a thematic review of assessment tools and types of activities in the application of robotics to autistic students during the period 1996–2021 using Web of Science and Scopus. The sample consisted of 119 documents.

Nowadays, emerging technologies have become increasingly prevalent across various fields of knowledge. In this regard, robotics is being increasingly applied in the educational environment. The characteristics of this tool are the ones that best suit the needs of autistic students.

Results reveal that 16.80% of the studies used automatic measurement systems, whilst 15.96% of the studies used user observation and recording techniques. As for the tasks, 37.80% were focussed on imitation tasks. Amongst the practical implications is the need to include tasks that could be developed collaboratively in the regular classroom.

With this research, it is intended to disseminate in the scientific community what are the characteristics that should have the interaction activities between a robot and autistic students. In addition, the type of tool needed to evaluate the improvements in the interaction is proposed.

Aiming at the problems of weak generalization of robot imitation learning methods and higher accuracy requirements of low-level detectors, this study aims to propose an imitation learning method based on structural grammar.

The paper proposes a hybrid training model based on artificial immune algorithm and the Baum–Welch algorithm to extract the action information of the demonstration activity to form the {action-object} sequence and extract the symbol description of the scene to form the symbol primitives sequence. Then, probabilistic context-free grammar is used to characterize and manipulate these sequences to form a grammar space. Minimum description length criteria are used to evaluate the quality of the grammar in the grammar space, and the improved beam search algorithm is used to find the optimal grammar.

It is found that the obtained general structure can parse the symbol primitive sequence containing noise and obtain the correct sequence, thereby guiding the robot to perform more complex and higher-order demonstration tasks.

Using this strategy, the robot completes the fourth-order Hanoi tower task has been verified.

An imitation learning method for robots based on structural grammar is first proposed. The experimental results show that the method has strong generalization ability and good anti-interference performance.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The purpose of this paper is to deal with a method for gesture encoding and reproduction, particularly aiming at a text‐to‐gesture (TTG) system that enables robotic agents to generate proper gestures automatically and naturally in human‐robot interaction.

Reproducing proper gestures, naturally synchronized with speech, is important under the TTG concept. The authors first introduce a gesture model that is effective to abstract and describe a variety of human gestures. Based on the model, a gesture encoding/decoding scheme is proposed to encode observed gestures symbolically and parametrically and to reproduce robot gestures from the codes. In particular, this paper mainly addresses a gesture scheduling method that deals with the alignment and refinement of gestural motions, in order to reproduce robotic gesticulation in a human‐like, natural fashion.

The proposed method has been evaluated through a series of questionnaire surveys, and it was found that reproduced gestures by a robotic agent could appeal satisfactorily to human beings.

This paper provides a series of algorithms to treat overlapped motions and to refine the timing parameters for the motions, so that robotic agents reproduce human‐like, natural gestures.

Achieving natural interactions by means of vision and speech between humans and robots is one of the major goals that many researchers are working on. This paper aims to describe a gesture‐based human‐robot interaction (HRI) system using a knowledge‐based software platform.

A frame‐based knowledge model is defined for the gesture interpretation and HRI. In this knowledge model, necessary frames are defined for the known users, robots, poses, gestures and robot behaviors. First, the system identifies the user using the eigenface method. Then, face and hand poses are segmented from the camera frame buffer using the person's specific skin color information and classified by the subspace method.

The system is capable of recognizing static gestures comprised of the face and hand poses, and dynamic gestures of face in motion. The system combines computer vision and knowledge‐based approaches in order to improve the adaptability to different people.

Provides information on an experimental HRI system that has been implemented in the frame‐based software platform for agent and knowledge management using the AIBO entertainment robot, and this has been demonstrated to be useful and efficient within a limited situation.

This paper aims to propose a novel method based on a gesture primitives analysis of human daily grasping tasks for designing dexterous hands with various grasping and in-hand manipulation abilities, which simplifies the complex and redundant humanoid five-finger hand system.

First, the authors developed the fingers and the joint configuration with a series of gesture primitives configurations and the modular virtual finger scheme, refined from the daily work gesture library by principal component analysis. Then, the authors optimized the joint degree-of-freedom configuration with the bionic design analysis of the anatomy, and the authors optimized the dexterity workspace. Furthermore, the adaptive fingertip and routing structure were designed based on the dexterous manipulation theory. Finally, the effectiveness of the design method was experimentally validated.

A novel lightweight three-finger and nine-degree-of-freedom dexterous hand with force/position perception was designed. The proposed routing structure was shown to have the capability of mapping the relationship between the joint space and actuator space. The adaptive fingertip with an embedded force sensor can effectively increase the robustness of the grasping operation. Moreover, the dexterous hand can grasp various objects in different configurations and perform in-hand manipulation dexterously.

The dexterous hand design developed in this study is less complex and performs better in dexterous manipulation than previous designs.

The purpose of this paper is the research of a novel gesture-based dual-robot collaborative interaction interface, which achieves the gesture recognition when both hands overlap. This paper designs a hybrid-sensor gesture recognition platform to detect the both-hand data for dual-robot control.

This paper uses a combination of Leap Motion and PrimeSense in the vertical direction, which detects both-hand data in real time. When there is occlusion between hands, each hand is detected by one of the sensors, and a quaternion-based algorithm is used to realize the conversion of two sensors corresponding to different coordinate systems. When there is no occlusion, the data are fused by a self-adaptive weight fusion algorithm. Then the collision detection algorithm is used to detect the collision between robots to ensure safety. Finally, the data are transmitted to the dual robots.

This interface is implemented on a dual-robot system consisting of two 6-DOF robots. The dual-robot cooperative experiment indicates that the proposed interface is feasible and effective, and it takes less time to operate and has higher interaction efficiency.

A novel gesture-based dual-robot collaborative interface is proposed. It overcomes the problem of gesture occlusion in two-hand interaction with low computational complexity and low equipment cost. The proposed interface can perform a long-term stable tracking of the two-hand gestures even if there is occlusion between the hands. Meanwhile, it reduces the number of hand reset to reduce the operation time. The proposed interface achieves a natural and safe interaction between the human and the dual robot.