Search results

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

The purpose of this paper is to propose an new online path planning method for porcine belly cutting. With the proliferation in demand for the automatic systems of pork production, the development of efficient and robust meat cutting algorithms are hot issues. The uncertain and dynamic nature of the online porcine belly cutting imposes a challenge for the robot to identify and cut efficiently and accurately. Based on the above challenges, an online porcine belly cutting method using 3D laser point cloud is proposed.

The robotic cutting system is composed of an industrial robotic manipulator, customized tools, a laser sensor and a PC.

Analysis of experimental results shows that by comparing with machine vision, laser sensor-based robot cutting has more advantages, and it can handle different carcass sizes.

An image pyramid method is used for dimensionality reduction of the 3D laser point cloud. From a detailed analysis of the outward and inward cutting errors, the outward cutting error is the limiting condition for reducing the segments by segmentation algorithm.

In corridor environments, human-following robot encounter difficulties when the target turning around at the corridor intersections, as walls may cause complete occlusion. This paper aims to propose a collision-free following system for robot to track humans in corridors without a prior map.

In addition to following a target and avoiding collisions robustly, the proposed system calculates the positions of walls in the environment in real-time. This allows the system to maintain a stable tracking of the target even if it is obscured after turning. The proposed solution is integrated into a four-wheeled differential drive mobile robot to follow a target in a corridor environment in real-world.

The experimental results demonstrate that the robot equipped with the proposed system is capable of avoiding obstacles and following a human target robustly in the corridors. Moreover, the robot achieves a 90% success rate in maintaining a stable tracking of the target after the target turns around a corner with high speed.

This paper proposes a human target following system incorporating three novel features: a path planning method based on wall positions is introduced to ensure stable tracking of the target even when it is obscured due to target turns; improvements are made to the random sample consensus (RANSAC) algorithm, enhancing its accuracy in calculating wall positions. The system is integrated into a four-wheeled differential drive mobile robot effectively demonstrates its remarkable robustness and real-time performance.

Visual feedback control is a promising solution for robots work in unstructured environments, and this is accomplished by estimation of the time derivative relationship between the image features and the robot moving. While some of the drawbacks associated with most visual servoing (VS) approaches include the vision–motor mapping computation and the robots’ dynamic performance, the problem of designing optimal and more effective VS systems still remains challenging. Thus, the purpose of this paper is to propose and evaluate the VS method for robots in an unstructured environment.

This paper presents a new model-free VS control of a robotic manipulator, for which an adaptive estimator aid by network learning is proposed using online estimation of the vision–motor mapping relationship in an environment without the knowledge of statistical noise. Based on the adaptive estimator, a model-free VS schema was constructed by introducing an active disturbance rejection control (ADRC). In our schema, the VS system was designed independently of the robot kinematic model.

The various simulations and experiments were conducted to verify the proposed approach by using an eye-in-hand robot manipulator without calibration and vision depth information, which can improve the autonomous maneuverability of the robot and also allow the robot to adapt its motion according to the image feature changes in real time. In the current method, the image feature trajectory was stable in the camera field range, and the robot’s end motion trajectory did not exhibit shock retreat. The results showed that the steady-state errors of image features was within 19.74 pixels, the robot positioning was stable within 1.53 mm and 0.0373 rad and the convergence rate of the control system was less than 7.21 s in real grasping tasks.

Compared with traditional Kalman filtering for image-based VS and position-based VS methods, this paper adopts the model-free VS method based on the adaptive mapping estimator combination with the ADRC controller, which is effective for improving the dynamic performance of robot systems. The proposed model-free VS schema is suitable for robots’ grasping manipulation in unstructured environments.

Presently, 6 Degree of Freedom (6DOF) visual pose measurement methods enjoy popularity in the industrial sector. However, challenges persist in accurately measuring the visual pose of blank and rough metal casts. Therefore, this paper introduces a 6DOF pose measurement method utilizing stereo vision, and aims to the 6DOF pose measurement of blank and rough metal casts.

This paper studies the 6DOF pose measurement of metal casts from three aspects: sample enhancement of industrial objects, optimization of detector and attention mechanism. Virtual reality technology is used for sample enhancement of metal casts, which solves the problem of large-scale sample sampling in industrial application. The method also includes a novel deep learning detector that uses multiple key points on the object surface as regression objects to detect industrial objects with rotation characteristics. By introducing a mixed paths attention module, the detection accuracy of the detector and the convergence speed of the training are improved.

The experimental results show that the proposed method has a better detection effect for metal casts with smaller size scaling and rotation characteristics.

A method for 6DOF pose measurement of industrial objects is proposed, which realizes the pose measurement and grasping of metal blanks and rough machined casts by industrial robots.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The purpose of this paper is to provide an insight into the present-day state of bin picking by considering research, technology, products and applications.

Following a short introduction, this first provides examples of recent bin picking research. It then discusses a selection of commercial product developments and applications. Finally, brief conclusions are drawn.

Bin picking has the potential to eliminate repetitive, manual part handling practices in many sectors of the manufacturing and logistics industries. Systems combine robotic gripping and manipulation with machine vision and specialist software and tend to be complex to install and commission. They are produced by robot manufacturers, system integrators, software developers and machine vision specialists and all are constantly developing and improving the technology. These developments are supported by a strong academic research effort, much involving artificial intelligence methods, and while the technology is evolving rapidly, it is yet to reach the point where deployments are routine and widespread.

This provides a timely review of recent bin picking research and commercial developments.

The purpose of this study is to plan and develop a cost-effective health-care robot for assisting and observing the patients in an accurate and effective way during pandemic situation like COVID-19. The purposed research work can help in better management of pandemic situations in rural areas as well as developing countries where medical facility is not easily available.

It becomes very difficult for the medical staff to have a continuous check on patient’s condition in terms of symptoms and critical parameters during pandemic situations. For dealing with these situations, a service mobile robot with multiple sensors for measuring patients bodily indicators has been proposed and the prototype for the same has been developed that can monitor and aid the patient using the robotic arm. The fuzzy controller has also been incorporated with the mobile robot through which decisions on patient monitoring can be taken automatically. Mamdani implication method has been utilized for formulating mathematical expression of M number of “if and then condition based rules” with defined input X_j (j = 1, 2, ………. s), and output y_i. The inputs and output variables are formed by the membership functions µ_Aij(x_j) and µ_Ci(y_i) to execute the Fuzzy Inference System controller. Here, Aij and Ci are the developed fuzzy sets.

The fuzzy-based prediction model has been tested with the output of medicines for the initial 27 runs and was validated by the correlation of predicted and actual values. The correlation coefficient has been found to be 0.989 with a mean square error value of 0.000174, signifying a strong relationship between the predicted values and the actual values. The proposed research work can handle multiple tasks like online consulting, continuous patient condition monitoring in general wards and ICUs, telemedicine services, hospital waste disposal and providing service to patients at regular time intervals.

The novelty of the proposed research work lies in the integration of artificial intelligence techniques like fuzzy logic with the multi-sensor-based service robot for easy decision-making and continuous patient monitoring in hospitals in rural areas and to reduce the work stress on medical staff during pandemic situation.

This paper aims to propose a lightweight, high-accuracy object detection model designed to enhance seam tracking quality under strong arcs and splashes condition. Simultaneously, the model aims to reduce computational costs.

The lightweight model is constructed based on Single Shot Multibox Detector (SSD). First, a neural architecture search method based on meta-learning and genetic algorithm is introduced to optimize pruning strategy, reducing human intervention and improving efficiency. Additionally, the Alternating Direction Method of Multipliers (ADMM) is used to perform structural pruning on SSD, effectively compressing the model with minimal loss of accuracy.

Compared to state-of-the-art models, this method better balances feature extraction accuracy and inference speed. Furthermore, seam tracking experiments on this welding robot experimental platform demonstrate that the proposed method exhibits excellent accuracy and robustness in practical applications.

This paper presents an innovative approach that combines ADMM structural pruning and meta-learning-based neural architecture search to significantly enhance the efficiency and performance of the SSD network. This method reduces computational cost while ensuring high detection accuracy, providing a reliable solution for welding robot laser vision systems in practical applications.

In response to the navigation challenges faced by coal mine tunnel inspection robots in semistructured underground intersection environments, many current studies rely on structured map-based planning algorithms and trajectory tracking techniques. However, this approach is highly dependent on the accuracy of the global map, which can lead to deviations from the predetermined route or collisions with obstacles. To improve the environmental adaptability and navigation precision of the robot, this paper aims to propose an adaptive navigation system based on a two-dimensional (2D) LiDAR.

Leveraging the geometric features of coal mine tunnel environments, the clustering and fitting algorithms are used to construct a geometric model within the navigation system. This not only reduces the complexity of the navigation system but also optimizes local positioning. By constructing a local potential field, there is no need for path-fitting planning, thus enhancing the robot’s adaptability in intersection environments. The feasibility of the algorithm principles is validated through MATLAB and robot operating system simulations in this paper.

The experiments demonstrate that this method enables autonomous driving and optimized positioning capabilities in harsh environments, with high real-time performance and environmental adaptability, achieving a positioning error rate of less than 3%.

This paper presents an adaptive navigation system for a coal mine tunnel inspection robot using a 2D LiDAR sensor. The system improves robot attitude estimation and motion control accuracy to ensure safe and reliable navigation, especially at tunnel intersections.