Search results

Visual simultaneous localization and mapping (SLAM) has limitations such as sensitivity to lighting changes and lower measurement accuracy. The effective fusion of information from multiple modalities to address these limitations has emerged as a key research focus. This study aims to provide a comprehensive review of the development of vision-based SLAM (including visual SLAM) for navigation and pose estimation, with a specific focus on techniques for integrating multiple modalities.

This paper initially introduces the mathematical models and framework development of visual SLAM. Subsequently, this paper presents various methods for improving accuracy in visual SLAM by fusing different spatial and semantic features. This paper also examines the research advancements in vision-based SLAM with respect to multi-sensor fusion in both loosely coupled and tightly coupled approaches. Finally, this paper analyzes the limitations of current vision-based SLAM and provides predictions for future advancements.

The combination of vision-based SLAM and deep learning has significant potential for development. There are advantages and disadvantages to both loosely coupled and tightly coupled approaches in multi-sensor fusion, and the most suitable algorithm should be chosen based on the specific application scenario. In the future, vision-based SLAM is evolving toward better addressing challenges such as resource-limited platforms and long-term mapping.

This review introduces the development of vision-based SLAM and focuses on the advancements in multimodal fusion. It allows readers to quickly understand the progress and current status of research in this field.

Dynamically tracking the target by unmanned ground vehicles (UGVs) plays a critical role in mobile drone recovery. This study aims to solve this challenge under diverse random disturbances, proposing a dynamic target tracking framework for UGVs based on target state estimation, trajectory prediction, and UGV control.

To mitigate the adverse effects of noise contamination in target detection, the authors use the extended Kalman filter (EKF) to improve the accuracy of locating unmanned aerial vehicles (UAVs). Furthermore, a robust motion prediction algorithm based on polynomial fitting is developed to reduce the impact of trajectory jitter caused by crosswinds, enhancing the stability of drone trajectory prediction. Regarding UGV control, a dynamic vehicle model featuring independent front and rear wheel steering is derived. Additionally, a linear time-varying model predictive control algorithm is proposed to minimize tracking errors for the UGV.

To validate the feasibility of the framework, the algorithms were deployed on the designed UGV. Experimental results demonstrate the effectiveness of the proposed dynamic tracking algorithm of UGV under random disturbances.

This paper proposes a tracking framework of UGV based on target state estimation, trajectory prediction and UGV predictive control, enabling the system to achieve dynamic tracking to the UAV under multiple disturbance conditions.

Soft robots are known for their excellent safe interaction ability and promising in surgical applications for their lower risks of damaging the surrounding organs when operating than their rigid counterparts. To explore the potential of soft robots in cardiac surgery, this paper aims to propose an adaptive iterative learning controller for tracking the irregular motion of the beating heart.

In continuous beating heart surgery, providing a relatively stable operating environment for the operator is crucial. It is highly necessary to use position-tracking technology to keep the target and the surgical manipulator as static as possible. To address the position tracking and control challenges associated with dynamic targets, with a focus on tracking the motion of the heart, control design work has been carried out. Considering the lag error introduced by the material properties of the soft surgical robotic arm and system delays, a controller design incorporating iterative learning control with parameter estimation was used for position control. The stability of the controller was analyzed and proven through the construction of a Lyapunov function, taking into account the unique characteristics of the soft robotic system.

The tracking performance of both the proportional-derivative (PD) position controller and the adaptive iterative learning controller are conducted on the simulated heart platform. The results of these two methods are compared and analyzed. The designed adaptive iterative learning control algorithm for position control at the end effector of the soft robotic system has demonstrated improved control precision and stability compared with traditional PD controllers. It exhibits effective compensation for periodic lag caused by system delays and material characteristics.

Tracking the beating heart, which undergoes quasi-periodic and complex motion with varying accelerations, poses a significant challenge even for rigid mechanical arms that can be precisely controlled and makes tracking targets located at the surface of the heart with the soft robot fraught with considerable difficulties. This paper originally proposes an adaptive interactive learning control algorithm to cope with the dynamic object tracking problem. The algorithm has theoretically proved its convergence and experimentally validated its performance at the cable-driven soft robot test bed.

The accuracy and reliability of upper limb motion assessment have received great attention in the field of rehabilitation. Grasping test is widely carried out for motion assessment, which requires patients to grasp objects and move them to target place. The traditional assessments test the upper limb motion ability by therapists, which mainly relies on experience and lacks quantitative indicators. This paper aims to propose a deep learning method based on the vision system of our upper limb rehabilitation robot to recognize the motion trajectory of rehabilitation target objects automatically and quantitatively assess the upper limb motion in the grasping test.

To begin with, an SRF network is designed to recognize rehabilitation target objects grasped in assessment tests. Moreover, the upper limb motion trajectory is calculated through the motion of objects’ central positions. After that, a GAE network is designed to analyze the motion trajectory which reflects the motion of upper limb. Finally, based on the upper limb rehabilitation exoskeleton platform, the upper limb motion assessment tests are carried out to show the accuracy of both object recognition of SRF network and motion assessment of GAE network. The results including object recognition, trajectory calculation and deviation assessment are given with details.

The performance of the proposed networks is validated by experiments that are developed on the upper limb rehabilitation robot. It is implemented by recognizing rehabilitation target objects, calculating the motion trajectory and grading the upper limb motion performance. It illustrates that the networks, including both object recognition and trajectory evaluation, can grade the upper limb motion functionn accurately, where the accuracy is above 95.0% in different grasping tests.

A novel assessment method of upper limb motion is proposed and verified. According to the experimental results, the accuracy can be remarkably enhanced, and the stability of the results can be improved, which provide more quantitative indicators for further application of upper limb motion assessment.

The purpose of this study is to introduce the top-level design ideas and the overall architecture of earthquake early-warning system for high speed railways in China, which is based on P-wave earthquake early-warning and multiple ways of rapid treatment.

The paper describes the key technologies that are involved in the development of the system, such as P-wave identification and earthquake early-warning, multi-source seismic information fusion and earthquake emergency treatment technologies. The paper also presents the test results of the system, which show that it has complete functions and its major performance indicators meet the design requirements.

The study demonstrates that the high speed railways earthquake early-warning system serves as an important technical tool for high speed railways to cope with the threat of earthquake to the operation safety. The key technical indicators of the system have excellent performance: The first report time of the P-wave is less than three seconds. From the first arrival of P-wave to the beginning of train braking, the total delay of onboard emergency treatment is 3.63 seconds under 95% probability. The average total delay for power failures triggered by substations is 3.3 seconds.

The paper provides a valuable reference for the research and development of earthquake early-warning system for high speed railways in other countries and regions. It also contributes to the earthquake prevention and disaster reduction efforts.

In response to the navigation challenges faced by coal mine tunnel inspection robots in semistructured underground intersection environments, many current studies rely on structured map-based planning algorithms and trajectory tracking techniques. However, this approach is highly dependent on the accuracy of the global map, which can lead to deviations from the predetermined route or collisions with obstacles. To improve the environmental adaptability and navigation precision of the robot, this paper aims to propose an adaptive navigation system based on a two-dimensional (2D) LiDAR.

Leveraging the geometric features of coal mine tunnel environments, the clustering and fitting algorithms are used to construct a geometric model within the navigation system. This not only reduces the complexity of the navigation system but also optimizes local positioning. By constructing a local potential field, there is no need for path-fitting planning, thus enhancing the robot’s adaptability in intersection environments. The feasibility of the algorithm principles is validated through MATLAB and robot operating system simulations in this paper.

The experiments demonstrate that this method enables autonomous driving and optimized positioning capabilities in harsh environments, with high real-time performance and environmental adaptability, achieving a positioning error rate of less than 3%.

This paper presents an adaptive navigation system for a coal mine tunnel inspection robot using a 2D LiDAR sensor. The system improves robot attitude estimation and motion control accuracy to ensure safe and reliable navigation, especially at tunnel intersections.

This study aims to address the issue of random movement and non coordination between docking mechanisms and locking mechanisms, and proposes a comprehensive dynamic docking control architecture that integrates perception, planning, and motion control.

Firstly, the proposed dynamic docking control architecture uses laser sensors and a charge-coupled device camera to perceive the pose of the target. The sensor data are mapped to a high-dimensional potential field space and fused to reduce interference caused by detection noise. Next, a new potential function based on multi-dimensional space is developed for docking path planning, which enables the docking mechanism based on Stewart platform to rapidly converge to the target axis of the locking mechanism, which improves the adaptability and terminal docking accuracy of the docking state. Finally, to achieve precise tracking and flexible docking in the final stage, the system combines a self-impedance controller and an impedance control algorithm based on the planned trajectory.

Extensive simulations and experiments have been conducted to validate the effectiveness of the dynamic docking system and its control architecture. The results indicate that even if the target moves randomly, the system can successfully achieve accurate, stable and flexible dynamic docking.

This research can provide technical guidance and reference for docking task of unmanned vehicles under the ground conditions. It can also provide ideas for space docking missions, such as space simulator docking.

Near-fault pulse-like ground motions have distinct and very severe effects on reinforced concrete (RC) structures. However, there is a paucity of recorded data from Near-Fault Ground Motions (NFGMs), and thus forecasting the dynamic seismic response of structures, using conventional techniques, under such intense ground motions has remained a challenge.

The present study utilizes a 2D finite element model of an RC structure subjected to near-fault pulse-like ground motions with a focus on the storey drift ratio (SDR) as the key demand parameter. Five machine learning classifiers (MLCs), namely decision tree, k-nearest neighbor, random forest, support vector machine and Naïve Bayes classifier , were evaluated to classify the damage states of the RC structure.

The results such as confusion matrix, accuracy and mean square error indicate that the Naïve Bayes classifier model outperforms other MLCs with 80.0% accuracy. Furthermore, three MLC models with accuracy greater than 75% were trained using a voting classifier to enhance the performance score of the models. Finally, a sensitivity analysis was performed to evaluate the model's resilience and dependability.

The objective of the current study is to predict the nonlinear storey drift demand for low-rise RC structures using machine learning techniques, instead of labor-intensive nonlinear dynamic analysis.

The purpose of this paper is to showcase the utilization of the magnetohydrodynamics-microrotating Casson’s nanofluid flow model (MHD-MRCNFM) in examining the impact of an inclined magnetic field within a porous medium on a nonlinear stretching plate. This investigation is conducted by using neural networking techniques, specifically using neural networks-backpropagated with the Levenberg–Marquardt scheme (NN-BLMS).

The initial nonlinear coupled PDEs system that represented the MRCNFM is transformed into an analogous nonlinear ODEs system by the adoption of similarity variables. The reference data set is created by varying important MHD-MRCNFM parameters using the renowned Lobatto IIIA solver. The numerical reference data are used in validation, testing and training sets to locate and analyze the estimated outcome of the created NN-LMA and its comparison with the corresponding reference solution. With mean squared error curves, error histogram analysis and a regression index, better performance is consistently demonstrated. Mu is a controller that controls the complete training process, and the NN-BLMS mainly concentrates on the higher precision of nonlinear systems.

The peculiar behavior of the appropriate physical parameters on nondimensional shapes is demonstrated and explored via sketches and tables. For escalating amounts of inclination angle and Brinkman number, a viable entropy profile is accomplished. The angular velocity curve grows as the rotation viscosity and surface condition factors rise. The dominance of friction-induced irreversibility is observed in the vicinity of the sheet, whereas in the farthest region, the situation is reversed with heat transfer playing a more significant role in causing irreversibilities.

To improve the efficiency of any thermodynamic system, it is essential to identify and track the sources of irreversible heat losses. Therefore, the authors analyze both flow phenomena and heat transport, with a particular focus on evaluating the generation of entropy within the system.

This study aims to achieve superior localization and mapping performance in point cloud degradation scenarios through the effective removal of dynamic obstacles. With the continuous development of various technologies for autonomous vehicles, the LIDAR-based Simultaneous localization and mapping (SLAM) system is becoming increasingly important. However, in SLAM systems, effectively addressing the challenges of point cloud degradation scenarios is essential for accurate localization and mapping, with dynamic obstacle removal being a key component.

This paper proposes a method that combines adaptive feature extraction and loop closure detection algorithms to address this challenge. In the SLAM system, the ground point cloud and non-ground point cloud are separated to reduce the impact of noise. And based on the cylindrical projection image of the point cloud, the intensity features are adaptively extracted, the degradation direction is determined by the degradation factor and the intensity features are matched with the map to correct the degraded pose. Moreover, through the difference in raster distribution of the point clouds before and after two frames in the loop process, the dynamic point clouds are identified and removed, and the map is updated.

Experimental results show that the method has good performance. The absolute displacement accuracy of the laser odometer is improved by 27.1%, the relative displacement accuracy is improved by 33.5% and the relative angle accuracy is improved by 23.8% after using the adaptive intensity feature extraction method. The position error is reduced by 30% after removing the dynamic target.

Compared with LiDAR odometry and mapping algorithm, the method has greater robustness and accuracy in mapping and localization.