Search results

The purpose of the paper is to propose and demonstrate a novel approach for addressing the challenges of path planning and obstacle avoidance in the context of mobile robots (MR). The specific objectives and purposes outlined in the paper include: introducing a new methodology that combines Q-learning with dynamic reward to improve the efficiency of path planning and obstacle avoidance. Enhancing the navigation of MR through unfamiliar environments by reducing blind exploration and accelerating the convergence to optimal solutions and demonstrating through simulation results that the proposed method, dynamic reward-enhanced Q-learning (DRQL), outperforms existing approaches in terms of achieving convergence to an optimal action strategy more efficiently, requiring less time and improving path exploration with fewer steps and higher average rewards.

The design adopted in this paper to achieve its purposes involves the following key components: (1) Combination of Q-learning and dynamic reward: the paper’s design integrates Q-learning, a popular reinforcement learning technique, with dynamic reward mechanisms. This combination forms the foundation of the approach. Q-learning is used to learn and update the robot’s action-value function, while dynamic rewards are introduced to guide the robot’s actions effectively. (2) Data accumulation during navigation: when a MR navigates through an unfamiliar environment, it accumulates experience data. This data collection is a crucial part of the design, as it enables the robot to learn from its interactions with the environment. (3) Dynamic reward integration: dynamic reward mechanisms are integrated into the Q-learning process. These mechanisms provide feedback to the robot based on its actions, guiding it to make decisions that lead to better outcomes. Dynamic rewards help reduce blind exploration, which can be time-consuming and inefficient and promote faster convergence to optimal solutions. (4) Simulation-based evaluation: to assess the effectiveness of the proposed approach, the design includes a simulation-based evaluation. This evaluation uses simulated environments and scenarios to test the performance of the DRQL method. (5) Performance metrics: the design incorporates performance metrics to measure the success of the approach. These metrics likely include measures of convergence speed, exploration efficiency, the number of steps taken and the average rewards obtained during the robot’s navigation.

The findings of the paper can be summarized as follows: (1) Efficient path planning and obstacle avoidance: the paper’s proposed approach, DRQL, leads to more efficient path planning and obstacle avoidance for MR. This is achieved through the combination of Q-learning and dynamic reward mechanisms, which guide the robot’s actions effectively. (2) Faster convergence to optimal solutions: DRQL accelerates the convergence of the MR to optimal action strategies. Dynamic rewards help reduce the need for blind exploration, which typically consumes time and this results in a quicker attainment of optimal solutions. (3) Reduced exploration time: the integration of dynamic reward mechanisms significantly reduces the time required for exploration during navigation. This reduction in exploration time contributes to more efficient and quicker path planning. (4) Improved path exploration: the results from the simulations indicate that the DRQL method leads to improved path exploration in unknown environments. The robot takes fewer steps to reach its destination, which is a crucial indicator of efficiency. (5) Higher average rewards: the paper’s findings reveal that MR using DRQL receive higher average rewards during their navigation. This suggests that the proposed approach results in better decision-making and more successful navigation.

The paper’s originality stems from its unique combination of Q-learning and dynamic rewards, its focus on efficiency and speed in MR navigation and its ability to enhance path exploration and average rewards. These original contributions have the potential to advance the field of mobile robotics by addressing critical challenges in path planning and obstacle avoidance.

Most of the conventional humanoid modeling approaches are not successful in coupling different branches of the tree-type humanoid robot. In this paper, a tree-type upper body humanoid robot with mobile base is modeled. The main purpose of this work is to model a non holonomic mobile platform and to develop a hybrid algorithm for avoiding dynamic obstacles. Decoupled Natural Orthogonal Complement methodology effectively combines different branches of the humanoid body during dynamic analysis. Collision avoidance also plays an important role along with modeling methods for successful operation of the upper body wheeled humanoid robot during real-time operations. The majority of path planning algorithms is facing problems in avoiding dynamic obstacles during real-time operations. Hence, a multi-fusion approach using a hybrid algorithm for avoiding dynamic obstacles in real time is introduced.

The kinematic and dynamic modeling of a humanoid robot with mobile platform is done using screw theory approach and Newton–Euler formulations, respectively. Dynamic obstacle avoidance using a novel hybrid algorithm is carried out and implemented in real time. D star lite and a geometric-based hybrid algorithms are combined to generate the optimized path for avoiding the dynamic obstacles. A weighting factor is added to the D star lite variant to optimize the basic version of D star lite algorithm. Lazy probabilistic road map (PRM) technique is used for creating nodes in configuration space. The dynamic obstacle avoidance is experimentally validated to achieve the optimum path.

The path obtained using the hybrid algorithm for avoiding dynamic obstacles is optimum. Path length, computational time, number of expanded nodes are analysed for determining the optimality of the path. The weighting function introduced along with the D star lite algorithm decreases computational time by decreasing the number of expanding nodes during path generation. Lazy evaluation technique followed in Lazy PRM algorithm reduces computational time for generating nodes and local paths.

Modeling of a tree-type humanoid robot along with the mobile platform is combinedly developed for the determination of the kinematic and dynamic equations. This paper also aims to develop a novel hybrid algorithm for avoiding collision with dynamic obstacles with minimal computational effort in real-time operations.

The purpose of this paper is to put forward a path planning method in complex environments containing dynamic obstacles, which improves the performance of the traditional A* algorithm, this method can plan the optimal path in a short running time.

To plan an optimal path in a complex environment with dynamic and static obstacles, a novel improved A* algorithm is proposed. First, obstacles are identified by GoogLeNet and classified into static obstacles and dynamic obstacles. Second, the ray tracing algorithm is used for static obstacle avoidance, and a dynamic obstacle avoidance waiting rule based on dilate principle is proposed. Third, the proposed improved A* algorithm includes adaptive step size adjustment, evaluation function improvement and path planning with quadratic B-spline smoothing. Finally, the proposed improved A* algorithm is simulated and validated in real-world environments, and it was compared with traditional A* and improved A* algorithms.

The experimental results show that the proposed improved A* algorithm is optimal and takes less execution time compared with traditional A* and improved A* algorithms in a complex dynamic environment.

This paper presents a waiting rule for dynamic obstacle avoidance based on dilate principle. In addition, the proposed improved A* algorithm includes adaptive step adjustment, evaluation function improvement and path smoothing operation with quadratic B-spline. The experimental results show that the proposed improved A* algorithm can get a shorter path length and less running time.

It is possible with classical path planning algorithms to plan a path in a static environment if the instant position of the vehicle is known and the target and obstacle positions are constant. In a dynamic case, these methods used for the static environment are insufficient. The purpose of this study is to find a new method that can provide a solution to the four-rotor unmanned aerial vehicle (UAV) path planning problem in static and dynamic environments.

As a solution to the problem within the scope of this study, there is a new hybrid method in which the global A* algorithm and local the VFH+ algorithm are combined.

The performance of the designed algorithm was tested in different environments using the Gazebo model of a real quadrotor and the robot operating system (ROS), which is the widely used platform for robotic applications. Navigation stacks developed for mobile robots on the ROS platform were also used for the UAV, and performance benchmarks were carried out. From the proposed hybrid algorithm, remarkable results were obtained in terms of both planning and implementation time compared to ROS navigation stacks.

This study proposes a new hybrid approach to the path planning problem for UAVs operating in both static and dynamic environments.

Wheeled mobile robots (WMR) are the most widely used robots. Avoiding obstacles in unstructured environments, especially dynamic obstacles such as pedestrians, is a serious challenge for WMR. This paper aims to present a hybrid obstacle avoidance method that combines an informed-rapidly exploring random tree* algorithm with a three-dimensional (3D)-object detection approach and model prediction controller (MPC) to conduct obstacle perception, collision-free path planning and obstacle avoidance for WMR in unstructured environments.

Given a reference orientation and speed, the hybrid method uses parametric ellipses to represent obstacle expansion boundaries based on the 3D target detection results, and a collision-free reference path is planned. Then, the authors build on a model predictive control for tracking the collision-free reference path by incorporating the distance between the robot and obstacles. The proposed framework is a mapless method for WMR.

The authors present experimental results with a mobile robot for obstacle avoidance in indoor environments crowded with obstacles, such as chairs and pedestrians. The results show that the proposed hybrid obstacle avoidance method can satisfy the application requirements of mobile robots in unstructured environments.

In this study, the parameter ellipse is used to represent the area occupied by the obstacle, which takes the velocity as the parameter. Therefore, the motion direction and position of dynamic obstacles can be considered in the planning stage, which enhances the success rate of obstacle avoidance. In addition, the distance between the obstacle and robot is increased in the MPC optimization function to ensure a safe distance between the robot and the obstacle.

Two and one half‐dimensional (2.5D) grid maps are useful for navigation in outdoor environment or on non‐flat surface. However, little attention has been given to how to find an optimal path in a 2.5D grid map. The purpose of this paper is to develop a path‐planning method in a 2.5D grid map, which aims to provide an efficient solution to robot path planning no matter whether the robot is equipped with the prior knowledge of the environment.

A 2.5D grid representation is proposed to model non‐flat surface for mobile robots. According to the graph extracted from the 2.5D grid map, an improved searching approach derived from A* algorithm is presented for the shortest path planning. With reasonable assumption, the approach is improved for the path planning in unknown environment.

It is confirmed by experiments that the proposed planning approach provide a solution to the problem of optimal path planning in 2.5 grid maps. Furthermore, the experiment results demonstrate that our 2.5D D* method leads to more efficient dynamic path planning for navigation in unknown environment.

This paper proposes a path‐planning approach in a 2.5D grid map which is used to represent a non‐flat surface. The approach is capable of efficient navigation no matter whether the global environmental information is available at the beginning of exploration.

In the running of multiple automated guided vehicles (AGVs) in warehouses, delay problems in motions happen unavoidably as there might exist some disabled components of robots, the instability of networks and the interference of people walking. Under this case, robots would not follow the designed paths and the coupled relationship between temporal and space domain for paths is broken. And there is no doubt that other robots are disturbed by the ones where delays happen. Finally, this brings about chaos or even breakdown of the whole system. Therefore, taking the delay disturbance into consideration in the path planning of multiple robots is an issue worthy of attention and research.

This paper proposes a prioritized path planning algorithm based on time windows to solve the delay problems of multiple AGVs. The architecture is a unity consisting of three components which are focused on scheduling AGVs under normal operations, delays of AGVs, and recovery of AGVs. In the components of scheduling AGVs under normal operations and recovery, this paper adopts a dynamic routing method based on time windows to ensure the coordination of multiple AGVs and efficient completion of tasks. In the component for scheduling AGVs under delays, a dynamical prioritized local path planning algorithm based on time windows is designed to solve delay problems. The introduced planning principle of time windows would enable the algorithm to plan new solutions of trajectories for multiple AGVs, which could lower the makespan. At the same time, the real-time performance is acceptable based on the planning principle which stipulates the parameters of local time windows to ensure that the computation of the designed algorithm would not be too large.

The simulation results demonstrate that the proposed algorithm is more efficient than the state-of-the-art method based on homotopy classes, which aims at solving the delay problems. What is more, it is validated that the proposed algorithm can achieve the acceptable real-time performance for the scheduling in warehousing applications.

By introducing the planning principle and generating delay space and local adjustable paths, the proposed algorithm in this paper can not only solve the delay problems in real time, but also lower the makespan compared with the previous method. The designed algorithm guarantees the scheduling of multiple AGVs with delay disturbance and enhances the robustness of the scheduling algorithm in multi-AGV system.

The goal of this research is to develop a dynamic step path planning algorithm based on the rapidly exploring random tree (RRT) algorithm that combines Q-learning with the Gaussian distribution of obstacles. A route for autonomous vehicles may be swiftly created using this algorithm.

The path planning issue is divided into three key steps by the authors. First, the tree expansion is sped up by the dynamic step size using a combination of Q-learning and the Gaussian distribution of obstacles. The invalid nodes are then removed from the initially created pathways using bidirectional pruning. B-splines are then employed to smooth the predicted pathways.

The algorithm is validated using simulations on straight and curved highways, respectively. The results show that the approach can provide a smooth, safe route that complies with vehicle motion laws.

An improved RRT algorithm based on Q-learning and obstacle Gaussian distribution (QGD-RRT) is proposed for the path planning of self-driving vehicles. Unlike previous methods, the authors use Q-learning to steer the tree's development direction. After that, the step size is dynamically altered following the density of the obstacle distribution to produce the initial path rapidly and cut down on planning time even further. In the aim to provide a smooth and secure path that complies with the vehicle kinematic and dynamical restrictions, the path is lastly optimized using an enhanced bidirectional pruning technique.

With the increasing demand for surveillance and smart transportation, drone technology has become the center of attraction for robotics researchers. This study aims to introduce a new path planning approach to drone navigation based on topology in an uncertain environment. The main objective of this study is to use the Ricci flow evolution equation of metric and curvature tensor over angular Riemannian metric, and manifold for achieving navigational goals such as path length optimization at the minimum required time, collision-free obstacle avoidance in static and dynamic environments and reaching to the static and dynamic goals. The proposed navigational controller performs linearly and nonlinearly both with reduced error-based objective function by Riemannian metric and scalar curvature, respectively.

Topology and manifolds application-based methodology establishes the resultant drone. The trajectory planning and its optimization are controlled by the system of evolution equation over Ricci flow entropy. The navigation follows the Riemannian metric-based optimal path with an angular trajectory in the range from 0° to 360°. The obstacle avoidance in static and dynamic environments is controlled by the metric tensor and curvature tensor, respectively. The in-house drone is developed and coded using C++. For comparison of the real-time results and simulation results in static and dynamic environments, the simulation study has been conducted using MATLAB software. The proposed controller follows the topological programming constituted with manifold-based objective function and Riemannian metric, and scalar curvature-based constraints for linear and nonlinear navigation, respectively.

This proposed study demonstrates the possibility to develop the new topology-based efficient path planning approach for navigation of drone and provides a unique way to develop an innovative system having characteristics of static and dynamic obstacle avoidance and moving goal chasing in an uncertain environment. From the results obtained in the simulation and real-time environments, satisfactory agreements have been seen in terms of navigational parameters with the minimum error that justifies the significant working of the proposed controller. Additionally, the comparison of the proposed navigational controller with the other artificial intelligent controllers reveals performance improvement.

In this study, a new topological controller has been proposed for drone navigation. The topological drone navigation comprises the effective speed control and collision-free decisions corresponding to the Ricci flow equation and Ricci curvature over the Riemannian metric, respectively.

The purpose of this paper is to improve the D* algorithm which has been used usually in robotics for mobile robot navigation in unknown or dynamic environments.

First, the model of 2D workspace with some obstacles is expressed in regularity grids. The optimal path is planned by using the improved D* algorithm by searching in the neighbor grid cells in 16 directions. It makes the robot that the smallest turning angle drops to π/8. The robot moving angle discrete precision is raised and the unnecessary cost of path planning is reduced so the robot motion path is smoother. Then, the improved D* algorithm is simulated in MOBOTSIM software environment and is tested by the WiRobotX80 mobile robot.

To search in the neighbor grid cells in 16 directions instead of eight directions by using D* algorithms for path planning.

The map should be expressed in regularity grids.

The improved D* algorithm is effective and it can result in a higher quality path than the conventional D* algorithm at the same map environment.