Search results

This study aims to achieve superior localization and mapping performance in point cloud degradation scenarios through the effective removal of dynamic obstacles. With the continuous development of various technologies for autonomous vehicles, the LIDAR-based Simultaneous localization and mapping (SLAM) system is becoming increasingly important. However, in SLAM systems, effectively addressing the challenges of point cloud degradation scenarios is essential for accurate localization and mapping, with dynamic obstacle removal being a key component.

This paper proposes a method that combines adaptive feature extraction and loop closure detection algorithms to address this challenge. In the SLAM system, the ground point cloud and non-ground point cloud are separated to reduce the impact of noise. And based on the cylindrical projection image of the point cloud, the intensity features are adaptively extracted, the degradation direction is determined by the degradation factor and the intensity features are matched with the map to correct the degraded pose. Moreover, through the difference in raster distribution of the point clouds before and after two frames in the loop process, the dynamic point clouds are identified and removed, and the map is updated.

Experimental results show that the method has good performance. The absolute displacement accuracy of the laser odometer is improved by 27.1%, the relative displacement accuracy is improved by 33.5% and the relative angle accuracy is improved by 23.8% after using the adaptive intensity feature extraction method. The position error is reduced by 30% after removing the dynamic target.

Compared with LiDAR odometry and mapping algorithm, the method has greater robustness and accuracy in mapping and localization.

Time of flight (ToF) imaging is a promising emerging technology for the purposes of crop identification. This paper aim to presents localization system for identifying and localizing asparagus in the field based on point clouds from ToF imaging. Since the semantics are not included in the point cloud, it contains the geometric information of other objects such as stones and weeds other than asparagus spears. An approach is required for extracting the spear information so that a robotic system can be used for harvesting.

A real-time convolutional neural network (CNN)-based method is used for filtering the point cloud generated by a ToF camera, allowing subsequent processing methods to operate over smaller and more information-dense data sets, resulting in reduced processing time. The segmented point cloud can then be split into clusters of points representing each individual spear. Geometric filters are developed to eliminate the non-asparagus points in each cluster so that each spear can be modelled and localized. The spear information can then be used for harvesting decisions.

The localization system is integrated into a robotic harvesting prototype system. Several field trials have been conducted with satisfactory performance. The identification of a spear from the point cloud is the key to successful localization. Segmentation and clustering points into individual spears are two major failures for future improvements.

Most crop localizations in agricultural robotic applications using ToF imaging technology are implemented in a very controlled environment, such as a greenhouse. The target crop and the robotic system are stationary during the localization process. The novel proposed method for asparagus localization has been tested in outdoor farms and integrated with a robotic harvesting platform. Asparagus detection and localization are achieved in real time on a continuously moving robotic platform in a cluttered and unstructured environment.

This paper aims to propose a robust method for non-rigid point set registration, using the Gaussian mixture model and accommodating non-rigid transformations. The posterior probabilities of the mixture model are determined through the proposed integrated feature divergence.

The method involves an alternating two-step framework, comprising correspondence estimation and subsequent transformation updating. For correspondence estimation, integrated feature divergences including both global and local features, are coupled with deterministic annealing to address the non-convexity problem of registration. For transformation updating, the expectation-maximization iteration scheme is introduced to iteratively refine correspondence and transformation estimation until convergence.

The experiments confirm that the proposed registration approach exhibits remarkable robustness on deformation, noise, outliers and occlusion for both 2D and 3D point clouds. Furthermore, the proposed method outperforms existing analogous algorithms in terms of time complexity. Application of stabilizing and securing intermodal containers loaded on ships is performed. The results demonstrate that the proposed registration framework exhibits excellent adaptability for real-scan point clouds, and achieves comparatively superior alignments in a shorter time.

The integrated feature divergence, involving both global and local information of points, is proven to be an effective indicator for measuring the reliability of point correspondences. This inclusion prevents premature convergence, resulting in more robust registration results for our proposed method. Simultaneously, the total operating time is reduced due to a lower number of iterations.

For a better understanding of the preferences and differences of young consumers in emerging wine markets, this study aims to propose a clustering method to segment the super-new generation wine consumers based on their sensitivity to wine brand, origin and price and then conduct user profiles for segmented consumer groups from the perspectives of demographic attributes, eating habits and wine sensory attribute preferences.

We first proposed a consumer clustering perspective based on their sensitivity to wine brand, origin and price and then conducted an adaptive density peak and label propagation layer-by-layer (ADPLP) clustering algorithm to segment consumers, which improved the issues of wrong centers' selection and inaccurate classification of remaining sample points for traditional DPC (DPeak clustering algorithm). Then, we built a consumer profile system from the perspectives of demographic attributes, eating habits and wine sensory attribute preferences for segmented consumer groups.

In this study, 10 typical public datasets and 6 basic test algorithms are used to evaluate the proposed method, and the results showed that the ADPLP algorithm was optimal or suboptimal on 10 datasets with accuracy above 0.78. The average improvement in accuracy over the base DPC algorithm is 0.184. As an outcome of the wine consumer profiles, sensitive consumers prefer wines with medium prices of 100–400 CNY and more personalized brands and origins, while casual consumers are fond of popular brands, popular origins and low prices within 50 CNY. The wine sensory attributes preferred by super-new generation consumers are red, semi-dry, semi-sweet, still, fresh tasting, fruity, floral and low acid.

Young Chinese consumers are the main driver of wine consumption in the future. This paper provides a tool for decision-makers and marketers to identify the preferences of young consumers quickly which is meaningful and helpful for wine marketing.

In this study, the ADPLP algorithm was introduced for the first time. Subsequently, the user profile label system was constructed for segmented consumers to highlight their characteristics and demand partiality from three aspects: demographic characteristics, consumers' eating habits and consumers' preferences for wine attributes. Moreover, the ADPLP algorithm can be considered for user profiles on other alcoholic products.

To ensure the motion attitude and stable contact force of massage robot working on unknown human tissue environment, this study aims to propose a robotic system for autonomous massage path planning and stable interaction control.

First, back region extraction and acupoint recognition based on deep learning is proposed, which provides a basis for determining the working area and path points of the robot. Second, to realize the standard approach and movement trajectory of the expert massage, 3D reconstruction and path planning of the massage area are performed, and normal vectors are calculated to control the normal orientation of robot-end. Finally, to cope with the soft and hard changes of human tissue state and body movement, an adaptive force tracking control strategy is presented to compensate the uncertainty of environmental position and tissue hardness online.

Improved network model can accomplish the acupoint recognition task with a large accuracy and integrate the point cloud to generate massage trajectories adapted to the shape of the human body. Experimental results show that the adaptive force tracking control can obtain a relatively smooth force, and the error is basically within ± 0.2 N during the online experiment.

This paper incorporates deep learning, 3D reconstruction and impedance control, the robot can understand the shape features of the massage area and adapt its planning massage path to carry out a stable and safe force tracking control during dynamic robot–human contact.

Facility management gained profound importance due to the increasing complexity of different systems and the cost of operation and maintenance. However, due to the increasing complexity of different systems, facility managers may suffer from a lack of information. The purpose of this paper is to propose a new facility management approach that links segmented assets to the vital data required for managing facilities.

Automatic point cloud segmentation is one of the most crucial processes required for modelling building facilities. In this research, laser scanning is used for point cloud acquisition. The research utilises region growing algorithm, colour-based region-growing algorithm and Euclidean cluster algorithm.

A case study is worked out to test the accuracy of the considered point cloud segmentation algorithms utilising metrics precision, recall and F-score. The results indicate that Euclidean cluster extraction and region growing algorithm revealed high accuracy for segmentation.

The research presents a comparative approach for selecting the most appropriate segmentation approach required for accurate modelling. As such, the segmented assets can be linked easily with the data required for facility management.

Because of the advantages of high deposition efficiency and low manufacturing cost compared with other additive technologies, robotic wire arc additive manufacturing (WAAM) technology has been widely applied for fabricating medium- to large-scale metallic components. The additive manufacturing (AM) method is a relatively complex process, which involves the workpiece modeling, conversion of the model file, slicing, path planning and so on. Then the structure is formed by the accumulated weld bead. However, the poor forming accuracy of WAAM usually leads to severe dimensional deviation between the as-built and the predesigned structures. This paper aims to propose a visual sensing technology and deep learning–assisted WAAM method for fabricating metallic structure, to simplify the complex WAAM process and improve the forming accuracy.

Instead of slicing of the workpiece modeling and generating all the welding torch paths in advance of the fabricating process, this method is carried out by adding the feature point regression branch into the Yolov5 algorithm, to detect the feature point from the images of the as-built structure. The coordinates of the feature points of each deposition layer can be calculated automatically. Then the welding torch trajectory for the next deposition layer is generated based on the position of feature point.

The mean average precision score of modified YOLOv5 detector is 99.5%. Two types of overhanging structures have been fabricated by the proposed method. The center contour error between the actual and theoretical is 0.56 and 0.27 mm in width direction, and 0.43 and 0.23 mm in height direction, respectively.

The fabrication of circular overhanging structures without using the complicate slicing strategy, turning table or other extra support verified the possibility of the robotic WAAM system with deep learning technology.

When a process experiences an out-of-control condition, identification of the change point is capable of leading practitioners to an effective root cause analysis. The change point addresses the time when a special cause(s) manifests itself into the process. In the statistical process monitoring when the chart signals an out-of-control condition, the change point analysis is an important step for the root cause analysis of the process. This paper attempts to propose a model approaching the artificial neural network to identify the change point of a multistage process with cascade property in the case that the process is modeled properly by a simple linear profile.

In practice, many processes can be modeled by a functional relationship rather than a single random variable or a random vector. This approach of modeling is referred to as the profile in the statistical process control literature. In this paper, two models based on multilayer perceptron (MLP) and convolutional neural network (CNN) approaches are proposed for identifying the change point of the profile of a multistage process.

The capability of the proposed models are evaluated and compared using several numerical scenarios. The numerical analysis of the proposed neural networks indicates that the two proposed models are capable of identifying the change point in different scenarios effectively. The comparative sensitivity analysis shows that the capability of the proposed convolutional network is superior compared to MLP network.

To the best of the authors' knowledge, this is the first time that: (1) A model is proposed to identify the change point of the profile of a multistage process. (2) A convolutional neural network is modeled for identifying the change point of an out-of-control condition.

As laser scanning technology becomes readily available and affordable, there is an increasing demand of using point cloud data collected from a laser scanner to create as-built building information modeling (BIM) models for quality assessment, schedule control and energy performance within construction projects. To enhance the as-built modeling efficiency, this study explores an integrated system, called Auto-Scan-To-BIM (ASTB), with an aim to automatically generate a complete Industry Foundation Classes (IFC) model consisted of the 3D building elements for the given building based on its point cloud without requiring additional modeling tools.

ASTB has been developed with three function modules. Taking the scanned point data as input, Module 1 is built on the basis of the widely used region segmentation methodology and expanded with enhanced plane boundary line detection methods and corner recalibration algorithms. Then, Module 2 is developed with a domain knowledge-based heuristic method to analyze the features of the recognized planes, to associate them with corresponding building elements and to create BIM models. Based on the spatial relationships between these building elements, Module 3 generates a complete IFC model for the entire project compatible with any BIM software.

A case study validated the ASTB with an application with five common types of building elements (e.g. wall, floor, ceiling, window and door).

First, an integrated system, ASTB, is developed to generate a BIM model from scanned point cloud data without using additional modeling tools. Second, an enhanced plane boundary line detection method and a corner recalibration algorithm are developed in ASTB with high accuracy in obtaining the true surface planes. At last, the research contributes to develop a module, which can automatically convert the identified building elements into an IFC format based on the geometry and spatial relationships of each plan.

This study aims to propose an efficient dual-robot task collaboration strategy to address the issue of low work efficiency and inability to meet the production needs of a single robot during construction operations.

A hybrid task allocation method based on integer programming and auction algorithms, with the aim of achieving a balanced workload between two robots has been proposed. In addition, while ensuring reasonable workload allocation between the two robots, an improved dual ant colony algorithm was used to solve the dual traveling salesman problem, and the global path planning of the two robots was determined, resulting in an efficient and collision-free path for the dual robots to operate. Meanwhile, an improved fast Random tree rapidly-exploring random tree algorithm is introduced as a local obstacle avoidance strategy.

The proposed method combines randomization and iteration techniques to achieve an efficient task allocation strategy for two robots, ensuring the relative optimal global path of the two robots in cooperation and solving complex local obstacle avoidance problems.

This method is applied to the scene of steel bar tying in construction work, with the workload allocation and collaborative work between two robots as evaluation indicators. The experimental results show that this method can efficiently complete the steel bar banding operation, effectively reduce the interference between the two robots and minimize the interference of obstacles in the environment.