Search results

The safety management of construction machines is of primary importance. Considering that traditional construction machine safety monitoring and evaluation methods cannot adapt to the complex construction environment, and the monitoring methods based on sensor equipment cost too much. This paper aims to introduce computer vision and deep learning technologies to propose the YOLOv5-FastPose (YFP) model to realize the pose estimation of construction machines by improving the AlphaPose human pose model.

This model introduced the object detection module YOLOv5m to improve the recognition accuracy for detecting construction machines. Meanwhile, to better capture the pose characteristics, the FastPose network optimized feature extraction was introduced into the Single-Machine Pose Estimation Module (SMPE) of AlphaPose. This study used Alberta Construction Image Dataset (ACID) and Construction Equipment Poses Dataset (CEPD) to establish the dataset of object detection and pose estimation of construction machines through data augmentation technology and Labelme image annotation software for training and testing the YFP model.

The experimental results show that the improved model YFP achieves an average normalization error (NE) of 12.94 × 10^–3, an average Percentage of Correct Keypoints (PCK) of 98.48% and an average Area Under the PCK Curve (AUC) of 37.50 × 10^–3. Compared with existing methods, this model has higher accuracy in the pose estimation of the construction machine.

This study extends and optimizes the human pose estimation model AlphaPose to make it suitable for construction machines, improving the performance of pose estimation for construction machines.

Limited geometric accuracy is one of the major challenges that hinder the wider application of additive manufacturing (AM). This paper aims to predict in-plane shape deviation for online inspection and compensation to prevent error accumulation and improve shape fidelity in AM.

A sequence-to-sequence model with an attention mechanism (Seq2Seq+Attention) is proposed and implemented to predict subsequent layers or the occluded toolpath deviations after the multiresolution alignment. A shape compensation plan can be performed for the large deviation predicted.

The proposed Seq2Seq+Attention model is able to provide consistent prediction accuracy. The compensation plan proposed based on the predicted deviation can significantly improve the printing fidelity for those layers detected with large deviations.

Based on the experiments conducted on the knee joint samples, the proposed method outperforms the other three machine learning methods for both subsequent layer and occluded toolpath deviation prediction.

This work fills a research gap for predicting in-plane deviation not only for subsequent layers but also for occluded paths due to the missing scanning measurements. It is also combined with the multiresolution alignment and change point detection to determine the necessity of a compensation plan with updated G-code.

To solve the obstacle detection problem in robot autonomous obstacle negotiation, this paper aims to propose an obstacle detection system based on elevation maps for three types of obstacles: positive obstacles, negative obstacles and trench obstacles.

The system framework includes mapping, ground segmentation, obstacle clustering and obstacle recognition. The positive obstacle detection is realized by calculating its minimum rectangle bounding boxes, which includes convex hull calculation, minimum area rectangle calculation and bounding box generation. The detection of negative obstacles and trench obstacles is implemented on the basis of information absence in the map, including obstacles discovery method and type confirmation method.

The obstacle detection system has been thoroughly tested in various environments. In the outdoor experiment, with an average speed of 22.2 ms, the system successfully detected obstacles with a 95% success rate, indicating the effectiveness of the detection algorithm. Moreover, the system’s error range for obstacle detection falls between 4% and 6.6%, meeting the necessary requirements for obstacle negotiation in the next stage.

This paper studies how to solve the obstacle detection problem when the robot obstacle negotiation.

The swivel construction method is a specially designed process used to build bridges that cross rivers, valleys, railroads and other obstacles. To carry out this construction method safely, real-time monitoring of the bridge rotation process is required to ensure a smooth swivel operation without collisions. However, the traditional means of monitoring using Electronic Total Station tools cannot realize real-time monitoring, and monitoring using motion sensors or GPS is cumbersome to use.

This study proposes a monitoring method based on a series of computer vision (CV) technologies, which can monitor the rotation angle, velocity and inclination angle of the swivel construction in real-time. First, three proposed CV algorithms was developed in a laboratory environment. The experimental tests were carried out on a bridge scale model to select the outperformed algorithms for rotation, velocity and inclination monitor, respectively, as the final monitoring method in proposed method. Then, the selected method was implemented to monitor an actual bridge during its swivel construction to verify the applicability.

In the laboratory study, the monitoring data measured with the selected monitoring algorithms was compared with those measured by an Electronic Total Station and the errors in terms of rotation angle, velocity and inclination angle, were 0.040%, 0.040%, and −0.454%, respectively, thus validating the accuracy of the proposed method. In the pilot actual application, the method was shown to be feasible in a real construction application.

In a well-controlled laboratory the optimal algorithms for bridge swivel construction are identified and in an actual project the proposed method is verified. The proposed CV method is complementary to the use of Electronic Total Station tools, motion sensors, and GPS for safety monitoring of swivel construction of bridges. It also contributes to being a possible approach without data-driven model training. Its principal advantages are that it both provides real-time monitoring and is easy to deploy in real construction applications.

This study aims to design and validate a theoretical model for capacitive imaging (CI) sensors that incorporates the interelectrode shielding and surrounding shielding electrodes. Through experimental verification, the effectiveness of the theoretical model in evaluating CI sensors equipped with shielding electrodes has been demonstrated.

The study begins by incorporating the interelectrode shielding and surrounding shielding electrodes of CI sensors into the theoretical model. A method for deriving the semianalytical model is proposed, using the renormalization group method and physical model. Based on random geometric parameters of CI sensors, capacitance values are calculated using both simulation models and theoretical models. Three different types of CI sensors with varying geometric parameters are designed and manufactured for experimental testing.

The study’s results indicate that the errors of the semianalytical model for the CI sensor are predominantly below 5%, with all errors falling below 10%. This suggests that the semianalytical model, derived using the renormalization group method, effectively evaluates CI sensors equipped with shielding electrodes. The experimental results demonstrate the efficacy of the theoretical model in accurately predicting the capacitance values of the CI sensors.

The theoretical model of CI sensors is described by incorporating the interelectrode shielding and surrounding shielding electrodes into the model. This comprehensive approach allows for a more accurate evaluation of the detecting capability of CI sensors, as well as optimization of their performance.

Presently, 6 Degree of Freedom (6DOF) visual pose measurement methods enjoy popularity in the industrial sector. However, challenges persist in accurately measuring the visual pose of blank and rough metal casts. Therefore, this paper introduces a 6DOF pose measurement method utilizing stereo vision, and aims to the 6DOF pose measurement of blank and rough metal casts.

This paper studies the 6DOF pose measurement of metal casts from three aspects: sample enhancement of industrial objects, optimization of detector and attention mechanism. Virtual reality technology is used for sample enhancement of metal casts, which solves the problem of large-scale sample sampling in industrial application. The method also includes a novel deep learning detector that uses multiple key points on the object surface as regression objects to detect industrial objects with rotation characteristics. By introducing a mixed paths attention module, the detection accuracy of the detector and the convergence speed of the training are improved.

The experimental results show that the proposed method has a better detection effect for metal casts with smaller size scaling and rotation characteristics.

A method for 6DOF pose measurement of industrial objects is proposed, which realizes the pose measurement and grasping of metal blanks and rough machined casts by industrial robots.

Lubricating oil leakage is a common issue in thermal power plant operation sites, requiring prompt equipment maintenance. The real-time detection of leakage occurrences could avoid disruptive consequences caused by the lack of timely maintenance. Currently, inspection operations are mostly carried out manually, resulting in time-consuming processes prone to health and safety hazards. To overcome such issues, this paper proposes a machine vision-based inspection system aimed at automating the oil leakage detection for improving the maintenance procedures.

The approach aims at developing a novel modular-structured automatic inspection system. The image acquisition module collects digital images along a predefined inspection path using a dual-light (i.e. ultraviolet and blue light) illumination system, deploying the fluorescence of the lubricating oil while suppressing unwanted background noise. The image processing module is designed to detect the oil leakage within the digital images minimizing detection errors. A case study is reported to validate the industrial suitability of the proposed inspection system.

On-site experimental results demonstrate the capabilities to complete the automatic inspection procedures of the tested industrial equipment by achieving an oil leakage detection accuracy up to 99.13%.

The proposed inspection system can be adopted in industrial context to detect lubricant leakage ensuring the equipment and the operators safety.

The proposed inspection system adopts a computer vision approach, which deploys the combination of two separate sources of light, to boost the detection capabilities, enabling the application for a variety of particularly hard-to-inspect industrial contexts.

This review provides an overview of recent advances in electrochemical sensors for analyte detection in saliva, highlighting their potential applications in diagnostics and health care. The purpose of this paper is to summarize the current state of the field, identify challenges and limitations and discuss future prospects for the development of saliva-based electrochemical sensors.

The paper reviews relevant literature and research articles to examine the latest developments in electrochemical sensing technologies for saliva analysis. It explores the use of various electrode materials, including carbon nanomaterial, metal nanoparticles and conducting polymers, as well as the integration of microfluidics, lab-on-a-chip (LOC) devices and wearable/implantable technologies. The design and fabrication methodologies used in these sensors are discussed, along with sample preparation techniques and biorecognition elements for enhancing sensor performance.

Electrochemical sensors for salivary analyte detection have demonstrated excellent potential for noninvasive, rapid and cost-effective diagnostics. Recent advancements have resulted in improved sensor selectivity, stability, sensitivity and compatibility with complex saliva samples. Integration with microfluidics and LOC technologies has shown promise in enhancing sensor efficiency and accuracy. In addition, wearable and implantable sensors enable continuous, real-time monitoring of salivary analytes, opening new avenues for personalized health care and disease management.

This review presents an up-to-date overview of electrochemical sensors for analyte detection in saliva, offering insights into their design, fabrication and performance. It highlights the originality and value of integrating electrochemical sensing with microfluidics, wearable/implantable technologies and point-of-care testing platforms. The review also identifies challenges and limitations, such as interference from other saliva components and the need for improved stability and reproducibility. Future prospects include the development of novel microfluidic devices, advanced materials and user-friendly diagnostic devices to unlock the full potential of saliva-based electrochemical sensing in clinical practice.

Time of flight (ToF) imaging is a promising emerging technology for the purposes of crop identification. This paper aim to presents localization system for identifying and localizing asparagus in the field based on point clouds from ToF imaging. Since the semantics are not included in the point cloud, it contains the geometric information of other objects such as stones and weeds other than asparagus spears. An approach is required for extracting the spear information so that a robotic system can be used for harvesting.

A real-time convolutional neural network (CNN)-based method is used for filtering the point cloud generated by a ToF camera, allowing subsequent processing methods to operate over smaller and more information-dense data sets, resulting in reduced processing time. The segmented point cloud can then be split into clusters of points representing each individual spear. Geometric filters are developed to eliminate the non-asparagus points in each cluster so that each spear can be modelled and localized. The spear information can then be used for harvesting decisions.

The localization system is integrated into a robotic harvesting prototype system. Several field trials have been conducted with satisfactory performance. The identification of a spear from the point cloud is the key to successful localization. Segmentation and clustering points into individual spears are two major failures for future improvements.

Most crop localizations in agricultural robotic applications using ToF imaging technology are implemented in a very controlled environment, such as a greenhouse. The target crop and the robotic system are stationary during the localization process. The novel proposed method for asparagus localization has been tested in outdoor farms and integrated with a robotic harvesting platform. Asparagus detection and localization are achieved in real time on a continuously moving robotic platform in a cluttered and unstructured environment.

This paper proposes a model for detecting unexpected examination scores based on past scores, current daily efforts and trend in the current score of individual students. The detection is performed soon after the current examination is completed, which helps take immediate action to improve the ability of students before the commencement of daily assessments during the next semester.

The scores of past examinations and current daily assessments are analyzed using a combination of an ANOVA, a principal component analysis and a multiple regression analysis. A case study is conducted using the assessment scores of secondary-level students of an international school in Japan.

The score for the current examination is predicted based on past scores, current daily efforts and trend in the current score. A lower control limit for detecting unexpected scores is derived based on the predicted score. The actual score, which is below the lower control limit, is recognized as an unexpected score. This case study verifies the effectiveness of the combinatorial usage of data in detecting unexpected scores.

Unlike previous studies that utilize attribute and background data to predict student scores, this study utilizes a combination of past examination scores, current daily efforts for related subjects and trend in the current score.