Search results

The first step toward developing an automated construction workers performance monitoring system is to initially establish a complete and competent activity recognition solution, which is still lacking. This study aims to propose a novel approach of using labor physiological data collected through wearable sensors as means of remote and automatic activity recognition.

A pilot study is conducted against three pre-fabrication stone construction workers throughout three full working shifts to test the ability of automatically recognizing the type of activities they perform in-site through their lively measured physiological signals (i.e. blood volume pulse, respiration rate, heart rate, galvanic skin response and skin temperature). The physiological data are broadcasted from wearable sensors to a tablet application developed for this particular purpose, and are therefore used to train and assess the performance of various machine-learning classifiers.

A promising result of up to 88% accuracy level for activity recognition was achieved by using an artificial neural network classifier. Nonetheless, special care needs to be taken for some activities that evoke similar physiological patterns. It is expected that blending this method with other currently developed camera-based or kinetic-based methods would yield higher activity recognition accuracy levels.

The proposed method complements previously proposed labor tracking methods that focused on monitoring labor trajectories and postures, by using additional rich source of information from labors physiology, for real-time and remote activity recognition. Ultimately, this paves for an automated and comprehensive solution with which construction managers could monitor, control and collect rich real-time data about workers performance remotely.

The paper aims to solve the problem of personnel intrusion identification within the limits of high-speed railways. It adopts the fusion method of millimeter wave radar and camera to improve the accuracy of object recognition in dark and harsh weather conditions.

This paper adopts the fusion strategy of radar and camera linkage to achieve focus amplification of long-distance targets and solves the problem of low illumination by laser light filling of the focus point. In order to improve the recognition effect, this paper adopts the YOLOv8 algorithm for multi-scale target recognition. In addition, for the image distortion caused by bad weather, this paper proposes a linkage and tracking fusion strategy to output the correct alarm results.

Simulated intrusion tests show that the proposed method can effectively detect human intrusion within 0–200 m during the day and night in sunny weather and can achieve more than 80% recognition accuracy for extreme severe weather conditions.

(1) The authors propose a personnel intrusion monitoring scheme based on the fusion of millimeter wave radar and camera, achieving all-weather intrusion monitoring; (2) The authors propose a new multi-level fusion algorithm based on linkage and tracking to achieve intrusion target monitoring under adverse weather conditions; (3) The authors have conducted a large number of innovative simulation experiments to verify the effectiveness of the method proposed in this article.

The future construction site will be pervasive, context aware and embedded with intelligence. The purpose of this paper is to explore and define the concept of the digital skin of the future smart construction site.

The paper provides a systematic and hierarchical classification of 114 articles from both industry and academia on the digital skin concept and evaluates them. The hierarchical classification is based on application areas relevant to construction, such as augmented reality, building information model-based visualisation, labour tracking, supply chain tracking, safety management, mobile equipment tracking and schedule and progress monitoring. Evaluations of the research papers were conducted based on three pillars: validation of technological feasibility, onsite application and user acceptance testing.

Technologies learned about in the literature review enabled the envisaging of the pervasive construction site of the future. The paper presents scenarios for the future context-aware construction site, including the construction worker, construction procurement management and future real-time safety management systems.

Based on the gaps identified by the review in the body of knowledge and on a broader analysis of technology diffusion, the paper highlights the research challenges to be overcome in the advent of digital skin. The paper recommends that researchers follow a coherent process for smart technology design, development and implementation in order to achieve this vision for the construction industry.

The purpose of this paper is to investigate the feasibility of an end-to-end simplified and automated reconstruction pipeline for digital building assets using the design science research approach. Current methods to create digital assets by capturing the state of existing buildings can provide high accuracy but are time-consuming, expensive and difficult.

Using design science research, this research identifies the need for a crowdsourced and cloud-based approach to reconstruct digital building assets. The research then develops and tests a fully functional smartphone application prototype. The proposed end-to-end smartphone workflow begins with data capture and ends with user applications.

The resulting implementation can achieve a realistic three-dimensional (3D) model characterized by different typologies, minimal trade-off in accuracy and low processing costs. By crowdsourcing the images, the proposed approach can reduce costs for asset reconstruction by an estimated 93% compared to manual modeling and 80% compared to locally processed reconstruction algorithms.

The resulting implementation achieves “good enough” reconstruction of as-is 3D models with minimal tradeoffs in accuracy compared to automated approaches and 15× cost savings compared to a manual approach. Potential facility management use cases include the issue and information tracking, 3D mark-up and multi-model configurators.

Through user engagement, development, testing and validation, this work demonstrates the feasibility and impact of a novel crowdsourced and cloud-based approach for the reconstruction of digital building assets.

The purpose of this paper is to propose a robotic system for percutaneous surgery. The key component in the system, a robotic arm that can manipulate a puncture needle is presented. The mechanical design, the motion control and the force control method of the robotic arm are discussed in the paper.

The arm with an arc mechanism placed on a 3D Cartesian stage is developed as a puncture needle manipulator to locate the position of the needle tip, tune the needle’s posture and actuate the puncture motion under the visual guidance of two orthogonal X-ray images of a patient by a surgeon. A focusing method by using two laser spots is proposed to automatically move the needle tip to a surgery entry point on the skin. A dynamics model is developed to control the position of the needle mechanism and an explicit force control strategy is utilized to perform the needle insertion.

With the surgical system, a surgeon can easily perform puncture operation by taking two orthogonal real-time X-ray images as a visual feedback and accurately navigating the needle insertion. The laser-guided focusing method is efficient in placement of the needle tip. The explicit force control strategy is proved to be effective for holding constant and stable puncture force in experiments.

The robotic arm has an advantage in easy redirection of the needle because the rotation and the translation are decoupled in the mechanism. By adopting simple laser pens and a well-developed kinematics model, the system can handle the entry point, locating task automatically. The focusing method and the force control method proposed in the paper are useful for the present system and could be intuitive for similar surgical robots.

Precise vehicle localization is a basic and critical technique for various intelligent transportation system (ITS) applications. It also needs to adapt to the complex road environments in real-time. The global positioning system and the strap-down inertial navigation system are two common techniques in the field of vehicle localization. However, the localization accuracy, reliability and real-time performance of these two techniques can not satisfy the requirement of some critical ITS applications such as collision avoiding, vision enhancement and automatic parking. Aiming at the problems above, this paper aims to propose a precise vehicle ego-localization method based on image matching.

This study included three steps, Step 1, extraction of feature points. After getting the image, the local features in the pavement images were extracted using an improved speeded up robust features algorithm. Step 2, eliminate mismatch points. Using a random sample consensus algorithm to eliminate mismatched points of road image and make match point pairs more robust. Step 3, matching of feature points and trajectory generation.

Through the matching and validation of the extracted local feature points, the relative translation and rotation offsets between two consecutive pavement images were calculated, eventually, the trajectory of the vehicle was generated.

The experimental results show that the studied algorithm has an accuracy at decimeter-level and it fully meets the demand of the lane-level positioning in some critical ITS applications.

Lubricating oil leakage is a common issue in thermal power plant operation sites, requiring prompt equipment maintenance. The real-time detection of leakage occurrences could avoid disruptive consequences caused by the lack of timely maintenance. Currently, inspection operations are mostly carried out manually, resulting in time-consuming processes prone to health and safety hazards. To overcome such issues, this paper proposes a machine vision-based inspection system aimed at automating the oil leakage detection for improving the maintenance procedures.

The approach aims at developing a novel modular-structured automatic inspection system. The image acquisition module collects digital images along a predefined inspection path using a dual-light (i.e. ultraviolet and blue light) illumination system, deploying the fluorescence of the lubricating oil while suppressing unwanted background noise. The image processing module is designed to detect the oil leakage within the digital images minimizing detection errors. A case study is reported to validate the industrial suitability of the proposed inspection system.

On-site experimental results demonstrate the capabilities to complete the automatic inspection procedures of the tested industrial equipment by achieving an oil leakage detection accuracy up to 99.13%.

The proposed inspection system can be adopted in industrial context to detect lubricant leakage ensuring the equipment and the operators safety.

The proposed inspection system adopts a computer vision approach, which deploys the combination of two separate sources of light, to boost the detection capabilities, enabling the application for a variety of particularly hard-to-inspect industrial contexts.

To support the standardized evaluation of bicyclist automatic emergency braking (AEB) systems, test scenarios, test procedures and test system hardware and software tools have been investigated and developed by the Transportation Active Safety Institute (TASI) at Indiana University-Purdue University Indianapolis. This paper aims to focus on the development of test scenarios and bicyclist surrogate for evaluating vehicle–bicyclist AEB systems.

The harmonized general estimates system (GES)/FARS 2010-2011 crash data and TASI 110-car naturalistic driving data (NDD) are used to determine the crash geometries and environmental factors of crash scenarios including lighting conditions, vehicle speeds, bicyclist speeds, etc. A surrogate bicyclist including a bicycle rider and a bicycle surrogate is designed to match the visual and radar characteristics of bicyclists in the USA. A bicycle target is designed with both leg pedaling and wheel rotation to produce proper micro-Doppler features and generate realistic motion for camera-based AEB systems.

Based on the analysis of the harmonized GES/FARS crash data, five crash scenarios are recommended for performance testing of bicyclist AEB systems. Combined with TASI 110-car naturalistic driving data, the crash environmental factors including lighting conditions, obscuring objects, vehicle speed and bicyclist speed are determined. The surrogate bicyclist was designed to represent the visual and radar characteristics of the real bicyclists in the USA. The height of the bicycle rider mannequin is 173 cm, representing the weighted height of 50th percentile US male and female adults. The size and shape of the surrogate bicycle were determined as 26-inch wheel and mountain/road bicycle frame, respectively. Both leg pedaling motion and wheel rotation are suggested to produce proper micro-Doppler features and support the camera-based AEB systems.

The results have demonstrated that the developed scenarios, test procedures and bicyclist surrogate will provide effective objective methods and necessary hardware and software tools for the evaluation and validation of bicyclist AEB systems. This is crucial for the development of advanced driver assistance systems.

This research aims to improve the performance of rail fastener defect inspection method for multi railways, to effectively ensure the safety of railway operation.

Firstly, a fastener region location method based on online learning strategy was proposed, which can locate fastener regions according to the prior knowledge of track image and template matching method. Online learning strategy is used to update the template library dynamically, so that the method not only can locate fastener regions in the track images of multi railways, but also can automatically collect and annotate fastener samples. Secondly, a fastener defect recognition method based on deep convolutional neural network was proposed. The structure of recognition network was designed according to the smaller size and the relatively single content of the fastener region. The data augmentation method based on the sample random sorting strategy is adopted to reduce the impact of the imbalance of sample size on recognition performance.

Test verification of the proposed method is conducted based on the rail fastener datasets of multi railways. Specifically, fastener location module has achieved an average detection rate of 99.36%, and fastener defect recognition module has achieved an average precision of 96.82%.

The proposed method can accurately locate fastener regions and identify fastener defect in the track images of different railways, which has high reliability and strong adaptability to multi railways.

This study aims to introduce a new methodology for generating synthetic images for facility management purposes. The method starts by leveraging the existing 3D open-source BIM models and using them inside a graphic engine to produce a photorealistic representation of indoor spaces enriched with facility-related objects. The virtual environment creates several images by changing lighting conditions, camera poses or material. Moreover, the created images are labeled and ready to be trained in the model.

This paper focuses on the challenges characterizing object detection models to enrich digital twins with facility management-related information. The automatic detection of small objects, such as sockets, power plugs, etc., requires big, labeled data sets that are costly and time-consuming to create. This study proposes a solution based on existing 3D BIM models to produce quick and automatically labeled synthetic images.

The paper presents a conceptual model for creating synthetic images to increase the performance in training object detection models for facility management. The results show that virtually generated images, rather than an alternative to real images, are a powerful tool for integrating existing data sets. In other words, while a base of real images is still needed, introducing synthetic images helps augment the model’s performance and robustness in covering different types of objects.

This study introduced the first pipeline for creating synthetic images for facility management. Moreover, this paper validates this pipeline by proposing a case study where the performance of object detection models trained on real data or a combination of real and synthetic images are compared.