Search results

Presently, 6 Degree of Freedom (6DOF) visual pose measurement methods enjoy popularity in the industrial sector. However, challenges persist in accurately measuring the visual pose of blank and rough metal casts. Therefore, this paper introduces a 6DOF pose measurement method utilizing stereo vision, and aims to the 6DOF pose measurement of blank and rough metal casts.

This paper studies the 6DOF pose measurement of metal casts from three aspects: sample enhancement of industrial objects, optimization of detector and attention mechanism. Virtual reality technology is used for sample enhancement of metal casts, which solves the problem of large-scale sample sampling in industrial application. The method also includes a novel deep learning detector that uses multiple key points on the object surface as regression objects to detect industrial objects with rotation characteristics. By introducing a mixed paths attention module, the detection accuracy of the detector and the convergence speed of the training are improved.

The experimental results show that the proposed method has a better detection effect for metal casts with smaller size scaling and rotation characteristics.

A method for 6DOF pose measurement of industrial objects is proposed, which realizes the pose measurement and grasping of metal blanks and rough machined casts by industrial robots.

The purpose of this paper is to provide a comprehensive review of a non-contact full-field optical measurement technique known as digital image correlation (DIC).

The approach of this review paper is to introduce the research pertaining to DIC. It comprehensively covers crucial facets including its principles, historical development, core challenges, current research status and practical applications. Additionally, it delves into unresolved issues and outlines future research objectives.

The findings of this review encompass essential aspects of DIC, including core issues like the subpixel registration algorithm, camera calibration, measurement of surface deformation in 3D complex structures and applications in ultra-high-temperature settings. Additionally, the review presents the prevailing strategies for addressing these challenges, the most recent advancements in DIC applications across quasi-static, dynamic, ultra-high-temperature, large-scale and micro-scale engineering domains, along with key directions for future research endeavors.

This review holds a substantial value as it furnishes a comprehensive and in-depth introduction to DIC, while also spotlighting its prospective applications.

In this study, an indoor sensor information fusion positioning system of the quadrotor unmanned aerial vehicle (UAV) was investigated to solve the problem of unstable indoor flight positioning.

The presented system was built on Light Detection and Ranging (LiDAR), Inertial Measurement Unit (IMU) and LiDAR-Lite devices. Based on this, one can obtain the aircraft's current attitude and the position vector relative to the target and control the attitudes and positions of the UAV to reach the specified target positions. While building a UAV positioning model relative to the target for indoor positioning scenarios under limited Global Navigation Satellite Systems (GNSS), the system detects the environment through the NVIDIA Jetson TX2 (Transmit Data) peripheral sensor, obtains the current attitude and the position vector of the UAV, packs the data in the format and delivers it to the flight controller. Then the flight controller controls the UAV by calculating the posture to reach the specified target position.

The authors used two systems in the experiment. The first is the proposed UAV, and the other is the Vicon system, our reference system for comparison purposes. Vicon positioning error can be considered lower than 2 mm from low to high-speed experiments. After comparison, experimental results demonstrated that the system could fully meet the requirements (less than 50 mm) in real-time positioning of the indoor quadrotor UAV flight. It verifies the accuracy and robustness of the proposed method compared with that of Vicon and achieves the aim of a stable indoor flight preliminarily.

Vicon positioning error can be considered lower than 2 mm from low to high-speed experiments. After comparison, experimental results demonstrated that the system could fully meet the requirements (less than 50 mm) in real-time positioning of the indoor quadrotor UAV flight. It verifies the accuracy and robustness of the proposed method compared with that of Vicon and achieves the aim of a stable indoor flight preliminarily.

In the context of fixed-wing aircraft wing assembly, there is a need for a rapid and precise measurement technique to determine the center distance between two double-hole components. This paper aims to propose an optical-based spatial point distance measurement technique using the spatial triangulation method. The purpose of this paper is to design a specialized measurement system, specifically a spherically mounted retroreflector nest (SMR nest), equipped with two laser displacement sensors and a rotary encoder as the core to achieve accurate distance measurements between the double holes.

To develop an efficient and accurate measurement system, the paper uses a combination of laser displacement sensors and a rotary encoder within the SMR nest. The system is designed, implemented and tested to meet the requirements of precise distance measurement. Software and hardware components have been developed and integrated for validation.

The optical-based distance measurement system achieves high precision at 0.04 mm and repeatability at 0.02 mm within a range of 412.084 mm to 1,590.591 mm. These results validate its suitability for efficient assembly processes, eliminating repetitive errors in aircraft wing assembly.

This paper proposes an optical-based spatial point distance measurement technique, as well as a unique design of a SMR nest and the introduction of two novel calibration techniques, all of which are validated by the developed software and hardware platform.

The coupling process between the loading mechanism and the tank car mouth is a crucial step in the tank car loading process. The purpose of this paper is to design a method to accurately measure the pose of the tanker car.

The collected image is first subjected to a gray enhancement operation, and the black parts of the image are extracted using Otsu’s threshold segmentation and morphological processing. The edge pixels are then filtered to remove outliers and noise, and the remaining effective points are used to fit the contour information of the tank car mouth. Using the successfully extracted contour information, the pose information of the tank car mouth in the camera coordinate system is obtained by establishing a binocular projection elliptical cone model, and the pixel position of the real circle center is obtained through the projection section. Finally, the binocular triangulation method is used to determine the position information of the tank car mouth in space.

Experimental results have shown that this method for measuring the position and orientation of the tank car mouth is highly accurate and can meet the requirements for industrial loading accuracy.

A method for extracting the contours of various types of complex tanker mouth is proposed. This method can accurately extract the contour of the tanker mouth when the contour is occluded or disturbed. Based on the binocular elliptic conical model and perspective projection theory, an innovative method for measuring the pose of the tanker mouth is proposed, and according to the space characteristics of the tanker mouth itself, the ambiguity of understanding is removed. This provides a new idea for the automatic loading of ash tank cars.

In order to encourage customers to try experience virtual tourism, researchers and practitioners pay more attention on how to improve customers' perception of authenticity.

Using the theory of cross-sensory compensation, through 4 experiments, this study examines the impact of social interaction and cross-sensory strategies on the relationship between virtual reality (VR) and improving customers' perception of authenticity and customer experience.

Through experimental research, this paper finds that (1) VR immersion has a significant positive impact on perception of authenticity, which in turn acts on customers' virtual tourism experience. (2) In addition, social interaction strengthens the relationship between VR immersion and customers' perception of authenticity. (3) The cross-sensory compensation has a positive effect on VR immersion to enhance customers' perception of authenticity.

The research conclusion provides a direction for further discussion on how to improve customers' perception of authenticity and provides theoretical guidance and reference for the virtual tourism industry.

Construction progress monitoring (CPM) is considered a difficult and tedious task in construction projects, which focuses on identifying discrepancies between the as-built product and the as-planned design. Computer vision (CV) technology is applied to automate the CPM process. However, the synergy between the CV and CPM in literature and industry practice is lacking. This study aims to fulfil this research gap.

A Delphi qualitative approach was used in this study by conducting two interview rounds. The collected data was analysed using manual content analysis.

This study identified seven stages of CPM; data acquisition, information retrieval, verification, progress estimation and comparison, visualisation of the results and schedule updating. Factors such as higher accuracy in data, less labourious process, efficiency and near real-time access are some of the significant enablers in instigating CV for CPM. Major challenges identified were occlusions and lighting issues in the site images and lack of support from the management. The challenges can be easily overcome by implementing suitable strategies such as familiarisation of the workforce with CV technology and application of CV research for the construction industry to grow with the technology in line with other industries.

This study addresses the gap pertaining to the synergy between the CV in CPM literature and the industry practice. This research contributes by enabling the construction personnel to identify the shortcomings and the opportunities to apply automated technologies concerning each stage in the progress monitoring process.

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.