Search results

This paper aims to study six degrees-of-freedom (6DOF) pose measurement of reflective metal casts by machine vision, analyze the problems existing in the positioning of metal casts by stereo vision sensor in unstructured environment and put forward the visual positioning and grasping strategy that can be used in industrial robot cell.

A multikeypoints detection network Binocular Attention Hourglass Net is constructed, which can complete the two-dimensional positioning of the left and right cameras of the stereo vision system at the same time and provide reconstruction information for three-dimensional pose measurement. Generate adversarial networks is introduced to enhance the image of local feature area of object surface, and the three-dimensional pose measurement of object is completed by combining RANSAC ellipse fitting algorithm and triangulation method.

The proposed method realizes the high-precision 6DOF positioning and grasping of reflective metal casts by industrial robots; it has been applied in many fields and solves the problem of difficult visual measurement of reflective casts. The experimental results show that the system exhibits superior recognition performance, which meets the requirements of the grasping task.

Because of the chosen research approach, the research results may lack generalizability. The proposed method is more suitable for objects with plane positioning features.

This paper realizes the 6DOF pose measurement of reflective casts by vision system, and solves the problem of positioning and grasping such objects by industrial robot.

The control of weld penetration in gas tungsten arc welding (GTAW) is required for a “teach and playback” robot to overcome the gap variation in the welding process. This paper aims to investigate this subject.

This paper presents a robotic system based on the real‐time vision measurement. The primary objective has been to demonstrate the feasibility of using vision‐based image processing to measure the seam gap in real‐time and adjust welding current and wire‐feed rate to realize the penetration control during the robot‐welding process.

The paper finds that vision‐based measurement of the seam gap can be used in the welding robot, in real‐time, to control weld penetration. It helps the “teach and playback” robot to adjust the welding procedures according to the gap variation.

The system requires that the seam edges can be accurately identified using a correlation method.

The system is applicable to storage tank welding of a rocket.

The control algorithm based on the knowledge base has been set up for continuous GTAW. A novel visual image analysis method has been developed in the study for a welding robot.

This paper aims to develop a method to achieve automatic robotic welding and seam tracking so that three‐dimensional weld seam could be tracked without teaching and good welding formation could be accomplished.

Adaptive image processing method was used for various types of weld seam. Also the relationship between welding height and arc signal was calibrated. Through the decomposition and synthesis, three‐dimensional space type weld seam could be extracted and tracked well. The workpiece without teaching was finally tracked precisely and in a timely way with use of the fuzzy controller.

Composite sensing technology including arc and visual sensing had obvious advantages. Image processing method could be used for tracking plane weld seam efficiently while arc sensing could characterize welding height. Through the coupled controlling algorithm, arc sensing and visual sensing could be fused effectively.

How to couple information more accurately and quickly was still one of the most important problems in composite sensing technology.

Composite sensing technology could reduce costs to achieve weld seam instead such expensive device as laser sensor. The simulating parts of scalloped segment of bottom board for rockets were tracked in the project. Once more adaptive algorithms were developed, more complicated practical workpieces could be dealt with in robotic welding which promotes the application of industry robots.

A useful method for three‐dimensional space type weld seam tracking without teaching was developed. The whole procedure of adaptive image processing method was simple but efficient and robust. The coupled controlling strategy addressed could accomplish seam tracking by composite sensing technology.

The traditional vision system cannot automatically adjust the feature point extraction method according to the type of welding seam. In addition, the robot cannot self-correct the laying position error or machining error. To solve this problem, this paper aims to propose a hierarchical visual model to achieve automatic arc welding guidance.

The hierarchical visual model proposed in this paper is divided into two layers: welding seam classification layer and feature point extraction layer. In the welding seam classification layer, the SegNet network model is trained to identify the welding seam type, and the prediction mask is obtained to segment the corresponding point clouds. In the feature point extraction layer, the scanning path is determined by the point cloud obtained from the upper layer to correct laying position error. The feature points extraction method is automatically determined to correct machining error based on the type of welding seam. Furthermore, the corresponding specific method to extract the feature points for each type of welding seam is proposed. The proposed visual model is experimentally validated, and the feature points extraction results as well as seam tracking error are finally analyzed.

The experimental results show that the algorithm can well accomplish welding seam classification, feature points extraction and seam tracking with high precision. The prediction mask accuracy is above 90% for three types of welding seam. The proposed feature points extraction method for each type of welding seam can achieve sub-pixel feature extraction. For the three types of welding seam, the maximum seam tracking error is 0.33–0.41 mm, and the average seam tracking error is 0.11–0.22 mm.

The main innovation of this paper is that a hierarchical visual model for robotic arc welding is proposed, which is suitable for various types of welding seam. The proposed visual model well achieves welding seam classification, feature point extraction and error correction, which improves the automation level of robot welding.

The purpose of this paper is to offer an introduction to the technological advances of the complementary metal–oxide–semiconductor (CMOS) image sensors along the past decades. The authors review some of those technological advances and examine potential disruptive growth directions for CMOS image sensors and proposed ways to achieve them.

Those advances include breakthroughs on image quality such as resolution, capture speed, light sensitivity and color detection and advances on the computational imaging.

The current trend is to push the innovation efforts even further, as the market requires even higher resolution, higher speed, lower power consumption and, mainly, lower cost sensors. Although CMOS image sensors are currently used in several different applications from consumer to defense to medical diagnosis, product differentiation is becoming both a requirement and a difficult goal for any image sensor manufacturer. The unique properties of CMOS process allow the integration of several signal processing techniques and are driving the impressive advancement of the computational imaging.

The authors offer a very comprehensive review of methods, techniques, designs and fabrication of CMOS image sensors that have impacted or will impact the images sensor applications and markets.

The purpose of this paper is to describe work aimed to control the Al alloy welding penetration through the passive vision for welding robot.

First a passive vision system was established. The system can capture the Al alloy welding image. Based on the analysis of the characteristic of the welding image, the composite edge detectors were developed to recognize the shape of the weld seam and the weld pool. To realize the automatic control of the Al alloy‐weld process, the relation between the welding parameter and the quality of the weld appearance was established through the random welding experiment. The wire feed was chosen with PID controller adjusting the wire feed rate according to the weld gap variation.

This paper finds that the passive vision system can be captured the clear weld seam and weld pool image simultaneously. the method of composite edge detectors can be effectively and accurately recognize the weld seam edges. The wire feed rate controller ensured the welding robot to adjust the wire feed rate according to the gap variation.

This system has been applied to the industrial welding robot production.

The weld seam and weld pool image can be simultaneously captured by the passive vision system. The composite edge detectors have been developed for the passive vision method. The controller has been set up for Al alloy welding process based on the neural network.

The purpose of this paper is to analyze the technology of capturing and processing weld images in real‐time, which is very important to the seam tracking and the weld quality control during the robotic gas tungsten arc welding (GTAW) process.

By analyzing some main parameters on the effect of image capturing, a passive vision sensor for welding robot was designed in order to capture clear and steady welding images. Based on the analysis of the characteristic of the welding images, a new improved Canny algorithm was proposed to detect the edges of seam and pool, and extract the seam and pool characteristic parameters. Finally, the image processing precision was verified by the random welding experiments.

It was found that the seam and pool images can be clearly acquired by using the passive vision system, and the welding image characteristic parameters were accurately extracted through processing. The experiment results show that the precision range of the image processing can be controlled about within ±0.169 mm, which can completely meet the requirement of real‐time seam tracking for welding robot.

This system will be applied to the industrial welding robot production during the GTAW process.

It is very important for the type of teaching‐playback robots with the passive vision that the real‐time images of seam and pool are acquired clearly and processed accurately during the robotic welding process, which helps determine follow‐up seam track and the control of welding quality.

This paper aims to solve the problem that the changing of groove size and assembly gap would affect the precision of the multi-pass path planning and the welding quality and realize the automatic welding of a thick plate.

First, a double-sided double arc welding (DSAW) system with a self-designed passive vision sensor was established, then the image of the groove was captured and the characteristic parameters of groove were extracted by image processing. According to the welding parameters and the extracted geometry size, multi-pass path planning was executed by the DSAW system.

A DSAW system with a self-designed passive vision sensor was established which can realize the welding thick plate by double-sided double arc by two robots. The clear welding image of the groove was acquired, and an available image processing algorithm was proposed to accurately extract the characteristic parameters of the groove. According to the welding parameters and the extracted geometry size, multi-pass path planning can be executed by the DSAW system automatically.

Gas metal arc welding is used for root welding and filler passes in DSAW. Multi-pass path planning for thick plate by Double-sided Double Arc Welding (DSAW) based on vision sensor was proposed.

Describes a study, which investigated the relationship between the transformational and transactional leadership behaviours of school principals in selected New South Wales state secondary schools with some teacher outcomes and aspects of school learning culture. Analysis suggested that there were two factors which were transformational, two factors which were transactional and one teacher outcome factor. Five school learning culture factors were identified. Furthermore, the transformational leadership behaviour (individual concern) was associated with the teacher outcomes – satisfaction, extra effort and perception of leader effectiveness. Contrary to what might be expected, transformational leadership behaviour (vision/inspiration) had a significant negative association with student learning culture. Significant interactions suggested that this relationship may be more complex than might be expected.

The purpose of this study is to establish a method for accurately extracting torch and seam features. This will improve the quality of narrow gap welding. An adaptive deflection correction system based on passive light vision sensors was designed using the Halcon software from MVtec Germany as a platform.

This paper proposes an adaptive correction system for welding guns and seams divided into image calibration and feature extraction. In the image calibration method, the field of view distortion because of the position of the camera is resolved using image calibration techniques. In the feature extraction method, clear features of the weld gun and weld seam are accurately extracted after processing using algorithms such as impact filtering, subpixel (XLD), Gaussian Laplacian and sense region for the weld gun and weld seam. The gun and weld seam centers are accurately fitted using least squares. After calculating the deviation values, the error values are monitored, and error correction is achieved by programmable logic controller (PLC) control. Finally, experimental verification and analysis of the tracking errors are carried out.

The results show that the system achieves great results in dealing with camera aberrations. Weld gun features can be effectively and accurately identified. The difference between a scratch and a weld is effectively distinguished. The system accurately detects the center features of the torch and weld and controls the correction error to within 0.3mm.

An adaptive correction system based on a passive light vision sensor is designed which corrects the field-of-view distortion caused by the camera’s position deviation. Differences in features between scratches and welds are distinguished, and image features are effectively extracted. The final system weld error is controlled to 0.3 mm.