Search results

Web users rely heavily on online content make decisions without assessing the veracity of the content. The online content comprising text, image, video or audio may be tampered with to influence public opinion. Since the consumers of online information (misinformation) tend to trust the content when the image(s) supplement the text, image manipulation software is increasingly being used to forge the images. To address the crucial problem of image manipulation, this study focusses on developing a deep-learning-based image forgery detection framework.

The proposed deep-learning-based framework aims to detect images forged using copy-move and splicing techniques. The image transformation technique aids the identification of relevant features for the network to train effectively. After that, the pre-trained customized convolutional neural network is used to train on the public benchmark datasets, and the performance is evaluated on the test dataset using various parameters.

The comparative analysis of image transformation techniques and experiments conducted on benchmark datasets from a variety of socio-cultural domains establishes the effectiveness and viability of the proposed framework. These findings affirm the potential applicability of proposed framework in real-time image forgery detection.

This study bears implications for several important aspects of research on image forgery detection. First this research adds to recent discussion on feature extraction and learning for image forgery detection. While prior research on image forgery detection, hand-crafted the features, the proposed solution contributes to stream of literature that automatically learns the features and classify the images. Second, this research contributes to ongoing effort in curtailing the spread of misinformation using images. The extant literature on spread of misinformation has prominently focussed on textual data shared over social media platforms. The study addresses the call for greater emphasis on the development of robust image transformation techniques.

This study carries important practical implications for various domains such as forensic sciences, media and journalism where image data is increasingly being used to make inferences. The integration of image forgery detection tools can be helpful in determining the credibility of the article or post before it is shared over the Internet. The content shared over the Internet by the users has become an important component of news reporting. The framework proposed in this paper can be further extended and trained on more annotated real-world data so as to function as a tool for fact-checkers.

In the current scenario wherein most of the image forgery detection studies attempt to assess whether the image is real or forged in an offline mode, it is crucial to identify any trending or potential forged image as early as possible. By learning from historical data, the proposed framework can aid in early prediction of forged images to detect the newly emerging forged images even before they occur. In summary, the proposed framework has a potential to mitigate physical spreading and psychological impact of forged images on social media.

This study focusses on copy-move and splicing techniques while integrating transfer learning concepts to classify forged images with high accuracy. The synergistic use of hitherto little explored image transformation techniques and customized convolutional neural network helps design a robust image forgery detection framework. Experiments and findings establish that the proposed framework accurately classifies forged images, thus mitigating the negative socio-cultural spread of misinformation.

This paper aims to implement and extend the You Only Live Once (YOLO) algorithm for detection of objects and activities. The advantage of YOLO is that it only runs a neural network once to detect the objects in an image, which is why it is powerful and fast. Cameras are found at many different crossroads and locations, but video processing of the feed through an object detection algorithm allows determining and tracking what is captured. Video Surveillance has many applications such as Car Tracking and tracking of people related to crime prevention. This paper provides exhaustive comparison between the existing methods and proposed method. Proposed method is found to have highest object detection accuracy.

The goal of this research is to develop a deep learning framework to automate the task of analyzing video footage through object detection in images. This framework processes video feed or image frames from CCTV, webcam or a DroidCam, which allows the camera in a mobile phone to be used as a webcam for a laptop. The object detection algorithm, with its model trained on a large data set of images, is able to load in each image given as an input, process the image and determine the categories of the matching objects that it finds. As a proof of concept, this research demonstrates the algorithm on images of several different objects. This research implements and extends the YOLO algorithm for detection of objects and activities. The advantage of YOLO is that it only runs a neural network once to detect the objects in an image, which is why it is powerful and fast. Cameras are found at many different crossroads and locations, but video processing of the feed through an object detection algorithm allows determining and tracking what is captured. For video surveillance of traffic cameras, this has many applications, such as car tracking and person tracking for crime prevention. In this research, the implemented algorithm with the proposed methodology is compared against several different prior existing methods in literature. The proposed method was found to have the highest object detection accuracy for object detection and activity recognition, better than other existing methods.

The results indicate that the proposed deep learning–based model can be implemented in real-time for object detection and activity recognition. The added features of car crash detection, fall detection and social distancing detection can be used to implement a real-time video surveillance system that can help save lives and protect people. Such a real-time video surveillance system could be installed at street and traffic cameras and in CCTV systems. When this system would detect a car crash or a fatal human or pedestrian fall with injury, it can be programmed to send automatic messages to the nearest local police, emergency and fire stations. When this system would detect a social distancing violation, it can be programmed to inform the local authorities or sound an alarm with a warning message to alert the public to maintain their distance and avoid spreading their aerosol particles that may cause the spread of viruses, including the COVID-19 virus.

This paper proposes an improved and augmented version of the YOLOv3 model that has been extended to perform activity recognition, such as car crash detection, human fall detection and social distancing detection. The proposed model is based on a deep learning convolutional neural network model used to detect objects in images. The model is trained using the widely used and publicly available Common Objects in Context data set. The proposed model, being an extension of YOLO, can be implemented for real-time object and activity recognition. The proposed model had higher accuracies for both large-scale and all-scale object detection. This proposed model also exceeded all the other previous methods that were compared in extending and augmenting the object detection to activity recognition. The proposed model resulted in the highest accuracy for car crash detection, fall detection and social distancing detection.

In the process of continuous casting and rolling of steel plate, due to the influence of rolling equipment and process, there are scratches, inclusions, patches, scabs and pitted surfaces on the surface of steel plate, which will not only affect the corrosion resistance, wear resistance and fatigue strength of steel plate but also may cause production accidents. Therefore, the detection of steel plate surface defect must be strengthened to ensure the production quality of steel plate and the smooth development of industrial construction.

(1) A steel plate surface defect detection technology based on small datasets is proposed, which can detect multiple surface defects and fill in the blank of scab defect detection. (2) A detection system based on intelligent recognition technology is built. The steel plate images are collected by the front-end monitoring device, then transmitted to the back-end monitoring center and processed by the embedded intelligent algorithms. (3) In order to reduce the impact of external light on the image, an improved Multi-Scale Retinex (MSR) enhancement algorithm based on adaptive weight calculation is proposed, which lays the foundation for subsequent object segmentation and feature extraction. (4) According to the different factors such as the cause and shape, the texture and shape features are combined to classify different defects on the steel plate surface. The defect classification model is constructed and the classification results are recorded and stored, which has certain application value in the field of steel plate surface defect detection. (5) The practicability and effectiveness of the proposed method are verified by comparison with other methods, and the field running tests are conducted based on the equipment commissioning field of China Heavy Machinery Institute.

When applied to small dataset, the precision of the proposed method is 94.5% and the time is 23.7 ms. In order to compare with deep learning technology, after expanding the image dataset, the precision and detection time of this paper are 0.948 and 24.2 ms, respectively. The proposed method is superior to other traditional image processing and deep learning methods. And the field recognition precision is 91.7%.

In brief, the steel plate surface defect detection technology based on computer vision is effective, but the previous attempts and methods are not comprehensive and the accuracy and detection speed need to be improved. Therefore, a more practical and comprehensive technology is developed in this paper. The main contributions are as follows: (1) A steel plate surface defect detection technology based on small datasets is proposed, which can detect multiple surface defects and fill in the blank of scab defect detection. (2) A detection system based on intelligent recognition technology is built. The steel plate images are collected by the front-end monitoring device, then transmitted to the back-end monitoring center and processed by the embedded intelligent algorithms. (3) In order to reduce the impact of external light on the image, an improved MSR enhancement algorithm based on adaptive weight calculation is proposed, which lays the foundation for subsequent object segmentation and feature extraction. (4) According to the different factors such as the cause and shape, the texture and shape features are combined to classify different defects on the steel plate surface. The defect classification model is constructed and the classification results are recorded and stored, which has certain application value in the field of steel plate surface defect detection. (5) The practicability and effectiveness of the proposed method are verified by comparison with other methods, and the field running tests are conducted based on the equipment commissioning field of China Heavy Machinery Institute.

Data quality and data resolution are essential for computer vision tasks like medical image processing, object detection, pattern recognition and so on. Super-resolution is a way to increase the image resolution, and super-resolved images contain more information compared to their low-resolution counterparts. The purpose of this study is analyzing the effects of the super resolution models trained before on object detection for aerial images.

Two different models were trained using the Super-Resolution Generative Adversarial Network (SRGAN) architecture on two aerial image data sets, the xView and the Dataset for Object deTection in Aerial images (DOTA). This study uses these models to increase the resolution of aerial images for improving object detection performance. This study analyzes the effects of the model with the best perceptual index (PI) and the model with the best RMSE on object detection in detail.

Super-resolution increases the object detection quality as expected. But, the super-resolution model with better perceptual quality achieves lower mean average precision results compared to the model with better RMSE. It means that the model with a better PI is more meaningful to human perception but less meaningful to computer vision.

The contributions of the authors to the literature are threefold. First, they do a wide analysis of SRGAN results for aerial image super-resolution on the task of object detection. Second, they compare super-resolution models with best PI and best RMSE to showcase the differences on object detection performance as a downstream task first time in the literature. Finally, they use a transfer learning approach for super-resolution to improve the performance of object detection.

This study aims to solve the problems of ambiguous localization, large calculation, poor real-time and limited applicability of bolt thread defect detection.

First, the acquired ultrasound image is used to acquire the larger area of the image, which is set as the compliant threaded area. Second, based on the determined coordinates of the center point in each selected region, the set of coordinates on the left and right sides of the bolts is acquired by DBSCAN method with parameters eps and MinPts, which is determined by data set dimension D and the k-distance curve. Finally, the defect detection boundary line fitting is completed using the acquired coordinate set, and the relationship between the distance from each detection point to the curve and d, which is obtained from the measurement of the standard bolt sample with known thread defect, is used to locate the bolt thread defect simultaneously.

In this paper, the bolt thread defect detection method with ultrasonic image is proposed; meanwhile, the ultrasonic image acquisition system is designed to complete the real-time localization of bolt thread defects.

The detection results show that the method can effectively detect bolt thread defects and locate the bolt thread defect location with wide applicability, small calculation and good real-time performance.

Lubricating oil leakage is a common issue in thermal power plant operation sites, requiring prompt equipment maintenance. The real-time detection of leakage occurrences could avoid disruptive consequences caused by the lack of timely maintenance. Currently, inspection operations are mostly carried out manually, resulting in time-consuming processes prone to health and safety hazards. To overcome such issues, this paper proposes a machine vision-based inspection system aimed at automating the oil leakage detection for improving the maintenance procedures.

The approach aims at developing a novel modular-structured automatic inspection system. The image acquisition module collects digital images along a predefined inspection path using a dual-light (i.e. ultraviolet and blue light) illumination system, deploying the fluorescence of the lubricating oil while suppressing unwanted background noise. The image processing module is designed to detect the oil leakage within the digital images minimizing detection errors. A case study is reported to validate the industrial suitability of the proposed inspection system.

On-site experimental results demonstrate the capabilities to complete the automatic inspection procedures of the tested industrial equipment by achieving an oil leakage detection accuracy up to 99.13%.

The proposed inspection system can be adopted in industrial context to detect lubricant leakage ensuring the equipment and the operators safety.

The proposed inspection system adopts a computer vision approach, which deploys the combination of two separate sources of light, to boost the detection capabilities, enabling the application for a variety of particularly hard-to-inspect industrial contexts.

Fire smoke detection in petrochemical plant can prevent fire and ensure production safety and life safety. The purpose of this paper is to solve the problem of missed detection and false detection in flame smoke detection under complex factory background.

This paper presents a flame smoke detection algorithm based on YOLOv5. The target regression loss function (CIoU) is used to improve the missed detection and false detection in target detection and improve the model detection performance. The improved activation function avoids gradient disappearance to maintain high real-time performance of the algorithm. Data enhancement technology is used to enhance the ability of the network to extract features and improve the accuracy of the model for small target detection.

Based on the actual situation of flame smoke, the loss function and activation function of YOLOv5 model are improved. Based on the improved YOLOv5 model, a flame smoke detection algorithm with generalization performance is established. The improved model is compared with SSD and YOLOv4-tiny. The accuracy of the improved YOLOv5 model can reach 99.5%, which achieves a more accurate detection effect on flame smoke. The improved network model is superior to the existing methods in running time and accuracy.

Aiming at the actual particularity of flame smoke detection, an improved flame smoke detection network model based on YOLOv5 is established. The purpose of optimizing the model is achieved by improving the loss function, and the activation function with stronger nonlinear ability is combined to avoid over-fitting of the network. This method is helpful to improve the problems of missed detection and false detection in flame smoke detection and can be further extended to pedestrian target detection and vehicle running recognition.

We propose in this paper a novel reliable detection method to recognize forged inpainting images. Detecting potential forgeries and authenticating the content of digital images is extremely challenging and important for many applications. The proposed approach involves developing new probabilistic support vector machines (SVMs) kernels from a flexible generative statistical model named “bounded generalized Gaussian mixture model”. The developed learning framework has the advantage to combine properly the benefits of both discriminative and generative models and to include prior knowledge about the nature of data. It can effectively recognize if an image is a tampered one and also to identify both forged and authentic images. The obtained results confirmed that the developed framework has good performance under numerous inpainted images.

The purpose of this paper is to present a deep ensemble neural network model for the detection of forest fires in aerial vehicle videos.

Presented deep ensemble models include four convolutional neural networks (CNNs): a faster region-based CNN (Faster R-CNN), a simple one-stage object detector (RetinaNet) and two different versions of the you only look once (Yolo) models. The presented method generates its output by fusing the outputs of these different deep learning (DL) models.

The presented fusing approach significantly improves the detection accuracy of fire incidents in the input data.

The computational complexity of the proposed method which is based on combining four different DL models is relatively higher than that of using each of these models individually. On the other hand, however, the performance of the proposed approach is considerably higher than that of any of the four DL models.

The simulation results show that using an ensemble model is quite useful for the precise detection of forest fires in real time through aerial vehicle videos or images.

By this method, forest fires can be detected more efficiently and precisely. Because forests are crucial breathing resources of the earth and a shelter for many living creatures, the social impact of the method can be considered to be very high.

This study fuses the outputs of different DL models into an ensemble model. Hence, the ensemble model provides more potent and beneficial results than any of the single models.

This paper aims to detect the printing failures (such as warpage and collapse) in material extrusion (MEX) process effectively and timely to reduce the waste of printing time, energy and material.

The approach is designed based on the frequently observed fact that printing failures are accompanied by abnormal material phenomena occurring close to the nozzle. To effectively and timely capture the phenomena near the nozzle, a camera is delicately installed on a typical MEX printer. Then, aided by the captured phenomena (images), a smart printing failure predictor is built based on the artificial neural network (ANN). Finally, based on the predictor, the printing failures, as well as their types, can be effectively detected from the images captured by the camera in real-time.

Experiments show that printing failures can be detected timely with an accuracy of more than 98% on average. Comparisons in methodology demonstrate that this approach has advantages in real-time printing failure detection in MEX.

A novel real-time approach for failure detection is proposed based on ANN. The following characteristics make the approach have a great potential to be implemented easily and widely: (1) the scheme designed to capture the phenomena near the nozzle is simple, low-cost, and effective; and (2) the predictor can be conveniently extended to detect more types of failures by using more abnormal material phenomena that are occurring close to the nozzle.