Search results

When a process experiences an out-of-control condition, identification of the change point is capable of leading practitioners to an effective root cause analysis. The change point addresses the time when a special cause(s) manifests itself into the process. In the statistical process monitoring when the chart signals an out-of-control condition, the change point analysis is an important step for the root cause analysis of the process. This paper attempts to propose a model approaching the artificial neural network to identify the change point of a multistage process with cascade property in the case that the process is modeled properly by a simple linear profile.

In practice, many processes can be modeled by a functional relationship rather than a single random variable or a random vector. This approach of modeling is referred to as the profile in the statistical process control literature. In this paper, two models based on multilayer perceptron (MLP) and convolutional neural network (CNN) approaches are proposed for identifying the change point of the profile of a multistage process.

The capability of the proposed models are evaluated and compared using several numerical scenarios. The numerical analysis of the proposed neural networks indicates that the two proposed models are capable of identifying the change point in different scenarios effectively. The comparative sensitivity analysis shows that the capability of the proposed convolutional network is superior compared to MLP network.

To the best of the authors' knowledge, this is the first time that: (1) A model is proposed to identify the change point of the profile of a multistage process. (2) A convolutional neural network is modeled for identifying the change point of an out-of-control condition.

Recently, the convolutional neural network (ConvNet) has a wide application in the classification of motor imagery EEG signals. However, the low signal-to-noise electroencephalogram (EEG) signals are collected under the interference of noises. However, the conventional ConvNet model cannot directly solve this problem. This study aims to discuss the aforementioned issues.

To solve this problem, this paper adopted a novel residual shrinkage block (RSB) to construct the ConvNet model (RSBConvNet). During the feature extraction from EEG signals, the proposed RSBConvNet prevented the noise component in EEG signals, and improved the classification accuracy of motor imagery. In the construction of RSBConvNet, the author applied the soft thresholding strategy to prevent the non-related motor imagery features in EEG signals. The soft thresholding was inserted into the residual block (RB), and the suitable threshold for the current EEG signals distribution can be learned by minimizing the loss function. Therefore, during the feature extraction of motor imagery, the proposed RSBConvNet de-noised the EEG signals and improved the discriminative of classification features.

Comparative experiments and ablation studies were done on two public benchmark datasets. Compared with conventional ConvNet models, the proposed RSBConvNet model has obvious improvements in motor imagery classification accuracy and Kappa coefficient. Ablation studies have also shown the de-noised abilities of the RSBConvNet model. Moreover, different parameters and computational methods of the RSBConvNet model have been tested on the classification of motor imagery.

Based on the experimental results, the RSBConvNet constructed in this paper has an excellent recognition accuracy of MI-BCI, which can be used for further applications for the online MI-BCI.

A community demonstrates the unique qualities and relationships between its members that distinguish it from other communities within a network. Network analysis relies heavily on community detection. Despite the traditional spectral clustering and statistical inference methods, deep learning techniques for community detection have grown in popularity due to their ease of processing high-dimensional network data. Graph convolutional neural networks (GCNNs) have received much attention recently and have developed into a potential and ubiquitous method for directly detecting communities on graphs. Inspired by the promising results of graph convolutional networks (GCNs) in analyzing graph structure data, a novel community graph convolutional network (CommunityGCN) as a semi-supervised node classification model has been proposed and compared with recent baseline methods graph attention network (GAT), GCN-based technique for unsupervised community detection and Markov random fields combined with graph convolutional network (MRFasGCN).

This work presents the method for identifying communities that combines the notion of node classification via message passing with the architecture of a semi-supervised graph neural network. Six benchmark datasets, namely, Cora, CiteSeer, ACM, Karate, IMDB and Facebook, have been used in the experimentation.

In the first set of experiments, the scaled normalized average matrix of all neighbor's features including the node itself was obtained, followed by obtaining the weighted average matrix of low-dimensional nodes. In the second set of experiments, the average weighted matrix was forwarded to the GCN with two layers and the activation function for predicting the node class was applied. The results demonstrate that node classification with GCN can improve the performance of identifying communities on graph datasets.

The experiment reveals that the CommunityGCN approach has given better results with accuracy, normalized mutual information, F1 and modularity scores of 91.26, 79.9, 92.58 and 70.5 per cent, respectively, for detecting communities in the graph network, which is much greater than the range of 55.7–87.07 per cent reported in previous literature. Thus, it has been concluded that the GCN with node classification models has improved the accuracy.

The energy efficiency of buildings has been emphasized along with the continual development in the building and construction sector that consumes a significant amount of energy. To this end, the purpose of this research paper is to forecast energy consumption to improve energy resource planning and management.

This study proposes the application of the convolutional neural network (CNN) for estimating the electricity consumption in the Grey Nuns building in Canada. The performance of the proposed model is compared against that of long short-term memory (LSTM) and multilayer perceptron (MLP) neural networks. The models are trained and tested using monthly electricity consumption records (i.e. from May 2009 to December 2021) available from Concordia’s facility department. Statistical measures (e.g. determination coefficient [R²], root mean squared error [RMSE], mean absolute error [MAE] and mean absolute percentage error [MAPE]) are used to evaluate the outcomes of models.

The results reveal that the CNN model outperforms the other model predictions for 6 and 12 months ahead. It enhances the performance metrics reported by the LSTM and MLP models concerning the R², RMSE, MAE and MAPE by more than 4%, 6%, 42% and 46%, respectively. Therefore, the proposed model uses the available data to predict the electricity consumption for 6 and 12 months ahead. In June and December 2022, the overall electricity consumption is estimated to be 195,312 kWh and 254,737 kWh, respectively.

This study discusses the development of an effective time-series model that can forecast future electricity consumption in a Canadian heritage building. Deep learning techniques are being used for the first time to anticipate the electricity consumption of the Grey Nuns building in Canada. Additionally, it evaluates the effectiveness of deep learning and machine learning methods for predicting electricity consumption using established performance indicators. Recognizing electricity consumption in buildings is beneficial for utility providers, facility managers and end users by improving energy and environmental efficiency.

Modern human society has continuous advancements that have a negative impact on the quality of the air. Daily transportation, industrial and residential operations churn up dangerous contaminants in our surroundings. Addressing air pollution issues is critical for human health and ecosystems, particularly in developing countries such as Egypt. Excessive levels of pollutants have been linked to a variety of circulatory, respiratory and nervous illnesses. To this end, the purpose of this research paper is to forecast air pollution concentrations in Egypt based on time series analysis.

Deep learning models are leveraged to analyze air quality time series in the 6th of October City, Egypt. In this regard, convolutional neural network (CNN), long short-term memory network and multilayer perceptron neural network models are used to forecast the overall concentrations of sulfur dioxide (SO₂) and particulate matter 10 µm in diameter (PM₁₀). The models are trained and validated by using monthly data available from the Egyptian Environmental Affairs Agency between December 2014 and July 2020. The performance measures such as determination coefficient, root mean square error and mean absolute error are used to evaluate the outcomes of models.

The CNN model exhibits the best performance in terms of forecasting pollutant concentrations 3, 6, 9 and 12 months ahead. Finally, using data from December 2014 to July 2021, the CNN model is used to anticipate the pollutant concentrations 12 months ahead. In July 2022, the overall concentrations of SO₂ and PM₁₀ are expected to reach 10 and 127 µg/m³, respectively. The developed model could aid decision-makers, practitioners and local authorities in planning and implementing various interventions to mitigate their negative influences on the population and environment.

This research introduces the development of an efficient time-series model that can project the future concentrations of particulate and gaseous air pollutants in Egypt. This research study offers the first time application of deep learning models to forecast the air quality in Egypt. This research study examines the performance of machine learning approaches and deep learning techniques to forecast sulfur dioxide and particular matter concentrations using standard performance metrics.

The purpose of this research is to achieve multi-task autonomous driving by adjusting the network architecture of the model. Meanwhile, after achieving multi-task autonomous driving, the authors found that the trained neural network model performs poorly in untrained scenarios. Therefore, the authors proposed to improve the transfer efficiency of the model for new scenarios through transfer learning.

First, the authors achieved multi-task autonomous driving by training a model combining convolutional neural network and different structured long short-term memory (LSTM) layers. Second, the authors achieved fast transfer of neural network models in new scenarios by cross-model transfer learning. Finally, the authors combined data collection and data labeling to improve the efficiency of deep learning. Furthermore, the authors verified that the model has good robustness through light and shadow test.

This research achieved road tracking, real-time acceleration–deceleration, obstacle avoidance and left/right sign recognition. The model proposed by the authors (UniBiCLSTM) outperforms the existing models tested with model cars in terms of autonomous driving performance. Furthermore, the CMTL-UniBiCL-RL model trained by the authors through cross-model transfer learning improves the efficiency of model adaptation to new scenarios. Meanwhile, this research proposed an automatic data annotation method, which can save 1/4 of the time for deep learning.

This research provided novel solutions in the achievement of multi-task autonomous driving and neural network model scenario for transfer learning. The experiment was achieved on a single camera with an embedded chip and a scale model car, which is expected to simplify the hardware for autonomous driving.

Automation of detecting cracked surfaces on buildings or in any industrially manufactured products is emerging nowadays. Detection of the cracked surface is a challenging task for inspectors. Image-based automatic inspection of cracks can be very effective when compared to human eye inspection. With the advancement in deep learning techniques, by utilizing these methods the authors can create automation of work in a particular sector of various industries.

In this study, an upgraded convolutional neural network-based crack detection method has been proposed. The dataset consists of 3,886 images which include cracked and non-cracked images. Further, these data have been split into training and validation data. To inspect the cracks more accurately, data augmentation was performed on the dataset, and regularization techniques have been utilized to reduce the overfitting problems. In this work, VGG19, Xception and Inception V3, along with Resnet50 V2 CNN architectures to train the data.

A comparison between the trained models has been performed and from the obtained results, Xception performs better than other algorithms with 99.54% test accuracy. The results show detecting cracked regions and firm non-cracked regions is very efficient by the Xception algorithm.

The proposed method can be way better back to an automatic inspection of cracks in buildings with different design patterns such as decorated historical monuments.

The purpose of this paper is to present a deep ensemble neural network model for the detection of forest fires in aerial vehicle videos.

Presented deep ensemble models include four convolutional neural networks (CNNs): a faster region-based CNN (Faster R-CNN), a simple one-stage object detector (RetinaNet) and two different versions of the you only look once (Yolo) models. The presented method generates its output by fusing the outputs of these different deep learning (DL) models.

The presented fusing approach significantly improves the detection accuracy of fire incidents in the input data.

The computational complexity of the proposed method which is based on combining four different DL models is relatively higher than that of using each of these models individually. On the other hand, however, the performance of the proposed approach is considerably higher than that of any of the four DL models.

The simulation results show that using an ensemble model is quite useful for the precise detection of forest fires in real time through aerial vehicle videos or images.

By this method, forest fires can be detected more efficiently and precisely. Because forests are crucial breathing resources of the earth and a shelter for many living creatures, the social impact of the method can be considered to be very high.

This study fuses the outputs of different DL models into an ensemble model. Hence, the ensemble model provides more potent and beneficial results than any of the single models.

The purpose of this paper is to present a deep-learning-based beamforming method for phased array weather radars, especially whose antenna arrays are equipped with large number of elements, for fast and accurate detection of weather observations.

The beamforming weights are computed by a convolutional neural network (CNN), which is trained with input–output pairs obtained from the Wiener solution.

To validate the robustness of the CNN-based beamformer, it is compared with the traditional beamforming methods, namely, Fourier (FR) beamforming and Capon beamforming. Moreover, the CNN is compared with a radial basis function neural network (RBFNN) which is a shallow type of neural network. It is shown that the CNN method has an excellent performance in radar signal simulations compared to the other methods. In addition to simulations, the robustness of the CNN beamformer is further validated by using real weather data collected by the phased array radar at Osaka University (PAR@OU) and compared to, besides the FR and RBFNN methods, the minimum mean square error beamforming method. It is shown that the CNN has the ability to rapidly and accurately detect the reflectivity of the PAR@OU with even less clutter level in comparison to the other methods.

Motivated by the inherit advantages of the CNN, this paper proposes the development of a CNN-based approach to the beamforming of PAR using both simulated and real data. In this paper, the CNN is trained on the optimum weights of Wiener solution. In simulations, it is applied on a large 32 × 32 planar phased array antenna. Moreover, it is operated on real data collected by the PAR@OU.

This study aims to obtain methods to identify and find the place of damage, which is one of the topics that has always been discussed in structural engineering. The cost of repairing and rehabilitating massive bridges and buildings is very high, highlighting the need to monitor the structures continuously. One way to track the structure's health is to check the cracks in the concrete. Meanwhile, the current methods of concrete crack detection have complex and heavy calculations.

This paper presents a new lightweight architecture based on deep learning for crack classification in concrete structures. The proposed architecture was identified and classified in less time and with higher accuracy than other traditional and valid architectures in crack detection. This paper used a standard dataset to detect two-class and multi-class cracks.

Results show that two images were recognized with 99.53% accuracy based on the proposed method, and multi-class images were classified with 91% accuracy. The low execution time of the proposed architecture compared to other valid architectures in deep learning on the same hardware platform. The use of Adam's optimizer in this research had better performance than other optimizers.

This paper presents a framework based on a lightweight convolutional neural network for nondestructive monitoring of structural health to optimize the calculation costs and reduce execution time in processing.