Search results

Metamodels are widely used to replace simulation models in engineering design optimization to reduce the computational cost. The purpose of this paper is to develop a novel sequential sampling strategy (weighted accumulative error sampling, WAES) to obtain accurate metamodels and apply it to improve the quality of global optimization.

A sequential single objective formulation is constructed to adaptively select new sample points. In this formulation, the optimization objective is to select a sample point with the maximum weighted accumulative predicted error obtained by analyzing data from previous iterations, and a space-filling criterion is introduced and treated as a constraint to avoid generating clustered sample points. Based on the proposed sequential sampling strategy, a two-step global optimization approach is developed.

The proposed WAES approach and the global optimization approach are tested in several cases. A comparison has been made between the proposed approach and other existing approaches. Results illustrate that WAES approach performs the best in improving metamodel accuracy and the two-step global optimization approach has a great ability to avoid local optimum.

The proposed WAES approach overcomes the shortcomings of some existing approaches. Besides, the two-step global optimization approach can be used for improving the optimization results.

This paper aims to propose hybrid global optimization based on multiple metamodels for improving the efficiency of global optimization.

The method has fully utilized the information provided by different metamodels in the optimization process. It not only imparts the expected improvement criterion of kriging into other metamodels but also intelligently selects appropriate metamodeling techniques to guide the search direction, thus making the search process very efficient. Besides, the corresponding local search strategies are also put forward to further improve the optimizing efficiency.

To validate the method, it is tested by several numerical benchmark problems and applied in two engineering design optimization problems. Moreover, an overall comparison between the proposed method and several other typical global optimization methods has been made. Results show that the global optimization efficiency of the proposed method is higher than that of the other methods for most situations.

The proposed method sufficiently utilizes multiple metamodels in the optimizing process. Thus, good optimizing results are obtained, showing great applicability in engineering design optimization problems which involve costly simulations.

To introduce Optimization‐Preserving‐Operators (O‐P‐Os), which are operators that are defined on classes of real functions that depend on a single variable, and allow us to eliminate local optima and to preserve global optima.

Outline a new method to build O‐P‐Os. These are introduced as O‐P‐O* and lead to a new approach for solving global optimization problems.

It was found that classical discretization methods for obtaining optimum of one variable function was too time‐consuming. The simple method introduced provided solutions to the test functions chosen as examples. The solutions were provided in a short time.

Provides new tools for mathematical programming and in particular the global optimization problems. The O‐P‐O* introduced innovative technique for solving such problems.

O‐P‐O* produces solutions to global optimization problems in a much improved time. The algorithm derived, and the steps for its operation proved on implementation, the efficiency of the new method. This was demonstrated by numerical results for selected functions obtained using microcomputer systems.

Provides new way of solving global optimization problems.

The aim of this paper is to explore the potential of particle swarm optimization (PSO) algorithm to solve an electromagnetic inverse problem.

A modified PSO algorithm is designed.

The modified PSO algorithm is a more stable, robust and efficient global optimizer for solving the well-known benchmark optimization problems. The new mutation approach preserves the diversity of the population, whereas the proposed dynamic and adaptive parameters maintain a good balance between the exploration and exploitation searches. The numerically experimental results of two case studies demonstrate the merits of the proposed algorithm.

Some improvements, such as the design of a new global mutation mechanism and introducing a novel strategy for learning and control parameters, are proposed.

This is an attempt to better bridge the gap between the mathematical and the engineering/physical aspects of the topic. The authors trace the different sources of non-convexification in the context of topology optimization problems starting from domain discretization, passing through penalization for discreteness and effects of filtering methods, and end with a note on continuation methods.

Starting from the global optimum of the compliance minimization problem, the authors employ analytical tools to investigate how intermediate density penalization affects the convexity of the problem, the potential penalization-like effects of various filtering techniques, how continuation methods can be used to approach the global optimum and how the initial guess has some weight in determining the final optimum.

The non-convexification effects of the penalization of intermediate density elements simply overshadows any other type of non-convexification introduced into the problem, mainly due to its severity and locality. Continuation methods are strongly recommended to overcome the problem of local minima, albeit its step and convergence criteria are left to the user depending on the type of application.

In this article, the authors present a comprehensive treatment of the sources of non-convexity in density-based topology optimization problems, with a focus on linear elastic compliance minimization. The authors put special emphasis on the potential penalization-like effects of various filtering techniques through a detailed mathematical treatment.

This study proposes targeted modernization of the Department of Defense (DoD's) Joint Forces Ammunition Logistics information system by implementing the optimized innovative information technology open architecture design and integrating Radio Frequency Identification Device data technologies and real-time optimization and control mechanisms as the critical technology components of the solution. The innovative information technology, which pursues the focused logistics, will be deployed in 36 months at the estimated cost of $568 million in constant dollars. We estimate that the Systems, Applications, Products (SAP)-based enterprise integration solution that the Army currently pursues will cost another $1.5 billion through the year 2014; however, it is unlikely to deliver the intended technical capabilities.

The purpose of this paper is three-fold: to review the categories explaining mainly optimization algorithms (techniques) in that needed to improve the generalization performance and learning speed of the Feedforward Neural Network (FNN); to discover the change in research trends by analyzing all six categories (i.e. gradient learning algorithms for network training, gradient free learning algorithms, optimization algorithms for learning rate, bias and variance (underfitting and overfitting) minimization algorithms, constructive topology neural networks, metaheuristic search algorithms) collectively; and recommend new research directions for researchers and facilitate users to understand algorithms real-world applications in solving complex management, engineering and health sciences problems.

The FNN has gained much attention from researchers to make a more informed decision in the last few decades. The literature survey is focused on the learning algorithms and the optimization techniques proposed in the last three decades. This paper (Part II) is an extension of Part I. For the sake of simplicity, the paper entitled “Machine learning facilitated business intelligence (Part I): Neural networks learning algorithms and applications” is referred to as Part I. To make the study consistent with Part I, the approach and survey methodology in this paper are kept similar to those in Part I.

Combining the work performed in Part I, the authors studied a total of 80 articles through popular keywords searching. The FNN learning algorithms and optimization techniques identified in the selected literature are classified into six categories based on their problem identification, mathematical model, technical reasoning and proposed solution. Previously, in Part I, the two categories focusing on the learning algorithms (i.e. gradient learning algorithms for network training, gradient free learning algorithms) are reviewed with their real-world applications in management, engineering, and health sciences. Therefore, in the current paper, Part II, the remaining four categories, exploring optimization techniques (i.e. optimization algorithms for learning rate, bias and variance (underfitting and overfitting) minimization algorithms, constructive topology neural networks, metaheuristic search algorithms) are studied in detail. The algorithm explanation is made enriched by discussing their technical merits, limitations, and applications in their respective categories. Finally, the authors recommend future new research directions which can contribute to strengthening the literature.

The FNN contributions are rapidly increasing because of its ability to make reliably informed decisions. Like learning algorithms, reviewed in Part I, the focus is to enrich the comprehensive study by reviewing remaining categories focusing on the optimization techniques. However, future efforts may be needed to incorporate other algorithms into identified six categories or suggest new category to continuously monitor the shift in the research trends.

The authors studied the shift in research trend for three decades by collectively analyzing the learning algorithms and optimization techniques with their applications. This may help researchers to identify future research gaps to improve the generalization performance and learning speed, and user to understand the applications areas of the FNN. For instance, research contribution in FNN in the last three decades has changed from complex gradient-based algorithms to gradient free algorithms, trial and error hidden units fixed topology approach to cascade topology, hyperparameters initial guess to analytically calculation and converging algorithms at a global minimum rather than the local minimum.

The existing literature surveys include comparative study of the algorithms, identifying algorithms application areas and focusing on specific techniques in that it may not be able to identify algorithms categories, a shift in research trends over time, application area frequently analyzed, common research gaps and collective future directions. Part I and II attempts to overcome the existing literature surveys limitations by classifying articles into six categories covering a wide range of algorithm proposed to improve the FNN generalization performance and convergence rate. The classification of algorithms into six categories helps to analyze the shift in research trend which makes the classification scheme significant and innovative.

The Alienor technique for global optimisation is described. The method is deterministic and uses the approximate properties of Archimedes' spirals, reducing n variables to a single one. It is shown that Monte Carlo methods are less efficient than Alienor, they need more computing time and convergence is not absolutely guaranteed. The application of the Alienor technique to many concrete problems is discussed.

This paper proposes a hybrid biogeography‐based optimization (BBO) with simplex method (SM) algorithm (HSMBBO).

BBO is a new intelligent optimization algorithm. The global optimization ability of BBO is better than that of genetic algorithm (GA) and particle swarm optimization (PSO), but BBO also easily falls into local minimum. To improve BBO, HSMBBO combines BBO and SM, which makes full use of the high local search ability of SM. In HSMBBO, BBO is used firstly to obtain the current global solution. Then SM is searched to acquire the optimum solution based on that global solution. Due to the searching of SM, the search range is expanded and the speed of convergence is faster. Meanwhile, HSMBBO is applied to motion estimation of video coding.

In total, six benchmark functions with multimodal and high dimension are tested. Simulation results show that HSMBBO outperforms GA, PSO and BBO in converging speed and global search ability. Meanwhile, the application results show that HSMBBO performs better than GA, PSO and BBO in terms of both searching precision and time‐consumption.

The proposed algorithm improves the BBO algorithm and provides a new approach for motion estimation of video coding.

Meta-heuristic algorithms are efficient in achieving the optimal solution for engineering problems. Hybridization of different algorithms may enhance the quality of the solutions and improve the efficiency of the algorithms. The purpose of this paper is to propose a novel, robust hybrid meta-heuristic optimization approach by adding differential evolution (DE) mutation operator to the accelerated particle swarm optimization (APSO) algorithm to solve numerical optimization problems.

The improvement includes the addition of DE mutation operator to the APSO updating equations so as to speed up convergence.

A new optimization method is proposed by introducing DE-type mutation into APSO, and the hybrid algorithm is called differential evolution accelerated particle swarm optimization (DPSO). The difference between DPSO and APSO is that the mutation operator is employed to fine-tune the newly generated solution for each particle, rather than random walks used in APSO.

A novel hybrid method is proposed and used to optimize 51 functions. It is compared with other methods to show its effectiveness. The effect of the DPSO parameters on convergence and performance is also studied and analyzed by detailed parameter sensitivity studies.