Search results

1 – 10 of 121
Article
Publication date: 1 March 2000

K.C. LAM, S. THOMAS NG, TIESONG HU, MARTIN SKITMORE and S.O. CHEUNG

The selection criteria for contractor pre‐qualification are characterized by the co‐existence of both quantitative and qualitative data. The qualitative data is non‐linear…

Abstract

The selection criteria for contractor pre‐qualification are characterized by the co‐existence of both quantitative and qualitative data. The qualitative data is non‐linear, uncertain and imprecise. An ideal decision support system for contractor pre‐qualification should have the ability of handling both quantitative and qualitative data, and of mapping the complicated non‐linear relationship of the selection criteria, such that rational and consistent decisions can be made. In this research paper, an artificial neural network model was developed to assist public clients identifying suitable contractors for tendering. The pre‐qualification criteria (variables) were identified for the model. One hundred and twelve real pre‐qualification cases were collected from civil engineering projects in Hong Kong, and 88 hypothetical pre‐qualification cases were also generated according to the ‘If‐then’ rules used by professionals in the pre‐qualification process. The results of the analysis totally comply with current practice (public developers in Hong Kong). Each pre‐qualification case consisted of input ratings for candidate contractors' attributes and their corresponding pre‐qualification decisions. The training of the neural network model was accomplished by using the developed program, in which a conjugate gradient descent algorithm was incorporated for improving the learning performance of the network. Cross‐validation was applied to estimate the generalization errors based on the ‘re‐sampling’ of training pairs. The case studies show that the artificial neural network model is suitable for mapping the complicated non‐linear relationship between contractors' attributes and their corresponding pre‐qualification (disqualification) decisions. The artificial neural network model can be concluded as an ideal alternative for performing the contractor pre‐qualification task.

Details

Engineering, Construction and Architectural Management, vol. 7 no. 3
Type: Research Article
ISSN: 0969-9988

Keywords

Article
Publication date: 27 May 2014

Behrooz Keshtegar and Mahmoud Miri

Generally, iterative methods which have some instability solutions in complex structural and non-linear mechanical problems are used to compute reliability index. The purpose of…

Abstract

Purpose

Generally, iterative methods which have some instability solutions in complex structural and non-linear mechanical problems are used to compute reliability index. The purpose of this paper is to establish a non-linear conjugate gradient (NCG) optimization algorithm to overcome instability solution of the Hasofer-Lind and Rackwitz-Fiessler (HL-RF) method in first-order reliability analysis. The NCG algorithms such as the Conjugate-Descent (CD) and the Liu-Storey (LS) are used for determining the safety index. An algorithm is found based on the new line search in the reliability analysis.

Design/methodology/approach

In the proposed line search for calculating the safety index, search direction is computed by using the conjugate gradient approach and the HL-RF method based on the new and pervious gradient vector of the reliability function. A simple step size is presented for the line search in the proposed algorithm, which is formulated by the Wolfe conditions based on the new and previous safety index results in the reliability analysis.

Findings

From the current work, it is concluded that the proposed NCG algorithm has more efficient, robust and appropriate convergence in comparison with the HL-RF method. The proposed methods can eliminate numerical instabilities of the HL-RF iterative algorithm in highly non-linear performance function and complicated structural limit state function. The NGC optimization is applicable to reliability analysis and it is correctly converged on the reliability index. In the NCG method, the CD algorithm is slightly more efficient than the LS algorithm.

Originality/value

This paper usefully shows how the HL-RF algorithm and the NCG scheme are formulated in first-order reliability analysis. The proposed algorithm is validated from six numerical and structural examples taken from the literature. The HL-RF method is not converged on several non-linear mathematic and complex structural examples, while the two proposed conjugate gradient methods are appropriately converged for all examples. The CD algorithm is converged about twice faster than the LS algorithm in most of the problems. Therefore, application of the NCG method is possible in reliability analysis.

Details

Engineering Computations, vol. 31 no. 4
Type: Research Article
ISSN: 0264-4401

Keywords

Article
Publication date: 24 February 2012

Feng Wang, Chenfeng Li, Jianwen Feng, Song Cen and D.R.J. Owen

The purpose of this paper is to present a novel gradient‐based iterative algorithm for the joint diagonalization of a set of real symmetric matrices. The approximate joint…

Abstract

Purpose

The purpose of this paper is to present a novel gradient‐based iterative algorithm for the joint diagonalization of a set of real symmetric matrices. The approximate joint diagonalization of a set of matrices is an important tool for solving stochastic linear equations. As an application, reliability analysis of structures by using the stochastic finite element analysis based on the joint diagonalization approach is also introduced in this paper, and it provides useful references to practical engineers.

Design/methodology/approach

By starting with a least squares (LS) criterion, the authors obtain a classical nonlinear cost‐function and transfer the joint diagonalization problem into a least squares like minimization problem. A gradient method for minimizing such a cost function is derived and tested against other techniques in engineering applications.

Findings

A novel approach is presented for joint diagonalization for a set of real symmetric matrices. The new algorithm works on the numerical gradient base, and solves the problem with iterations. Demonstrated by examples, the new algorithm shows the merits of simplicity, effectiveness, and computational efficiency.

Originality/value

A novel algorithm for joint diagonalization of real symmetric matrices is presented in this paper. The new algorithm is based on the least squares criterion, and it iteratively searches for the optimal transformation matrix based on the gradient of the cost function, which can be computed in a closed form. Numerical examples show that the new algorithm is efficient and robust. The new algorithm is applied in conjunction with stochastic finite element methods, and very promising results are observed which match very well with the Monte Carlo method, but with higher computational efficiency. The new method is also tested in the context of structural reliability analysis. The reliability index obtained with the joint diagonalization approach is compared with the conventional Hasofer Lind algorithm, and again good agreement is achieved.

Article
Publication date: 14 December 2021

Abubakar Sani Halilu, Arunava Majumder, Mohammed Yusuf Waziri, Kabiru Ahmed and Aliyu Muhammed Awwal

The purpose of this research is to propose a new choice of nonnegative parameter t in Dai–Liao conjugate gradient method.

58

Abstract

Purpose

The purpose of this research is to propose a new choice of nonnegative parameter t in Dai–Liao conjugate gradient method.

Design/methodology/approach

Conjugate gradient algorithms are used to solve both constrained monotone and general systems of nonlinear equations. This is made possible by combining the conjugate gradient method with the Newton method approach via acceleration parameter in order to present a derivative-free method.

Findings

A conjugate gradient method is presented by proposing a new Dai–Liao nonnegative parameter. Furthermore the proposed method is successfully applied to handle the application in motion control of the two joint planar robotic manipulators.

Originality/value

The proposed algorithm is a new approach that will not either submitted or publish somewhere.

Article
Publication date: 1 January 1994

F. Beux and A. Dervieux

We consider the gradient method applied to the optimal control of asystem for which each simulation is expensive. A method for increasing thenumber of unknowns, and relying on…

Abstract

We consider the gradient method applied to the optimal control of a system for which each simulation is expensive. A method for increasing the number of unknowns, and relying on multilevel ideas is tested for the academic problem of shape optimization of a nozzle in a subsonic or transonic Euler flow.

Details

Engineering Computations, vol. 11 no. 1
Type: Research Article
ISSN: 0264-4401

Keywords

Article
Publication date: 1 February 2016

S. Ali Faghidian

The linear regression technique is widely used to determine empirical parameters of fatigue life profile while the results may not continuously depend on experimental data. Thus…

Abstract

Purpose

The linear regression technique is widely used to determine empirical parameters of fatigue life profile while the results may not continuously depend on experimental data. Thus Tikhonov-Morozov method is utilized here to regularize the linear regression results and consequently reduces the influence of measurement noise without notably distorting the fatigue life distribution. The paper aims to discuss these issues.

Design/methodology/approach

Tikhonov-Morozov regularization method would be shown to effectively reduce the influences of measurement noise without distorting the fatigue life distribution. Moreover since iterative regularization methods are known to be an attractive alternative to Tikhonov regularization, four gradient iterative methods called as simple iteration, minimum error, steepest descent and conjugate gradient methods are examined with an appropriate initial guess of regularized coefficients.

Findings

It has been shown that in case of sparse fatigue life measurements, linear regression results may not have continuous dependence on experimental data and measurement error could lead to misinterpretations of the solution. Therefore from engineering safety point of view, utilizing regularization method could successfully reduce the influence of measurement noise without significantly distorting the fatigue life distribution.

Originality/value

An excellent initial guess for mixed iterative-direct algorithm is introduced and it has been shown that the combination of Newton iterative approach and Morozov discrepancy principle is one of the interesting strategies for determination of regularization parameter having an excellent rate of convergence. Moreover since iterative methods are known to be an attractive alternative to Tikhonov regularization, four gradient descend methods are examined here for regularization of the linear regression problem. It has been found that all of gradient decent methods with an appropriate initial guess of regularized coefficients have an excellent convergence to Tikhonov-Morozov regularization results.

Details

International Journal of Structural Integrity, vol. 7 no. 1
Type: Research Article
ISSN: 1757-9864

Keywords

Article
Publication date: 12 April 2013

Hosein Molavi, Javad Rezapour, Sahar Noori, Sadjad Ghasemloo and Kourosh Amir Aslani

The purpose of this paper is to present novel search formulations in gradient‐type methods for prediction of boundary heat flux distribution in two‐dimensional nonlinear heat…

Abstract

Purpose

The purpose of this paper is to present novel search formulations in gradient‐type methods for prediction of boundary heat flux distribution in two‐dimensional nonlinear heat conduction problems.

Design/methodology/approach

The performance of gradient‐type methods is strongly contingent upon the effective determination of the search direction. Based on the definition of this parameter, gradient‐based methods such as steepest descent, various versions of both conjugate gradient and quasi‐Newton can be distinguished. By introducing new search techniques, several examples in the presence of noise in data are studied and discussed to verify the accuracy and efficiency of the present strategies.

Findings

The verification of the proposed methods for recovering time and space varying heat flux. The performance of the proposed methods via comparisons with the classical methods involved in its derivation.

Originality/value

The innovation of the present method is to use a hybridization of a conjugate gradient and a quasi‐Newton method to determine the search directions in gradient‐based approaches.

Details

International Journal of Numerical Methods for Heat & Fluid Flow, vol. 23 no. 3
Type: Research Article
ISSN: 0961-5539

Keywords

Article
Publication date: 19 December 2019

Waqar Ahmed Khan, S.H. Chung, Muhammad Usman Awan and Xin Wen

The purpose of this paper is to conduct a comprehensive review of the noteworthy contributions made in the area of the Feedforward neural network (FNN) to improve its…

1390

Abstract

Purpose

The purpose of this paper is to conduct a comprehensive review of the noteworthy contributions made in the area of the Feedforward neural network (FNN) to improve its generalization performance and convergence rate (learning speed); to identify new research directions that will help researchers to design new, simple and efficient algorithms and users to implement optimal designed FNNs for solving complex problems; and to explore the wide applications of the reviewed FNN algorithms in solving real-world management, engineering and health sciences problems and demonstrate the advantages of these algorithms in enhancing decision making for practical operations.

Design/methodology/approach

The FNN has gained much popularity during the last three decades. Therefore, the authors have focused on algorithms proposed during the last three decades. The selected databases were searched with popular keywords: “generalization performance,” “learning rate,” “overfitting” and “fixed and cascade architecture.” Combinations of the keywords were also used to get more relevant results. Duplicated articles in the databases, non-English language, and matched keywords but out of scope, were discarded.

Findings

The authors studied a total of 80 articles and classified them into six categories according to the nature of the algorithms proposed in these articles which aimed at improving the generalization performance and convergence rate of FNNs. To review and discuss all the six categories would result in the paper being too long. Therefore, the authors further divided the six categories into two parts (i.e. Part I and Part II). The current paper, Part I, investigates two categories that focus on learning algorithms (i.e. gradient learning algorithms for network training and gradient-free learning algorithms). Furthermore, the remaining four categories which mainly explore optimization techniques are reviewed in Part II (i.e. optimization algorithms for learning rate, bias and variance (underfitting and overfitting) minimization algorithms, constructive topology neural networks and metaheuristic search algorithms). For the sake of simplicity, the paper entitled “Machine learning facilitated business intelligence (Part II): Neural networks optimization techniques and applications” is referred to as Part II. This results in a division of 80 articles into 38 and 42 for Part I and Part II, respectively. After discussing the FNN algorithms with their technical merits and limitations, along with real-world management, engineering and health sciences applications for each individual category, the authors suggest seven (three in Part I and other four in Part II) new future directions which can contribute to strengthening the literature.

Research limitations/implications

The FNN contributions are numerous and cannot be covered in a single study. The authors remain focused on learning algorithms and optimization techniques, along with their application to real-world problems, proposing to improve the generalization performance and convergence rate of FNNs with the characteristics of computing optimal hyperparameters, connection weights, hidden units, selecting an appropriate network architecture rather than trial and error approaches and avoiding overfitting.

Practical implications

This study will help researchers and practitioners to deeply understand the existing algorithms merits of FNNs with limitations, research gaps, application areas and changes in research studies in the last three decades. Moreover, the user, after having in-depth knowledge by understanding the applications of algorithms in the real world, may apply appropriate FNN algorithms to get optimal results in the shortest possible time, with less effort, for their specific application area problems.

Originality/value

The existing literature surveys are limited in scope due to comparative study of the algorithms, studying algorithms application areas and focusing on specific techniques. This implies that the existing surveys are focused on studying some specific algorithms or their applications (e.g. pruning algorithms, constructive algorithms, etc.). In this work, the authors propose a comprehensive review of different categories, along with their real-world applications, that may affect FNN generalization performance and convergence rate. This makes the classification scheme novel and significant.

Details

Industrial Management & Data Systems, vol. 120 no. 1
Type: Research Article
ISSN: 0263-5577

Keywords

Article
Publication date: 30 June 2020

Sajad Ahmad Rather and P. Shanthi Bala

In this paper, a newly proposed hybridization algorithm namely constriction coefficient-based particle swarm optimization and gravitational search algorithm (CPSOGSA) has been…

Abstract

Purpose

In this paper, a newly proposed hybridization algorithm namely constriction coefficient-based particle swarm optimization and gravitational search algorithm (CPSOGSA) has been employed for training MLP to overcome sensitivity to initialization, premature convergence, and stagnation in local optima problems of MLP.

Design/methodology/approach

In this study, the exploration of the search space is carried out by gravitational search algorithm (GSA) and optimization of candidate solutions, i.e. exploitation is performed by particle swarm optimization (PSO). For training the multi-layer perceptron (MLP), CPSOGSA uses sigmoid fitness function for finding the proper combination of connection weights and neural biases to minimize the error. Secondly, a matrix encoding strategy is utilized for providing one to one correspondence between weights and biases of MLP and agents of CPSOGSA.

Findings

The experimental findings convey that CPSOGSA is a better MLP trainer as compared to other stochastic algorithms because it provides superior results in terms of resolving stagnation in local optima and convergence speed problems. Besides, it gives the best results for breast cancer, heart, sine function and sigmoid function datasets as compared to other participating algorithms. Moreover, CPSOGSA also provides very competitive results for other datasets.

Originality/value

The CPSOGSA performed effectively in overcoming stagnation in local optima problem and increasing the overall convergence speed of MLP. Basically, CPSOGSA is a hybrid optimization algorithm which has powerful characteristics of global exploration capability and high local exploitation power. In the research literature, a little work is available where CPSO and GSA have been utilized for training MLP. The only related research paper was given by Mirjalili et al., in 2012. They have used standard PSO and GSA for training simple FNNs. However, the work employed only three datasets and used the MSE performance metric for evaluating the efficiency of the algorithms. In this paper, eight different standard datasets and five performance metrics have been utilized for investigating the efficiency of CPSOGSA in training MLPs. In addition, a non-parametric pair-wise statistical test namely the Wilcoxon rank-sum test has been carried out at a 5% significance level to statistically validate the simulation results. Besides, eight state-of-the-art meta-heuristic algorithms were employed for comparative analysis of the experimental results to further raise the authenticity of the experimental setup.

Details

International Journal of Intelligent Computing and Cybernetics, vol. 13 no. 2
Type: Research Article
ISSN: 1756-378X

Keywords

Article
Publication date: 6 March 2017

Oleg M. Alifanov

The main purpose of this study, reflecting mainly the content of the authors’ plenary lecture, is to make a brief overview of several approaches developed by the author and his…

Abstract

Purpose

The main purpose of this study, reflecting mainly the content of the authors’ plenary lecture, is to make a brief overview of several approaches developed by the author and his colleagues to the solution to ill-posed inverse heat transfer problems (IHTPs) with their possible extension to a wider class of inverse problems of mathematical physics and, most importantly, to show the wide possibilities of this methodology by examples of aerospace applications. In this regard, this study can be seen as a continuation of those applications that were discussed in the lecture.

Design/methodology/approach

The application of the inverse method was pre-tested with experimental investigations on a special test equipment in laboratory conditions. In these studies, the author used the solution to the nonlinear inverse problem in the conjugate (conductive and convective) statement. The corresponding iterative algorithm has been developed and tested by a numerical and experimental way.

Findings

It can be stated that the theory and methodology of solving IHTPs combined with experimental simulation of thermal conditions is an effective tool for various fundamental and applied research and development in the field of heat and mass transfer.

Originality/value

With the help of the developed methods of inverse problems, the investigation was conducted for a porous cooling with a gaseous coolant for heat protection of the re-entry vehicle in the natural environment of hypersonic flight. Moreover, the analysis showed that the inverse methods can make a useful contribution to the study of heat transfer at the surface of a solid body under the influence of the hypersonic heterogeneous (dusty) gas stream and in many other aerospace applications.

Details

International Journal of Numerical Methods for Heat & Fluid Flow, vol. 27 no. 3
Type: Research Article
ISSN: 0961-5539

Keywords

1 – 10 of 121