Search results

Because of the various advantages of reinforcement learning (RL) mentioned above, this study uses RL to train unmanned aerial vehicles to perform two tasks: target search and cooperative obstacle avoidance.

This study draws inspiration from the recurrent state-space model and recurrent models (RPM) to propose a simpler yet highly effective model called the unmanned aerial vehicles prediction model (UAVPM). The main objective is to assist in training the UAV representation model with a recurrent neural network, using the soft actor-critic algorithm.

This study proposes a generalized actor-critic framework consisting of three modules: representation, policy and value. This architecture serves as the foundation for training UAVPM. This study proposes the UAVPM, which is designed to aid in training the recurrent representation using the transition model, reward recovery model and observation recovery model. Unlike traditional approaches reliant solely on reward signals, RPM incorporates temporal information. In addition, it allows the inclusion of extra knowledge or information from virtual training environments. This study designs UAV target search and UAV cooperative obstacle avoidance tasks. The algorithm outperforms baselines in these two environments.

It is important to note that UAVPM does not play a role in the inference phase. This means that the representation model and policy remain independent of UAVPM. Consequently, this study can introduce additional “cheating” information from virtual training environments to guide the UAV representation without concerns about its real-world existence. By leveraging historical information more effectively, this study enhances UAVs’ decision-making abilities, thus improving the performance of both tasks at hand.

Serious concerns about the stability of the international financial systems have arisen recently, resulting from the mounting inflation rates and the accompanying procedures to control them. Consequently, this study aims at examining empirically the impact of inflationary pressures/shocks on the stability of banking sectors.

The study adopts a dynamic GMM models and exploits a sample of 188 banks operating in 14 MENA economies, over the period 1999–2021.

This research finds that high inflation does indeed harm bank financial stability and deteriorates banks credit risk. Furthermore, the examination of the impact of interaction terms between inflation and bank-specific and institutional quality variables shows that better capitalisation levels, higher liquidity buffers, larger asset size, greater market power, foreign ownership and overall political stability, all can counterbalance the impact of inflationary pressures on MENA banks financial stability.

In addition to empirically revealing how inflationary shocks can deteriorate financial stability, the main novelty of this research is examining how the interactions between inflation on one hand, and bank-specific and institutional quality on the other, affect bank stability.

To effectively combat the increasing rates of obesity, it is crucial to explore how environmental factors like sidewalk access impact weight-related outcomes. This study aimed to systematically examine the association between sidewalk accessibility and weight-related outcomes.

Databases were searched by keywords for relevant articles, which were published before March 3, 2024, to report the role of neighborhood sidewalk access on weight-related outcomes. The main findings of the selected articles were extracted from eligible studies by two independent reviewers.

A total of 20 out of 33 studies indicated a significant negative relationship between access to sidewalks and weight-related outcomes. Three studies demonstrated an indirect relationship between access to sidewalks and weight-related outcomes by greater access to physical environments. In addition, five studies reported no clear relationship, and three studies reported a significantly positive relationship between access to sidewalks and weight-related outcomes.

In general, people who live in urban areas with better sidewalk access benefit from better weight-related outcomes. Adults showed this correlation more prominently than adolescents and children. Therefore, sidewalks that have a positive effect on physical activity levels could be considered as a preventive measure against obesity.

One of the weight-related outcomes is obesity. Every community faces numerous challenges due to obesity, which adversely affects the quality of life and health. Environmental factors such as access to sidewalks could be associated with body weight due to lifestyle influences.

This paper aims to study the agent learning from expert demonstration data while incorporating reinforcement learning (RL), which enables the agent to break through the limitations of expert demonstration data and reduces the dimensionality of the agent’s exploration space to speed up the training convergence rate.

Firstly, the decay weight function is set in the objective function of the agent’s training to combine both types of methods, and both RL and imitation learning (IL) are considered to guide the agent's behavior when updating the policy. Second, this study designs a coupling utilization method between the demonstration trajectory and the training experience, so that samples from both aspects can be combined during the agent’s learning process, and the utilization rate of the data and the agent’s learning speed can be improved.

The method is superior to other algorithms in terms of convergence speed and decision stability, avoiding training from scratch for reward values, and breaking through the restrictions brought by demonstration data.

The agent can adapt to dynamic scenes through exploration and trial-and-error mechanisms based on the experience of demonstrating trajectories. The demonstration data set used in IL and the experience samples obtained in the process of RL are coupled and used to improve the data utilization efficiency and the generalization ability of the agent.

This study aimed at exploring the differential effects of different corporate governance (CG) indicators on risk management practices in Islamic financial institutions (IFIs) and conventional financial institutions (CFIs) of Pakistan. It also investigated the moderating role of institutional quality (IQ) in shaping the effects of CG practices on financial institutions of Pakistan.

A sample of 57 financial institutions including commercial banks, insurance companies and Modarba companies over the period 2006–2017 is used to carry out the empirical analysis. The authors applied the robust two-step system-generalized method of moments estimator, which is also called the dynamic panel data estimator. They also built the PCA-based composite index of CG and IQ by using different indicators to investigate the moderating role of IQ. They used three proxies for risk taking, five for CG and one for Shari’ah governance. To test the validity of the instruments, they applied the Arellano and Bond’s (1991) AR (1) and AR (2) tests and the J-statistic of Hansen (1982).

The results provided strong evidence that several individual characteristics of CG and the composite index are significantly related to the operational risk, the liquidity risk and the Z-score (a proxy for solvency risk). The results also revealed that IQ significantly and substantially contributes in reducing the level of risks. Finally, the estimation results indicated that the effects of CG on risk management are significantly different at IFIs and CFIs. This differential impact is mainly attributed to the fundamental differences in business models, operational strategies and contractual obligations of both types of institutions.

The findings of this study are important for enhancing our understanding of how CG relates to risk taking in Islamic and conventional financial services industries and how good quality institutions are important for formulating the governance effects on the risk-taking behavior of financial institutions. The findings suggest that a suitable size of board should be chosen to manage the risk effectively. As the findings show that the risk-taking behavior of IFIs differs from that of CFIs, the regulators and international standard setting bodies should tailor the regulatory frameworks accordingly.

This paper is different from the existing studies in four aspects. First, to the best of the authors’ knowledge, this is the first empirical investigation in Pakistan, which does the comparison of IFIs and CFIs while examining the impacts of CG on risk management. Second, the paper constructs the composite index of CG by considering several different indicators of governance and examines the combined effect of governance indicators on risk management process. Third, this paper adds to the growing literature on the role of IQ by investigating whether it acts as a moderator between CG structures and risk management and if yes, then whether this moderating role is different for IFIs and CFIs. Finally, the paper builds upon the existing research work on the CG effects for different types of financial institutions by proposing a single regression based analytical framework for comparing the effects across two different types of institutions, harvesting the benefits of higher degrees of freedom and avoiding/minimizing the measurement error.

Completing construction projects within the planned schedule has widely been considered as one of the major project success factors. This study investigates the use of technologies to address delays in construction projects and aims to address three research questions (1) to identify the adopted technologies and proposed solutions in the literature, (2) to explore the reasons why the delays cannot be prevented despite disruptive technologies and (3) to determine the major strategies to prevent delays in construction projects.

In total, 208 research articles that used innovative technologies, methods, or tools to avoid delays in construction projects were investigated by conducting a comprehensive literature review. An elaborative content analysis was performed to cover the implemented technologies and their transformation, highlighted research fields in relation to selected technologies, focused delay causes and corresponding delay mitigation strategies and emphasized project types with specific delay causes. According to the analysis results, a typological framework with appropriate technological means was proposed.

The findings revealed that several tools such as planning, imaging, geo-spatial data collection, machine learning and optimization have widely been adopted to address specific delay causes. It was also observed that strategies to address various delay causes throughout the life cycle of construction projects have been overlooked in the literature. The findings of the present research underpin the trends and technological advances to address significant delay causes.

Despite the technological advancements in the digitalization era of Industry 4.0, many construction projects still suffer from poor schedule performance. However, the reason of this is questionable and has not been investigated thoroughly.

Limited by the types of sensors, the state information available for musculoskeletal robots with highly redundant, nonlinear muscles is often incomplete, which makes the control face a bottleneck problem. The aim of this paper is to design a method to improve the motion performance of musculoskeletal robots in partially observable scenarios, and to leverage the ontology knowledge to enhance the algorithm’s adaptability to musculoskeletal robots that have undergone changes.

A memory and attention-based reinforcement learning method is proposed for musculoskeletal robots with prior knowledge of muscle synergies. First, to deal with partially observed states available to musculoskeletal robots, a memory and attention-based network architecture is proposed for inferring more sufficient and intrinsic states. Second, inspired by muscle synergy hypothesis in neuroscience, prior knowledge of a musculoskeletal robot’s muscle synergies is embedded in network structure and reward shaping.

Based on systematic validation, it is found that the proposed method demonstrates superiority over the traditional twin delayed deep deterministic policy gradients (TD3) algorithm. A musculoskeletal robot with highly redundant, nonlinear muscles is adopted to implement goal-directed tasks. In the case of 21-dimensional states, the learning efficiency and accuracy are significantly improved compared with the traditional TD3 algorithm; in the case of 13-dimensional states without velocities and information from the end effector, the traditional TD3 is unable to complete the reaching tasks, while the proposed method breaks through this bottleneck problem.

In this paper, a novel memory and attention-based reinforcement learning method with prior knowledge of muscle synergies is proposed for musculoskeletal robots to deal with partially observable scenarios. Compared with the existing methods, the proposed method effectively improves the performance. Furthermore, this paper promotes the fusion of neuroscience and robotics.

This paper aim to solve the problem of low assembly success rate for 3c assembly lines designed based on classical control algorithms due to inevitable random disturbances and other factors,by incorporating intelligent algorithms into the assembly line, the assembly process can be extended to uncertain assembly scenarios.

This work proposes a reinforcement learning framework based on digital twins. First, the authors used Unity3D to build a simulation environment that matches the real scene and achieved data synchronization between the real environment and the simulation environment through the robot operating system. Then, the authors trained the reinforcement learning model in the simulation environment. Finally, by creating a digital twin environment, the authors transferred the skill learned from the simulation to the real environment and achieved stable algorithm deployment in real-world scenarios.

In this work, the authors have completed the transfer of skill-learning algorithms from virtual to real environments by establishing a digital twin environment. On the one hand, the experiment proves the progressiveness of the algorithm and the feasibility of the application of digital twins in reinforcement learning transfer. On the other hand, the experimental results also provide reference for the application of digital twins in 3C assembly scenarios.

In this work, the authors designed a new encoder structure in the simulation environment to encode image information, which improved the model’s perception of the environment. At the same time, the authors used the fixed strategy combined with the reinforcement learning strategy to learn skills, which improved the rate of convergence and stability of skills learning. Finally, the authors transferred the learned skills to the physical platform through digital twin technology and realized the safe operation of the flexible printed circuit assembly task.

The purposes of this paper are (1) to identify and rank the various enablers for an integrated sustainable-green-lean-six sigma-agile manufacturing system (ISGLSAMS), and (2) to study their correlations and their impact on organizational performance.

Three tiers methodology is used to analyze the enablers for the successful adoption of ISGLSAMS. First, a total of 32 ISGLSAMS enablers are identified through a comprehensive literature review. Then, data are collected with a structured questionnaire from 108 Indian manufacturing industries. Then, an analytic approach is used to analyze (1) the relevance and significance of enablers and (2) their correlations (1) with each other, and (2) with the organizational performance outcomes, to strengthen the understanding of ISGLSAMS.

The findings suggest that top management commitment, sustainable reconfigurable manufacturing system, organization resources for 6 Rs, customers' and stakeholders' involvement, corporate social responsibility (CSR), customers and stakeholders-focused strategic alliances, dynamic manufacturing strategies, use of information and communication technology, concurrent engineering, standardized tasks for continuous improvement, virtual network of supply chain partners, real-time monitoring and control, training and education, employees' involvement and empowerment enablers are the higher level enablers for the adoption of ISGLSAMS. Findings also suggest that there is a scope for research in the incorporation of lot size reduction, Keiretsu-Kraljic supply chain relationship strategy, external collaborations with the stakeholders other than supply chain members, matrix flatter organization structure, employees' career development, justified employees' wages, government support for research fund and subsidies and vendor-managed inventory practices for ISGLSAMS. Top management commitment, sustainable reconfigurable manufacturing system, organization resources for 6 Rs, corporate social responsibility (CSR), dynamic manufacturing strategies, use of information and communication technology, concurrent engineering, virtual network of supply chain partners, real-time monitoring and control, training and education, employees' involvement and empowerment have a significant effect on (1) sustainable product design, (2) sustainable production system, (3) improvement in the sale, (4) improvement in market responsiveness, (5) improvement in the competitive position and (6) improvement in the global market image.

Through this study of ISGLSAMS enablers and their interdependence, and their impact on ISGLSAMS performance outcomes government, organizations, stakeholders, policymakers and supply chain partners may plan the policy, roadmap and strategies for the successful adoption of (1) ISGLSAMS in the organizational value chain, and (2) Industrial ecology and industrial symbiosis in India. The study also contributes to the industrial managers, and value chain partners a better understanding of ISGLSAMS.

This study is the first attempt to understand (1) the ISGLSAMS enablers and their correlations, and (2) the effect of ISGLSAMS enablers on ISGLSAMS performance outcomes to get the competitive and sustainability advantage. The study contributes to the practitioners, policymakers, organizations, government, researchers and academicians a better understanding of ISGLSAMS enablers and its performance outcomes.

In recent years, there has been a growing interest in the potential of data analytics to enhance project delivery. Yet many argue that its application in projects is still lagging behind other disciplines. This paper aims to provide a review of the current use of data analytics in project delivery encompassing both academic research and practice to accelerate current understanding and use this to formulate questions and goals for future research.

We propose to achieve the research aim through the creation of a systematic review of the status of data analytics in project delivery. Fusing the methodology of integrative literature review with a recently established practice to include both white and grey literature amounts to an approach tailored to the state of the domain. It serves to delineate a research agenda informed by current developments in both academic research and industrial practice.

The literature review reveals a dearth of work in both academic research and practice relating to data analytics in project delivery and characterises this situation as having “more gap than knowledge.” Some work does exist in the application of machine learning to predicting project delivery though this is restricted to disparate, single context studies that do not reach extendible findings on algorithm selection or key predictive characteristics. Grey literature addresses the potential benefits of data analytics in project delivery but in a manner reliant on “thought-experiments” and devoid of empirical examples.

Based on the review we articulate a research agenda to create knowledge fundamental to the effective use of data analytics in project delivery. This is structured around the functional framework devised by this investigation and highlights both organisational and data analytic challenges. Specifically, we express this structure in the form of an “onion-skin” model for conceptual structuring of data analytics in projects. We conclude with a discussion about if and how today’s project studies research community can respond to the totality of these challenges. This paper provides a blueprint for a bridge connecting data analytics and project management.