Search results

Collaborative robotics and autonomous driving are fairly new disciplines, still with a long way to go to achieve goals, set by the research community, manufacturers and users. For technologies like collaborative robotics and autonomous driving, which focus on closing the gap between humans and machines, the physical, psychological and emotional needs of human individuals becoming increasingly important in order to ensure effective and safe human–machine interaction. The authors' goal was to conceptualize ways to combine experience from both fields and transfer artificial intelligence knowledge from one to another. By identifying transferable meta-knowledge, the authors will increase quality of artificial intelligence applications and raise safety and contextual awareness for users and environment in both fields.

First, the authors presented autonomous driving and collaborative robotics and autonomous driving and collaborative robotics' connection to artificial intelligence. The authors continued with advantages and challenges of both fields and identified potential topics for transferrable practices. Topics were divided into three time slots according to expected research timeline.

The identified research opportunities seem manageable in the presented timeline. The authors' expectation was that autonomous driving and collaborative robotics will start moving closer in the following years and even merging in some areas like driverless and humanless transport and logistics.

The authors' findings confirm the latest trends in autonomous driving and collaborative robotics and expand them into new research and collaboration opportunities for the next few years. The authors' research proposal focuses on those that should have the most positive impact to safety, complement, optimize and evolve human capabilities and increase productivity in line with social expectations. Transferring meta-knowledge between fields will increase progress and, in some cases, cut some shortcuts in achieving the aforementioned goals.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Based on the systematic literature review, this paper aims to propose a framework of Construction 4.0 (C4.0) scenarios, identifying Industry 4.0 (I4.0) enabling technologies and their applications in the construction industry. The paper reviews C4.0 trends and potential areas for development.

In this research, a systematic literature review (SLR) methodology has been applied, including bibliographic coupling analysis (BCA), co-citation network analysis of keywords, the content analysis with the visualisation of similarities (VOSviewer) software and aggregative thematic analysis (ATA). In total, 170 articles from the top 22 top construction journals in the Scopus database between 2013 and 2021 were analysed.

Six C4.0 scenarios of applications were identified. Out of nine I4.0 technology domains, Industrial Internet of Things (IIoT), Cloud Computing, Big Data and Analytics had the most references in C4.0 research, while applications of augmented/virtual reality, vertical and horizontal integration and autonomous robotics yet provide ample avenues for the future applied research. The C4.0 application scenarios include efficient energy usage, prefabricated construction, sustainability, safety and environmental management, indoor occupant comfort and efficient asset utilisation.

This research contributes to the body of knowledge by offering a framework of C4.0 scenarios revealing the status quo of research published in the top construction journals into I4.0 technology applications in the sector. The framework evaluates current C4.0 research trends and gaps in relation to nine I4.0 technology domains as compared with more advanced industry sectors and informs academic community, practitioners and strategic policymakers with interest in C4.0 trends.

The purpose of this study is to analyze the robot trends of the next generation.

This paper is divided into two sections: the key modern technology on which Europe's robotics industry has built its foundation is described. Then, the next key megatrends were analyzed.

Artificial intelligence (AI) and robotics are technologies of major importance for the development of humanity. This time is mature for the evolution of industrial and service robots. The perception of robot use has changed from threading to aiding. The cost of mass production of technological devices is decreasing, while a rich set of enabling technologies is under development. Soft mechanisms, 5G and AI have enabled us to address a wide range of new problems. Ethics should guide human behavior in addressing this newly available powerful technology in the right direction.

The paper describes the impact of new technology, such as AI and soft robotics. The world of work must react quickly to these epochal changes to enjoy their full benefits.

The study proposed a human–robot interaction (HRI) framework to enable operators to communicate remotely with robots in a simple and intuitive way. The study focused on the situation when operators with no programming skills have to accomplish teleoperated tasks dealing with randomly localized different-sized objects in an unstructured environment. The purpose of this study is to reduce stress on operators, increase accuracy and reduce the time of task accomplishment. The special application of the proposed system is in the radioactive isotope production factories. The following approach combined the reactivity of the operator’s direct control with the powerful tools of vision-based object classification and localization.

Perceptive real-time gesture control predicated on a Kinect sensor is formulated by information fusion between human intuitiveness and an augmented reality-based vision algorithm. Objects are localized using a developed feature-based vision algorithm, where the homography is estimated and Perspective-n-Point problem is solved. The 3D object position and orientation are stored in the robot end-effector memory for the last mission adjusting and waiting for a gesture control signal to autonomously pick/place an object. Object classification process is done using a one-shot Siamese neural network (NN) to train a proposed deep NN; other well-known models are also used in a comparison. The system was contextualized in one of the nuclear industry applications: radioactive isotope production and its validation were performed through a user study where 10 participants of different backgrounds are involved.

The system was contextualized in one of the nuclear industry applications: radioactive isotope production and its validation were performed through a user study where 10 participants of different backgrounds are involved. The results revealed the effectiveness of the proposed teleoperation system and demonstrate its potential for use by robotics non-experienced users to effectively accomplish remote robot tasks.

The proposed system reduces risk and increases level of safety when applied in hazardous environment such as the nuclear one.

The contribution and uniqueness of the presented study are represented in the development of a well-integrated HRI system that can tackle the four aforementioned circumstances in an effective and user-friendly way. High operator–robot reactivity is kept by using the direct control method, while a lot of cognitive stress is removed using elective/flapped autonomous mode to manipulate randomly localized different configuration objects. This necessitates building an effective deep learning algorithm (in comparison to well-known methods) to recognize objects in different conditions: illumination levels, shadows and different postures.

This paper aims to provide a comprehensive analysis of the state of the art in energy efficiency for autonomous mobile robots (AMRs), focusing on energy sources, consumption models, energy-efficient locomotion, hardware energy consumption, optimization in path planning and scheduling methods, and to suggest future research directions.

The systematic literature review (SLR) identified 244 papers for analysis. Research articles published from 2010 onwards were searched in databases including Google Scholar, ScienceDirect and Scopus using keywords and search criteria related to energy and power management in various robotic systems.

The review highlights the following key findings: batteries are the primary energy source for AMRs, with advances in battery management systems enhancing efficiency; hybrid models offer superior accuracy and robustness; locomotion contributes over 50% of a mobile robot’s total energy consumption, emphasizing the need for optimized control methods; factors such as the center of mass impact AMR energy consumption; path planning algorithms and scheduling methods are essential for energy optimization, with algorithm choice depending on specific requirements and constraints.

The review concentrates on wheeled robots, excluding walking ones. Future work should improve consumption models, explore optimization methods, examine artificial intelligence/machine learning roles and assess energy efficiency trade-offs.

This paper provides a comprehensive analysis of energy efficiency in AMRs, highlighting the key findings from the SLR and suggests future research directions for further advancements in this field.

The purpose of this paper is to illustrate the growing role of robots in the logistics industry.

Following an introduction, which identifies key challenges facing the industry, this paper discusses robotic applications in warehouses, followed by sections covering transportation and delivery and conclusions.

The logistics industry faces a number of challenges that drive technological and operational changes. Robots are already playing a role within the warehouse sector and more complex applications have recently arisen from developments in artificial intelligence-enabled vision technology. In the transportation sector, autonomous trucks are being developed and trialled by leading manufacturers. Many major logistics companies are involved and limited services are underway. Last-mile delivery applications are growing rapidly, and trials, pilot schemes and commercial services are underway in Europe, the USA and the Far East. The Chinese market is particularly buoyant, and in 2019, a delivery robot was launched that operates on public roads, based on Level-4 autonomous driving technology. The drone delivery sector has been slower to develop, in part due to regulatory constraints, but services are now being operated by drone manufacturers, retailers and logistics providers.

This paper provides details of existing and future applications of robots in the logistics industry.

Despite its potential, warehouse managers still struggle to successfully assimilate autonomous mobile robots (AMRs) in their operations. This paper means to identify the moderating factors of AMR assimilation for production warehouses that influence the digital transformation of their intralogistics via AMRs.

Drawing on innovation of assimilation theory (IAT), this study followed an explorative approach using the principles of the case study method in business research. The cases comprised of four AMR end users and six AMR service providers. Data were collected through semi-structured interviews.

Four clusters of moderators that affect each stage of AMR assimilation were identified. These clusters include organizational attributes of end users (i.e. production warehouses), service attributes of service providers, technology attributes of AMRs and relational attributes between the AMR service providers and the AMR end users.

The authors extend the IAT framework by identifying various moderating factors between different stages of the AMR assimilation process. To the authors' knowledge, this is the first study to introduce the perspective of AMR end users in conjunction with AMR service providers to the “Industry 4.0” technology assimilation literature. The study propositions regarding these factors guide future intralogistics and AMR research.

A distinctive feature of tilt-rotor UAVs is that they can be fully actuated, whereas in fixed-angle rotor UAVs (e.g. common-type quadrotors, octorotors, etc.), the associated dynamic model is characterized by underactuation. Because of the existence of more control inputs, in tilt-rotor UAVs, there is more flexibility in the solution of the associated nonlinear control problem. On the other side, the dynamic model of the tilt-rotor UAVs remains nonlinear and multivariable and this imposes difficulty in the drone's controller design. This paper aims to achieve simultaneously precise tracking of trajectories and minimization of energy dissipation by the UAV's rotors. To this end elaborated control methods have to be developed.

A solution of the nonlinear control problem of tilt-rotor UAVs is attempted using a novel nonlinear optimal control method. This method is characterized by computational simplicity, clear implementation stages and proven global stability properties. At the first stage, approximate linearization is performed on the dynamic model of the tilt-rotor UAV with the use of first-order Taylor series expansion and through the computation of the system's Jacobian matrices. This linearization process is carried out at each sampling instance, around a temporary operating point which is defined by the present value of the tilt-rotor UAV's state vector and by the last sampled value of the control inputs vector. At the second stage, an H-infinity stabilizing controller is designed for the approximately linearized model of the tilt-rotor UAV. To find the feedback gains of the controller, an algebraic Riccati equation is repetitively solved, at each time-step of the control method. Lyapunov stability analysis is used to prove the global stability properties of the control scheme. Moreover, the H-infinity Kalman filter is used as a robust observer so as to enable state estimation-based control. The paper's nonlinear optimal control approach achieves fast and accurate tracking of reference setpoints under moderate variations of the control inputs. Finally, the nonlinear optimal control approach for UAVs with tilting rotors is compared against flatness-based control in successive loops, with the latter method to be also exhibiting satisfactory performance.

So far, nonlinear model predictive control (NMPC) methods have been of questionable performance in treating the nonlinear optimal control problem for tilt-rotor UAVs because NMPC's convergence to optimum depends often on the empirical selection of parameters while also lacking a global stability proof. In the present paper, a novel nonlinear optimal control method is proposed for solving the nonlinear optimal control problem of tilt rotor UAVs. Firstly, by following the assumption of small tilting angles, the state-space model of the UAV is formulated and conditions of differential flatness are given about it. Next, to implement the nonlinear optimal control method, the dynamic model of the tilt-rotor UAV undergoes approximate linearization at each sampling instance around a temporary operating point which is defined by the present value of the system's state vector and by the last sampled value of the control inputs vector. The linearization process is based on first-order Taylor series expansion and on the computation of the associated Jacobian matrices. The modelling error, which is due to the truncation of higher-order terms from the Taylor series, is considered to be a perturbation that is asymptotically compensated by the robustness of the control scheme. For the linearized model of the UAV, an H-infinity stabilizing feedback controller is designed. To select the feedback gains of the H-infinity controller, an algebraic Riccati equation has to be repetitively solved at each time-step of the control method. The stability properties of the control scheme are analysed with the Lyapunov method.

There are no research limitations in the nonlinear optimal control method for tilt-rotor UAVs. The proposed nonlinear optimal control method achieves fast and accurate tracking of setpoints by all state variables of the tilt-rotor UAV under moderate variations of the control inputs. Compared to past approaches for treating the nonlinear optimal (H-infinity) control problem, the paper's approach is applicable also to dynamical systems which have a non-constant control inputs gain matrix. Furthermore, it uses a new Riccati equation to compute the controller's gains and follows a novel Lyapunov analysis to prove global stability for the control loop.

There are no practical implications in the application of the nonlinear optimal control method for tilt-rotor UAVs. On the contrary, the nonlinear optimal control method is applicable to a wider class of dynamical systems than approaches based on the solution of state-dependent Riccati equations (SDRE). The SDRE approaches can be applied only to dynamical systems which can be transformed to the linear parameter varying (LPV) form. Besides, the nonlinear optimal control method performs better than nonlinear optimal control schemes which use approximation of the solution of the Hamilton–Jacobi–Bellman equation by Galerkin series expansions. The stability properties of the Galerkin series expansion-based optimal control approaches are still unproven.

The proposed nonlinear optimal control method is suitable for using in various types of robots, including robotic manipulators and autonomous vehicles. By treating nonlinear control problems for complicated robotic systems, the proposed nonlinear optimal control method can have a positive impact towards economic development. So far the method has been used successfully in (1) industrial robotics: robotic manipulators and networked robotic systems. One can note applications to fully actuated robotic manipulators, redundant manipulators, underactuated manipulators, cranes and load handling systems, time-delayed robotic systems, closed kinematic chain manipulators, flexible-link manipulators and micromanipulators and (2) transportation systems: autonomous vehicles and mobile robots. Besides, one can note applications to two-wheel and unicycle-type vehicles, four-wheel drive vehicles, four-wheel steering vehicles, articulated vehicles, truck and trailer systems, unmanned aerial vehicles, unmanned surface vessels, autonomous underwater vessels and underactuated vessels.

The proposed nonlinear optimal control method is a novel and genuine result and is used for the first time in the dynamic model of tilt-rotor UAVs. The nonlinear optimal control approach exhibits advantages against other control schemes one could have considered for the tilt-rotor UAV dynamics. For instance, (1) compared to the global linearization-based control schemes (such as Lie algebra-based control or flatness-based control), it does not require complicated changes of state variables (diffeomorphisms) and transformation of the system's state-space description. Consequently, it also avoids inverse transformations which may come against singularity problems, (2) compared to NMPC, the proposed nonlinear optimal control method is of proven global stability and the convergence of its iterative search for an optimum does not depend on initialization and controller's parametrization, (3) compared to sliding-mode control and backstepping control the application of the nonlinear optimal control method is not constrained into dynamical systems of a specific state-space form. It is known that unless the controlled system is found in the input–output linearized form, the definition of the associated sliding surfaces is an empirical procedure. Besides, unless the controlled system is found in the backstepping integral (triangular) form, the application of backstepping control is not possible, (4) compared to PID control, the nonlinear optimal control method is of proven global stability and its performance is not dependent on heuristics-based selection of parameters of the controller and (5) compared to multiple-model-based optimal control, the nonlinear optimal control method requires the computation of only one linearization point and the solution of only one Riccati equation.

The emerging industrial revolution referred to as Industry 5.0 is focusing on leveraging human creativity with intelligent and autonomous systems to derive user-friendly work environment for the businesses. Industry 5.0 stresses on people centric work ecosystem, zero accident policy and the well-being of labour within the production processes. This approach of Industry 5.0 to obtain human-centric safety solutions through the deployment of digital technologies deduces workplace accidents and costs leading to the development of Safety 4.0. This chapter aims to investigate the opportunities and challenges of Safety 4.0 and its enabling technologies aspiring towards the greater impact on safety management. Further, we have proposed a framework for the role of human centric digital transformations concerning safety in the manufacturing industry propelling Safety 4.0. Concluding, we discuss the implications for managers and practitioners. We found that Safety 4.0 will strengthen industrial safety, and instead of reacting to accidents, the concept evolved towards a preventive and proactive approach for a healthy industrial ecosystem.