Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The paper aims to promote the development of intelligent materials and the 4D printing technology by introducing recent advances and applications of additive layered manufacturing (ALM) technology of intelligent materials and the development of the 4D printing technology. Also, an arm-type ALM technology of shape memory polymer (SMP) with thermosetting polyurethane is briefly introduced.

This paper begins with an overview of the development and applications of intelligent materials around the world and the 4D printing technology. Then, the authors provide a brief outline of their research on arm-type ALM technology of SMP with thermosetting polyurethane.

The paper provides the recent developments and applications of intelligent materials and 4D printing technology. Then, it is suggested that intelligent materials mixed with different functional materials will be developed, and these types of materials will be more suitable for 4D printing.

This paper overviews the current developments and applications of intelligent materials and its use in 4D printing technology, and briefly states the authors’ research on arm-type ALM technology of SMP with thermosetting polyurethane.

The proliferation of customer-related data provides companies with numerous service opportunities to create customer value. The purpose of this study is to develop a framework to use this data to provide services.

This study conducted four action research projects on the use of customer-related data for service design with industry and government. Based on these projects, a practical framework was designed, applied, and validated, and was further refined by analyzing relevant service cases and incorporating the service and operations management literature.

The proposed customer process management (CPM) framework suggests steps a service provider can take when providing information to its customers to improve their processes and create more value-in-use by using data related to their processes. The applicability of this framework is illustrated using real examples from the action research projects and relevant literature.

“Using data to advance service” is a critical and timely research topic in the service literature. This study develops an original, specific framework for a company’s use of customer-related data to advance its services and create customer value. Moreover, the four projects with industry and government are early CPM case studies with real data.

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

The future construction site will be pervasive, context aware and embedded with intelligence. The purpose of this paper is to explore and define the concept of the digital skin of the future smart construction site.

The paper provides a systematic and hierarchical classification of 114 articles from both industry and academia on the digital skin concept and evaluates them. The hierarchical classification is based on application areas relevant to construction, such as augmented reality, building information model-based visualisation, labour tracking, supply chain tracking, safety management, mobile equipment tracking and schedule and progress monitoring. Evaluations of the research papers were conducted based on three pillars: validation of technological feasibility, onsite application and user acceptance testing.

Technologies learned about in the literature review enabled the envisaging of the pervasive construction site of the future. The paper presents scenarios for the future context-aware construction site, including the construction worker, construction procurement management and future real-time safety management systems.

Based on the gaps identified by the review in the body of knowledge and on a broader analysis of technology diffusion, the paper highlights the research challenges to be overcome in the advent of digital skin. The paper recommends that researchers follow a coherent process for smart technology design, development and implementation in order to achieve this vision for the construction industry.

Modern meat processing requires automation and robotisation to remain sustainable and adapt to future challenges, including those brought by global infection events. Automation of all or many processes is seen as the way forward, with robots performing various tasks instead of people. Meat cutting is one of these tasks. Smart novel solutions, including smart knives, are required, with the smart knife being able to analyse and predict the meat it cuts. This paper aims to review technologies with the potential to be used as a so-called “smart knife” The criteria for a smart knife are also defined.

This paper reviews various technologies that can be used, either alone or in combination, for developing a future smart knife for robotic meat cutting, with possibilities for their integration into automatic meat processing. Optical methods, Near Infra-Red spectroscopy, electrical impedance spectroscopy, force sensing and electromagnetic wave-based sensing approaches are assessed against the defined criteria for a smart knife.

Optical methods are well established for meat quality and composition characterisation but lack speed and robustness for real-time use as part of a cutting tool. Combining these methods with artificial intelligence (AI) could improve the performance. Methods, such as electrical impedance measurements and rapid evaporative ionisation mass spectrometry, are invasive and not suitable in meat processing since they damage the meat. One attractive option is using athermal electromagnetic waves, although no commercially developed solutions exist that are readily adaptable to produce a smart knife with proven functionality, robustness or reliability.

This paper critically reviews and assesses a range of sensing technologies with very specific requirements: to be compatible with robotic assisted cutting in the meat industry. The concept of a smart knife that can benefit from these technologies to provide a real-time “feeling feedback” to the robot is at the centre of the discussion.

The purpose of this paper is to characterize distracted driving by quantifying the response time and response intensity to an emergency stop using the driver’s physiological states.

Field tests with 17 participants were conducted in the connected and automated vehicle test field. All participants were required to prioritize their primary driving tasks while a secondary nondriving task was asked to be executed. Demographic data, vehicle trajectory data and various physiological data were recorded through a biosignalsplux signal data acquisition toolkit, such as electrocardiograph for heart rate, electromyography for muscle strength, electrodermal activity for skin conductance and force-sensing resistor for braking pressure.

This study quantified the psychophysiological responses of the driver who returns to the primary driving task from the secondary nondriving task when an emergency occurs. The results provided a prototype analysis of the time required for making a decision in the context of advanced driver assistance systems or for rebuilding the situational awareness in future automated vehicles when a driver’s take-over maneuver is needed.

The hypothesis is that the secondary task will result in a higher mental workload and a prolonged reaction time. Therefore, the driver states in distracted driving are significantly different than in regular driving, the physiological signal improves measuring the brake response time and distraction levels and brake intensity can be expressed as functions of driver demographics. To the best of the authors’ knowledge, this is the first study using psychophysiological measures to quantify a driver’s response to an emergency stop during distracted driving.