Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

In corridor environments, human-following robot encounter difficulties when the target turning around at the corridor intersections, as walls may cause complete occlusion. This paper aims to propose a collision-free following system for robot to track humans in corridors without a prior map.

In addition to following a target and avoiding collisions robustly, the proposed system calculates the positions of walls in the environment in real-time. This allows the system to maintain a stable tracking of the target even if it is obscured after turning. The proposed solution is integrated into a four-wheeled differential drive mobile robot to follow a target in a corridor environment in real-world.

The experimental results demonstrate that the robot equipped with the proposed system is capable of avoiding obstacles and following a human target robustly in the corridors. Moreover, the robot achieves a 90% success rate in maintaining a stable tracking of the target after the target turns around a corner with high speed.

This paper proposes a human target following system incorporating three novel features: a path planning method based on wall positions is introduced to ensure stable tracking of the target even when it is obscured due to target turns; improvements are made to the random sample consensus (RANSAC) algorithm, enhancing its accuracy in calculating wall positions. The system is integrated into a four-wheeled differential drive mobile robot effectively demonstrates its remarkable robustness and real-time performance.

This paper aims to explore and review the potential of robotic rehabilitation as a treatment approach for Alzheimer’s disease (AD) and its impact on the health and quality of life of AD patients.

The present discourse endeavors to provide a comprehensive overview of extant scholarly inquiries that have examined the salience of inhibitory mechanisms vis-à-vis robotic interventions and their impact on patients with AD. Specifically, this review aims to explicate the contemporary state of affairs in this realm by furnishing a detailed explication of ongoing research endeavors. With the objective of elucidating the significance of inhibitory processes in robotic therapies for individuals with AD, this analysis offers a critical appraisal of extant literature that probes the intersection of cognitive mechanisms and assistive technologies. Through a meticulous analysis of diverse scholarly contributions, this review advances a nuanced understanding of the intricate interplay between inhibitory processes and robotic interventions in the context of AD.

According to the review papers, it appears that implementing robot-assisted rehabilitation can serve as a pragmatic and effective solution for enhancing the well-being and overall quality of life of patients and families engaged with AD. Besides, this new feature in the robotic area is anticipated to have a critical role in the success of this innovative approach.

Due to the nascent nature of this cutting-edge technology and the constrained configuration of the mechanized entity in question, further protracted analysis is imperative to ascertain the advantages and drawbacks of robotic rehabilitation vis-à-vis individuals afflicted with Alzheimer’s ailment.

The potential for robots to serve as indispensable assets in the provision of care for individuals afflicted with AD is significant; however, their efficacy and appropriateness for utilization by caregivers of AD patients must be subjected to further rigorous scrutiny.

This paper reviews the current robotic method and compares the current state of the art for the AD patient.

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

The purpose of this research is to propose and empirically validate a theoretical framework to investigate the willingness of the elderly to disclose personal health information (PHI) to improve the operational efficiency of AI-integrated caregiver robots.

Drawing upon Privacy Calculus Theory (PCT) and the Technology Acceptance Model (TAM), 274 usable responses were collected through an online survey.

Empirical results reveal that trust, privacy concerns, and social isolation have a direct impact on the willingness to disclose PHI. Perceived ease of use (PEOU), perceived usefulness (PU), social isolation, and recognized benefits significantly influence user trust. Conversely, elderly individuals with pronounced privacy concerns are less inclined to disclose PHI when using AI-enabled caregiver robots.

Given the pressing need for AI-enabled caregiver robots due to the aging population and a decrease in professional human caregivers, understanding factors that influence the elderly's disclosure of PHI can guide design considerations and policymaking.

Considering the increased demand for accurate and comprehensive elder services, this is the first time that information disclosure and AI-enabled caregiver robot technologies have been combined in the field of healthcare management. This study bridges the gap between the necessity for technological improvement in caregiver robots and the importance of transparent operational information by disclosing the elderly's willingness to share PHI.

Maintaining the safety of the human is a major concern in factories where humans co-exist with robots and other physical tools. Typically, the area around the robots is monitored using lasers. However, lasers cannot distinguish between human and non-human objects in the robot’s path. Stopping or slowing down the robot when non-human objects approach is unproductive. This research contribution addresses that inefficiency by showing how computer-vision techniques can be used instead of lasers which improve up-time of the robot.

A computer-vision safety system is presented. Image segmentation, 3D point clouds, face recognition, hand gesture recognition, speed and trajectory tracking and a digital twin are used. Using speed and separation, the robot’s speed is controlled based on the nearest location of humans accurate to their body shape. The computer-vision safety system is compared to a traditional laser measure. The system is evaluated in a controlled test, and in the field.

Computer-vision and lasers are shown to be equivalent by a measure of relationship and measure of agreement. R² is given as 0.999983. The two methods are systematically producing similar results, as the bias is close to zero, at 0.060 mm. Using Bland–Altman analysis, 95% of the differences lie within the limits of maximum acceptable differences.

In this paper an original model for future computer-vision safety systems is described which is equivalent to existing laser systems, identifies and adapts to particular humans and reduces the need to slow and stop systems thereby improving efficiency. The implication is that computer-vision can be used to substitute lasers and permit adaptive robotic control in human–robot collaboration systems.

In the current era of Industry 4.0, the manufacturing industries are striving toward mass production with mass customization by considering human–robot collaboration. This study aims to propose the reconfiguration of assembly systems by incorporating multiple humans with robots using a human–robot task allocation (HRTA) to enhance productivity.

A human–robot task scheduling approach has been developed by considering task suitability, resource availability and resource selection through multicriteria optimization using the Linear Regression with Optimal Point and Minimum Distance Calculation algorithm. Using line-balancing techniques, the approach estimates the optimum number of resources required for assembly tasks operating by minimum idle time.

The task allocation schedule for a case study involving a punching press was solved using human–robot collaboration, and the approach incorporated the optimum number of appropriate resources to handle different types of proportion of resources.

This proposed work integrates the task allocation by human–robot collaboration and decrease the idle time of resource by integrating optimum number of resources.

To ensure the motion attitude and stable contact force of massage robot working on unknown human tissue environment, this study aims to propose a robotic system for autonomous massage path planning and stable interaction control.

First, back region extraction and acupoint recognition based on deep learning is proposed, which provides a basis for determining the working area and path points of the robot. Second, to realize the standard approach and movement trajectory of the expert massage, 3D reconstruction and path planning of the massage area are performed, and normal vectors are calculated to control the normal orientation of robot-end. Finally, to cope with the soft and hard changes of human tissue state and body movement, an adaptive force tracking control strategy is presented to compensate the uncertainty of environmental position and tissue hardness online.

Improved network model can accomplish the acupoint recognition task with a large accuracy and integrate the point cloud to generate massage trajectories adapted to the shape of the human body. Experimental results show that the adaptive force tracking control can obtain a relatively smooth force, and the error is basically within ± 0.2 N during the online experiment.

This paper incorporates deep learning, 3D reconstruction and impedance control, the robot can understand the shape features of the massage area and adapt its planning massage path to carry out a stable and safe force tracking control during dynamic robot–human contact.

This study aims to propose a research model integrating technology acceptance model 3 (TAM3) constructs and human aspects of humanoid service robots (HSRs), measured by the Godspeed questionnaire series and tested across two hotel properties in Japan and the USA.

Potential participants were approached randomly by email invitation. A final sample size of 395 across two hotels, one in Japan and the other in the USA, was obtained, and the data were analysed using structural equation modelling.

The results confirm that perceived usefulness, driven by subjective norms and output quality, and perceived ease of use, driven by perceived enjoyment and absence of anxiety, are the immediate direct determinants of users’ re-patronage intentions for HSRs. Results also showed that users prefer anthropomorphism, perceived intelligence and the safety of an HSR for reusing it.

The findings have practical implications for the hospitality industry, suggesting multiple attributes of an HSRs that managers need to consider before deploying them in their properties.

The current study proposes an integrated model determining factors that affect the re-patronage of HSRs in hotels.

Limited by the types of sensors, the state information available for musculoskeletal robots with highly redundant, nonlinear muscles is often incomplete, which makes the control face a bottleneck problem. The aim of this paper is to design a method to improve the motion performance of musculoskeletal robots in partially observable scenarios, and to leverage the ontology knowledge to enhance the algorithm’s adaptability to musculoskeletal robots that have undergone changes.

A memory and attention-based reinforcement learning method is proposed for musculoskeletal robots with prior knowledge of muscle synergies. First, to deal with partially observed states available to musculoskeletal robots, a memory and attention-based network architecture is proposed for inferring more sufficient and intrinsic states. Second, inspired by muscle synergy hypothesis in neuroscience, prior knowledge of a musculoskeletal robot’s muscle synergies is embedded in network structure and reward shaping.

Based on systematic validation, it is found that the proposed method demonstrates superiority over the traditional twin delayed deep deterministic policy gradients (TD3) algorithm. A musculoskeletal robot with highly redundant, nonlinear muscles is adopted to implement goal-directed tasks. In the case of 21-dimensional states, the learning efficiency and accuracy are significantly improved compared with the traditional TD3 algorithm; in the case of 13-dimensional states without velocities and information from the end effector, the traditional TD3 is unable to complete the reaching tasks, while the proposed method breaks through this bottleneck problem.

In this paper, a novel memory and attention-based reinforcement learning method with prior knowledge of muscle synergies is proposed for musculoskeletal robots to deal with partially observable scenarios. Compared with the existing methods, the proposed method effectively improves the performance. Furthermore, this paper promotes the fusion of neuroscience and robotics.