Search results

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

This paper aims to explore and review the potential of robotic rehabilitation as a treatment approach for Alzheimer’s disease (AD) and its impact on the health and quality of life of AD patients.

The present discourse endeavors to provide a comprehensive overview of extant scholarly inquiries that have examined the salience of inhibitory mechanisms vis-à-vis robotic interventions and their impact on patients with AD. Specifically, this review aims to explicate the contemporary state of affairs in this realm by furnishing a detailed explication of ongoing research endeavors. With the objective of elucidating the significance of inhibitory processes in robotic therapies for individuals with AD, this analysis offers a critical appraisal of extant literature that probes the intersection of cognitive mechanisms and assistive technologies. Through a meticulous analysis of diverse scholarly contributions, this review advances a nuanced understanding of the intricate interplay between inhibitory processes and robotic interventions in the context of AD.

According to the review papers, it appears that implementing robot-assisted rehabilitation can serve as a pragmatic and effective solution for enhancing the well-being and overall quality of life of patients and families engaged with AD. Besides, this new feature in the robotic area is anticipated to have a critical role in the success of this innovative approach.

Due to the nascent nature of this cutting-edge technology and the constrained configuration of the mechanized entity in question, further protracted analysis is imperative to ascertain the advantages and drawbacks of robotic rehabilitation vis-à-vis individuals afflicted with Alzheimer’s ailment.

The potential for robots to serve as indispensable assets in the provision of care for individuals afflicted with AD is significant; however, their efficacy and appropriateness for utilization by caregivers of AD patients must be subjected to further rigorous scrutiny.

This paper reviews the current robotic method and compares the current state of the art for the AD patient.

This paper aims to provide a comprehensive analysis of the state of the art in energy efficiency for autonomous mobile robots (AMRs), focusing on energy sources, consumption models, energy-efficient locomotion, hardware energy consumption, optimization in path planning and scheduling methods, and to suggest future research directions.

The systematic literature review (SLR) identified 244 papers for analysis. Research articles published from 2010 onwards were searched in databases including Google Scholar, ScienceDirect and Scopus using keywords and search criteria related to energy and power management in various robotic systems.

The review highlights the following key findings: batteries are the primary energy source for AMRs, with advances in battery management systems enhancing efficiency; hybrid models offer superior accuracy and robustness; locomotion contributes over 50% of a mobile robot’s total energy consumption, emphasizing the need for optimized control methods; factors such as the center of mass impact AMR energy consumption; path planning algorithms and scheduling methods are essential for energy optimization, with algorithm choice depending on specific requirements and constraints.

The review concentrates on wheeled robots, excluding walking ones. Future work should improve consumption models, explore optimization methods, examine artificial intelligence/machine learning roles and assess energy efficiency trade-offs.

This paper provides a comprehensive analysis of energy efficiency in AMRs, highlighting the key findings from the SLR and suggests future research directions for further advancements in this field.

This study aims to discuss the state-of-the-art digital factory (DF) development combining digital twins (DTs), sensing devices, laser additive manufacturing (LAM) and subtractive manufacturing (SM) processes. The current shortcomings and outlook of the DF also have been highlighted. A DF is a state-of-the-art manufacturing facility that uses innovative technologies, including automation, artificial intelligence (AI), the Internet of Things, additive manufacturing (AM), SM, hybrid manufacturing (HM), sensors for real-time feedback and control, and a DT, to streamline and improve manufacturing operations.

This study presents a novel perspective on DF development using laser-based AM, SM, sensors and DTs. Recent developments in laser-based AM, SM, sensors and DTs have been compiled. This study has been developed using systematic reviews and meta-analyses (PRISMA) guidelines, discussing literature on the DTs for laser-based AM, particularly laser powder bed fusion and direct energy deposition, in-situ monitoring and control equipment, SM and HM. The principal goal of this study is to highlight the aspects of DF and its development using existing techniques.

A comprehensive literature review finds a substantial lack of complete techniques that incorporate cyber-physical systems, advanced data analytics, AI, standardized interoperability, human–machine cooperation and scalable adaptability. The suggested DF effectively fills this void by integrating cyber-physical system components, including DT, AM, SM and sensors into the manufacturing process. Using sophisticated data analytics and AI algorithms, the DF facilitates real-time data analysis, predictive maintenance, quality control and optimal resource allocation. In addition, the suggested DF ensures interoperability between diverse devices and systems by emphasizing standardized communication protocols and interfaces. The modular and adaptable architecture of the DF enables scalability and adaptation, allowing for rapid reaction to market conditions.

Based on the need of DF, this review presents a comprehensive approach to DF development using DTs, sensing devices, LAM and SM processes and provides current progress in this domain.

This study aims to reduce data bias during human activity and increase the accuracy of activity recognition.

A convolutional neural network and a bidirectional long short-term memory model are used to automatically capture feature information of time series from raw sensor data and use a self-attention mechanism to learn select potential relationships of essential time points. The proposed model has been evaluated on six publicly available data sets and verified that the performance is significantly improved by combining the self-attentive mechanism with deep convolutional networks and recursive layers.

The proposed method significantly improves accuracy over the state-of-the-art method between different data sets, demonstrating the superiority of the proposed method in intelligent sensor systems.

Using deep learning frameworks, especially activity recognition using self-attention mechanisms, greatly improves recognition accuracy.

This paper aims to provide insight into the evolving relationship between humans and machines, understanding its multifaceted impact on our lifestyle and landscape in the past as well as in the present, with implications for the near future. It uses bibliometric analysis combined with a systematic literature review to identify themes, trace historical developments and offer a direction for future human–machine interactions (HMIs).

To provide thorough coverage of publications from the previous four decades, the first section presents a text-based cluster bibliometric analysis based on 305 articles from 2,293 initial papers in the Scopus and Web of Science databases produced between 1984 and 2022. The authors used VOS viewer software to identify the most prominent themes through cluster identification. This paper presents a systematic literature review of 63 qualified papers using the PRISMA framework.

Next, the systematic literature review and bibliometric analysis revealed four major historical themes and future directions. The results highlight four major research themes for the future: from Taylorism to advanced technologies; machine learning and innovation; Industry 4.0, Society 5.0 and cyber–physical system; and psychology and emotions.

There is growing anxiety among humankind that in the future, machines will overtake humans to replace them in various roles. The current study investigates the evolution of HMIs from their historical roots to Society 5.0, which is understood to be a human-centred society. It balances economic advancement with the resolution of social problems through a system that radically integrates cyberspace and physical space. This paper contributes to research and current limited knowledge by identifying relevant themes and offering scope for future research directions. A close look at the analysis posits that humans and machines complement each other in various roles. Machines reduce the mechanical work of human beings, bringing the elements of humanism and compassion to mechanical tasks. However, in the future, smart innovations may yield machines with unmatched dexterity and capability unthinkable today.

This paper attempts to explore the ambiguous and dynamic relationships between humans and machines. The present study combines systematic review and bibliometric analysis to identify prominent trends and themes. This provides a more robust and systematic encapsulation of this evolution and interaction, from Taylorism to Society 5.0. The principles of Taylorism are extended and redefined in the context of HMIs, especially advanced technologies.

This article takes into account object identification, enhanced visual feature optimization, cost effectiveness and speed selection in response to terrain conditions. Neither supervised machine learning nor manual engineering are used in this work. Instead, the OTV educates itself without instruction from humans or labeling. Beyond its link to stopping distance and lateral mobility, choosing the right speed is crucial. One of the biggest problems with autonomous operations is accurate perception. Obstacle avoidance is typically the focus of perceptive technology. The vehicle's shock is nonetheless controlled by the terrain's roughness at high speeds. The precision needed to recognize difficult terrain is far higher than the accuracy needed to avoid obstacles.

Robots that can drive unattended in an unfamiliar environment should be used for the Orbital Transfer Vehicle (OTV) for the clearance of space debris. In recent years, OTV research has attracted more attention and revealed several insights for robot systems in various applications. Improvements to advanced assistance systems like lane departure warning and intelligent speed adaptation systems are eagerly sought after by the industry, particularly space enterprises. OTV serves as a research basis for advancements in machine learning, computer vision, sensor data fusion, path planning, decision making and intelligent autonomous behavior from a computer science perspective. In the framework of autonomous OTV, this study offers a few perceptual technologies for autonomous driving in this study.

One of the most important steps in the functioning of autonomous OTVs and aid systems is the recognition of barriers, such as other satellites. Using sensors to perceive its surroundings, an autonomous car decides how to operate on its own. Driver-assistance systems like adaptive cruise control and stop-and-go must be able to distinguish between stationary and moving objects surrounding the OTV.

One of the most important steps in the functioning of autonomous OTVs and aid systems is the recognition of barriers, such as other satellites. Using sensors to perceive its surroundings, an autonomous car decides how to operate on its own. Driver-assistance systems like adaptive cruise control and stop-and-go must be able to distinguish between stationary and moving objects surrounding the OTV.

This study aims to offer a comprehensive exploration of the potential and challenges associated with sensor fusion-based virtual reality (VR) applications in the context of enhanced physical training. The main objective is to identify key advancements in sensor fusion technology, evaluate its application in VR systems and understand its impact on physical training.

The research initiates by providing context to the physical training environment in today’s technology-driven world, followed by an in-depth overview of VR. This overview includes a concise discussion on the advancements in sensor fusion technology and its application in VR systems for physical training. A systematic review of literature then follows, examining VR’s application in various facets of physical training: from exercise, skill development and technique enhancement to injury prevention, rehabilitation and psychological preparation.

Sensor fusion-based VR presents tangible advantages in the sphere of physical training, offering immersive experiences that could redefine traditional training methodologies. While the advantages are evident in domains such as exercise optimization, skill acquisition and mental preparation, challenges persist. The current research suggests there is a need for further studies to address these limitations to fully harness VR’s potential in physical training.

The integration of sensor fusion technology with VR in the domain of physical training remains a rapidly evolving field. Highlighting the advancements and challenges, this review makes a significant contribution by addressing gaps in knowledge and offering directions for future research.

The purpose of this paper is to propose an new online path planning method for porcine belly cutting. With the proliferation in demand for the automatic systems of pork production, the development of efficient and robust meat cutting algorithms are hot issues. The uncertain and dynamic nature of the online porcine belly cutting imposes a challenge for the robot to identify and cut efficiently and accurately. Based on the above challenges, an online porcine belly cutting method using 3D laser point cloud is proposed.

The robotic cutting system is composed of an industrial robotic manipulator, customized tools, a laser sensor and a PC.

Analysis of experimental results shows that by comparing with machine vision, laser sensor-based robot cutting has more advantages, and it can handle different carcass sizes.

An image pyramid method is used for dimensionality reduction of the 3D laser point cloud. From a detailed analysis of the outward and inward cutting errors, the outward cutting error is the limiting condition for reducing the segments by segmentation algorithm.