Search results

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The safety of high-speed rail operation environments is an important guarantee for the safe operation of high-speed rail. The operating environment of the high-speed rail is complex, and the main factors affecting the safety of high-speed rail operating environment include meteorological disasters, perimeter intrusion and external environmental hazards. The purpose of the paper is to elaborate on the current research status and team research progress on the perception of safety situation in high-speed rail operation environment and to propose directions for further research in the future.

In terms of the mechanism and spatio-temporal evolution law of the main influencing factors on the safety of high-speed rail operation environments, the research status is elaborated, and the latest research progress and achievements of the team are introduced. This paper elaborates on the research status and introduces the latest research progress and achievements of the team in terms of meteorological, perimeter and external environmental situation perception methods for high-speed rail operation.

Based on the technical route of “situational awareness evaluation warning active control,” a technical system for monitoring the safety of high-speed train operation environments has been formed. Relevant theoretical and technical research and application have been carried out around the impact of meteorological disasters, perimeter intrusion and the external environment on high-speed rail safety. These works strongly support the improvement of China’s railway environmental safety guarantee technology.

With the operation of CR450 high-speed trains with a speed of 400 km per hour and the application of high-speed train autonomous driving technology in the future, new and higher requirements have been put forward for the safety of high-speed rail operation environments. The following five aspects of work are urgently needed: (1) Research the single factor disaster mechanism of wind, rain, snow, lightning, etc. for high-speed railways with a speed of 400 kms per hour, and based on this, study the evolution characteristics of multiple safety factors and the correlation between the high-speed driving safety environment, revealing the coupling disaster mechanism of multiple influencing factors; (2) Research covers multi-source data fusion methods and associated features such as disaster monitoring data, meteorological information, route characteristics and terrain and landforms, studying the spatio-temporal evolution laws of meteorological disasters, perimeter intrusions and external environmental hazards; (3) In terms of meteorological disaster situation awareness, research high-precision prediction methods for meteorological information time series along high-speed rail lines and study the realization of small-scale real-time dynamic and accurate prediction of meteorological disasters along high-speed rail lines; (4) In terms of perimeter intrusion, research a multi-modal fusion perception method for typical scenarios of high-speed rail operation in all time, all weather and all coverage and combine artificial intelligence technology to achieve comprehensive and accurate perception of perimeter security risks along the high-speed rail line and (5) In terms of external environment, based on the existing general network framework for change detection, we will carry out research on change detection and algorithms in the surrounding environment of high-speed rail.

With the advance of Web 3.0 and the range of sensory experiences offered by virtual reality (VR) to sport fans, this study examines how VR spectators’ sensory experiences affect their intentions to consume VR products and services. For this purpose, the study puts forth an expanded stimulus-organism-response (S-O-R) model. In this framework, the stimuli are the sensory imagery and stimuli, the organism factors are presence and arousal and the response is the consumption intention. This model adeptly encapsulates the comprehensive process of stimuli while spectating a sporting event in a virtual environment.

For a VR stimulus, researchers developed a 3-min collegiate women’s volleyball game. Watching the game in VR were 131 collegiate students, who were then questioned about their visual and aural imagination of the game stimuli, perceived visual and aural stimuli, sense of presence, arousal and VR consumption intentions. To ensure the validity and reliability of the measurement model, confirmatory factor analysis was first conducted. Subsequently, the model was subjected to path analysis.

The measurement model demonstrated both validity and reliability. The subsequent path analysis yielded the model’s satisfactory fit. In particular, the mental visualization of VR spectators significantly influenced their perception of visual stimuli, while their imaginative engagement with auditory aspects impacted their perception of aural stimuli. The observed visual stimuli positively impacted the degree of presence experienced and the level of arousal induced. Similarly, the auditory stimuli exerted comparable effects on presence and arousal. The sense of arousal exhibited a considerable influence on the sense of presence. Furthermore, arousal emerged as a substantial determinant of individuals' VR consumption intentions.

The study highlights that the affective status of VR sport spectators is dominant in determining their consumption intentions. Also, the study finds the decisive role of presence in processing sensory stimuli in virtual sport spectating. It also provides managerial insight into designing and customizing VR sport experiences to be more enjoyable and impactful.

With the aid of naturalistic simulations, this paper aims to investigate human behavior during manual and autonomous driving modes in complex scenarios.

The simulation environment is established by integrating virtual reality interface with a micro-simulation model. In the simulation, the vehicle autonomy is developed by a framework that integrates artificial neural networks and genetic algorithms. Human-subject experiments are carried, and participants are asked to virtually sit in the developed autonomous vehicle (AV) that allows for both human driving and autopilot functions within a mixed traffic environment.

Not surprisingly, the inconsistency is identified between two driving modes, in which the AV’s driving maneuver causes the cognitive bias and makes participants feel unsafe. Even though only a shallow portion of the cases that the AV ended up with an accident during the testing stage, participants still frequently intervened during the AV operation. On a similar note, even though the statistical results reflect that the AV drives under perceived high-risk conditions, rarely an actual crash can happen. This suggests that the classic safety surrogate measurement, e.g. time-to-collision, may require adjustment for the mixed traffic flow.

Understanding the behavior of AVs and the behavioral difference between AVs and human drivers are important, where the developed platform is only the first effort to identify the critical scenarios where the AVs might fail to react.

This paper attempts to fill the existing research gap in preparing close-to-reality tools for AV experience and further understanding human behavior during high-level autonomous driving.

This work aims to systematically analyze the inconsistency in driving patterns between manual and autopilot modes in various driving scenarios (i.e. multiple scenes and various traffic conditions) to facilitate user acceptance of AV technology.

A close-to-reality tool for AV experience and AV-related behavioral study. A systematic analysis in relation to the inconsistency in driving patterns between manual and autonomous driving. A foundation for identifying the critical scenarios where the AVs might fail to react.

This study aims to explore how people bodily narrate and use collective memory to clarify their embodied experiences regarding a city which they memorise.

Drawing on 1,359 short stories collected by the online travel portal Visit Turku about ‘How the city feels’, the fine-grained embodied experiences of people are represented through descriptions of their feelings towards the city of Turku.

Based on the analysis, two aspects through which the respondents narrated their embodied experiences of cities have been identified: (1) the sociomaterial entanglements with the city and (2) the humane relationship with the city.

This study is limited to short stories acquired online, raising questions of anonymity and representativeness. Thus, these narrations are constructions which have to be interpreted as told by specific people in a certain time and place.

Tourist agencies should pay attention to the value of looking at written stories as bodily materialisations of people’s experiences of city destinations. Understanding this would strengthen the cities’ competitiveness.

By empirically highlighting how people memorise a city through narrations, the study offers novel viewpoints on the embodied experiences in cities as well as the cultural constructs these narrations are based on, thus broadening our understanding of how cities become bodily entangled with us.