Search results

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

With the advance of Web 3.0 and the range of sensory experiences offered by virtual reality (VR) to sport fans, this study examines how VR spectators’ sensory experiences affect their intentions to consume VR products and services. For this purpose, the study puts forth an expanded stimulus-organism-response (S-O-R) model. In this framework, the stimuli are the sensory imagery and stimuli, the organism factors are presence and arousal and the response is the consumption intention. This model adeptly encapsulates the comprehensive process of stimuli while spectating a sporting event in a virtual environment.

For a VR stimulus, researchers developed a 3-min collegiate women’s volleyball game. Watching the game in VR were 131 collegiate students, who were then questioned about their visual and aural imagination of the game stimuli, perceived visual and aural stimuli, sense of presence, arousal and VR consumption intentions. To ensure the validity and reliability of the measurement model, confirmatory factor analysis was first conducted. Subsequently, the model was subjected to path analysis.

The measurement model demonstrated both validity and reliability. The subsequent path analysis yielded the model’s satisfactory fit. In particular, the mental visualization of VR spectators significantly influenced their perception of visual stimuli, while their imaginative engagement with auditory aspects impacted their perception of aural stimuli. The observed visual stimuli positively impacted the degree of presence experienced and the level of arousal induced. Similarly, the auditory stimuli exerted comparable effects on presence and arousal. The sense of arousal exhibited a considerable influence on the sense of presence. Furthermore, arousal emerged as a substantial determinant of individuals' VR consumption intentions.

The study highlights that the affective status of VR sport spectators is dominant in determining their consumption intentions. Also, the study finds the decisive role of presence in processing sensory stimuli in virtual sport spectating. It also provides managerial insight into designing and customizing VR sport experiences to be more enjoyable and impactful.

This study aims to assess the usability of augmented reality (AR) based mobile app for excavation and earthmoving processes using a novel tool entitled Excavator Augmented Reality (EAR).

A mixed-methods research approach was used through conducting experimentation to collect qualitative and quantitative data collected from the Sri Lankan construction sector. EAR app was used for experimentation in outdoor areas examining how a 360° tracked hydraulic excavator can be navigated in different physical environments similar to the real prospected job.

The findings reveal that EAR could make a considerable impact on enhancing productivity, safety and training processes. However, the developed EAR App subjected to assessment demonstrated the highest satisfaction gap for the auditory aspects. Among the remaining criterion, the satisfaction met user expectations for comfortability and no-risk practice. An analysis of strengths, weaknesses, opportunities and threats (SWOT analysis) conducted revealed that visualising the excavator activities and the requirements of improved features were the highest agreed strengths and weaknesses of the EAR. Among the opportunities for improvement, the necessity of improving emergency and safety reached the highest agreement. Moreover, the study presented the challenges in introducing mobile augmented reality (MAR) to the construction sector under the political, economic, sociocultural, technological, environmental and legal (PESTEL) model along with solutions to be taken.

This study provides a novel approach to addressing the safety, productivity and training concerns in heavy mobile plants and machinery on construction sites which remains to be unexplored to this end.

Emergency service dispatchers perform a vital role in assisting callers by helping them through the emergency they are in and ensuring the delivery of first responders. If an emergency caller prematurely hangs up a call, before the arrival of first responders, it can impact a dispatcher’s ability to provide them with assistance. This paper aims to understand why staged callers, who are attempting to cover up a crime, and authentic callers hang up by identifying which linguistic and behavioural indicators occur prior to the end of a call.

A sample of 40 emergency calls (20 staged; 20 authentic) related to health and welfare emergencies were analysed with a temporal measure known as indicator waves. This provided a means to identify which indicators occurred above the level expected by chance near the end of authentic and staged calls.

The results of the current study show that the indicators that proceeded hanging up in authentic calls reflected the nature of the situation (e.g. nonurgency wherein the victim is deceased or is in a stable condition). Whereas the indicators that proceeded hanging up in staged calls focused on the “staging” aspect of the incident by accounting for forensic evidence that could be incriminating.

The identification of indicators that occur before the end of staged and authentic calls provides further insight into the differences between the two call types and offers opportunities for further research, potentially leading to application.

Spatial olfactory design in the library appears to be a practical approach to enhance the coordination between architectural spaces and user behaviors, shape immersive activity experiences and shape immersive activity experiences. Therefore, this study aims to explore the association between the olfactory elements of library space and users’ olfactory perception, providing a foundation for the practical design of olfactory space in libraries.

Using the olfactory perception semantic differential experiment method, this study collected feedback on the emotional experience of olfactory stimuli from 56 participants in an academic library. From the perspective of environmental psychology, the dimensions of pleasure, control and arousal of users’ olfactory perception in the academic library environment were semantically and emotionally described. In addition, the impact of fatigue state on users’ olfactory perception was analyzed through statistical methods to explore the impact path of individual physical differences on olfactory perception.

It was found that users’ olfactory perception in the academic library environment is likely semantically described from the dimensions of pleasure, arousal and control. These dimensions mutually influence users’ satisfaction with olfactory elements. Moreover, there is a close correlation between pleasure and satisfaction. In addition, fatigue states may impact users’ olfactory perception. Furthermore, users in a high-fatigue state may be more sensitive to the arousal of olfactory perception.

This article is an empirical exploration of users’ perception of the environmental odors in libraries. The experimental results of this paper may have practical implications for the construction of olfactory space in academic libraries.

This study investigated the impact of octomodal mental imagery (OMI) on brand experience and authenticity in advocating sustainable development and responding to the lack of brand experience and customers’ growing demand for authentic brands.

Based on quantitative research and convenience sampling, data for the study were collected from 480 marketing students in Tehran, Iran. The research model is tested using partial least squares structural equation modeling (PLS-SEM).

The results showed that all the sensory attributes of OMI positively influenced consumers’ brand experience. Among the structural attributes of OMI, only spatial mental imagery positively influenced consumers’ brand experience, while autonomy and kinesthetic mental imagery did not have a significant effect. This study also found that consumers’ brand experience positively influenced brand authenticity, while social presence positively moderated the relationship.

This study provides branding managers and scholars with a new reference point and scientific data support for companies to implement brand strategies and marketing models, which helps brands maintain sustainable development in a competitive business environment.

Tourism via virtual reality (VR) technology has become an interesting option for consumers to “travel.” The best approaches to optimizing the VR tourism environment, improving the interactive experience of tourists and encouraging tourists to adopt VR are not yet fully understood. This study explores the willingness of tourists to adopt VR tourism from the dual aspects, richness and dynamics, of virtual social cues.

To examine the effects of richness (multiple vs. few cues) and dynamic (changeable vs. static cues) on consumers' willingness to adopt VR tourism, three virtual tourism scenes were designed and presented by head-mounted displays. The data were collected for participants in the VR laboratory and tested by ANOVA and partial least squares–structural equation modeling.

Virtual social cues can generate mental imagery through interactivity, vividness and parasocial interactions, thus increasing the consumer's likelihood of adopting VR tourism. It was also found that imagination moderates mental imagery and adoption intention. When the consumer's imagination is stronger, their mental imagery stimulates a stronger willingness to adopt VR tourism.

The authors innovatively utilize concepts of parasocial interaction and mental imagery and discuss the various influences and mediation mechanisms of social cue characteristics on consumers' adoption of VR tourism. The conclusions may provide new insights for VR tourism managers and tourism scholars.

This article explores the scientific construction of library olfactory space, based on the case of the olfactory space in the Jiangsu University library. It specifically focuses on understanding the interaction between the physical architectural space of the library and users’ olfactory perception and behavioral activities, with the ultimate goal of creating a deeply integrated olfactory experience in the Jiangsu University Library.

In this article, an empirical research method was used to gather perceptions from 30 university student users regarding the library olfactory space and to understand their olfactory preferences and requirements for its construction. Through qualitative analysis of the interview texts, the study identified correlations between user perceptions and elements of the library olfactory space.

The qualitative analysis of user interview texts and results from the library olfactory space design experiment contributed to the design proposal for the Jiangsu University Library olfactory space. The design proposal for the Jiangsu University Library olfactory space is provided and includes library architecture, activity context, functional services, olfactory experience design and technological applications.

This case study takes the environment, development strategy and user needs of the Jiangsu University Library as its unique research background and as such is not universal or generalizable to other libraries.

This article differs from others by advocating for the innovative architectural spatial design of libraries through olfactory experience, breaking the traditional perception of libraries as solely through visual and auditory senses.

This study aims to investigate the effect of virtual reality experience quality on destination visit intention and virtual reality travel intention through the technology acceptance model (TAM).

Quantitative data gathered from questionnaires applied to 198 people after undertaking an imaginary three-dimensional (3D) destination experience were analyzed with PLS-SEM.

Virtual reality experience quality influences perceptions and intentions. The perceived ease of use affects perceived usefulness, perceived usefulness effects attitude and destination visit intention, while perceived risk affects only virtual reality travel intention. Attitude affects both intentions.

The main limitation of the study relates to the quality of the experience offered, which is limited to the technical capacity of the virtual reality glasses used. Virtual reality can be used as a new economic offering and create a realistic destination experience. Virtual reality experience quality is an important determinant of intention in physical and imaginary travels, in shaping perceptions and minimizing travel risks. The explanatory power of the model can be increased by adding the perceived risk variable to TAM. The study has brought new perspectives, new insights and suggestions for developing tourism.

In the study, a 3D imaginary destination with its mise-en-scène and story, which includes more than one destination type, was designed. This study contributes to the literature by analyzing real and virtual visit intentions, combining the fields of the experience economy, risk perception and TAM.

本研究通过应用技术接受模型, 探讨虚拟现实体验质量对目的地参访意愿和虚拟现实旅游意愿的影响。旨在识别这些变量之间存在的关系, 并解释这些关系的因果链接。

本研究从198名参与虚拟三维目的地体验后填写的问卷中获得定量数据并通过PLS-SEM方法进行分析。

虚拟现实体验的质量影响用户的感知和意愿。虚拟现实旅游意愿仅受感知风险的影响。感知易用性影响感知有用性。意愿受态度影响, 但感知有用性不影响虚拟现实旅游。

本研究的主要局限性与提供的体验质量有关, 该质量受到虚拟现实眼镜技术能力的限制。虚拟现实可以作为一种新的经济提供方式进行开发。通过将感知风险变量添加到技术接受模型中, 可以增加模型的解释力。本研究为旅游业的发展提供了新的视角、见解和建议, 并解释了虚拟现实提供的真实目的地体。

为了研究的目的, 本研究设计了一个虚拟的三维目的地, 包含多个目的地类型。该目的地有自己的布景和故事情节。本研究通过分析真实和虚拟参访意愿的领域, 将体验经济、风险感知和技术接受模型领域相结合, 为文献做出了贡献。

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.