Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.

The concept of ubiquitous assimilation in e-commerce, denoting the seamless integration of technologies into customer shopping experiences, has played a pivotal role in aiding e-satisfaction and, consequently, fostering patronage intention. Among these, text-based chatbots are significant innovations. In light of this, the paper aims to develop a conceptual framework and comprehend the patronage behaviour of artificial intelligence-enabled chatbot users by using chatbot usability cues and to determine whether the social presence and flow theories impact e-satisfaction, which leads to users’ patronage intention. The current research provides insights into online travel agencies (OTAs), a crucial segment within the travel and tourism sector. Given the significance of building a loyal clientele and cultivating patronage in this industry, these insights are of paramount importance for achieving sustained profitability and growth.

The research framework primarily focused on the factors that precede e-satisfaction and patronage intention among chatbot users, which include social presence, flow, perceived anthropomorphism and need for human interaction. The researchers collected the data by surveying 397 OTA chatbot users by using an online questionnaire. The data of this cross-sectional study were analysed using covariance-based structural equation modelling.

Findings reveal that e-satisfaction is positively linked with patronage intention and the variables of social presence and flow impact e-satisfaction along with chatbot usability cues. There were direct and indirect relations between chatbot usability and e-satisfaction. Moreover, the personal attributes, “need for human interaction” and, “perceived anthropomorphism” were found to moderate relations between chatbot usability cues, social presence and flow.

The impact of chatbot’s usability cues/attributes on e-satisfaction, along with perceived attributes – social presence and flow in the realm of OTAs contributes to the human–chatbot interaction literature. Moreover, the interacting effects of perceived anthropomorphism and the need for human interaction are unique in the current contextual relations.

AI-driven product recommendation chatbots have markedly reduced operating costs and increased sales for marketers. However, previous literature has paid little attention to the effects of the personality of e-commerce chatbots. This study aimed to examine the ways that the interplay between the chatbot's and the user's personality can increase favorable product attitudes and future intentions to use the chatbot. Based on prior literature, we specifically focused on the degree of extroversion of both chatbot and user.

A total of 291 individuals participated in this study. Two different versions of chatbot were created for this study (i.e. extroversion: high vs. low). Participants self-reported their degree of extroversion. The PROCESS macro Model 1 and Model 7 with the Johnson–Neyman technique were employed to test the hypotheses.

The results showed that the high extroversion chatbot elicited greater user satisfactions and perceptions of chatbot friendliness among users with a high level of extroversion. On the contrary, the low extroversion chatbot resulted in greater user satisfactions and perceived chatbot friendliness among users with a low level of extroversion. This study further found that user satisfactions and perceived chatbot friendliness mediated the effects of the chatbot on greater intentions to use the chatbot and more favorable product attitudes.

By showing the effects of matching the personality of the chatbot and user, this study revealed that similarity-attraction effects also apply to human–chatbot interaction in e-commerce. Future studies would benefit by investigating the similarity-attraction effects in different characteristics, such as appearance, opinion and preference. This study also provides useful information for e-commerce marketers and chatbot UX/UI designers.

In the tourism industry, immersive technologies become increasingly vital, amplifying traveler experiences and industry growth. By studying “e-booking” applications prevalent in hotels, this study aims to analyze the impact of integrating an anthropomorphic virtual agent (AVA) on user perceptions of humanness and service usage intent.

Two experiments were conducted to examine the effects of using an AVA and explain the psychological mechanism of how AVA’s attributes increase intention to use “e-booking” application.

The results highlight the positive influence of AVA on the intention to use. They illustrate the psychological mechanism of how AVA’s attributes (agency and emotionality) influence perceived humanness and intention to use. More specifically, the results indicate that perceived humanness mediated the effect of an AVA on intention to use.

Further research should delve into additional capabilities related to humanness.

This study provides useful insights for hotels’ managers about incorporating AVAs in digital services to enhance the perceived humanness of AVAs. The findings suggest that such efforts could yield benefits, especially when they involve conveying that AVAs possess agency and emotionality.

To the best of the author’s knowledge, this study is the first to investigate how AVA impacts hotel human–computer interaction. It examines agency and emotionality features on humanness perception and behavioral intent. It also guides successful digitalized hotel service development and design, expanding existing research on human–virtual agent digital services, which mainly focuses on superficial traits like face and gender.

This study aims to empirically analyse the influence mechanism of perceived interactivity in real estate APP which affects consumers' psychological well-being. With the growing application of human–machine interaction in real estate APP, it is crucial to utilize human–machine interaction to stimulate perceived interactivity between humans and machines to positively impact consumers' psychological well-being and sustainable development of real estate APP. However, it is unclear whether perceived interactivity improves consumers' psychological well-being.

This study proposes and examines a theoretical model grounded in the perceived interactivity theory, considers the relationship between perceived interactivity and consumers' psychological well-being and explores the mediating effect of perceived value and the moderating role of privacy concerns. It takes real estate APP as the research object, analyses the data of 568 consumer samples collected through questionnaires and then employs structural equation modelling to explore and examine the proposed theoretical model of this study.

The findings are that perceived interactivity (i.e. human–human interaction and human–information interaction) positively influences perceived value, which in turn affects psychological well-being, and that perceived value partially mediates the effect of perceived interaction on psychological well-being. More important findings are that privacy concerns not only negatively moderate human–information interaction on perceived value, but also negatively moderate the indirect effects of human–information interaction on users' psychological well-being through perceived value.

This study expands the context on perceived interaction and psychological well-being in the field of real estate APP, validating the mediating role and boundary conditions of perceived interactivity created by human–machine interaction on consumers' psychological well-being, and suggesting positive implications for practitioners exploring human–machine interaction technologies to improve the perceived interaction between humans and machines and thus enhance consumer psychological well-being and span sustainable development of real estate APP.

This paper aims to provide insight into the evolving relationship between humans and machines, understanding its multifaceted impact on our lifestyle and landscape in the past as well as in the present, with implications for the near future. It uses bibliometric analysis combined with a systematic literature review to identify themes, trace historical developments and offer a direction for future human–machine interactions (HMIs).

To provide thorough coverage of publications from the previous four decades, the first section presents a text-based cluster bibliometric analysis based on 305 articles from 2,293 initial papers in the Scopus and Web of Science databases produced between 1984 and 2022. The authors used VOS viewer software to identify the most prominent themes through cluster identification. This paper presents a systematic literature review of 63 qualified papers using the PRISMA framework.

Next, the systematic literature review and bibliometric analysis revealed four major historical themes and future directions. The results highlight four major research themes for the future: from Taylorism to advanced technologies; machine learning and innovation; Industry 4.0, Society 5.0 and cyber–physical system; and psychology and emotions.

There is growing anxiety among humankind that in the future, machines will overtake humans to replace them in various roles. The current study investigates the evolution of HMIs from their historical roots to Society 5.0, which is understood to be a human-centred society. It balances economic advancement with the resolution of social problems through a system that radically integrates cyberspace and physical space. This paper contributes to research and current limited knowledge by identifying relevant themes and offering scope for future research directions. A close look at the analysis posits that humans and machines complement each other in various roles. Machines reduce the mechanical work of human beings, bringing the elements of humanism and compassion to mechanical tasks. However, in the future, smart innovations may yield machines with unmatched dexterity and capability unthinkable today.

This paper attempts to explore the ambiguous and dynamic relationships between humans and machines. The present study combines systematic review and bibliometric analysis to identify prominent trends and themes. This provides a more robust and systematic encapsulation of this evolution and interaction, from Taylorism to Society 5.0. The principles of Taylorism are extended and redefined in the context of HMIs, especially advanced technologies.

The purpose of this study is to design a wearable medical device as a human care platform and to introduce the design details, key technologies and practical implementation methods of the system.

A multi-channel data acquisition scheme based on PCI-E (rapid interconnection of peripheral components) was proposed. The flexible biosensor is integrated with the flexible data acquisition card with monitoring capability, and the embedded (device that can operate independently) chip STM32F103VET6 is used to realize the simultaneous processing of multi-channel human health parameters. The human health parameters were transferred to the upper computer LabVIEW by intelligent clothing through USB or wireless Bluetooth to complete the transmission and processing of clinical data, which facilitates the analysis of medical data.

The smart clothing provides a mobile medical cloud platform for wearable medical through cloud computing, which can continuously monitor the body's wrist movement, body temperature and perspiration for 24 h. The result shows that each channel is completely accurate to the top computer display, which can meet the expected requirements, and the wearable instant care system can be applied to healthcare.

The smart clothing in this study is based on the monitoring and diagnosis of textiles, and the electronic communication devices can cooperate and interact to form a wearable textile system that provides medical monitoring and prevention services to individuals in the fastest and most accurate way. Each channel of the system is precisely matched to the display screen of the host computer and meets the expected requirements. As a real-time human health protection platform technology, continuous monitoring of human vital signs can complete the application of human motion detection, medical health monitoring and human–computer interaction. Ultimately, such an intelligent garment will become an integral part of our everyday clothing.

The present study investigates human behavioral and emotional experiences based on human-built environment interaction with a specific interest in urban graffiti displaying fear and pleasure-inducing facial expressions. Regarding human behavioral and emotional experience, two questions are asked for the outcome of human responses and two hypotheses are formulated. H1 is based on the behavioral experience and posits that the urban graffiti displaying fear and pleasure-inducing facial expressions elicit specified behavioral fear and pleasure responses. H2 is based on emotional experience and states that the urban graffiti displaying fear and pleasure-inducing facial expressions elicit specified emotional fear and pleasure responses.

The research design is developed as a multi-method approach, applying a lab-based experimental strategy (N:39). The research equipment includes a mobile electroencephalogram (EEG) and a Virtual Reality (VR) headset. The behavioral and emotional human responses concerning the representational features of urban graffiti are assessed objectively by measuring physiological variables, EEG signals and subjectively by behavioral variables, systematic behavioral observation and self-report variables, Self-assessment Manikin (SAM) questionnaire. Additionally, correlational analyses between behavioral and emotional results are performed.

The findings of behavioral and emotional evaluations and correlational results show that specialized fear and pleasure response patterns occur due to the affective characteristics of the urban graffiti's representational features, supporting our hypotheses. As a result, the characteristics of behavioral fear and pleasure response and emotional fear and pleasure response are identified.

The present paper contributes to the literature on human-built environment interactions by using physiological, behavioral and self-report measurements as indicators of human behavioral and emotional experiences. Additionally, the literature on urban graffiti is expanded by studying the representational features of urban graffiti as a parameter of investigating human experience in the built environment.

This paper aims to examine the relationships between anthropomorphic cues (i.e. degrees of the humanized profile picture and naming) in artificial intelligence (AI) chatbots and business types (utilitarian-centered business vs hedonic-centered business) on consumers’ attitudes toward the AI chatbot and intentions to use the AI chatbot app and to accept the AI chatbot’s recommendation.

An online experiment with a 2 (humanized profile pictures: low [semihumanoid] vs high [full-humanoid]) × 2 (naming: Mary vs virtual assistant) × 2 (business types: utilitarian-centered business [bank] vs hedonic-centered business [café]) between-subjects design (N = 520 Mturk samples) was used.

The results of this study show significant main effects of anthropomorphic cues (i.e. degrees of profile picture and naming) in AI chatbots and three-way interactions among humanized profile pictures, naming and business types (utilitarian-centered business vs hedonic-centered business) on consumers’ attitudes toward the AI chatbot, intentions to use the AI chatbot app and intentions to accept the AI chatbot’s recommendation. This indicates that the high level of anthropomorphism generates more positive attitudes toward the AI chatbot and intentions to use the AI chatbot app and to accept the AI chatbot’s recommendation in the hedonic-centered business condition. Moreover, the mediated role of parasocial interaction occurs in this relationship.

This study is the original endeavor to examine the moderating role of business types influencing the effect of anthropomorphism on consumers’ responses, while existing literature overweighted the value of anthropomorphism in AI chatbots without considering the variation of businesses.