Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.

The concept of ubiquitous assimilation in e-commerce, denoting the seamless integration of technologies into customer shopping experiences, has played a pivotal role in aiding e-satisfaction and, consequently, fostering patronage intention. Among these, text-based chatbots are significant innovations. In light of this, the paper aims to develop a conceptual framework and comprehend the patronage behaviour of artificial intelligence-enabled chatbot users by using chatbot usability cues and to determine whether the social presence and flow theories impact e-satisfaction, which leads to users’ patronage intention. The current research provides insights into online travel agencies (OTAs), a crucial segment within the travel and tourism sector. Given the significance of building a loyal clientele and cultivating patronage in this industry, these insights are of paramount importance for achieving sustained profitability and growth.

The research framework primarily focused on the factors that precede e-satisfaction and patronage intention among chatbot users, which include social presence, flow, perceived anthropomorphism and need for human interaction. The researchers collected the data by surveying 397 OTA chatbot users by using an online questionnaire. The data of this cross-sectional study were analysed using covariance-based structural equation modelling.

Findings reveal that e-satisfaction is positively linked with patronage intention and the variables of social presence and flow impact e-satisfaction along with chatbot usability cues. There were direct and indirect relations between chatbot usability and e-satisfaction. Moreover, the personal attributes, “need for human interaction” and, “perceived anthropomorphism” were found to moderate relations between chatbot usability cues, social presence and flow.

The impact of chatbot’s usability cues/attributes on e-satisfaction, along with perceived attributes – social presence and flow in the realm of OTAs contributes to the human–chatbot interaction literature. Moreover, the interacting effects of perceived anthropomorphism and the need for human interaction are unique in the current contextual relations.

In the tourism industry, immersive technologies become increasingly vital, amplifying traveler experiences and industry growth. By studying “e-booking” applications prevalent in hotels, this study aims to analyze the impact of integrating an anthropomorphic virtual agent (AVA) on user perceptions of humanness and service usage intent.

Two experiments were conducted to examine the effects of using an AVA and explain the psychological mechanism of how AVA’s attributes increase intention to use “e-booking” application.

The results highlight the positive influence of AVA on the intention to use. They illustrate the psychological mechanism of how AVA’s attributes (agency and emotionality) influence perceived humanness and intention to use. More specifically, the results indicate that perceived humanness mediated the effect of an AVA on intention to use.

Further research should delve into additional capabilities related to humanness.

This study provides useful insights for hotels’ managers about incorporating AVAs in digital services to enhance the perceived humanness of AVAs. The findings suggest that such efforts could yield benefits, especially when they involve conveying that AVAs possess agency and emotionality.

To the best of the author’s knowledge, this study is the first to investigate how AVA impacts hotel human–computer interaction. It examines agency and emotionality features on humanness perception and behavioral intent. It also guides successful digitalized hotel service development and design, expanding existing research on human–virtual agent digital services, which mainly focuses on superficial traits like face and gender.

This study aims to empirically analyse the influence mechanism of perceived interactivity in real estate APP which affects consumers' psychological well-being. With the growing application of human–machine interaction in real estate APP, it is crucial to utilize human–machine interaction to stimulate perceived interactivity between humans and machines to positively impact consumers' psychological well-being and sustainable development of real estate APP. However, it is unclear whether perceived interactivity improves consumers' psychological well-being.

This study proposes and examines a theoretical model grounded in the perceived interactivity theory, considers the relationship between perceived interactivity and consumers' psychological well-being and explores the mediating effect of perceived value and the moderating role of privacy concerns. It takes real estate APP as the research object, analyses the data of 568 consumer samples collected through questionnaires and then employs structural equation modelling to explore and examine the proposed theoretical model of this study.

The findings are that perceived interactivity (i.e. human–human interaction and human–information interaction) positively influences perceived value, which in turn affects psychological well-being, and that perceived value partially mediates the effect of perceived interaction on psychological well-being. More important findings are that privacy concerns not only negatively moderate human–information interaction on perceived value, but also negatively moderate the indirect effects of human–information interaction on users' psychological well-being through perceived value.

This study expands the context on perceived interaction and psychological well-being in the field of real estate APP, validating the mediating role and boundary conditions of perceived interactivity created by human–machine interaction on consumers' psychological well-being, and suggesting positive implications for practitioners exploring human–machine interaction technologies to improve the perceived interaction between humans and machines and thus enhance consumer psychological well-being and span sustainable development of real estate APP.

This paper aims to provide insight into the evolving relationship between humans and machines, understanding its multifaceted impact on our lifestyle and landscape in the past as well as in the present, with implications for the near future. It uses bibliometric analysis combined with a systematic literature review to identify themes, trace historical developments and offer a direction for future human–machine interactions (HMIs).

To provide thorough coverage of publications from the previous four decades, the first section presents a text-based cluster bibliometric analysis based on 305 articles from 2,293 initial papers in the Scopus and Web of Science databases produced between 1984 and 2022. The authors used VOS viewer software to identify the most prominent themes through cluster identification. This paper presents a systematic literature review of 63 qualified papers using the PRISMA framework.

Next, the systematic literature review and bibliometric analysis revealed four major historical themes and future directions. The results highlight four major research themes for the future: from Taylorism to advanced technologies; machine learning and innovation; Industry 4.0, Society 5.0 and cyber–physical system; and psychology and emotions.

There is growing anxiety among humankind that in the future, machines will overtake humans to replace them in various roles. The current study investigates the evolution of HMIs from their historical roots to Society 5.0, which is understood to be a human-centred society. It balances economic advancement with the resolution of social problems through a system that radically integrates cyberspace and physical space. This paper contributes to research and current limited knowledge by identifying relevant themes and offering scope for future research directions. A close look at the analysis posits that humans and machines complement each other in various roles. Machines reduce the mechanical work of human beings, bringing the elements of humanism and compassion to mechanical tasks. However, in the future, smart innovations may yield machines with unmatched dexterity and capability unthinkable today.

This paper attempts to explore the ambiguous and dynamic relationships between humans and machines. The present study combines systematic review and bibliometric analysis to identify prominent trends and themes. This provides a more robust and systematic encapsulation of this evolution and interaction, from Taylorism to Society 5.0. The principles of Taylorism are extended and redefined in the context of HMIs, especially advanced technologies.

The purpose of this study is to design a wearable medical device as a human care platform and to introduce the design details, key technologies and practical implementation methods of the system.

A multi-channel data acquisition scheme based on PCI-E (rapid interconnection of peripheral components) was proposed. The flexible biosensor is integrated with the flexible data acquisition card with monitoring capability, and the embedded (device that can operate independently) chip STM32F103VET6 is used to realize the simultaneous processing of multi-channel human health parameters. The human health parameters were transferred to the upper computer LabVIEW by intelligent clothing through USB or wireless Bluetooth to complete the transmission and processing of clinical data, which facilitates the analysis of medical data.

The smart clothing provides a mobile medical cloud platform for wearable medical through cloud computing, which can continuously monitor the body's wrist movement, body temperature and perspiration for 24 h. The result shows that each channel is completely accurate to the top computer display, which can meet the expected requirements, and the wearable instant care system can be applied to healthcare.

The smart clothing in this study is based on the monitoring and diagnosis of textiles, and the electronic communication devices can cooperate and interact to form a wearable textile system that provides medical monitoring and prevention services to individuals in the fastest and most accurate way. Each channel of the system is precisely matched to the display screen of the host computer and meets the expected requirements. As a real-time human health protection platform technology, continuous monitoring of human vital signs can complete the application of human motion detection, medical health monitoring and human–computer interaction. Ultimately, such an intelligent garment will become an integral part of our everyday clothing.

Based on appraisal theory and social response theory, this study aims to explore the mechanism of AI failure types on consumer recovery expectation from the perspective of service failure assessment and validate the moderate role of anthropomorphism level.

Three scenario-based experiments were conducted to validate the research model. First, to test the effect of robot service failure types on customer recovery expectation; second, to further test the mediating role of perceived controllability, perceived stability and perceived severity; finally, to verify the moderating effect of anthropomorphic level.

Non-functional failures reduce consumer recovery expectation compared to functional failures; perceived controllability and perceived severity play a mediating role in the impact of service failure types on recovery expectation; the influence of service failure types on perceived controllability and perceived severity is moderated by the anthropomorphism level.

The findings enrich the influence mechanism and boundary conditions of service failure types, and have implications for online enterprise follow-up service recovery and improvement of anthropomorphic design.

The lack of conceptual approaches for organizing and expressing capabilities, usage and impact of intelligent machines (IMs) in work settings is an obstacle to moving beyond isolated case examples, domain-specific studies, 2 × 2 frameworks and expert opinion in discussions of IMs and work. This paper's purpose is to illuminate many issues that often are not addressed directly in research, practice or punditry related to IMs. It pursues that purpose by presenting an integrated approach for identifying and organizing important aspects of analysis and evaluation related to IMs in work settings. 

This paper integrates previously published ideas related to work systems (WSs), smart devices and systems, facets of work, roles and responsibilities of information systems, interactions between people and machines and a range of criteria for evaluating system performance.

Eight principles outline a straightforward and flexible approach for analyzing and evaluating IMs and the WSs that use them. Those principles are based on the above ideas.

This paper provides a novel approach for identifying design choices for situated use of IMs. The breadth, depth and integration of this approach address a gap in existing literature, which rarely aspires to this paper’s thoroughness in combining ideas that support the description, analysis, design and evaluation of situated uses of IMs.

This paper aims to study the role of self-concept in consumer relationships with anthropomorphised conversational artificially intelligent (AI) agents. First, the authors investigate how the self-congruence between consumer self-concept and AI and the integration of the conversational AI agent into consumer self-concept might influence such relationships. Second, the authors examine whether these links with self-concept have implications for mental well-being.

This study conducted in-depth interviews with 20 consumers who regularly use popular conversational AI agents for functional or emotional tasks. Based on a thematic analysis and an ideal-type analysis, this study derived a taxonomy of consumer–AI relationships, with self-congruence and self–AI integration as the two axes.

The findings unveil four different relationships that consumers forge with their conversational AI agents, which differ in self-congruence and self–AI integration. Both dimensions are prominent in replacement and committed relationships, where consumers rely on conversational AI agents for companionship and emotional tasks such as personal growth or as a means for overcoming past traumas. These two relationships carry well-being risks in terms of changing expectations that consumers seek to fulfil in human-to-human relationships. Conversely, in the functional relationship, the conversational AI agents are viewed as an important part of one’s professional performance; however, consumers maintain a low sense of self-congruence and distinguish themselves from the agent, also because of the fear of losing their sense of uniqueness and autonomy. Consumers in aspiring relationships rely on their agents for companionship to remedy social exclusion and loneliness, but feel this is prevented because of the agents’ technical limitations.

Although this study provides insights into the dynamics of consumer relationships with conversational AI agents, it comes with limitations. The sample of this study included users of conversational AI agents such as Siri, Google Assistant and Replika. However, future studies should also investigate other agents, such as ChatGPT. Moreover, the self-related processes studied here could be compared across public and private contexts. There is also a need to examine such complex relationships with longitudinal studies. Moreover, future research should explore how consumers’ self-concept could be negatively affected if the support provided by AI is withdrawn. Finally, this study reveals that in some cases, consumers are changing their expectations related to human-to-human relationships based on their interactions with conversational AI agents.

This study enables practitioners to identify specific anthropomorphic cues that can support the development of different types of consumer–AI relationships and to consider their consequences across a range of well-being aspects.

This research equips marketing scholars with a novel understanding of the role of self-concept in the relationships that consumers forge with popular conversational AI agents and the associated well-being implications.