Search results

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.

The concept of ubiquitous assimilation in e-commerce, denoting the seamless integration of technologies into customer shopping experiences, has played a pivotal role in aiding e-satisfaction and, consequently, fostering patronage intention. Among these, text-based chatbots are significant innovations. In light of this, the paper aims to develop a conceptual framework and comprehend the patronage behaviour of artificial intelligence-enabled chatbot users by using chatbot usability cues and to determine whether the social presence and flow theories impact e-satisfaction, which leads to users’ patronage intention. The current research provides insights into online travel agencies (OTAs), a crucial segment within the travel and tourism sector. Given the significance of building a loyal clientele and cultivating patronage in this industry, these insights are of paramount importance for achieving sustained profitability and growth.

The research framework primarily focused on the factors that precede e-satisfaction and patronage intention among chatbot users, which include social presence, flow, perceived anthropomorphism and need for human interaction. The researchers collected the data by surveying 397 OTA chatbot users by using an online questionnaire. The data of this cross-sectional study were analysed using covariance-based structural equation modelling.

Findings reveal that e-satisfaction is positively linked with patronage intention and the variables of social presence and flow impact e-satisfaction along with chatbot usability cues. There were direct and indirect relations between chatbot usability and e-satisfaction. Moreover, the personal attributes, “need for human interaction” and, “perceived anthropomorphism” were found to moderate relations between chatbot usability cues, social presence and flow.

The impact of chatbot’s usability cues/attributes on e-satisfaction, along with perceived attributes – social presence and flow in the realm of OTAs contributes to the human–chatbot interaction literature. Moreover, the interacting effects of perceived anthropomorphism and the need for human interaction are unique in the current contextual relations.

In the tourism industry, immersive technologies become increasingly vital, amplifying traveler experiences and industry growth. By studying “e-booking” applications prevalent in hotels, this study aims to analyze the impact of integrating an anthropomorphic virtual agent (AVA) on user perceptions of humanness and service usage intent.

Two experiments were conducted to examine the effects of using an AVA and explain the psychological mechanism of how AVA’s attributes increase intention to use “e-booking” application.

The results highlight the positive influence of AVA on the intention to use. They illustrate the psychological mechanism of how AVA’s attributes (agency and emotionality) influence perceived humanness and intention to use. More specifically, the results indicate that perceived humanness mediated the effect of an AVA on intention to use.

Further research should delve into additional capabilities related to humanness.

This study provides useful insights for hotels’ managers about incorporating AVAs in digital services to enhance the perceived humanness of AVAs. The findings suggest that such efforts could yield benefits, especially when they involve conveying that AVAs possess agency and emotionality.

To the best of the author’s knowledge, this study is the first to investigate how AVA impacts hotel human–computer interaction. It examines agency and emotionality features on humanness perception and behavioral intent. It also guides successful digitalized hotel service development and design, expanding existing research on human–virtual agent digital services, which mainly focuses on superficial traits like face and gender.

This study aims to empirically analyse the influence mechanism of perceived interactivity in real estate APP which affects consumers' psychological well-being. With the growing application of human–machine interaction in real estate APP, it is crucial to utilize human–machine interaction to stimulate perceived interactivity between humans and machines to positively impact consumers' psychological well-being and sustainable development of real estate APP. However, it is unclear whether perceived interactivity improves consumers' psychological well-being.

This study proposes and examines a theoretical model grounded in the perceived interactivity theory, considers the relationship between perceived interactivity and consumers' psychological well-being and explores the mediating effect of perceived value and the moderating role of privacy concerns. It takes real estate APP as the research object, analyses the data of 568 consumer samples collected through questionnaires and then employs structural equation modelling to explore and examine the proposed theoretical model of this study.

The findings are that perceived interactivity (i.e. human–human interaction and human–information interaction) positively influences perceived value, which in turn affects psychological well-being, and that perceived value partially mediates the effect of perceived interaction on psychological well-being. More important findings are that privacy concerns not only negatively moderate human–information interaction on perceived value, but also negatively moderate the indirect effects of human–information interaction on users' psychological well-being through perceived value.

This study expands the context on perceived interaction and psychological well-being in the field of real estate APP, validating the mediating role and boundary conditions of perceived interactivity created by human–machine interaction on consumers' psychological well-being, and suggesting positive implications for practitioners exploring human–machine interaction technologies to improve the perceived interaction between humans and machines and thus enhance consumer psychological well-being and span sustainable development of real estate APP.

This paper aims to provide insight into the evolving relationship between humans and machines, understanding its multifaceted impact on our lifestyle and landscape in the past as well as in the present, with implications for the near future. It uses bibliometric analysis combined with a systematic literature review to identify themes, trace historical developments and offer a direction for future human–machine interactions (HMIs).

To provide thorough coverage of publications from the previous four decades, the first section presents a text-based cluster bibliometric analysis based on 305 articles from 2,293 initial papers in the Scopus and Web of Science databases produced between 1984 and 2022. The authors used VOS viewer software to identify the most prominent themes through cluster identification. This paper presents a systematic literature review of 63 qualified papers using the PRISMA framework.

Next, the systematic literature review and bibliometric analysis revealed four major historical themes and future directions. The results highlight four major research themes for the future: from Taylorism to advanced technologies; machine learning and innovation; Industry 4.0, Society 5.0 and cyber–physical system; and psychology and emotions.

There is growing anxiety among humankind that in the future, machines will overtake humans to replace them in various roles. The current study investigates the evolution of HMIs from their historical roots to Society 5.0, which is understood to be a human-centred society. It balances economic advancement with the resolution of social problems through a system that radically integrates cyberspace and physical space. This paper contributes to research and current limited knowledge by identifying relevant themes and offering scope for future research directions. A close look at the analysis posits that humans and machines complement each other in various roles. Machines reduce the mechanical work of human beings, bringing the elements of humanism and compassion to mechanical tasks. However, in the future, smart innovations may yield machines with unmatched dexterity and capability unthinkable today.

This paper attempts to explore the ambiguous and dynamic relationships between humans and machines. The present study combines systematic review and bibliometric analysis to identify prominent trends and themes. This provides a more robust and systematic encapsulation of this evolution and interaction, from Taylorism to Society 5.0. The principles of Taylorism are extended and redefined in the context of HMIs, especially advanced technologies.

The purpose of this study is to design a wearable medical device as a human care platform and to introduce the design details, key technologies and practical implementation methods of the system.

A multi-channel data acquisition scheme based on PCI-E (rapid interconnection of peripheral components) was proposed. The flexible biosensor is integrated with the flexible data acquisition card with monitoring capability, and the embedded (device that can operate independently) chip STM32F103VET6 is used to realize the simultaneous processing of multi-channel human health parameters. The human health parameters were transferred to the upper computer LabVIEW by intelligent clothing through USB or wireless Bluetooth to complete the transmission and processing of clinical data, which facilitates the analysis of medical data.

The smart clothing provides a mobile medical cloud platform for wearable medical through cloud computing, which can continuously monitor the body's wrist movement, body temperature and perspiration for 24 h. The result shows that each channel is completely accurate to the top computer display, which can meet the expected requirements, and the wearable instant care system can be applied to healthcare.

The smart clothing in this study is based on the monitoring and diagnosis of textiles, and the electronic communication devices can cooperate and interact to form a wearable textile system that provides medical monitoring and prevention services to individuals in the fastest and most accurate way. Each channel of the system is precisely matched to the display screen of the host computer and meets the expected requirements. As a real-time human health protection platform technology, continuous monitoring of human vital signs can complete the application of human motion detection, medical health monitoring and human–computer interaction. Ultimately, such an intelligent garment will become an integral part of our everyday clothing.

About 70% of all aircraft accidents are caused by human–machine interaction, thus identifying and quantifying performance shaping factors is a significant challenge in the study of human reliability. An information flow field model of human–machine interaction is put forward to help better pinpoint the factors influencing performance and to make up for the lack of a model of information flow and feedback processes in the aircraft cockpit. To enhance the efficacy of the human–machine interaction, this paper aims to examine the important coupling factors in the system using the findings of the simulation.

The performance-shaping factors were retrieved from the model, which was created to thoroughly describe the information flow. The coupling degree between the performance shaping factors was calculated, and simulation and sensitivity analysis are based on system dynamics.

The results show that the efficacy of human–computer interaction is significantly influenced by individual important factors and coupling factors. To decrease the frequency of accidents after seven hours, attention should be paid to these factors.

The novelty of this work lies in proposing a theoretical model of cockpit information flow and using system dynamics to analyse the effect of the factors in the human–machine loop on human–machine efficacy.

The lack of conceptual approaches for organizing and expressing capabilities, usage and impact of intelligent machines (IMs) in work settings is an obstacle to moving beyond isolated case examples, domain-specific studies, 2 × 2 frameworks and expert opinion in discussions of IMs and work. This paper's purpose is to illuminate many issues that often are not addressed directly in research, practice or punditry related to IMs. It pursues that purpose by presenting an integrated approach for identifying and organizing important aspects of analysis and evaluation related to IMs in work settings. 

This paper integrates previously published ideas related to work systems (WSs), smart devices and systems, facets of work, roles and responsibilities of information systems, interactions between people and machines and a range of criteria for evaluating system performance.

Eight principles outline a straightforward and flexible approach for analyzing and evaluating IMs and the WSs that use them. Those principles are based on the above ideas.

This paper provides a novel approach for identifying design choices for situated use of IMs. The breadth, depth and integration of this approach address a gap in existing literature, which rarely aspires to this paper’s thoroughness in combining ideas that support the description, analysis, design and evaluation of situated uses of IMs.

This paper aims to study the role of self-concept in consumer relationships with anthropomorphised conversational artificially intelligent (AI) agents. First, the authors investigate how the self-congruence between consumer self-concept and AI and the integration of the conversational AI agent into consumer self-concept might influence such relationships. Second, the authors examine whether these links with self-concept have implications for mental well-being.

This study conducted in-depth interviews with 20 consumers who regularly use popular conversational AI agents for functional or emotional tasks. Based on a thematic analysis and an ideal-type analysis, this study derived a taxonomy of consumer–AI relationships, with self-congruence and self–AI integration as the two axes.

The findings unveil four different relationships that consumers forge with their conversational AI agents, which differ in self-congruence and self–AI integration. Both dimensions are prominent in replacement and committed relationships, where consumers rely on conversational AI agents for companionship and emotional tasks such as personal growth or as a means for overcoming past traumas. These two relationships carry well-being risks in terms of changing expectations that consumers seek to fulfil in human-to-human relationships. Conversely, in the functional relationship, the conversational AI agents are viewed as an important part of one’s professional performance; however, consumers maintain a low sense of self-congruence and distinguish themselves from the agent, also because of the fear of losing their sense of uniqueness and autonomy. Consumers in aspiring relationships rely on their agents for companionship to remedy social exclusion and loneliness, but feel this is prevented because of the agents’ technical limitations.

Although this study provides insights into the dynamics of consumer relationships with conversational AI agents, it comes with limitations. The sample of this study included users of conversational AI agents such as Siri, Google Assistant and Replika. However, future studies should also investigate other agents, such as ChatGPT. Moreover, the self-related processes studied here could be compared across public and private contexts. There is also a need to examine such complex relationships with longitudinal studies. Moreover, future research should explore how consumers’ self-concept could be negatively affected if the support provided by AI is withdrawn. Finally, this study reveals that in some cases, consumers are changing their expectations related to human-to-human relationships based on their interactions with conversational AI agents.

This study enables practitioners to identify specific anthropomorphic cues that can support the development of different types of consumer–AI relationships and to consider their consequences across a range of well-being aspects.

This research equips marketing scholars with a novel understanding of the role of self-concept in the relationships that consumers forge with popular conversational AI agents and the associated well-being implications.

This chapter provides an overview of the strategic implications of chatbot use and implementation, including potential applications in marketing, and factors affecting customer acceptance. After presenting a brief history and a classification of conversational artificial intelligence (AI) and chatbots, the authors provide an in-depth review at the crossroads between marketing, business, and human–computer interaction, to outline the main factors that drive users' perceptions and acceptance of chatbots. In particular, the authors describe technology-related factors and chatbot design characteristics, such as anthropomorphism, gender, identity, and emotional design; context-related factors, such as the product type, task orientation, and consumption contexts; and users-related factors such as sociodemographic and psychographic characteristics. Next, the authors detail the strategic importance of chatbots in the field of marketing and their impact on consumers' perceived service quality, satisfaction, trust, and loyalty. After discussing the ethical implications related to chatbots implementation, the authors conclude with an exploration of future opportunities and potential strategies related to new generative AI technologies, such as ChatGPT. Throughout the chapter, the authors offer theoretical insights and practical implications for incorporating conversational AI into marketing strategies.