Search results

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.

This chapter proposes a conceptualization of joyful leadership as a unique leadership style and identifies a future research agenda to further explore the concept. While the concept of joyful leadership appears repeatedly in the nonacademic literature, including in blogs, vlogs, and podcasts, there is limited reference to joyful leadership in the academic literature highlighting a lack of academic rigor around the concept. Joyful leadership is proposed as a unique leadership style with specific patterns of behavior demonstrated by the leader. This research draws on understandings of emotion, positive affect, and leadership in the academic literature to develop a conceptualization of joyful leadership.

The proposed conceptualization is based on an extensive literature review drawing from both the leadership field and the study of emotions including various theoretical perspectives from these diverse fields.

Based on discrete emotion theory a conceptualization of joyful leadership as a unique leadership style is presented, identifying key patterns of behavior associated with joyful leadership including discrete autonomic patterns, actions, nonverbal signals, and identified feelings.

This research outlines a conceptual model to provide an understanding of the concept of joyful leadership as a unique leadership style. It draws on the current study of emotion, positive affect, and leadership and more specifically examines the concept of joyful leadership aligned to discrete emotion theory. This particular theory of emotion, when examined in relation to leadership, provides a basis for the concept of joyful leadership as a leadership style and the basis for its proposed characteristics and outcomes.

The study investigates the consumer’s attitude to using artificial intelligence (AI) devices in hospitality service settings considering social influence, hedonic motivation, anthropomorphism, effort expectancy, performance expectancy and emotions.

This study employed a quantitative methodology to collect data from Bangladeshi consumers who utilized AI-enabled technologies in the hospitality sector. A total of 343 data were collected using a purposive sampling method. The SmartPLS 4.0 software was used to determine the constructs' internal consistency, reliability and validity. This study also applied the partial least squares structural equation modeling (PLS-SEM) to test the research model and hypotheses.

The finding shows that consumer attitude toward AI is influenced by social influence, hedonic motivation, anthropomorphism, performance and effort expectancy and emotions. Specifically, hedonic motivation, social influence and anthropomorphism affect performance and effort expectations, affecting consumer emotion. Moreover, emotions ultimately influenced the perceptions of hotel customers' willingness to use AI devices.

This study provides a practical understanding of issues when adopting more stringent AI-enabled devices in the hospitality sector. Managers, practitioners and decision-makers will get helpful information discussed in this article.

This study investigates the perceptions of guests' attitudes toward the use of AI devices in hospitality services. This study emphasizes the cultural context of the hospitality industry in Bangladesh, but its findings may be reflected in other areas and regions.

Deep learning (DL) technology is used to design a voice evaluation system to understand the impact of learning aids on DL and mobile platforms on students’ learning behavior.

DL technology is used to design a speech evaluation system.

The experimental results show that the speech evaluation system designed has a high accuracy rate, the highest agreement rate with manual evaluation of pronunciation is 89.5%, and the correct speech recognition rate is 96.64%. The designed voice evaluation system and the manual voice rating system have a maximum error rate of 2%. The experimental results suggest that it is necessary to further optimize the learning aids for mobile platform. The learning aids of the mobile platform need to be further optimized to promote the improvement of student learning efficiency.

The results show that the speech evaluation system designed has good practical application value, and it provides a certain reference value for the future study of learning tools on DL.

This paper aims to provide insight into the evolving relationship between humans and machines, understanding its multifaceted impact on our lifestyle and landscape in the past as well as in the present, with implications for the near future. It uses bibliometric analysis combined with a systematic literature review to identify themes, trace historical developments and offer a direction for future human–machine interactions (HMIs).

To provide thorough coverage of publications from the previous four decades, the first section presents a text-based cluster bibliometric analysis based on 305 articles from 2,293 initial papers in the Scopus and Web of Science databases produced between 1984 and 2022. The authors used VOS viewer software to identify the most prominent themes through cluster identification. This paper presents a systematic literature review of 63 qualified papers using the PRISMA framework.

Next, the systematic literature review and bibliometric analysis revealed four major historical themes and future directions. The results highlight four major research themes for the future: from Taylorism to advanced technologies; machine learning and innovation; Industry 4.0, Society 5.0 and cyber–physical system; and psychology and emotions.

There is growing anxiety among humankind that in the future, machines will overtake humans to replace them in various roles. The current study investigates the evolution of HMIs from their historical roots to Society 5.0, which is understood to be a human-centred society. It balances economic advancement with the resolution of social problems through a system that radically integrates cyberspace and physical space. This paper contributes to research and current limited knowledge by identifying relevant themes and offering scope for future research directions. A close look at the analysis posits that humans and machines complement each other in various roles. Machines reduce the mechanical work of human beings, bringing the elements of humanism and compassion to mechanical tasks. However, in the future, smart innovations may yield machines with unmatched dexterity and capability unthinkable today.

This paper attempts to explore the ambiguous and dynamic relationships between humans and machines. The present study combines systematic review and bibliometric analysis to identify prominent trends and themes. This provides a more robust and systematic encapsulation of this evolution and interaction, from Taylorism to Society 5.0. The principles of Taylorism are extended and redefined in the context of HMIs, especially advanced technologies.

Nature’s evolution has shaped intelligent behaviors in creatures like insects and birds, inspiring the field of Swarm Intelligence. Researchers have developed bio-inspired algorithms to address complex optimization problems efficiently. These algorithms strike a balance between computational efficiency and solution optimality, attracting significant attention across domains.

Bio-inspired optimization techniques for feature engineering and its applications are systematically reviewed with chief objective of assessing statistical influence and significance of “Bio-inspired optimization”-based computational models by referring to vast research literature published between year 2015 and 2022.

The Scopus and Web of Science databases were explored for review with focus on parameters such as country-wise publications, keyword occurrences and citations per year. Springer and IEEE emerge as the most creative publishers, with indicative prominent and superior journals, namely, PLoS ONE, Neural Computing and Applications, Lecture Notes in Computer Science and IEEE Transactions. The “National Natural Science Foundation” of China and the “Ministry of Electronics and Information Technology” of India lead in funding projects in this area. China, India and Germany stand out as leaders in publications related to bio-inspired algorithms for feature engineering research.

The review findings integrate various bio-inspired algorithm selection techniques over a diverse spectrum of optimization techniques. Anti colony optimization contributes to decentralized and cooperative search strategies, bee colony optimization (BCO) improves collaborative decision-making, particle swarm optimization leads to exploration-exploitation balance and bio-inspired algorithms offer a range of nature-inspired heuristics.

With the rapid development of short videos in China, the public has become accustomed to using short videos to express their opinions. This paper aims to solve problems such as how to represent the features of different modalities and achieve effective cross-modal feature fusion when analyzing the multi-modal sentiment of Chinese short videos (CSVs).

This paper aims to propose a sentiment analysis model MSCNN-CPL-CAFF using multi-scale convolutional neural network and cross attention fusion mechanism to analyze the CSVs. The audio-visual and textual data of CSVs themed on “COVID-19, catering industry” are collected from CSV platform Douyin first, and then a comparative analysis is conducted with advanced baseline models.

The sample number of the weak negative and neutral sentiment is the largest, and the sample number of the positive and weak positive sentiment is relatively small, accounting for only about 11% of the total samples. The MSCNN-CPL-CAFF model has achieved the Acc-2, Acc-3 and F1 score of 85.01%, 74.16 and 84.84%, respectively, which outperforms the highest value of baseline methods in accuracy and achieves competitive computation speed.

This research offers some implications regarding the impact of COVID-19 on catering industry in China by focusing on multi-modal sentiment of CSVs. The methodology can be utilized to analyze the opinions of the general public on social media platform and to categorize them accordingly.

This paper presents a novel deep-learning multimodal sentiment analysis model, which provides a new perspective for public opinion research on the short video platform.

The purpose of this study is to identify the research fronts by analysing highly cited core papers adjusted with the age of a paper in library and information science (LIS) where natural language processing (NLP) is being applied significantly.

By excavating international databases, 3,087 core papers that received at least 5% of the total citations have been identified. By calculating the average mean years of these core papers, and total citations received, a CPT (citation/publication/time) value was calculated in all 20 fronts to understand how a front is relatively receiving greater attention among peers within a course of time. One theme article has been finally identified from each of these 20 fronts.

Bidirectional encoder representations from transformers with CPT value 1.608 followed by sentiment analysis with CPT 1.292 received highest attention in NLP research. Columbia University New York, in terms of University, Journal of the American Medical Informatics Association, in terms of journals, USA followed by People Republic of China, in terms of country and Xu, H., University of Texas, in terms of author are the top in these fronts. It is identified that the NLP applications boost the performance of digital libraries and automated library systems in the digital environment.

Any research fronts that are identified in the findings of this paper may be used as a base for researchers who intended to perform extensive research on NLP.

To the best of the authors’ knowledge, the methodology adopted in this paper is the first of its kind where meta-analysis approach has been used for understanding the research fronts in sub field like NLP for a broad domain like LIS.

Customer service conversations are becoming increasingly digital and automated, leaving service encounters impersonal. The purpose of this paper is to identify how customer service agents and conversational artificial intelligence (AI) applications can provide a personal touch and improve the customer experience in customer service. The authors offer a conceptual framework delineating how text-based customer service communication should be designed to increase relational personalization.

This paper presents a systematic literature review on conversation styles of conversational AI and integrates the extant research to inform the development of the proposed conceptual framework. Using social information processing theory as a theoretical lens, the authors extend the concept of relational personalization for text-based customer service communication.

The conceptual framework identifies conversation styles, whose degree of expression needs to be personalized to provide a personal touch and improve the customer experience in service. The personalization of these conversation styles depends on available psychological and individual customer knowledge, contextual factors such as the interaction and service type, as well as the freedom of communication the conversational AI or customer service agent has.

The article is the first to conduct a systematic literature review on conversation styles of conversational AI in customer service and to conceptualize critical elements of text-based customer service communication required to provide a personal touch with conversational AI. Furthermore, the authors provide managerial implications to advance customer service conversations with three types of conversational AI applications used in collaboration with customer service agents, namely conversational analytics, conversational coaching and chatbots.

This chapter critically examines whether it may be possible to create an AI-based authentic leader, questioning the inherent contradiction between artificial and authentic. The authors pose central research questions: Does the application of AI – even just as a powerful resource – challenge the tenets of authentic leadership? What are the possibilities and limitations of the concept of authenticity in AI-based management systems? Moreover, with the help of three vignettes illustrating practical applications of AI-based systems in leadership and management tasks, the authors illustrate how technology may be used to either control or empower workers and leaders. The authors call for research to assess whether the search for authenticity in AI-based leadership could lead anywhere, warning that it could entrap us in unresolvable existential and conceptual ambiguity, ultimately diverting our focus from the essence of leadership altogether.