Search results

Although numerous signal modalities are available for emotion recognition, audio and visual modalities are the most common and predominant forms for human beings to express their emotional states in daily communication. Therefore, how to achieve automatic and accurate audiovisual emotion recognition is significantly important for developing engaging and empathetic human–computer interaction environment. However, two major challenges exist in the field of audiovisual emotion recognition: (1) how to effectively capture representations of each single modality and eliminate redundant features and (2) how to efficiently integrate information from these two modalities to generate discriminative representations.

A novel key-frame extraction-based attention fusion network (KE-AFN) is proposed for audiovisual emotion recognition. KE-AFN attempts to integrate key-frame extraction with multimodal interaction and fusion to enhance audiovisual representations and reduce redundant computation, filling the research gaps of existing approaches. Specifically, the local maximum–based content analysis is designed to extract key-frames from videos for the purpose of eliminating data redundancy. Two modules, including “Multi-head Attention-based Intra-modality Interaction Module” and “Multi-head Attention-based Cross-modality Interaction Module”, are proposed to mine and capture intra- and cross-modality interactions for further reducing data redundancy and producing more powerful multimodal representations.

Extensive experiments on two benchmark datasets (i.e. RAVDESS and CMU-MOSEI) demonstrate the effectiveness and rationality of KE-AFN. Specifically, (1) KE-AFN is superior to state-of-the-art baselines for audiovisual emotion recognition. (2) Exploring the supplementary and complementary information of different modalities can provide more emotional clues for better emotion recognition. (3) The proposed key-frame extraction strategy can enhance the performance by more than 2.79 per cent on accuracy. (4) Both exploring intra- and cross-modality interactions and employing attention-based audiovisual fusion can lead to better prediction performance.

The proposed KE-AFN can support the development of engaging and empathetic human–computer interaction environment.

This study aims to develop an experimentally validated three-dimensional numerical model for predicting different flow patterns produced with a gas dynamic virtual nozzle (GDVN).

The physical model is posed in the mixture formulation and copes with the unsteady, incompressible, isothermal, Newtonian, low turbulent two-phase flow. The computational fluid dynamics numerical solution is based on the half-space finite volume discretisation. The geo-reconstruct volume-of-fluid scheme tracks the interphase boundary between the gas and the liquid. To ensure numerical stability in the transition regime and adequately account for turbulent behaviour, the k-ω shear stress transport turbulence model is used. The model is validated by comparison with the experimental measurements on a vertical, downward-positioned GDVN configuration. Three different combinations of air and water volumetric flow rates have been solved numerically in the range of Reynolds numbers for airflow 1,009–2,596 and water 61–133, respectively, at Weber numbers 1.2–6.2.

The half-space symmetry allows the numerical reconstruction of the dripping, jetting and indication of the whipping mode. The kinetic energy transfer from the gas to the liquid is analysed, and locations with locally increased gas kinetic energy are observed. The calculated jet shapes reasonably well match the experimentally obtained high-speed camera videos.

The model is used for the virtual studies of new GDVN nozzle designs and optimisation of their operation.

To the best of the authors’ knowledge, the developed model numerically reconstructs all three GDVN flow regimes for the first time.

This review aims to give a critical view of the wheel/rail high frequency vibration-induced vibration fatigue in railway bogie.

Vibration fatigue of railway bogie arising from the wheel/rail high frequency vibration has become the main concern of railway operators. Previous reviews usually focused on the formation mechanism of wheel/rail high frequency vibration. This paper thus gives a critical review of the vibration fatigue of railway bogie owing to the short-pitch irregularities-induced high frequency vibration, including a brief introduction of short-pitch irregularities, associated high frequency vibration in railway bogie, typical vibration fatigue failure cases of railway bogie and methodologies used for the assessment of vibration fatigue and research gaps.

The results showed that the resulting excitation frequencies of short-pitch irregularity vary substantially due to different track types and formation mechanisms. The axle box-mounted components are much more vulnerable to vibration fatigue compared with other components. The wheel polygonal wear and rail corrugation-induced high frequency vibration is the main driving force of fatigue failure, and the fatigue crack usually initiates from the defect of the weld seam. Vibration spectrum for attachments of railway bogie defined in the standard underestimates the vibration level arising from the short-pitch irregularities. The current investigations on vibration fatigue mainly focus on the methods to improve the accuracy of fatigue damage assessment, and a systematical design method for vibration fatigue remains a huge gap to improve the survival probability when the rail vehicle is subjected to vibration fatigue.

The research can facilitate the development of a new methodology to improve the fatigue life of railway vehicles when subjected to wheel/rail high frequency vibration.

Cross-layer approach in media access control (MAC) layer will address interference and jamming problems. Hybrid distributed MAC can be used for simultaneous voice, data transmissions in wireless sensor network (WSN) and Internet of Things (IoT) applications. Choosing the correct objective function in Nash equilibrium for game theory will address fairness index and resource allocation to the nodes. Game theory optimization for distributed may increase the network performance. The purpose of this study is to survey the various operations that can be carried out using distributive and adaptive MAC protocol. Hill climbing distributed MAC does not need a central coordination system and location-based transmission with neighbor awareness reduces transmission power.

Distributed MAC in wireless networks is used to address the challenges like network lifetime, reduced energy consumption and for improving delay performance. In this paper, a survey is made on various cooperative communications in MAC protocols, optimization techniques used to improve MAC performance in various applications and mathematical approaches involved in game theory optimization for MAC protocol.

Spatial reuse of channel improved by 3%–29%, and multichannel improves throughput by 8% using distributed MAC protocol. Nash equilibrium is found to perform well, which focuses on energy utility in the network by individual players. Fuzzy logic improves channel selection by 17% and secondary users’ involvement by 8%. Cross-layer approach in MAC layer will address interference and jamming problems. Hybrid distributed MAC can be used for simultaneous voice, data transmissions in WSN and IoT applications. Cross-layer and cooperative communication give energy savings of 27% and reduces hop distance by 4.7%. Choosing the correct objective function in Nash equilibrium for game theory will address fairness index and resource allocation to the nodes.

Other optimization techniques can be applied for WSN to analyze the performance.

Game theory optimization for distributed may increase the network performance. Optimal cuckoo search improves throughput by 90% and reduces delay by 91%. Stochastic approaches detect 80% attacks even in 90% malicious nodes.

Channel allocations in centralized or static manner must be based on traffic demands whether dynamic traffic or fluctuated traffic. Usage of multimedia devices also increased which in turn increased the demand for high throughput. Cochannel interference keep on changing or mitigations occur which can be handled by proper resource allocations. Network survival is by efficient usage of valid patis in the network by avoiding transmission failures and time slots’ effective usage.

Literature survey is carried out to find the methods which give better performance.

Time of flight (ToF) imaging is a promising emerging technology for the purposes of crop identification. This paper aim to presents localization system for identifying and localizing asparagus in the field based on point clouds from ToF imaging. Since the semantics are not included in the point cloud, it contains the geometric information of other objects such as stones and weeds other than asparagus spears. An approach is required for extracting the spear information so that a robotic system can be used for harvesting.

A real-time convolutional neural network (CNN)-based method is used for filtering the point cloud generated by a ToF camera, allowing subsequent processing methods to operate over smaller and more information-dense data sets, resulting in reduced processing time. The segmented point cloud can then be split into clusters of points representing each individual spear. Geometric filters are developed to eliminate the non-asparagus points in each cluster so that each spear can be modelled and localized. The spear information can then be used for harvesting decisions.

The localization system is integrated into a robotic harvesting prototype system. Several field trials have been conducted with satisfactory performance. The identification of a spear from the point cloud is the key to successful localization. Segmentation and clustering points into individual spears are two major failures for future improvements.

Most crop localizations in agricultural robotic applications using ToF imaging technology are implemented in a very controlled environment, such as a greenhouse. The target crop and the robotic system are stationary during the localization process. The novel proposed method for asparagus localization has been tested in outdoor farms and integrated with a robotic harvesting platform. Asparagus detection and localization are achieved in real time on a continuously moving robotic platform in a cluttered and unstructured environment.

The purpose of this paper is to understand how hospitality companies can best explain controversial corporate social responsibility (CSR) activities to consumers who may not agree with the CSR activity. This research explores message framing through emotional and cognitive appeals to influence consumer perceptions of the Gideon Bible in USA hotel rooms. The study uses the theory of deontic justice to measure the impacts of messaging on consumer perceptions of the morality of the Gideon Bible as suicide prevention in hotels and its relation to controversial CSR initiatives.

The study uses an experimental study design via a self-administered survey to analyze participants’ perceptions of the placement of the Gideon Bible in hotel rooms and participants’ attitudes toward CSR initiatives based on deontic justice and religion using different message framing conditions.

Results show that religion was a major determinant of attitude towards the Gideon Bible, but the sentiment analysis also revealed that negative perceptions can be mitigated through message framing via emotional and cognitive appeals. Additionally, the cognitive appeal did impact CSR perceptions, as did identifying as Christian. Moral outrage emerged as a significant moderator for the relationships between message framing, attitudes toward the Gideon Bible and CSR.

This study provides an extension of deontic justice research to examine justice traits in accepting controversial CSR.

Beneficiary photos on charity appeals are believed to engender prosocial behavior. This study explores photo framing of healthy and unhealthy beneficiary photos in the context of photo-rich online medical crowdfunding. Based on framing theory, emphasis framing effect (i.e. unhealthy photos only vs both healthy and unhealthy photos) and equivalency framing effect (i.e. healthy photos prior to unhealthy photos vs unhealthy photos prior to healthy photos) are identified.

A scenario-based experiment with 135 participants was used to empirically test the proposed research hypotheses. The subjects were randomly assigned to three treatment groups, with 45 subjects in each group. ANOVA, linear regression, and multiple mediation analysis were used to analysis data.

The results reveal that disclosing both healthy and unhealthy photos can elicit stronger sympathy and perceived need than merely disclosing unhealthy photos. Moreover, the order of unhealthy photos prior to healthy photos leads to a higher level of sympathy than the order of healthy photos prior to unhealthy photos. Furthermore, sympathy and perceived need are positively related to donation intention.

First, this study extends the photo-related research limited to certain characteristics of a single photo to the sequence effect of multiple photos. Second, this study contributes to framing theory by introducing photo framing, particularly the equivalence and emphasis framing effect of beneficiary photos. Finally, this study reveals the emotional and cognitive routes through which beneficiary photos stimulate prosocial behavior. It also offers practical guidance in the aspects of the framing effect of beneficiary photos for crowdfunding management.

This paper examines how key actors in the UK food system (FS) understand the role of the local food sector in relation to FS resilience.

Discourse analysis was used to assess and compare the framings of the UK FS in 36 publications released during Covid-19 from alternative food networks (AFNs) actors and from other more mainstream FS actors, including the UK government.

The analysis shows that AFNs actors perceive the UK FS as not resilient and identify local FSs as a route towards greater resilience (“systemic” framing). In contrast, other food actors perceive the UK FS as already resilient, with the role of local food limited to specific functions within the existing system (“add-on” framing). The two groups converge on the importance of dynamic public procurement and local abattoir provision, but this convergence does not undermine the fundamental divergence in the understanding of the role of “the local” in resilient UK FSs. The local food sector’s messages appear to have gone largely unheard in mainstream policy.

The paper presents an analysis of public sector reports focused on the UK FS released during the Covid-19 pandemic years 2020–2021. The corpus inclusion criteria mean that publications during this period which focus on other food sector issues, such social injustices, climate change and health, were not included in the analysis, although they may have touched upon local food issues. The authors further recognise that Covid-19 had a longer lasting effect on FSs than the years 2020–2021, and that many other publications on FSs have been published since. The time span chosen targets the time at which FSs were most disrupted and therefore aims to capture emerging issues and solutions for the UK FS. The authors’ insights should be further validated through a more complete review of both public reports and academic papers covering a wider base of food-related issues and sectors as well as a broader timespan.

A comparison of how different FS actors understand the importance of local food, especially in relation to resilience, has not been undertaken to date. The findings raise important questions about the disconnect between AFN actors and other actors in the framing of resilience. Considering the need to ensure resilience of the UK FS, this study's findings raise important insights for UK food policy about the “local food blindspot” and for food movement actors wishing to progress their vision of transformative change.

Research on artificial intelligence (AI) and its potential effects on the workplace is increasing. How AI and the futures of work are framed in traditional media has been examined in prior studies, but current research has not gone far enough in examining how AI is framed on social media. This paper aims to fill this gap by examining how people frame the futures of work and intelligent machines when they post on social media.

We investigate public interpretations, assumptions and expectations, referring to framing expressed in social media conversations. We also coded the emotions and attitudes expressed in the text data. A corpus consisting of 998 unique Reddit post titles and their corresponding 16,611 comments was analyzed using computer-aided textual analysis comprising a BERTopic model and two BERT text classification models, one for emotion and the other for sentiment analysis, supported by human judgment.

Different interpretations, assumptions and expectations were found in the conversations. Three subframes were analyzed in detail under the overarching frame of the New World of Work: (1) general impacts of intelligent machines on society, (2) undertaking of tasks (augmentation and substitution) and (3) loss of jobs. The general attitude observed in conversations was slightly positive, and the most common emotion category was curiosity.

Findings from this research can uncover public needs and expectations regarding the future of work with intelligent machines. The findings may also help shape research directions about futures of work. Furthermore, firms, organizations or industries may employ framing methods to analyze customers’ or workers’ responses or even influence the responses. Another contribution of this work is the application of framing theory to interpreting how people conceptualize the future of work with intelligent machines.

Taking the dialogic organizational development perspective, this study aims to investigate the framing processes when engaging in dialogue for strategy implementation and how these enable the evolution of implementation opportunities.

Through a qualitative exploratory study conducted in a large multinational, the authors analyse the dialogue and interactions among 25 dyads when identifying opportunities to contribute to strategy implementation. The data analysis relies on a process-coding approach and linkography, a valuable protocol analysis for identifying recursive interaction schemas in conversations.

The authors identify four main framing processes – shaping, unveiling, scattering and shifting – and provide a framework of how these processes affect individuals’ mental models through increasing the tangibility of opportunities or elevating them to new value hierarchies.

From a theoretical perspective, this study contributes to the strategy implementation and organizational development literature, providing a micro-perspective of how dialogue allows early knowledge structures to emerge and shape the development of opportunities for strategy implementation.

From a managerial perspective, the authors offer insights to trigger action and change in individuals to contribute to strategy when moving from formulation to implementation.

Rather than focusing on the structural control view of strategy implementation and the role of the top management team, this study considers strategy implementation as a practice and what it takes for organizational actors who do not take part in strategy formulation to enact and shape opportunities for strategy implementation through constructive dialogue.