Search results

With the increasing abundance of network resources and big data, multi-modal information search (MMIS) has been paid more and more attention, but the research results of MMIS are relatively few. This paper attempts to put forward constructive suggestions for the design of multi-modal information system, so that the system can have a better user experience, help users improve the efficiency of obtaining information and optimize the information service mode.

A research model of influencing factors is established by using the TAM (technology acceptance model) theory. The influencing factors of users' multi-modal information search behavior (MMISB) are analyzed by using questionnaire, experiment and the structural equation model. On the basis of this, some suggestions are put forward to build the multi-modal search (MMS) system and improve the efficiency of MMIS.

The research shows that users' MMISB is directly related to their search intention, and the search intention can influence users' cognition of the usefulness and ease of MMIS through their own information search ability and system characteristics. The user's MMIS ability is affected by the demand expression ability and retrieval ability cognition; the user's cognition of system characteristics is affected by the system function and information quality. This shows that the user's MMISB is closely related to the user's cognitive situation, but due to the author's limited time and research ability, only the questionnaire survey method cannot be used to in-depth research and explore the influencing factors of MMIS. Therefore, in the future research, we should combine the interview method to further track the user's emotional factors and scene factors.

For the first time, TAM theory is combined with cross-modal retrieval behavior and the paper explores the influencing factors and evaluation indexes of users' MMISB. The second, the questionnaire was compiled to investigate the influencing factors of the MMISB of the university group, and the reliability analysis, validity analysis, correlation analysis and structural equation model analysis of the survey data are carried out . The survey data and analysis results are original, which can provide a theoretical basis for improving the service level of MMIS.

This paper aims to improve the diversity and richness of haptic perception by recognizing multi-modal haptic images.

First, the multi-modal haptic data collected by BioTac sensors from different objects are pre-processed, and then combined into haptic images. Second, a multi-class and multi-label deep learning model is designed, which can simultaneously learn four haptic features (hardness, thermal conductivity, roughness and texture) from the haptic images, and recognize objects based on these features. The haptic images with different dimensions and modalities are provided for testing the recognition performance of this model.

The results imply that multi-modal data fusion has a better performance than single-modal data on tactile understanding, and the haptic images with larger dimension are conducive to more accurate haptic measurement.

The proposed method has important potential application in unknown environment perception, dexterous grasping manipulation and other intelligent robotics domains.

This paper proposes a new deep learning model for extracting multiple haptic features and recognizing objects from multi-modal haptic images.

The purpose of this paper is to elaborate on a novel multi-modal enabling technique for contextualising brand consumption experiences.

A multi-modal interpretive narrative approach is presented as a means of investigating brands as experiential entities for use in consumer identity projects. It reports the strategic use of different modes of data collection: autobiographical narratives generated by solo participants to create a benchmark of identity and subsequent friendship pair guided discussion interviews. This offers a faster, cheaper and more convenient means of gaining access to consumer experiences of brands than traditional ethnographic methods, which require prolonged engagements within a community.

Consumer narratives of actual brand consumption and of mediated brand consumption are enhanced using this method. The consumer narratives generated provided rich insights into the role of brands in contributing to national identity. The contextualised use and function of identity narratives provided by brands were identified in addition to the identification of national community rituals of consumption.

The multi-modal use of friendship pair interviews with solo autobiographical interviews is shown to offer benefits to qualitative consumer researchers focussing on brand/identity issues. The combination of data collection methods allowed for greater reflexive, memorial and contextualised discussion in the friendship pair interviews about brand narrative consumption and generated responses that advance beyond socio-political conventions concerning brands. Consequently, contextualised brand consumption experiences can be accessed more effectively than in conventional depth interviews.

Discusses the importance of an effective supply chain to companies trading in Europe. Looks at the recent technological developments which are leading to more sophisticated multi‐modal distribution techniques. Suggests that technology is the most important issue which businesses must address if they are to compete as world‐class companies. Proposes that multi‐modal distribution is becoming a key part in the successful management of the European supply chain and that logistics professionals should work closely with their clients to ensure the most effective method is selected.

Marketers use e-mail in new, potentially more informative, entertaining and lucrative ways – such as embedding video. The purpose of this paper is to examine consumer responses to audiovisual (i.e. text along with a short video) versus text-only messages in brand communication. Specifically, authors seek to uncover the efficacy of marketer-embedded video (vs text-only) in e-mail on the consumer's product interest, informativeness, perceived prestige, electronic word-of-mouth (e-WOM) intentions and willingness to pass the electronic message along digitally or on social media. With the dual coding theory and selective visual attention as theoretical guideposts, the intended contribution is a framework that can explain and predict advantages for multi-modal e-mail marketing communications.

Five hypotheses are tested experimentally with a one-factor experiment with two conditions (text-only vs audiovisual). The sample was 240 adult participants. Real brands (Audi and Apple) were used. For both brands, participants were randomly assigned to one of two conditions of the e-mail (i.e. audiovisual vs text-only). The stimuli are identical, with the exception of embedded video in the e-mail body. The videos are authentic brand videos, are approximately 50 s and use a product feature appeal. Participants’ pre-existing brand attitude was measured. Then, five dependent variables (product interest, informativeness, perceived prestige, e-WOM intentions and willingness to pass the electronic message along digitally or on social media) were considered with respect to consumer exposure to e-mail with video and text in the e-mail from the brand versus text-only e-mail from the brand.

The results supported the hypotheses that audiovisual messages (i.e. those with text and video) heighten informativeness, product interest, perceived prestige, intentions to spread e-WOM for a brand and willingness to pass along the e-mail along to friends and family when compared to text-only messages. These experimental findings from a one-factor experiment with two conditions (text-only vs audiovisual) are generally consistent for an American consumer technology brand Apple (iPhone) and a German luxury automobile brand Audi (S4). Hypotheses are supported for both brands (Apple and Audi), with the exception of product interest for Audi, which may be explained by the high price of a luxury automobile.

An implication here for the dual coding theory is that the theory may be extended to consider what happens after the consumer codes the information with both the verbal and the non-verbal subsystem. The finding of interest to information processing scholars is that a video accompanying text communication from a brand to a consumer has an advantage over text-only communication. Brands that communicate with multi-modal marketing communication have better outcomes in informativeness, brand prestige perceptions and intentions of online consumer behaviors, including positive e-WOM for the brand in general and willingness to pass the specific content along in digital and social media platforms. Consumers can become brand advocates by being more inclined to forward the e-mails with the product short video as well as the e-mail text.

Brand marketers should consider e-mail in an integrated brand promotion (IBP) campaign as a cost advantage; one of the reasons e-mail should have a solid place in the IBP toolkit is due to e-mail's relatively low cost. The main cost comes with administration and production of the video. As a managerial implication for advertisers, embedding ads of a short video format in e-mails is a way to be more effective than plain-text e-mails. Short videos in e-mails are a reasonable idea to include in an integrated marketing communications effort (plausibly due to information processing with both a verbal and a non-verbal system). Brands can use videos in e-mails to enhance informativeness regarding products to enhance product differentiation from competitors. Yet, it is important to raise caution with some concerning disadvantages potentially associated with e-mail marketing and video. The three areas of caution include potential issues of privacy, clutter and technical inhibitors.

Despite the fact that e-mail is one of the most heavily used communication tools in marketing, there is scarce literature on e-mail and branding. By brands evoking a degree of prestige with embedded videos, consumer willingness to become part of the marketing communications is enhanced, as their e-WOM and willingness to share the branded content increase.

The paper aims to propose a virtual reality (VR) wisdom teaching model in open university English course from the perspective of “Metaverse”. The study aims to testify the stimulation for English learning and the effectiveness of English-expressing with VR tools for adult learners from the practice in a pilot reform project.

The paper opted for an exploratory study using ICARE Design Model as the framework, under the grounded theories of constructivism and multi-modal teaching. The study compared the evaluation data of one-semester English learning performance between the experimental class (67 students) with VR practice and the controlled class (67 students), including speaking test score, qualitative feedback and in-depth experience analysis. The data were complemented by reflection paper analysis, including manual evaluation (the criteria of semantics, pronunciation, fluency and completeness), questionnaire survey (in the form of five-point Likert scale) and semi-structured interview.

The paper provides empirical insights about the VR wisdom teaching model in English language teaching and learning in a Chinese Open University. The empirical results suggest that “3I” features of VR technology could make up for the shortcomings of traditional English classes in open universities in China, and VR resources designed with curriculum teaching materials could also be helpful for students’ command of knowledge points and language skills. What’s more, the sense of authentic experience in virtual could promote the teaching and learning effect in college English classes.

The present study focuses on a wisdom mode of foreign language teaching and learning for adult learners in open education, so the research results may lack generalizability. Therefore, researchers are encouraged to further explore the deep integration of VR/artificial intelligence in foreign language teaching and learning.

This paper fulfills an identified need to study how VR tools provide an engaging, fun and immersive language learning environment, to enhance autonomous learning and learning engagement.

The purpose of this paper is to provide a framework for analysing and modelling detailed workflow of image‐guided interventions to facilitate simulation and the re‐engineering process for the development of new procedures in multi‐modal imaging environments.

The methodology presented includes a literature review on workflow simulation in surgery, focussing on radiology environments, an assessment of simulation tools, a data gathering and management framework and research on methods for conceptual modelling of the processes.

The literature review reveals that few authors attempted to analyse the phases within image‐guided interventions, and those that did, only did so partially. The framework developed for this work intends to fill the gap found in the survey. It allows the maintenance and management of large amounts of data, one of the most critical factors when modelling detailed workflow. In addition, selecting the appropriate simulation software plays an important role, saving time in later stages of the project.

The framework presented for endovascular interventions can be extended to other types of image‐guided interventions. Moreover, modelling the workflow processes in a modular way facilitates the re‐engineering process when integrating different imaging modalities during the same procedure.

The purpose of this paper is to explore how student learning materials, such as textbooks, are becoming more oriented toward multi-modal approaches using visuality and orality. While such approaches may help students to understand and then to reproduce taught materials, the objective of this paper is to question whether they are serving to promote students’ critical literacy.

The paper assesses the character of current textbooks and other means of student support, such as online learning management systems, and assesses how well they seem able to promote the critical literacy that requires ability in “reading against” and “writing back”. The paper goes on to identify ways in which some parts of the university see orality as preliminary and subordinate to literacy-focused communication, but elsewhere, the pinnacle of students’ work is artistic or creative attainments with lesser need to write complexly literate textual works.

As a means of trying to resolve inherent tensions between differing pedagogical assumptions and methods in the university, the paper proposes ways in which Ong’s (1982, p. 36) nine communication characteristics of “orally based thought and expression” may be able to offer insights into challenges of improving students’ critical literacy.

The inherent academic tensions within the university still remain insufficiently theorized. For example, the humanities and social sciences (still) place much store on developing students’ abilities in critical writing, while disciplines such as design or creative arts are much more focused on students’ creative outputs. The paper contributes to a better understanding of such scholars talking past one another.

Scholars in different academic camps often note the discrepancies in how their relative pedagogical tasks are to be understood, but typically, it is not clear to them how they might better relate to other parts of the university. The paper aims to elucidate the nature of academic differences that often appear to exist to provide insights into possibly new ways of seeing everyday teaching and learning.

Ong’s insights into literacy and orality when viewed through a prism of tertiary teaching and learning provide a practical means whereby students and other university stakeholders can develop a better appreciation of the character of the modern university.

The novel use of Walter Ong’s model of literacy and orality provides fresh ways of seeing challenges and disputes within the academic community and suggests new ways of seeing students’ work and their teachers’ expectations of them.

The purpose of this paper is to explore how corporate heritage identity (CHI) implementation strategies are communicated by Grundfos, a 70-year-old global company from Denmark, in their internal history references.

Drawing on an interdisciplinary methodological framework related to heritage identity communication, hypertextuality, and multi-modality, it proposes a multi-leveled analysis model through which communicative strategies are explored at the level of four semiotic modes (written text, speech, still image, and moving image) and at the level of their hypermodal interplay.

This exploratory case study explains how CHI implementation strategies are communicated in accordance with the potential and constraints of semiotic modes and hyperlinking affordances. The analytical work suggests that the management employs complex CHI implementation strategies in order to strengthen organizational identity and to influence employees’ identification with the company across past, present, and future.

By examining the semiotic modes’ interconnectivity and functional differentiation in a hypermodal context, this paper expands existing research by extending the multi-modal focus to a hypertextual one.

By exploring CHI implementation strategies from a hypermodal perspective and by providing a replicable model of hypermodal analysis, this paper fills a gap in the heritage identity research. Furthermore, it can also be of value to practitioners who intend to design company webpages that strategically communicate heritage identity implementation strategies in order to engage the employees in the company’s heritage.