Search results

Artificial intelligence (AI) has become increasingly important and influential in reading and writing. The influx of social media digital spaces, like TikTok, has also shifted the ways multimodal composition takes place alongside AI. This study aims to argue that within spaces like TikTok, human composers must attend to the ways they write for, with and against the AI-powered algorithm.

Data collection was drawn from a larger study on #BookTok (the TikTok subcommunity for readers) that included semi-structured interviews including watching and reflecting on a TikTok they created. The authors grounded this study in critical posthumanist literacies to analyze and open code five #BookTok content creators’ interview transcripts. Using axial coding, authors collaboratively determined three overarching and entangled themes: writing for, with and against.

Findings highlight the nuanced ways #BookTokers consider the AI algorithm in their compositional choices, namely, in the ways how they want to disseminate their videos to a larger audience or more niche-focused community. Throughout the interviews, participants revealed how the AI algorithm was situated differently as both audience member, co-author and censor.

This study is grounded in critical posthumanist literacies and explores composition as a joint accomplishment between humans and machines. The authors argued that it is necessary to expand our human-centered notions of what it means to write for an audience, to co-author and to resist censorship or gatekeeping.

The purpose of this research is to explore how an industry is represented in multimodal public media narratives and to explore how this representation subsequently affects the formation of public sense-giving space during a persisting crisis, such as a pandemic. The question asked is: how do the use of multimodality by public service media dynamically shape representations of industry identity during a persisting crisis?

This study made use of a multimodal approach. The verbal and visual media text on the restaurant industry during the COVID-19 pandemic that were published in Finland by the public service media distributor Yle were studied. Data published between March 2020 and March 2022 were analysed. The data consisted of 236 verbal texts, including 263 visuals.

Three narratives were identified– victim, servant and survivor – that construct power relations and depict the identity of the restaurant industry differently. It was argued that multimodal media narratives hold three meaning making functions: sentimentalizing, juxtaposing and nuancing industry characteristics. It was also argued that multimodal public service media narratives have wider implications in possibly shaping the future attractiveness of the industry and organizational members' understanding of their identity.

This research contributes to sensemaking literature in that it explores the role of power – explicitly or implicitly constructed through media narratives during crisis. Furthermore, this research contributes to sensemaking literature in that it shows how narratives take shape multimodally during a continuous crisis, and how this impacts the construction of industry identity.

This paper aims to trace how Asian American girls engaged with civic learning in a virtual out-of-school literacy community featuring a curriculum of diverse literary texts.

The researcher used practitioner inquiry to construct a virtual literacy education community dedicated to the civic learning of Asian American girls.

The paper explores how participants mobilized critical practices of textual consumption and production rooted in their intersectional identities and embodied experiences to make meaning of the civic constraints and affordances of marginalized identities and to read and (re)design author choices for civic purposes. These findings – examples of youths’ critical civic meaning-making – indicate how they claimed space for Asian American civic girlhoods in literacy education.

This paper foregrounds how Asian American girls mobilize critical processes of text consumption and production to assert civic identities in literacy education – a significantly under-examined topic in literacy studies. This work has implications for how literacy practitioners and scholars can prioritize Asian American civic girlhoods through pedagogy and research.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

This study aims to explore motives behind teachers' and students' use of translanguaging and how they use it in Tanzanian public secondary school classrooms.

Data were collected using interviews and non-participant observations.

The findings indicate that translanguaging was used to facilitate content comprehension, promote classroom interaction and increase students' motivation to learn. Translanguaging was implemented using three strategies: paraphrasing an English text into Kiswahili, translating an English text into its Kiswahili equivalent and word-level translanguaging.

By highlighting the motivations for translanguaging and corresponding strategies associated with translanguaging pedagogy in the Tanzanian context, this study has significant practical implications for teachers and students to showcase their linguistic and multimodal knowledge, while fostering a safe learning space that relates to students' daily experiences.

The study offers new insights into previous research on the role of language-supportive pedagogy appropriate for teachers and students working within bi-/multilingual education settings.

The aim of the study is threefold: understanding the interconnections amongst visual and verbal multimodal communication strategies used in food discourse; identifying the themes of celebrity chef's food discourse with respect to pro-environmental behaviour; and providing a methodological framework to visually analyse food-themed videos.

This study uses mise-en-scène and critical discourse and multimodal analyses to gain insights on food discourse from 20 videos shared by a Michelin starred chef on social media platforms.

Results show that a pro-environmental cooking philosophy challenges the normative discourse on food and educates general audiences and foodies alike. Mise-en-scène and discourse analyses of Instagram visual content reveal that leftovers are central to the ethical message and are intertwined – through the aesthetic of the videos-with concepts of inclusivity, diversity and nourishment.

Chefs, and restaurants, are encouraged to recognise their responsibility as role models, thus able to influence the societal production of food discourse.

The findings provide new insights into the role of a celebrity chef in promoting sustainable food preparation and consumption.

Vision, audition, olfactory, tactile and taste are five important senses that human uses to interact with the real world. As facing more and more complex environments, a sensing system is essential for intelligent robots with various types of sensors. To mimic human-like abilities, sensors similar to human perception capabilities are indispensable. However, most research only concentrated on analyzing literature on single-modal sensors and their robotics application.

This study presents a systematic review of five bioinspired senses, especially considering a brief introduction of multimodal sensing applications and predicting current trends and future directions of this field, which may have continuous enlightenments.

This review shows that bioinspired sensors can enable robots to better understand the environment, and multiple sensor combinations can support the robot’s ability to behave intelligently.

The review starts with a brief survey of the biological sensing mechanisms of the five senses, which are followed by their bioinspired electronic counterparts. Their applications in the robots are then reviewed as another emphasis, covering the main application scopes of localization and navigation, objection identification, dexterous manipulation, compliant interaction and so on. Finally, the trends, difficulties and challenges of this research were discussed to help guide future research on intelligent robot sensors.

This paper aims to concentrate on recent innovations in flexible wearable sensor technology tailored for monitoring vital signals within the contexts of wearable sensors and systems developed specifically for monitoring health and fitness metrics.

In recent decades, wearable sensors for monitoring vital signals in sports and health have advanced greatly. Vital signals include electrocardiogram, electroencephalogram, electromyography, inertial data, body motions, cardiac rate and bodily fluids like blood and sweating, making them a good choice for sensing devices.

This report reviewed reputable journal articles on wearable sensors for vital signal monitoring, focusing on multimode and integrated multi-dimensional capabilities like structure, accuracy and nature of the devices, which may offer a more versatile and comprehensive solution.

The paper provides essential information on the present obstacles and challenges in this domain and provide a glimpse into the future directions of wearable sensors for the detection of these crucial signals. Importantly, it is evident that the integration of modern fabricating techniques, stretchable electronic devices, the Internet of Things and the application of artificial intelligence algorithms has significantly improved the capacity to efficiently monitor and leverage these signals for human health monitoring, including disease prediction.

Microwave curing (MC) can facilitate rapid concrete repair in cold climates without using conventional accelerated curing technologies which are environmentally unsustainable. Accelerated curing of concrete under MC can contribute to the decarbonisation of the environment and provide economies in construction in several ways such as reducing construction time, energy efficiency, lower cement content, lower carbonation risk and reducing emissions from equipment.

The paper investigates moisture loss and pore properties of six cement-based proprietary concrete repair materials subjected to MC. The impact of MC on these properties is critically important for its successful implementation in practice and current literature lacks this information. Specimens were microwave cured for 40–45 min to surface temperatures between 39.9 and 44.1 °C. The fast-setting repair material was microwave cured for 15 min to 40.7 °C. MC causes a higher water loss which shows the importance of preventing drying during MC and the following 24 h.

Portland cement-based normal density repair mortars, including materials incorporating pfa and polymer latex, benefit from the thermal effect of MC on hydration, resulting in up to 24% reduction in porosity relative to normal curing. Low density and flowing repair materials suffer an increase in porosity up to 16% due to MC. The moisture loss at the end of MC and after 24h is related to the mix water content and porosity, respectively.

The research on the application of MC for rapid repair of concrete is original. The research was funded by the European commission following a very rigorous and competitive review process which ensured its originality. Original data on the parameters of porosity and moisture loss under MC are provided for different generic cementitious repair materials which have not been studied before. Application of MC to concrete construction especially in cold climates will provide environmental, economic and energy benefits.