Search results

The purpose of this study is to examine playful practices in the science video composition of a fourth-grader.

With an analytic interest in “chasing the theory of muchness” (Thiel, 2015a) that describes distinctive moments of affective energies in playful learning, the authors explored a child’s video in which a food chain is dramatized.

The authors identified how muchness manifested in/through her compositional play.

The potential of playful composing and dramatizing to support meaning-making across contexts and disciplines is discussed.

Multimodal writing portfolios were introduced and integrated into an undergraduate course and a graduate course in a research-oriented university in northwest Taiwan. This study aims to examine the influence of multimodal writing portfolios of novice researchers' academic writing.

Comparative case studies involve collecting data from several cases and analyzing the similarities, differences and patterns across cases (Merriam, 2009). To address this underdeveloped area of research, a comparative case study method was employed to understand undergraduate and graduate students' multimodal writing portfolios in academic writing in two courses in Taiwan.

First, multimodal writing portfolios enabled novice researchers to be more familiar with the structure of academic paper and they had better performance in intrapersonal and linguistic aspects. Second, novice researchers held positive attitude toward multimodal writing portfolios because they regarded process of making multimodal writing portfolios as preparation for their future academic writing. Finally, participants highly valued the class PowerPoint slides, weekly writing tasks and the instructor's modeling as effective facilitation for making multimodal writing portfolios.

Limited studies focus on multimodal writing portfolios (e.g. Silver, 2019). The present case study explores the integration of a multimodal writing portfolio into one undergraduate and one graduate course to explore learners' attitude and performance in academic writing.

Novice researchers can learn to compose multimodal academic texts for the academic writing community.

Suggestions on effective integration of multimodal writing portfolios into academic writing instruction were provided based on the research findings.

The findings of the study provide the field of L2 writing with insights into the pedagogical development of multilingual writing portfolios and help educators to be better prepared for teaching novice researchers to comprehend and compose multimodal texts and enter the academic writing community. The framework in Figure 1 and suggestions on course designs for academic writing can inform educators on the integration of multimodality in academic discourse. Moreover, this study moves beyond general writing courses at the tertiary level and could contribute to L2 writers' deeper understanding of how multimodal writing portfolios can be constructed.

This paper aims to demonstrate how Alayah, a 16-year-old African American girl, leverages multiple expressive modes for intersectional self-representation as speculative design. Here, speculative design refers to a multimodal composition (i.e. digital collage) which leverages multiple expressive modes for intersectional self-celebration in possible futures.

Informed by intersectional multimodal literacy frameworks and analyses, this paper addresses the question, “How does Alayah represent her college and career futures in her speculative multimodal design? To address this question, the author analyzed Alayah's digital collage using an intersectional multimodal analysis template complemented by a thematic analysis of her interview data and the narrated explanation of her collage.

In a speculative design composed of 15 images and words, Alayah agentively determined and critically celebrated her intersectional college and career futures through four interrelated themes: Black girl affirmation; Collegiate success; “Sweet” work; and Black livingness.

By centering Black girls’ speculative multimodal designs in college and career curricula, ELA educators (re)imagine college and career pedagogies to critically celebrate Black adolescent girls as intelligent, empowered and literate young women worthy of the futures that they desire.

Artificial intelligence (AI) has become increasingly important and influential in reading and writing. The influx of social media digital spaces, like TikTok, has also shifted the ways multimodal composition takes place alongside AI. This study aims to argue that within spaces like TikTok, human composers must attend to the ways they write for, with and against the AI-powered algorithm.

Data collection was drawn from a larger study on #BookTok (the TikTok subcommunity for readers) that included semi-structured interviews including watching and reflecting on a TikTok they created. The authors grounded this study in critical posthumanist literacies to analyze and open code five #BookTok content creators’ interview transcripts. Using axial coding, authors collaboratively determined three overarching and entangled themes: writing for, with and against.

Findings highlight the nuanced ways #BookTokers consider the AI algorithm in their compositional choices, namely, in the ways how they want to disseminate their videos to a larger audience or more niche-focused community. Throughout the interviews, participants revealed how the AI algorithm was situated differently as both audience member, co-author and censor.

This study is grounded in critical posthumanist literacies and explores composition as a joint accomplishment between humans and machines. The authors argued that it is necessary to expand our human-centered notions of what it means to write for an audience, to co-author and to resist censorship or gatekeeping.

The purpose of this research is to explore how an industry is represented in multimodal public media narratives and to explore how this representation subsequently affects the formation of public sense-giving space during a persisting crisis, such as a pandemic. The question asked is: how do the use of multimodality by public service media dynamically shape representations of industry identity during a persisting crisis?

This study made use of a multimodal approach. The verbal and visual media text on the restaurant industry during the COVID-19 pandemic that were published in Finland by the public service media distributor Yle were studied. Data published between March 2020 and March 2022 were analysed. The data consisted of 236 verbal texts, including 263 visuals.

Three narratives were identified– victim, servant and survivor – that construct power relations and depict the identity of the restaurant industry differently. It was argued that multimodal media narratives hold three meaning making functions: sentimentalizing, juxtaposing and nuancing industry characteristics. It was also argued that multimodal public service media narratives have wider implications in possibly shaping the future attractiveness of the industry and organizational members' understanding of their identity.

This research contributes to sensemaking literature in that it explores the role of power – explicitly or implicitly constructed through media narratives during crisis. Furthermore, this research contributes to sensemaking literature in that it shows how narratives take shape multimodally during a continuous crisis, and how this impacts the construction of industry identity.

This study aims to explore the implications of a recent case in spring 2022 where the novel Dracula went “viral” as tens of thousands of Tumblr users participated in a serialized re-reading and discussion of the text through the hashtags #dracula and #dracula daily.

The authors use a mixed-methods sequential explanatory design approach (quant: topic modeling; qual: multimodal content analysis) to examine how users describe their own practices as well as top posts (more than 25,000 likes, comments and reblogs) in the first month of the collective reading of the novel.

The authors found that the serialization of Dracula made space for “wandering reading practices” (Chavez, 2010) relevant to this interpretive community on Tumblr. The quantitative methods determined specific affective, intertextual and serialized aspects of textual play that were salient to readers. In top posts themselves, the authors saw readers creating metaleptic content imagining characters like the protagonist Jonathan in other novels or contexts, as well as processing and playing with their collective emotional responses toward characters. Additionally, readers used irony or satire through multimodal compositions to create literary arguments.

Playfully analyzing literature together through intertextual connections and multimodal memes has the potential to be both emotionally resonant, culturally relevant and supportive of literary interpretive practices. Based on these findings, the authors provide suggestions for teachers working to embrace interpretive play in formal learning spaces.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The purpose of this paper is to re-center playfulness as a humanizing approach in teacher education. As teachers navigate the current moment of heightened control, surveillance, and systemic inequity, these proposed moves in teacher education can be transgressive. Rather than play as relegated to childhood or infancy, what does it look like to continue to be “playful” in teaching and teacher education?

To examine how teacher educators may design for teachers’ critical playful literacies, the authors offer three “worked examples” (Gee, 2009) of preservice teachers’ playful practices in an English literacies teacher education course.

The authors highlight instructional design elements pertinent to co-designing for teachers’ play and playful literacies in teacher education: generative constraints to practice everyday ingenuity, figuring it out to foster teacher agency and debriefs to interrupt the teaching’s perpetual performance.

The term “playful,” as a descriptor of practice and qualifier of activity appears frequently in educational literature across domains. The relationship of play to critical literacies – and, more specifically, educators’ literacies and learning – is less frequently explored.

This paper aims to explore sonic play in close proximity to a music, literacy and songwriting for social change community-based initiative. The authors leverage ideas about time, space and narrative under the concept of sonic flux to understand youth’s sonic and aural play on digital beatmaking technologies. In doing so, the authors break from a fixation on the written and spoken word and address sound, aurality and Blacktronika creative technologies that are often present but muted in literacies and songwriting scholarship.

The authors’ team consisted of three community-based teaching artists who situated this inquiry around their own practice with youth. The authors conducted this inquiry through a qualitative, participatory and community-engaged research approach. As such, the authors codeveloped and carried out research questions and sense-making protocols that balance the power of interpretation and epistemologies among us.

The findings address how the joy, laughter and play of one young musician, Malik, moved across different conceptions of time while learning to make beats in proximity to peers writing lyrics for songs. Specifically, the authors unpack how Malik’s play with mobile sound-making technologies moved across linear and nonlinear time that characterize sonic space and sound art, not music and lyric writing. In doing so, the loops and durations of his sonic play were sometimes unbound by narrative structures that often code literacy and songwriting initiatives.

The authors’ inquiry speaks into literacy and songwriting initiatives that privilege spoken, written and performed word over sound. The authors ask what kind of participating structures, collaborations, ontologies and youth epistemologies open up if we think of youth in these spaces not only as performers but as programmers tinkering with time in the machine. In addition, the authors ask what literacy and songwriting spaces might look like when the duration, loops and drones of sonic space and not music are the structuring codes over narratives and linearity.

This study aims to explore motives behind teachers' and students' use of translanguaging and how they use it in Tanzanian public secondary school classrooms.

Data were collected using interviews and non-participant observations.

The findings indicate that translanguaging was used to facilitate content comprehension, promote classroom interaction and increase students' motivation to learn. Translanguaging was implemented using three strategies: paraphrasing an English text into Kiswahili, translating an English text into its Kiswahili equivalent and word-level translanguaging.

By highlighting the motivations for translanguaging and corresponding strategies associated with translanguaging pedagogy in the Tanzanian context, this study has significant practical implications for teachers and students to showcase their linguistic and multimodal knowledge, while fostering a safe learning space that relates to students' daily experiences.

The study offers new insights into previous research on the role of language-supportive pedagogy appropriate for teachers and students working within bi-/multilingual education settings.