Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Bayesian cubature (BC) has emerged to be one of most competitive approach for estimating the multi-dimensional integral especially when the integrand is expensive to evaluate, and alternative acquisition functions, such as the Posterior Variance Contribution (PVC) function, have been developed for adaptive experiment design of the integration points. However, those sequential design strategies also prevent BC from being implemented in a parallel scheme. Therefore, this paper aims at developing a parallelized adaptive BC method to further improve the computational efficiency.

By theoretically examining the multimodal behavior of the PVC function, it is concluded that the multiple local maxima all have important contribution to the integration accuracy as can be selected as design points, providing a practical way for parallelization of the adaptive BC. Inspired by the above finding, four multimodal optimization algorithms, including one newly developed in this work, are then introduced for finding multiple local maxima of the PVC function in one run, and further for parallel implementation of the adaptive BC.

The superiority of the parallel schemes and the performance of the four multimodal optimization algorithms are then demonstrated and compared with the k-means clustering method by using two numerical benchmarks and two engineering examples.

Multimodal behavior of acquisition function for BC is comprehensively investigated. All the local maxima of the acquisition function contribute to adaptive BC accuracy. Parallelization of adaptive BC is realized with four multimodal optimization methods.

The aim of the study is threefold: understanding the interconnections amongst visual and verbal multimodal communication strategies used in food discourse; identifying the themes of celebrity chef's food discourse with respect to pro-environmental behaviour; and providing a methodological framework to visually analyse food-themed videos.

This study uses mise-en-scène and critical discourse and multimodal analyses to gain insights on food discourse from 20 videos shared by a Michelin starred chef on social media platforms.

Results show that a pro-environmental cooking philosophy challenges the normative discourse on food and educates general audiences and foodies alike. Mise-en-scène and discourse analyses of Instagram visual content reveal that leftovers are central to the ethical message and are intertwined – through the aesthetic of the videos-with concepts of inclusivity, diversity and nourishment.

Chefs, and restaurants, are encouraged to recognise their responsibility as role models, thus able to influence the societal production of food discourse.

The findings provide new insights into the role of a celebrity chef in promoting sustainable food preparation and consumption.

An increasing number of images are generated daily, and images are gradually becoming a search target. Content-based image retrieval (CBIR) is helpful for users to express their requirements using an image query. Nevertheless, determining whether the retrieval system can provide convenient operation and relevant retrieval results is challenging. A CBIR system based on deep learning features was proposed in this study to effectively search and navigate images in digital articles.

Convolutional neural networks (CNNs) were used as the feature extractors in the author's experiments. Using pretrained parameters, the training time and retrieval time were reduced. Different CNN features were extracted from the constructed image databases consisting of images taken from the National Palace Museum Journals Archive and were compared in the CBIR system.

DenseNet201 achieved the best performance, with a top-10 mAP of 89% and a query time of 0.14 s.

The CBIR homepage displayed image categories showing the content of the database and provided the default query images. After retrieval, the result showed the metadata of the retrieved images and links back to the original pages.

With the interface and retrieval demonstration, a novel image-based reading mode can be established via the CBIR and links to the original images and contextual descriptions.

This study aims to explore the role of the linguistic style used in the brand-posted social media content on consumer engagement in the Fintech domain.

A total of 3,286 tweets (registering nearly 1.35 million impressions) published by 10 leading Fintech unicorns in India were extracted using the Twitter API. The Linguistic Inquiry and Word Count (LIWC) dictionary was used to analyse the linguistic characteristics of the shared tweets. Negative Binomial Regression (NBR) was used for testing the hypotheses.

This study finds that using drive words and cognitive language increases consumer engagement with Fintech messages via the central route of information processing. Further, affective words and conversational language drive consumer engagement through the peripheral route of information processing.

The study extends the literature on brand engagement by unveiling the effect of linguistic features used to design social media messages.

The study provides guidance to social media marketers of Fintech brands regarding what content strategies best enhance consumer engagement. The linguistic style to improve online consumer engagement (OCE) is detailed.

The study’s findings contribute to the growing stream of Fintech literature by exploring the role of linguistic style on consumer engagement in social media communication. The study’s findings indicate the relevance of the dual processing mechanism of elaboration likelihood model (ELM) as an explanatory theory for evaluating consumer engagement with messages posted by Fintech brands.

This study aims to intend and implement the optimal power flow, where tuning the production cost is done with the inclusion of stochastic wind power and different kinds of flexible AC transmission systems (FACTS) devices. Here, the speed with fitness-based krill herd algorithm (SF-KHA) is adopted for deciding the FACTS devices’ optimal sizing and placement integrated with wind power. Here, the modified SF-KHA optimizes the sizing and location of FACTS devices for attaining the minimum average production cost and real power depletions of the system. Especially, the objective includes reserve cost for overestimation, cost of thermal generation of the wind power, direct cost of scheduled wind power and penalty cost for underestimation. The efficiency of the offered method over several popular optimization algorithms has been done, and the comparison over different algorithms establishes proposed KHA algorithm attains the accurate optimal efficiency for all other algorithms.

The proposed FACTS devices-based power system with the integration of wind generators is based on the accurate placement and sizing of FACTS devices for decreasing the actual power loss and total production cost of the power system.

Through the cost function evaluation of the offered SF-KHA, it was noted that the proposed SF-KHA-based power system had secured 13.04% superior to success history-based adaptive differential evolution, 9.09% enhanced than differential evolution, 11.5% better than artificial bee colony algorithm, 15.2% superior to particle swarm optimization and 9.09% improved than flower pollination algorithm.

The proposed power system with the accurate placement and sizing of FACTS devices and wind generator using the suggested SF-KHA was effective when compared with the conventional algorithm-based power systems.

Recently, autonomous vehicles (AV) acceptance has been studied intensively. This paper aims to map and analyze the bibliometric characteristics of AV acceptance literature. Furthermore, this research aims to identify research gaps and propose future research opportunities.

The bibliometric analysis was performed. Scopus database was used as the source of the literature. This study selected and analyzed 297 AV acceptance papers. The performance and science mapping analysis were performed.

The developed countries tended to dominate the topic. The publication outlet tended to be in transportation or technology journals. There were four research themes in existing literature. Technology acceptance model (TAM) and UTAUT2 tended to be used for explaining AV acceptance. AV acceptance studies tended to use two types of psychological concepts for understanding AV acceptance, namely risk related concepts and functional utilitarian benefit related concepts. In the context of research design, quantitative approach tended to be used. Self-driving feature was the most exploited feature of AV in the existing literature. Three research gaps were mapped and future research opportunities were proposed.

This paper provided a comprehensive information that allowed scientists to develop future research on AV acceptance.

There is lack of paper that discussed the bibliometric characteristics of AV acceptance literature. This paper fulfilled the gap.

In the growing information systems (IS) literature on metaverse, augmented reality (AR) technology is regarded as a cornerstone of the metaverse which enables interaction services. Interaction has been identified as a core technology characteristic of metaverse shopping environments. Based on previous human–technology interaction research, the authors further explicate interaction to be multimodal sensory. The purpose of this study is thus to better understand the unique nature of interaction in AR technology and highlight the technology's benefits for shopping in metaverse spaces.

An experiment has been conducted to empirically examine the authors' research model. The authors use the structural equation modeling (SEM) approach to analyze the collected data.

This study conceptualizes image, motion and touchscreen interactions as the three dimensions of multimodal sensory interaction, which can reflect visual-, kinesthetic- and haptic-based sensation stimulation. The authors' findings show that multimodal sensory interaction of AR activates consumers' intention to purchase via a psychological process. To delineate this psychological process, the authors use feelings-as-information theory to posit that experiential factors can influence cognitive factors. More specifically, multimodal sensory interaction is shown to increase multisensory experience and spatial presence, which can effectively reduce product uncertainty and information overload. The two outcomes have been considered to be key issues in online shopping environments.

This study is one of the first ones that shed light on the multimodal sensory peculiarity of AR interactions in the extant IS literature. The authors further highlight the benefits of AR in addressing major online shopping concerns about product uncertainty and information overload, which are largely overlooked by prior research. This study uses feelings-as-information theory to explain the impacts of AR interactions, which reveal the essential role of the experiential process in sensory-enabling technologies. This study enriches the existing theoretical frameworks that mostly focus on the cognitive process. The authors' findings about AR interactions provide noteworthy guidelines for the design of metaverse environments and extend the authors' understanding of how the metaverse may bring benefits beyond traditional online shopping settings.

The digitalization of archival management has rapidly developed with the maturation of digital technology. With data's exponential growth, archival resources have transitioned from single modalities, such as text, images, audio and video, to integrated multimodal forms. This paper identifies key trends, gaps and areas of focus in the field. Furthermore, it proposes a theoretical organizational framework based on deep learning to address the challenges of managing archives in the era of big data.

Via a comprehensive systematic literature review, the authors investigate the field of multimodal archive resource organization and the application of deep learning techniques in archive organization. A systematic search and filtering process is conducted to identify relevant articles, which are then summarized, discussed and analyzed to provide a comprehensive understanding of existing literature.

The authors' findings reveal that most research on multimodal archive resources predominantly focuses on aspects related to storage, management and retrieval. Furthermore, the utilization of deep learning techniques in image archive retrieval is increasing, highlighting their potential for enhancing image archive organization practices; however, practical research and implementation remain scarce. The review also underscores gaps in the literature, emphasizing the need for more practical case studies and the application of theoretical concepts in real-world scenarios. In response to these insights, the authors' study proposes an innovative deep learning-based organizational framework. This proposed framework is designed to navigate the complexities inherent in managing multimodal archive resources, representing a significant stride toward more efficient and effective archival practices.

This study comprehensively reviews the existing literature on multimodal archive resources organization. Additionally, a theoretical organizational framework based on deep learning is proposed, offering a novel perspective and solution for further advancements in the field. These insights contribute theoretically and practically, providing valuable knowledge for researchers, practitioners and archivists involved in organizing multimodal archive resources.

The aim of this study is to propose a governance model and key performance indicators on how policymakers can contribute to a more accessible, inclusive and sustainable mobility within and across smart cities to examine sustainable urban mobility grounded on the rational management of public transportation infrastructure.

This study employed desk research methodology grounded on secondary data from existing documents and previous research to develop a sustainable mobility governance model that explores key factors that influence future urban policy development. The collected secondary data was descriptively analyzed to provide initiatives and elements needed to achieve sustainable mobility services in smart cities.

Findings from this study provide evidence on how cities can benefit from the application of data from different sources to provide value-added services to promote integrated and sustainable mobility. Additionally, findings from this study discuss the role of smart mobility for sustainable services and the application for data-driven initiatives toward sustainable smart cities to enhance mobility interconnectivity, accessibility and multimodality. Findings from this study identify technical and non-technical factors that impact the sustainable mobility transition.

Practically, this study advocates for the use of smart mobility and data-driven services in smart cities to improve commuters' behavior aimed at long-term behavior change toward sustainable mobility by creating awareness on the society and supporting policymakers for informed decisions. Implications from this study provide information that supports policymakers and municipalities to implement data-driven mobility services.

This study provides implications toward behavioral change of individuals to adopt a more sustainable mode of travels, increase citizens’ quality of life, improve economic viability of business involved in providing mobility-related services and support decision-making for municipalities and policymakers during urban planning and design by incorporating the sustainability dimension into their present and future developments.

This paper explores how urban transportation can greatly reduce greenhouse gas emissions and provides implications for cities to improve accessibility and sustainability of public transportation, while simultaneously promoting the adoption of more environmentally friendly means of mobility within and across cities. Besides, this study provides a detailed discussion focusing on the potential opportunities and challenges faced in urban environment in achieving sustainable mobility. The governance model developed in this study can also be utilized by technology startups and transportation companies to assess the factors that they need to put in place or improve for the provision of sustainable mobility services.