Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

In recent years, there has been significant interest in adopting XR (extended reality) technologies such as VR (virtual reality) and AR (augmented reality), particularly in retail. However, extending activities through reality-mediation is still mostly believed to offer an inferior experience due to their shortcomings in usability, wearability, graphical fidelity, etc. This study aims to address the research gap by experimentally examining the acceptance of metaverse shopping.

This study conducts a 2 (VR: with vs. without) × 2 (AR: with vs. without) between-subjects laboratory experiment involving 157 participants in simulated daily shopping environments. This study builds a physical brick-and-mortar store at the campus and stocked it with approximately 600 products with accompanying product information and pricing. The XR devices and a 3D laser scanner were used in constructing the three XR shopping conditions.

Results indicate that XR can offer an experience comparable to, or even surpassing, traditional shopping in terms of its instrumental and hedonic aspects, regardless of a slightly reduced perception of usability. AR negatively affected perceived ease of use, while VR significantly increased perceived enjoyment. It is surprising that the lower perceived ease of use appeared to be disconnected from the attitude toward metaverse shopping.

This study provides important experimental evidence on the acceptance of XR shopping, and the finding that low perceived ease of use may not always be detrimental adds to the theory of technology adoption as a whole. Additionally, it provides an important reference point for future randomized controlled studies exploring the effects of technology on adoption.

Despite the significance of the construction industry to the nation's economic growth, there is empirical evidence that the sector is lagging behind other industries in terms of productivity growth. The need for improvements inspired the industry's stakeholders to consider using emerging technologies that support the enhancement. This research aims to report augmented reality applications essential for contractors' productivity improvement.

This study systematically reviewed academic journals. The selection of journal articles entailed searching Scopus and Web of Science databases. Relevant articles for reviews were identified and screened. Content analysis was used to classify key applications into six categories. The research results were limited to journal articles published between 2010 and 2021.

Augmented reality can improve construction productivity through its applications in assembly, training and education, monitoring and controlling, interdisciplinary function, health and safety and design information.

The research provides a direction for contractors on key augmented reality applications they can leverage to improve their organisations' productivity.

The continuous development of mobile platforms provides the opportunity to integrate and improve existing applications or to introduce new features to make life better. The purpose of this paper is to investigate the use of mobile platforms in civilization (museums) and present the design and the implementation of a mobile application that satisfies various design criteria. Through this application the visitor can navigate and tour virtually in the museum through a smartphone. In addition, features have been included in the application that make it easier for a user to visit the museum. First, we present the operating parameters and the aesthetic presentation of the application, which delimits usability and ease of access through the interfaces of a smartphone. Then we highlight the cloud features that were exploited in the application. Then, an extended evaluation of the mobile application is presented, that proves its high applicability and user acceptability.

The future construction site will be pervasive, context aware and embedded with intelligence. The purpose of this paper is to explore and define the concept of the digital skin of the future smart construction site.

The paper provides a systematic and hierarchical classification of 114 articles from both industry and academia on the digital skin concept and evaluates them. The hierarchical classification is based on application areas relevant to construction, such as augmented reality, building information model-based visualisation, labour tracking, supply chain tracking, safety management, mobile equipment tracking and schedule and progress monitoring. Evaluations of the research papers were conducted based on three pillars: validation of technological feasibility, onsite application and user acceptance testing.

Technologies learned about in the literature review enabled the envisaging of the pervasive construction site of the future. The paper presents scenarios for the future context-aware construction site, including the construction worker, construction procurement management and future real-time safety management systems.

Based on the gaps identified by the review in the body of knowledge and on a broader analysis of technology diffusion, the paper highlights the research challenges to be overcome in the advent of digital skin. The paper recommends that researchers follow a coherent process for smart technology design, development and implementation in order to achieve this vision for the construction industry.

The transition to omnichannel retail is the recognized future of retail, which uses digital technologies (e.g. augmented reality shopping assistants) to enhance the customer shopping experience. However, retailers struggle with the implementation of such technologies in brick-and-mortar stores. Against this background, the present study investigates the impact of a smartphone-based augmented reality shopping assistant application, which uses personalized recommendations and explainable artificial intelligence features on customer shopping experiences.

The authors follow a design science research approach to develop a shopping assistant application artifact, evaluated by means of an online experiment (n = 252), providing both qualitative and quantitative data.

Results indicate a positive impact of the augmented reality shopping assistant application on customers' perception of brick-and-mortar shopping experiences. Based on the empirical insights this study also identifies possible improvements of the artifact.

This study's assessment is limited to an online evaluation approach. Therefore, future studies should test actual usage of the technology in brick-and-mortar stores. Contrary to the suggestions of established theories (i.e. technology acceptance model, uses and gratification theory), this study shows that an increase of shopping experience does not always convert into an increase in the intention to purchase or to visit a brick-and-mortar store. Additionally, this study provides novel design principles and ideas for crafting augmented reality shopping assistant applications that can be used by future researchers to create advanced versions of such applications.

This paper demonstrates that a shopping assistant artifact provides a good opportunity to enhance users' shopping experience on their path-to-purchase, as it can support customers by providing rich information (e.g. explainable recommendations) for decision-making along the customer shopping journey.

This paper shows that smartphone-based augmented reality shopping assistant applications have the potential to increase the competitive power of brick-and-mortar retailers.

Metaverse, that is extended reality (XR)-based technologies such as augmented reality (AR) and virtual reality (VR), are increasingly believed to facilitate fundamental human practice in the future. One of the vanguards of this development has been the consumption domain, where the multi-modal and multi-sensory technology-mediated immersion is expected to enrich consumers' experience. However, it remains unclear whether these expectations have been warranted in reality and whether, rather than enhancing the experience, metaverse technologies inhibit the functioning and experience, such as cognitive functioning and experience.

This study utilizes a 2 (VR: yes vs no) × 2 (AR: yes vs no) between-subjects laboratory experiment. A total of 159 student participants are randomly assigned to one condition — a brick-and-mortar store, a VR store, an AR store and an augmented virtuality (AV) store — to complete a typical shopping task. Four spatial attention indicators — visit shift, duration shift, visit variation and duration variation — are compared based on attention allocation data converted from head movements extracted from recorded videos during the experiments.

This study identifies three essential effects of XR technologies on consumers' spatial attention allocation: the inattention effect, acceleration effect and imbalance effect. Specifically, the inattention effect (the attentional visit shift from showcased products to the environmental periphery) appears when VR or AR technology is applied to virtualize the store and disappears when AR and VR are used together. The acceleration effect (the attentional duration shift from showcased products to the environmental periphery) exists in the VR store. Additionally, AR causes an imbalance effect (the attentional duration variation increases horizontally among the showcased products).

This study provides valuable empirical evidence of how VR and AR influence consumers' spatial bias in attention allocation, filling the research gap on cognitive function in the metaverse. This study also provides practical guidelines for retailers and XR designers and developers.

This paper presents a model aiming to identify the factors influencing the adoption of augmented reality (AR) for industrial services.

The study combines a literature analysis with an empirical study conducted exploring how five large industrial companies are introducing AR for supporting the provision of technical assistance and industrial services to their installed base.

The authors identify four categories (task, workforce, context and technology) that combine 18 factors that manufacturing companies should consider when introducing AR technology to support industrial services.

This paper systematises the fragmented literature on technology adoption and in particular those works related to the factors affecting the adoption of AR in industrial services. Based on literature and empirical evidence, the authors propose a novel framework that can help companies in the selection of AR solution based on their specific applications and situations. This study therefore contributes also to the existing literature on the adoption of I4.0 and digital technologies in industrial services.