Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The purpose of this paper is to investigate how previous literature has analyzed the role of augmented reality and virtual reality in the field of tourism, distinguishing between studies focused on one technology or the other as both have characteristics that profoundly differentiate them.

This study carries out a critical review to assess and synthesize the literature on augmented reality and virtual reality in tourism. Literature searches are conducted using various keywords, resulting in a selection of 84 articles (19 on augmented reality and 65 on virtual reality) from 39 indexed journals.

The research findings demonstrate an increasing scholarly focus on exploring the application of virtual reality and augmented reality within the realm of tourism. These results highlight a noticeable progression in recent years with respect to different matters, such as methodologies, used theories or considered variables, among others. Based on these results, it is proposed a future research agenda that seeks to establish a cohesive framework and drive the development of both augmented reality and virtual reality research in tourism.

By conducting an individual and comparative review of the literature on the application of augmented reality and virtual reality in tourism, this research helps elucidate the specific lines of research for each technology while providing a better understanding of how each technology can be used to generate effective tourist experiences.

El objetivo de este artículo es investigar cómo la literatura previa ha analizado el papel de la realidad aumentada y la realidad virtual en el ámbito del turismo, distinguiendo entre estudios centrados en una u otra tecnología ya que ambas tienen características que las diferencian profundamente.

Este estudio realiza una revisión crítica para evaluar y sintetizar la literatura sobre realidad aumentada y realidad virtual en turismo. Se realizan búsquedas de literatura utilizando diversas palabras clave, que dan como resultado la selección de 84 artículos (19 sobre realidad aumentada y 65 sobre realidad virtual) procedentes de 39 revistas indexadas.

Los resultados de la investigación demuestran que existe un interés creciente en explorar la aplicación de la realidad virtual y la realidad aumentada en el ámbito del turismo. Asimismo, se pone de manifiesto una notable progresión en los últimos años con respecto a diferentes cuestiones, como las metodologías aplicadas, las teorías empleadas o las variables consideradas, entre otras. A partir de estos resultados, se propone una agenda de investigación futura que pretende establecer un marco cohesionado e impulsar el desarrollo de la investigación en el ámbito tanto de la realidad aumentada como de la realidad virtual en turismo.

Al realizar una revisión individual y comparativa de la literatura sobre la aplicación de la realidad aumentada y la realidad virtual en el turismo, esta investigación ayuda a esclarecer las líneas de investigación específicas de cada tecnología a la vez que proporciona una mejor comprensión de cómo cada tecnología puede ser utilizada para generar experiencias turísticas efectivas.

本文旨在研究以往的文献是如何分析增强现实和虚拟现实在旅游领域的作用的, 并对侧重于其中一种技术或另一种技术的研究加以区分, 因为这两种技术都有深刻区别于其他技术的特点。

本研究通过批判性综述来评估和归纳有关旅游业中增强现实和虚拟现实技术的文献。通过使用各种关键词进行文献检索, 从 39 种索引期刊中筛选出 84 篇文章（19 篇关于增强现实技术, 65 篇关于虚拟现实技术）。

研究结果表明, 学术界越来越重视探索虚拟现实和增强现实在旅游业中的应用。这些结果突显了近年来在方法论、采用的理论或考虑的变量等不同方面的明显进步。在这些成果的基础上, 提出了未来的研究议程, 旨在建立一个具有凝聚力的框架, 推动旅游业中增强现实和虚拟现实研究的发展。

本研究通过对增强现实和虚拟现实技术在旅游业中应用的文献进行单独和比较审查, 有助于阐明每种技术的具体研究方向, 同时让人们更好地了解如何使用每种技术来产生有效的旅游体验。

In recent years, there has been significant interest in adopting XR (extended reality) technologies such as VR (virtual reality) and AR (augmented reality), particularly in retail. However, extending activities through reality-mediation is still mostly believed to offer an inferior experience due to their shortcomings in usability, wearability, graphical fidelity, etc. This study aims to address the research gap by experimentally examining the acceptance of metaverse shopping.

This study conducts a 2 (VR: with vs. without) × 2 (AR: with vs. without) between-subjects laboratory experiment involving 157 participants in simulated daily shopping environments. This study builds a physical brick-and-mortar store at the campus and stocked it with approximately 600 products with accompanying product information and pricing. The XR devices and a 3D laser scanner were used in constructing the three XR shopping conditions.

Results indicate that XR can offer an experience comparable to, or even surpassing, traditional shopping in terms of its instrumental and hedonic aspects, regardless of a slightly reduced perception of usability. AR negatively affected perceived ease of use, while VR significantly increased perceived enjoyment. It is surprising that the lower perceived ease of use appeared to be disconnected from the attitude toward metaverse shopping.

This study provides important experimental evidence on the acceptance of XR shopping, and the finding that low perceived ease of use may not always be detrimental adds to the theory of technology adoption as a whole. Additionally, it provides an important reference point for future randomized controlled studies exploring the effects of technology on adoption.

Despite the significance of the construction industry to the nation's economic growth, there is empirical evidence that the sector is lagging behind other industries in terms of productivity growth. The need for improvements inspired the industry's stakeholders to consider using emerging technologies that support the enhancement. This research aims to report augmented reality applications essential for contractors' productivity improvement.

This study systematically reviewed academic journals. The selection of journal articles entailed searching Scopus and Web of Science databases. Relevant articles for reviews were identified and screened. Content analysis was used to classify key applications into six categories. The research results were limited to journal articles published between 2010 and 2021.

Augmented reality can improve construction productivity through its applications in assembly, training and education, monitoring and controlling, interdisciplinary function, health and safety and design information.

The research provides a direction for contractors on key augmented reality applications they can leverage to improve their organisations' productivity.

This pragmatic research paper aims to unravel the smart vision-based method (SVBM), an AI program to correlate the computer vision (recorded and live videos using mobile and embedded cameras) that aids in manual lifting human pose deduction, analysis and training in the construction sector.

Using a pragmatic approach combined with the literature review, this study discusses the SVBM. The research method includes a literature review followed by a pragmatic approach and lab validation of the acquired data. Adopting the practical approach, the authors of this article developed an SVBM, an AI program to correlate computer vision (recorded and live videos using mobile and embedded cameras).

Results show that SVBM observes the relevant events without additional attachments to the human body and compares them with the standard axis to identify abnormal postures using mobile and other cameras. Angles of critical nodal points are projected through human pose detection and calculating body part movement angles using a novel software program and mobile application. The SVBM demonstrates its ability to data capture and analysis in real-time and offline using videos recorded earlier and is validated for program coding and results repeatability.

Literature review methodology limitations include not keeping in phase with the most updated field knowledge. This limitation is offset by choosing the range for literature review within the last two decades. This literature review may not have captured all published articles because the restriction of database access and search was based only on English. Also, the authors may have omitted fruitful articles hiding in a less popular journal. These limitations are acknowledged. The critical limitation is that the trust, privacy and psychological issues are not addressed in SVBM, which is recognised. However, the benefits of SVBM naturally offset this limitation to being adopted practically.

The theoretical and practical implications include customised and individualistic prediction and preventing most posture-related hazardous behaviours before a critical injury happens. The theoretical implications include mimicking the human pose and lab-based analysis without attaching sensors that naturally alter the working poses. SVBM would help researchers develop more accurate data and theoretical models close to actuals.

By using SVBM, the possibility of early deduction and prevention of musculoskeletal disorders is high; the social implications include the benefits of being a healthier society and health concerned construction sector.

Human pose detection, especially joint angle calculation in a work environment, is crucial to early deduction of muscoloskeletal disorders. Conventional digital technology-based methods to detect pose flaws focus on location information from wearables and laboratory-controlled motion sensors. For the first time, this paper presents novel computer vision (recorded and live videos using mobile and embedded cameras) and digital image-related deep learning methods without attachment to the human body for manual handling pose deduction and analysis of angles, neckline and torso line in an actual construction work environment.

The continuous development of mobile platforms provides the opportunity to integrate and improve existing applications or to introduce new features to make life better. The purpose of this paper is to investigate the use of mobile platforms in civilization (museums) and present the design and the implementation of a mobile application that satisfies various design criteria. Through this application the visitor can navigate and tour virtually in the museum through a smartphone. In addition, features have been included in the application that make it easier for a user to visit the museum. First, we present the operating parameters and the aesthetic presentation of the application, which delimits usability and ease of access through the interfaces of a smartphone. Then we highlight the cloud features that were exploited in the application. Then, an extended evaluation of the mobile application is presented, that proves its high applicability and user acceptability.

The future construction site will be pervasive, context aware and embedded with intelligence. The purpose of this paper is to explore and define the concept of the digital skin of the future smart construction site.

The paper provides a systematic and hierarchical classification of 114 articles from both industry and academia on the digital skin concept and evaluates them. The hierarchical classification is based on application areas relevant to construction, such as augmented reality, building information model-based visualisation, labour tracking, supply chain tracking, safety management, mobile equipment tracking and schedule and progress monitoring. Evaluations of the research papers were conducted based on three pillars: validation of technological feasibility, onsite application and user acceptance testing.

Technologies learned about in the literature review enabled the envisaging of the pervasive construction site of the future. The paper presents scenarios for the future context-aware construction site, including the construction worker, construction procurement management and future real-time safety management systems.

Based on the gaps identified by the review in the body of knowledge and on a broader analysis of technology diffusion, the paper highlights the research challenges to be overcome in the advent of digital skin. The paper recommends that researchers follow a coherent process for smart technology design, development and implementation in order to achieve this vision for the construction industry.