Search results

This paper presents a reclassification of markers for mixed reality environments that is also applicable to the use of markers in robot navigation systems and 3D modelling. In the case of Augmented Reality (AR) mixed reality environments, markers are used to integrate computer generated (virtual) objects into a predominantly real world, while in Augmented Virtuality (AV) mixed reality environments, the goal is to integrate real objects into a predominantly virtual (computer generated) world. Apart from AR/AV classifications, mixed reality environments have also been classified by reality; output technology/display devices; immersiveness as well as by visibility of markers.

The approach adopted consists of presenting six existing classifications of mixed reality environments and then extending them to define new categories of abstract, blended, virtual augmented, active and smart markers. This is supported with results/examples taken from the joint Mixed Augmented and Virtual Reality Laboratory (MAVRLAB) of the Ulster University, Belfast, Northern Ireland; the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste, Italy and Santasco SrL, Regio Emilia/Milan, Italy.

Existing classification of markers and mixed reality environments are mainly binary in nature and do not adequately capture the contextual relationship between markers and their use and application. The reclassification of markers into abstract, blended and virtual categories captures the context for simple use and applications while the categories of augmented, active and smart markers captures the relationship for enhanced or more complex use of markers. The new classifications are capable of improving the definitions of existing simple marker and markerless mixed reality environments as well as supporting more complex features within mixed reality environments such as co-location of objects, advanced interactivity, personalised user experience.

It is thought that applications and devices in mixed reality environments when properly developed and deployed enhances the real environment by making invisible information visible to the user. The current work only marginally covers the use of internet of things (IoT) devices in mixed reality environments as well as potential implications for robot navigation systems and 3D modelling.

The use of these reclassifications enables researchers, developers and users of mixed reality environments to select and make informed decisions on best tools and environment for their respective application, while conveying information with additional clarity and accuracy. The development and application of more complex markers would contribute in no small measure to attaining greater advancements in extending current knowledge and developing applications to positively impact entertainment, business and health while minimizing costs and maximizing benefits.

The originality of this paper lies in the approach adopted in reclassifying markers. This is supported with results and work carried out at the MAV Reality Laboratory of Ulster University, Belfast–UK, the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste-Italy and Santasco SrL, Regio Emilia, Milan–Italy. The value of present research lies in the definitions of new categories as well as the discussions of how they improve mixed reality environments and application especially in the health and education sectors.

The purpose of this paper is to report on developments and applications of mixed reality cubicles and their impacts on learning in higher education. This paper investigates and presents the cost effective application of augmented reality (AR) as a mixed reality technology via or to mobile devices such as head-mounted devices, smart phones and tablets. Discuss the development of mixed reality applications for mobile (smartphones and tablets) devices leading up to the implementation of a mixed reality cubicle for immersive three dimensional (3D) visualizations.

The approach adopted was to limit the considerations to the application of AR via mobile platforms including head-mounted devices with focus on smartphones and tablets, which contain basic feedback–to-user channels such as speakers and display screens. An AR visualization cubicle was jointly developed and applied by three collaborating institutions. The markers, acting as placeholders acts as identifiable reference points for objects being inserted in the mixed reality world. Hundreds of participants comprising academics and students from seven different countries took part in the studies and gave feedback on impact on their learning experience.

Results from current study show less than 30 percent had used mixed reality environments. This is lower than expected. About 70 percent of participants were first time users of mixed reality technologies. This indicates a relatively low use of mixed reality technologies in education. This is consistent with research findings reported that educational use and research on AR is still not common despite their categorization as emerging technologies with great promise for educational use.

Current research has focused mainly on cubicles which provides immersive experience if used with head-mounted devices (goggles and smartphones), that are limited by their display/screen sizes. There are some issues with limited battery lifetime for energy to function, hence the need to use rechargeable batteries. Also, the standard dimension of cubicles does not allow for group visualizations. The current cubicle has limitations associated with complex gestures and movements involving two hands, as one hand are currently needed for holding the mobile phone.

The use of mixed reality cubicles would allow and enhance information visualization for big data in real time and without restrictions. There is potential to have this extended for use in exploring and studying otherwise inaccessible locations such as sea beds and underground caves. Social implications – Following on from this study further work could be done to developing and application of mixed reality cubicles that would impact businesses, health and entertainment.

The originality of this paper lies in the unique approach used in the study of developments and applications of mixed reality cubicles and their impacts on learning. The diverse composition in nature and location of participants drawn from many countries comprising of both tutors and students adds value to the present study. The value of this research include amongst others, the useful results obtained and scope for developments in the future.

The change in the technological environment within the macro-environment factors in recent years affects states, businesses, societies and individuals and concerns not only technology-based sectors but also many fields. In particular, trends such as artificial intelligence, metaverse, robotics, advanced connectivity, the Internet of Things, big data, small data, blockchain, cloud technologies and reality technologies, which are called new technology, are developing very quickly compared to the past and expanding their global usage areas. Creating strategies and policies without considering these factors creates problems in many areas. These problems are marketing, competition, cost, efficiency and productivity.

Reality technologies, which are the research area in this chapter and enable users to interact with the digital world, have a wide application area in the tourism industry. With technological tools such as smartphones and virtual reality (VR) glasses; personalisation, interactive experience, information gathering and decision-making; many different solutions are produced in areas such as education, service and security. Along with its many advantages, the disadvantages of reality technologies and the negative outputs of this transformation are significant for the understanding and future of the subject.

The motivation for this research is the emergence of mobile information systems where information is disseminated to mobile individuals via handheld devices. A key distinction between mobile and desktop computing is the significance of the relationship between the spatial location of an individual and the spatial location associated with information accessed by that individual. Given a set of spatially referenced documents retrieved from a mobile information system, this set can be presented using alternative interfaces of which two presently dominate: textual lists and graphical two‐dimensional maps. The purpose of this paper is to explore how mixed reality interfaces can be used for the presentation of information on mobile devices.

A review of relevant literature is followed by a proposed classification of four alternative interfaces. Each interface is the result of a rapid prototyping approach to software development. Some brief evaluation is described, based upon thinking aloud and cognitive walk‐through techniques with expert users.

The most suitable interface for mobile information systems is likely to be user‐ and task‐dependent; however, mixed reality interfaces offer promise in allowing mobile users to make associations between spatially referenced information and the physical world.

Evaluation of these interfaces is limited to a small number of expert evaluators, and does not include a full‐scale evaluation with a large number of end users.

The application of mixed reality interfaces to the task of displaying spatially referenced information for mobile individuals.

The Operations and Maintenance (O&M) cost of a facility is typically 60–85% of the total life cycle cost of a building whereas its design and construction cost accounts for only 5–10%. Therefore, enhancing and optimizing the O&M of a facility is a crucial issue. In addition, with the increasing complexities in a building's operating systems, more technologically advanced solutions are required for proactively maintaining a facility. Thereby, a tool is needed which can optimize and reduce the cost of facility maintenance. One of the solutions is Augmented or Mixed Reality (AR/MR) technologies which can reduce repair time, training time and streamline inspections. Therefore, the purpose of this study is to establish contextual knowledge of AR/MR application in facilities operation and maintenance and present an implementation framework through the analysis and classification of articles published between 2015 and 2022.

To effectively understand all AR/MR applications in facilities management (FM), a systematic literature review is performed. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) protocol was followed for searching and describing the search strategies. Keywords were identified through the concept mapping technique. The Scopus database and Google Scholar were employed to find relevant articles, books and conference papers. A thorough bibliometric analysis was conducted using VOS Viewer and subsequently, a thematic analysis was performed for the selected publications.

The use of AR/MR within facilities O&M could be categorized into five different application areas: (1) visualization; (2) maintenance; (3) indoor localization and positioning; (4) information management and (5) indoor environment. After a thematic analysis of the literature, it was found that maintenance and indoor localization were the most frequently used research application domains. The chronological evolution of AR/MR in FM is also presented along with the origin of publications, which showed that the technology is out of its infancy stage and is ready for implementation. However, literature showed many challenges hindering this goal, that is (1) reluctance of the organizational leadership to bear the cost of hardware and trainings for the employees, (2) Lack of BIM use in FM and (3) system lagging, crashing and unable to register the real environment. A preliminary framework is presented to overcome these challenges.

This study accommodates a variety of application domains within facilities O&M. The publications were systematically selected from the existing literature and then reviewed to exhibit various AR/MR applications to support FM. There have been no literature reviews that focus on AR and/or MR in the FM and this paper fills the gap by not only presenting its applications but also developing an implementation framework.

This paper aims to examine the current technology acceptance model (TAM) in the field of mixed reality and digital twin (MRDT) and identify key factors affecting users' intentions to use MRDT. The factors are used as a set of key metrics for proposing a predictive model for virtual, augmented and mixed reality (MR) acceptance by users. This model is called the extended TAM for MRDT adoption in the architecture, engineering, construction and operations (AECO) industry.

An interpretivist philosophical lens was adopted to conduct an inductive systematic and bibliographical analysis of secondary data contained within published journal articles that focused upon MRDT acceptance modelling. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) approach to meta-analysis were adopted to ensure all key investigations were included in the final database set. Quantity indicators such as path coefficients, factor ranking, Cronbach’s alpha (a) and chi-square (b) test, coupled with content analysis, were used for examining the database constructed. The database included journal papers from 2010 to 2020.

The extant literature revealed that the most commonly used constructs of the MRDT–TAM included: subjective norm; social influence; perceived ease of use (PEOU); perceived security; perceived enjoyment; satisfaction; perceived usefulness (PU); attitude; and behavioural intention (BI). Using these identified constructs, the general extended TAM for MRDT in the AECO industry is developed. Other important factors such as “perceived immersion” could be added to the obtained model.

The decision to utilise a new technology is difficult and high risk in the construction project context, due to the complexity of MRDT technologies and dynamic construction environment. The outcome of the decision may affect employee performance, project productivity and on-site safety. The extended acceptance model offers a set of factors that assist managers or practitioners in making effective decisions for utilising any type of MRDT technology.

Several constraints are apparent due to the limited investigation of MRDT evaluation matrices and empirical studies. For example, the research only covers technologies which have been reported in the literature, relating to virtual reality (VR), augmented reality (AR), MR, DT and sensors, so newer technologies may not be included. Moreover, the review process could span a longer time period and thus embrace a fuller spectrum of technology development in these different areas.

The research provides a theoretical model for measuring and evaluating MRDT acceptance at the individual level in the AECO context and signposts future research related to MRDT adoption in the AECO industry, as well as providing managerial guidance for progressive AECO professionals who seek to expand their use of MRDT in the Fourth Industrial Revolution (4IR). A set of key factors affecting MRDT acceptance is identified which will help innovators to improve their technology to achieve a wider acceptance.

In recent years, deep learning and extended reality (XR) technologies have gained popularity in the built environment, especially in construction engineering and management. A significant amount of research efforts has been thus dedicated to the automation of construction-related activities and visualization of the construction process. The purpose of this study is to investigate potential research opportunities in the integration of deep learning and XR technologies in construction engineering and management.

This study presents a literature review of 164 research articles published in Scopus from 2006 to 2021, based on strict data acquisition criteria. A mixed review method, consisting of a scientometric analysis and systematic review, is conducted in this study to identify research gaps and propose future research directions.

The proposed research directions can be categorized into four areas, including realism of training simulations; integration of visual and audio-based classification; automated hazard detection in head-mounted displays (HMDs); and context awareness in HMDs.

This study contributes to the body of knowledge by identifying the necessity of integrating deep learning and XR technologies in facilitating the construction engineering and management process.

The objective of this paper is two‐fold: to share information about color and to solicit information about sound, with the ultimate goal of producing a simple formula for generating a cybernetic mixed reality environment; and to serve as a vehicle for inviting conversation at the “Cybernetics: Art, Design and Mathematics 2010” Conference.

The majority of research in color focuses on the perceptual, experiential, phenomenon. Conceptual color is a perceptual and non‐experiential. It is color observed as a thought. By engaging in study, from this methodological approach, color can be modeled as a simple computational system of inter‐related abstract elements. This makes the complexity of the perceptual environment understandable and translatable to abstract data, but also makes the transition from the abstract back to actual possible.

The conceptual model approach has yielded a number of features for future study, not least of which is color, as a true mathematical system. This is very different from a simple color‐coding system.

With more development, the new system may prove to be of significance to future digital design applications. Given that music is also a spatial pattern system, revisiting the age‐old belief that there must be a correlation between color and music may now be productive.

This paper presents a puzzle with thought‐provoking questions, designed to solicit the information needed, in order to determine if a spatial correlation between color and sound is identifiable.