Search results
1 – 10 of over 5000Ziming Zeng, Shouqiang Sun, Tingting Li, Jie Yin and Yueyan Shen
The purpose of this paper is to build a mobile visual search service system for the protection of Dunhuang cultural heritage in the smart library. A novel mobile visual search…
Abstract
Purpose
The purpose of this paper is to build a mobile visual search service system for the protection of Dunhuang cultural heritage in the smart library. A novel mobile visual search model for Dunhuang murals is proposed to help users acquire rich knowledge and services conveniently.
Design/methodology/approach
First, local and global features of images are extracted, and the visual dictionary is generated by the k-means clustering. Second, the mobile visual search model based on the bag-of-words (BOW) and multiple semantic associations is constructed. Third, the mobile visual search service system of the smart library is designed in the cloud environment. Furthermore, Dunhuang mural images are collected to verify this model.
Findings
The findings reveal that the BOW_SIFT_HSV_MSA model has better search performance for Dunhuang mural images when the scale-invariant feature transform (SIFT) and the hue, saturation and value (HSV) are used to extract local and global features of the images. Compared with different methods, this model is the most effective way to search images with the semantic association in the topic, time and space dimensions.
Research limitations/implications
Dunhuang mural image set is a part of the vast resources stored in the smart library, and the fine-grained semantic labels could be applied to meet diverse search needs.
Originality/value
The mobile visual search service system is constructed to provide users with Dunhuang cultural services in the smart library. A novel mobile visual search model based on BOW and multiple semantic associations is proposed. This study can also provide references for the protection and utilization of other cultural heritages.
Details
Keywords
Ziming Zeng, Shouqiang Sun, Jingjing Sun, Jie Yin and Yueyan Shen
Dunhuang murals are rich in cultural and artistic value. The purpose of this paper is to construct a novel mobile visual search (MVS) framework for Dunhuang murals, enabling users…
Abstract
Purpose
Dunhuang murals are rich in cultural and artistic value. The purpose of this paper is to construct a novel mobile visual search (MVS) framework for Dunhuang murals, enabling users to efficiently search for similar, relevant and diversified images.
Design/methodology/approach
The convolutional neural network (CNN) model is fine-tuned in the data set of Dunhuang murals. Image features are extracted through the fine-tuned CNN model, and the similarities between different candidate images and the query image are calculated by the dot product. Then, the candidate images are sorted by similarity, and semantic labels are extracted from the most similar image. Ontology semantic distance (OSD) is proposed to match relevant images using semantic labels. Furthermore, the improved DivScore is introduced to diversify search results.
Findings
The results illustrate that the fine-tuned ResNet152 is the best choice to search for similar images at the visual feature level, and OSD is the effective method to search for the relevant images at the semantic level. After re-ranking based on DivScore, the diversification of search results is improved.
Originality/value
This study collects and builds the Dunhuang mural data set and proposes an effective MVS framework for Dunhuang murals to protect and inherit Dunhuang cultural heritage. Similar, relevant and diversified Dunhuang murals are searched to meet different demands.
Details
Keywords
Abstract
Purpose
The authors aim to present a vision based wide area registration method for camera phones based mobile augmented reality applications.
Design/methodology/approach
The tracking system uses a drift‐free 6 DOF tracker based on prebuilt multiple maps, and can be initialized using the authors' compacted key‐frames recognition engine.
Findings
Given the current location and camera pose, the authors show how the corresponding virtual objects can be accurately superimposed even in the case of varying user positions.
Originality/value
The authors' system can be used in wide area scenarios and provides an accurate registration between real and virtual objects.
Details
Keywords
Chia-Chen Chen, Patrick C.K. Hung, Erol Egrioglu, Dickson K.W. Chiu and Kevin K.W. Ho
Weimin Zhai, Zhongzhen Lin and Biwen Xu
With the rapid development of technology, 360° panorama on mobile as a very convenient way to present virtual reality has brought a new shopping experience to consumers. Usually…
Abstract
Purpose
With the rapid development of technology, 360° panorama on mobile as a very convenient way to present virtual reality has brought a new shopping experience to consumers. Usually, consumers get product information through virtual annotations in 360° panorama and then make a series of shopping behaviors. The visual design of virtual annotation significantly influences users' online visual search for product information. This study aims to investigate the influence of the visual design of virtual annotation on consumers' shopping experience in the online shopping interface of 360° panorama.
Design/methodology/approach
A 2 × 3 between-subject design was planned to help explore whether different display model of annotation (i.e. negative polarity and positive polarity) and different background transparency of annotation (i.e. 0% transparency, 25% transparency and 50% transparency) may affect users' task performance and their subjective evaluations.
Findings
(1) Virtual annotations with different background transparency affect user performance, and transparency has better visual search performance. (2) Virtual annotation background display mode may affect the user operation performance; the positive polarity of the virtual annotation is more convenient for the users' visual searching for product information. (3) When the annotation background transparency is opaque or semi-transparent, the negative polarity display is more favorable to the users' visual search. However, this situation is reversed when the annotation background transparency is 25%. (4) Participants preferred the presentation of positive polarity virtual annotations. (5) Regarding the degree of willingness to use and ease of understanding, participants preferred the negative polarity display for 0% background transparency or 50% background transparency. However, the opposite result was obtained for 25% background transparency.
Originality/value
The findings generated from the research can be a good reference for the development of virtual annotation visual design for mobile shopping applications.
Highlights
Virtual annotation background transparency and background display mode are two essential attributes of 360° panoramas.
This study examined how virtual annotation background transparency and background display mode influence user performance and experience.
It is recommended to use a translucent or opaque annotation background with a negative polarity display.
Virtual annotation presentation with 25% background transparency facilitates consumer searching and comparison of product information.
Users prefer a positive polarity annotation display.
Virtual annotation background transparency and background display mode are two essential attributes of 360° panoramas.
This study examined how virtual annotation background transparency and background display mode influence user performance and experience.
It is recommended to use a translucent or opaque annotation background with a negative polarity display.
Virtual annotation presentation with 25% background transparency facilitates consumer searching and comparison of product information.
Users prefer a positive polarity annotation display.
Details
Keywords
Abstract
Purpose
The purpose of this paper is to explore a novel control approach for swift and accurate positioning and tracking of a mobile robot. Coordinated movement of the mobile robot-body and chameleon-inspired binocular “negative correlation” visual system (CIBNCVS) with neck has rarely been considered in conventional mobile robot design. However, it is vital in swift and accurate positioning and tracking of the target. Consequently, it is valuable to find an optimized method where the robot-body, the biomimetic eyes and neck could achieve optimal coordinated movement.
Design/methodology/approach
Based on a wheeled mobile robot, a biomimetic dual Pan–Tilt–Zoom visual system with neck is constructed. The cameras can rely on the unique “negative correlation” mode of chameleon vision, and cooperate with neck, achieving swift search of the 160° scope in front of the robot. Genetic algorithm is used to obtain optimal rotation of the neck and robot-body. Variable resolution targeting is also applied for accurate aiming. Using these two approaches, we can achieve efficient targeting with low energy consumption. Particle filter algorithm is further utilized for real-time tracking.
Findings
In the proposed approach, swift and accurate positioning and tracking of the target can be obtained. The rationality of the approach is verified by experiments on flat and sandy terrains with satisfactory results.
Originality/value
This paper proposes a novel control approach for wheeled mobile robots, which achieves coordinated movement of the robot-body and CIBNCVS with neck concerning time and energy saving in the process of swift and accurate tracking.
Details
Keywords
Liang Xiao and Shu Wang
The rapid growth of m-commerce and mobile marketing has flooded the users with homogeneous contents that raise little user interest making the users' browsing pattern on these…
Abstract
Purpose
The rapid growth of m-commerce and mobile marketing has flooded the users with homogeneous contents that raise little user interest making the users' browsing pattern on these contents aimless free browsing. However, the interface that presents the mobile marketing contents triggers much user attention, especially the layout. Without significant usability defects, the layout poses influences on the user's aesthetic experience. Identifying the layout attributes that affect user aesthetic preference is critical to the design of mobile marketing interfaces since they influence users' interaction intention, cognitive process, and decision-making.
Design/methodology/approach
In this paper, 6 layout attributes that quantify the aesthetic design of the interface layout and 3 eye-movement indicators that connect to human aesthetic preference were identified through literature research. An eye-tracking experiment measuring the 3 eye-movement indicators on 6 pairs of interface layout materials corresponding to the 6 layout attributes was conducted. The experiment was designed to mimic the free browsing context in mobile marketing. The materials were divided into Liked/Disliked preference groups according to the response of the subjects. Analysis of indicators on materials between the L/D groups shows that the attributes of balance, centricity, density, simplicity, and symmetry affect user aesthetic preferences.
Findings
Analysis of the attribute value levels shows that balance, centricity, and density are responsible for addressing users' aesthetic preferences for a disliked interface layout. The study suggests an attribute set for quantitatively optimizing the aesthetic design of mobile marketing system interfaces and provides evidence for the visual attention and cognitive process under the free browsing context.
Originality/value
The study contributes to the field both theoretically and practically: (1) it provides support for optimizing the interface layout of mobile marketing systems quantitatively from the aesthetic perspective. (2) It promotes the cognitive attention theory by providing evidence for the cognitive process of interacting with mobile marketing interfaces from the perspective of visual attention and cognitive fluency. (3) It expands the objects of visual perception from traditional or symbolic artworks (such as logos) to the abstract visual stimuli of interface layout. (4) It suggests an optimization tool of five quantification layout attributes for mobile marketing businesses and platforms to aesthetically improve their marketing interfaces to improve user experiences.
Details
Keywords
This paper describes an ongoing mobile library project for the National Library of Norway. The purpose is to develop a visual web service prototype providing mobile access to the…
Abstract
Purpose
This paper describes an ongoing mobile library project for the National Library of Norway. The purpose is to develop a visual web service prototype providing mobile access to the library's growing repository of digital data.
Design/methodology/approach
The author has set up several test databases and developed a number of Android applications (apps) for testing purposes: image presentation; library's digital exhibition “in the pocket”; traditional free text search; location based search; barcode scan for ISBN search / QR encapsulation; and voice/spoken search.
Findings
These six approaches were found to be promising using mobile technology. Cloud technology has changed the mobile phone from a voice transmitter to a multi-purpose device connected to the network. Library resources may now be distributed in the cloud, with global mobile access, to really achieve a global library network.
Originality/value
The applications developed here are innovative and unique, and will add to the general body of use cases.
Details