Search results

The purpose of this paper is to build a mobile visual search service system for the protection of Dunhuang cultural heritage in the smart library. A novel mobile visual search model for Dunhuang murals is proposed to help users acquire rich knowledge and services conveniently.

First, local and global features of images are extracted, and the visual dictionary is generated by the k-means clustering. Second, the mobile visual search model based on the bag-of-words (BOW) and multiple semantic associations is constructed. Third, the mobile visual search service system of the smart library is designed in the cloud environment. Furthermore, Dunhuang mural images are collected to verify this model.

The findings reveal that the BOW_SIFT_HSV_MSA model has better search performance for Dunhuang mural images when the scale-invariant feature transform (SIFT) and the hue, saturation and value (HSV) are used to extract local and global features of the images. Compared with different methods, this model is the most effective way to search images with the semantic association in the topic, time and space dimensions.

Dunhuang mural image set is a part of the vast resources stored in the smart library, and the fine-grained semantic labels could be applied to meet diverse search needs.

The mobile visual search service system is constructed to provide users with Dunhuang cultural services in the smart library. A novel mobile visual search model based on BOW and multiple semantic associations is proposed. This study can also provide references for the protection and utilization of other cultural heritages.

Dunhuang murals are rich in cultural and artistic value. The purpose of this paper is to construct a novel mobile visual search (MVS) framework for Dunhuang murals, enabling users to efficiently search for similar, relevant and diversified images.

The convolutional neural network (CNN) model is fine-tuned in the data set of Dunhuang murals. Image features are extracted through the fine-tuned CNN model, and the similarities between different candidate images and the query image are calculated by the dot product. Then, the candidate images are sorted by similarity, and semantic labels are extracted from the most similar image. Ontology semantic distance (OSD) is proposed to match relevant images using semantic labels. Furthermore, the improved DivScore is introduced to diversify search results.

The results illustrate that the fine-tuned ResNet152 is the best choice to search for similar images at the visual feature level, and OSD is the effective method to search for the relevant images at the semantic level. After re-ranking based on DivScore, the diversification of search results is improved.

This study collects and builds the Dunhuang mural data set and proposes an effective MVS framework for Dunhuang murals to protect and inherit Dunhuang cultural heritage. Similar, relevant and diversified Dunhuang murals are searched to meet different demands.

The authors aim to present a vision based wide area registration method for camera phones based mobile augmented reality applications.

The tracking system uses a drift‐free 6 DOF tracker based on prebuilt multiple maps, and can be initialized using the authors' compacted key‐frames recognition engine.

Given the current location and camera pose, the authors show how the corresponding virtual objects can be accurately superimposed even in the case of varying user positions.

The authors' system can be used in wide area scenarios and provides an accurate registration between real and virtual objects.

The purpose of this paper is to explore a novel control approach for swift and accurate positioning and tracking of a mobile robot. Coordinated movement of the mobile robot-body and chameleon-inspired binocular “negative correlation” visual system (CIBNCVS) with neck has rarely been considered in conventional mobile robot design. However, it is vital in swift and accurate positioning and tracking of the target. Consequently, it is valuable to find an optimized method where the robot-body, the biomimetic eyes and neck could achieve optimal coordinated movement.

Based on a wheeled mobile robot, a biomimetic dual Pan–Tilt–Zoom visual system with neck is constructed. The cameras can rely on the unique “negative correlation” mode of chameleon vision, and cooperate with neck, achieving swift search of the 160° scope in front of the robot. Genetic algorithm is used to obtain optimal rotation of the neck and robot-body. Variable resolution targeting is also applied for accurate aiming. Using these two approaches, we can achieve efficient targeting with low energy consumption. Particle filter algorithm is further utilized for real-time tracking.

In the proposed approach, swift and accurate positioning and tracking of the target can be obtained. The rationality of the approach is verified by experiments on flat and sandy terrains with satisfactory results.

This paper proposes a novel control approach for wheeled mobile robots, which achieves coordinated movement of the robot-body and CIBNCVS with neck concerning time and energy saving in the process of swift and accurate tracking.

The rapid growth of m-commerce and mobile marketing has flooded the users with homogeneous contents that raise little user interest making the users' browsing pattern on these contents aimless free browsing. However, the interface that presents the mobile marketing contents triggers much user attention, especially the layout. Without significant usability defects, the layout poses influences on the user's aesthetic experience. Identifying the layout attributes that affect user aesthetic preference is critical to the design of mobile marketing interfaces since they influence users' interaction intention, cognitive process, and decision-making.

In this paper, 6 layout attributes that quantify the aesthetic design of the interface layout and 3 eye-movement indicators that connect to human aesthetic preference were identified through literature research. An eye-tracking experiment measuring the 3 eye-movement indicators on 6 pairs of interface layout materials corresponding to the 6 layout attributes was conducted. The experiment was designed to mimic the free browsing context in mobile marketing. The materials were divided into Liked/Disliked preference groups according to the response of the subjects. Analysis of indicators on materials between the L/D groups shows that the attributes of balance, centricity, density, simplicity, and symmetry affect user aesthetic preferences.

Analysis of the attribute value levels shows that balance, centricity, and density are responsible for addressing users' aesthetic preferences for a disliked interface layout. The study suggests an attribute set for quantitatively optimizing the aesthetic design of mobile marketing system interfaces and provides evidence for the visual attention and cognitive process under the free browsing context.

The study contributes to the field both theoretically and practically: (1) it provides support for optimizing the interface layout of mobile marketing systems quantitatively from the aesthetic perspective. (2) It promotes the cognitive attention theory by providing evidence for the cognitive process of interacting with mobile marketing interfaces from the perspective of visual attention and cognitive fluency. (3) It expands the objects of visual perception from traditional or symbolic artworks (such as logos) to the abstract visual stimuli of interface layout. (4) It suggests an optimization tool of five quantification layout attributes for mobile marketing businesses and platforms to aesthetically improve their marketing interfaces to improve user experiences.

This paper describes an ongoing mobile library project for the National Library of Norway. The purpose is to develop a visual web service prototype providing mobile access to the library's growing repository of digital data.

The author has set up several test databases and developed a number of Android applications (apps) for testing purposes: image presentation; library's digital exhibition “in the pocket”; traditional free text search; location based search; barcode scan for ISBN search / QR encapsulation; and voice/spoken search.

These six approaches were found to be promising using mobile technology. Cloud technology has changed the mobile phone from a voice transmitter to a multi-purpose device connected to the network. Library resources may now be distributed in the cloud, with global mobile access, to really achieve a global library network.

The applications developed here are innovative and unique, and will add to the general body of use cases.

Although brands have developed mobile applications (apps) to offer consumers new experiences, low app usage numbers indicate the need to develop a systematic, practical evaluation framework for branded app design that specifies concrete design features.

An expert review provides an overview of the design of current branded apps. On the basis of an extensive literature review, this article classifies state-of-the-art design features for branded apps according to a proposed evaluation framework that includes human–computer interaction (HCI)–related and marketing-related evaluation criteria. In an application of these evaluation criteria, the authors evaluate 73 branded apps issued by 11 top fast-moving consumer goods (FMCG) brands.

The expert review identifies strengths and weaknesses that are common to the design of current branded apps. These findings inform the set of design recommendations that this article offers, which includes 14 features common to all types of apps and 9 features specific to particular types of apps.

This research offers practical implications for app designers, who need to address design dimensions contained in the proposed framework including the HCI-related (mobile, social and user experience design features) and marketing-related (branding and customer relationship management design features) to create effective branded apps.

Design elements identified in prior literature remain abstract and do not prescribe a systematic or pragmatic approach to using them in practice. This study takes a multidisciplinary perspective (HCI, marketing and design science) to establish a practical evaluation framework for branded app designs.