Search results

Intelligent and connected vehicle technology is in the ascendant. High-level autonomous driving places more stringent requirements on the accuracy and reliability of environmental perception. Existing research works on multitarget tracking based on multisensor fusion mostly focuses on the vehicle perspective, but limited by the principal defects of the vehicle sensor platform, it is difficult to comprehensively and accurately describe the surrounding environment information.

In this paper, a multitarget tracking method based on roadside multisensor fusion is proposed, including a multisensor fusion method based on measurement noise adaptive Kalman filtering, a global nearest neighbor data association method based on adaptive tracking gate, and a Track life cycle management method based on M/N logic rules.

Compared with fixed-size tracking gates, the adaptive tracking gates proposed in this paper can comprehensively improve the data association performance in the multitarget tracking process. Compared with single sensor measurement, the proposed method improves the position estimation accuracy by 13.5% and the velocity estimation accuracy by 22.2%. Compared with the control method, the proposed method improves the position estimation accuracy by 23.8% and the velocity estimation accuracy by 8.9%.

A multisensor fusion method with adaptive Kalman filtering of measurement noise is proposed to realize the adaptive adjustment of measurement noise. A global nearest neighbor data association method based on adaptive tracking gate is proposed to realize the adaptive adjustment of the tracking gate.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

The purpose of this paper is to accurately capture the risks which are caused by each road user in time.

The authors proposed a novel risk assessment approach based on the multi-sensor fusion algorithm in the real traffic environment. Firstly, they proposed a novel detection-level fusion approach for multi-object perception in dense traffic environment based on evidence theory. This approach integrated four states of track life into a generic fusion framework to improve the performance of multi-object perception. The information of object type, position and velocity was accurately obtained. Then, they conducted several experiments in real dense traffic environment on highways and urban roads, which enabled them to propose a novel road traffic risk modeling approach based on the dynamic analysis of vehicles in a variety of driving scenarios. By analyzing the generation process of traffic risks between vehicles and the road environment, the equivalent forces of vehicle–vehicle and vehicle–road were presented and theoretically calculated. The prediction steering angle and trajectory were considered in the determination of traffic risk influence area.

The results of multi-object perception in the experiments showed that the proposed fusion approach achieved low false and missing tracking, and the road traffic risk was described as a field of equivalent force. The results extend the understanding of the traffic risk, which supported that the traffic risk from the front and back of the vehicle can be perceived in advance.

This approach integrated four states of track life into a generic fusion framework to improve the performance of multi-object perception. The information of object type, position and velocity was used to reduce erroneous data association between tracks and detections. Then, the authors conducted several experiments in real dense traffic environment on highways and urban roads, which enabled them to propose a novel road traffic risk modeling approach based on the dynamic analysis of vehicles in a variety of driving scenarios. By analyzing the generation process of traffic risks between vehicles and the road environment, the equivalent forces of vehicle–vehicle and vehicle–road were presented and theoretically calculated.

Steer-by-wire (SBW) system mainly relies on sensors, controllers and motors to replace the traditionally mechanical transmission mechanism to realize steering functions. However, the sensors in the SBW system are particularly vulnerable to external influences, which can cause systemic faults, leading to poor steering performance and even system instability. Therefore, this paper aims to adopt a fault-tolerant control method to solve the safety problem of the SBW system caused by sensors failure.

This paper proposes an active fault-tolerant control framework to deal with sensors failure in the SBW system by hierarchically introducing fault observer, fault estimator, fault reconstructor. Firstly, the fault observer is used to obtain the observation output of the SBW system and then obtain the residual between the observation output and the SBW system output. And then judge whether the SBW system fails according to the residual. Secondly, dependent on the residual obtained by the fault observer, a fault estimator is designed using bounded real lemma and regional pole configuration to estimate the amplitude and time-varying characteristics of the faulty sensor. Eventually, a fault reconstructor is designed based on the estimation value of sensors fault obtained by the fault estimator and SBW system output to tolerate the faulty sensor.

The numerical analysis shows that the fault observer can be rapidly activated to detect the fault while the sensors fault occurs. Moreover, the estimation accuracy of the fault estimator can reach to 98%, and the fault reconstructor can make the faulty SBW system to retain the steering characteristics, comparing to those of the fault-free SBW system. In addition, it was verified for the feasibility and effectiveness of the proposed control framework.

As the SBW fault diagnosis and fault-tolerant control in this paper only carry out numerical simulation research on sensors faults in matrix and laboratory/Simulink, the subsequent hardware in the loop test is needed for further verification.

Aiming at the SBW system with parameter perturbation and sensors failure, this paper proposes an active fault-tolerant control framework, which integrates fault observer, fault estimator and fault reconstructor so that the steering performance of SBW system with sensors faults is basically consistent with that of the fault-free SBW system.

The purpose of this study is to introduce the top-level design ideas and the overall architecture of earthquake early-warning system for high speed railways in China, which is based on P-wave earthquake early-warning and multiple ways of rapid treatment.

The paper describes the key technologies that are involved in the development of the system, such as P-wave identification and earthquake early-warning, multi-source seismic information fusion and earthquake emergency treatment technologies. The paper also presents the test results of the system, which show that it has complete functions and its major performance indicators meet the design requirements.

The study demonstrates that the high speed railways earthquake early-warning system serves as an important technical tool for high speed railways to cope with the threat of earthquake to the operation safety. The key technical indicators of the system have excellent performance: The first report time of the P-wave is less than three seconds. From the first arrival of P-wave to the beginning of train braking, the total delay of onboard emergency treatment is 3.63 seconds under 95% probability. The average total delay for power failures triggered by substations is 3.3 seconds.

The paper provides a valuable reference for the research and development of earthquake early-warning system for high speed railways in other countries and regions. It also contributes to the earthquake prevention and disaster reduction efforts.

Aircraft assembly is the crucial part of aircraft manufacturing, and to meet the high-precision and high-efficiency requirements, cooperative measurement consisting of multiple measurement instruments and automatic assisted devices is being adopted. To achieve the complete data of all assembly features, measurement devices need to be placed at different positions, and the flexible and efficient transfer relies on Automated Guided Vehicles (AGVs) and robots in the large-size space and close range. This paper aims to improve the automatic station transfer in accuracy and flexibility.

A transferring system with Light Detection and Ranging (LiDAR) and markers is established. The map coupling for navigation is optimized. Markers are distributed according to the accumulated uncertainties. The path planning method applied to the collaborative measurement is proposed for better accuracy. The motion planning method is optimized for better positioning accuracy.

A transferring system is constructed and the system is verified in the laboratory. Experimental results show that the proposed system effectively improves positioning accuracy and efficiency, which improves the station transfer for the cooperative measurement.

A Transferring system for collaborative measurement is proposed. The optimized navigation method extends the application of visual markers. With this system, AGV is capable of the cooperative measurement of large aircraft structural parts.

The purpose of this paper is to propose and evaluate the method for grasping a defined set of objects in an unstructured environment. To this end, the authors propose the method of integrating convolutional neural network (CNN)-based object detection and the category-free grasping method. The considered scenario is related to mobile manipulating platforms that move freely between workstations and manipulate defined objects. In this application, the robot is not positioned with respect to the table and manipulated objects. The robot detects objects in the environment and uses grasping methods to determine the reference pose of the gripper.

The authors implemented the whole pipeline which includes object detection, grasp planning and motion execution on the real robot. The selected grasping method uses raw depth images to find the configuration of the gripper. The authors compared the proposed approach with a representative grasping method that uses a 3D point cloud as an input to determine the grasp for the robotic arm equipped with a two-fingered gripper. To measure and compare the efficiency of these methods, the authors measured the success rate in various scenarios. Additionally, they evaluated the accuracy of object detection and pose estimation modules.

The performed experiments revealed that the CNN-based object detection and the category-free grasping methods can be integrated to obtain the system which allows grasping defined objects in the unstructured environment. The authors also identified the specific limitations of neural-based and point cloud-based methods. They show how the determined properties influence the performance of the whole system.

The authors identified the limitations of the proposed methods and the improvements are envisioned as part of future research.

The evaluation of the grasping and object detection methods on the mobile manipulating robot may be useful for all researchers working on the autonomy of similar platforms in various applications.

The proposed method increases the autonomy of robots in applications in the small industry which is related to repetitive tasks in a noisy and potentially risky environment. This allows reducing the human workload in these types of environments.

The main contribution of this research is the integration of the state-of-the-art methods for grasping objects with object detection methods and evaluation of the whole system on the industrial robot. Moreover, the properties of each subsystem are identified and measured.

Improvement of reverse supply chains requires accurate and timely information about the patterns of consumption. In the consumer context, the ways to generate and access such use-visibility data are in their infancy. The purpose of this study is to demonstrate how the Internet of Things (IoT) may be operationalised in the domestic setting to capture data on a consumer’s use of products and the implications for reverse supply chains.

This study uses an explorative case approach drawing on data from studies of six UK households. “Horizontal” data, which reveals patterns in consumers’ use processes, is generated by combining “vertical” data from multiple sources. Use processes in the homes are mapped using IDEF0 and illustrated with the data. The quantitative data are generated using wireless sensors in the home, and qualitative data are drawn from online calendars, social media, interviews and ethnography.

The study proposes four generic measurement categories for operationalising the concept of use-visibility: experience, consumption, interaction and depletion, which together address the use of different household resources. The explorative case demonstrates how these measures can be operationalised to achieve visibility of the context of use in the home. The potential of such use-visibility for reverse supply chains is discussed.

This explorative case study is based on an in-depth study of the bathroom which illustrates the application of use-visibility measures (UVMs) but provides a limited use context. Further research is needed from a wider set of homes and a wider set of use processes and contexts.

The case demonstrates the operationalisation of the combination of data from different sources and helps answer questions of “why?”, “how?”, “when?” and “how much?”, which can inform reverse supply chains. The four UVMs can be operationalised in a way that can contribute to supply chain visibility, providing accurate and timely information of consumption, optimising resource use and eliminating waste.

IDEF0 framework and case analysis is used to identify and validate four UVMs available through IoT data – that of experience, consumption, interaction and depletion. The UVMs characterise IoT data generated from a given process and inform the primary reverse flow in the future supply chain. They provide the basis for future data collection and development of theory around their effect on reverse supply chain efficiency.