Search results

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

This study aims to examine activity-related sound levels and pupils’ perceptions of the acoustic environment in two classrooms, one of which was a traditional classroom (Reference classroom, reverberation time (RT) 0.54 s) and the other a refurbished classroom (Demo classroom, RT 0.32 s).

Three types of data were gathered: room acoustic measurements, activity sound levels during different activities and pupils’ subjective experience concerning factors related to acoustics. Pupils, 10–11 years old (N = 34), estimated their subjective experience in general and after four test lessons. Teachers planned the test lessons to have four different lesson types: quiet work, one-person speaking, group work and activity-based work. The sound levels of activities were measured during the test lessons.

The activity sound levels were 2–13 dB L_Aeq lower in the Demo classroom than in the Reference classroom, depending on lesson type. Pupils were less annoyed by noise in the Demo than in the Reference classroom. Pupils’ speech was the most annoying sound source. More pupils were annoyed by it in the Reference classroom (65%) than in the Demo classroom (15%). Hearing the teacher while not seeing her face, concentrating on teaching and sitting in one’s place were estimated easier in the Demo classroom than in the Reference classroom.

This study offers a new approach using test lessons for studying activity sounds in schools. Activity sounds and their annoyance can be significantly diminished by classroom refurbishments.

Due to the continuous and rapid evolution of telecommunication equipment, the demand for more efficient and noise-robust detection of dual-tone multi-frequency (DTMF) signals is most significant.

A novel machine learning-based approach to detect DTMF tones affected by noise, frequency and time variations by employing the k-nearest neighbour (KNN) algorithm is proposed. The features required for training the proposed KNN classifier are extracted using Goertzel's algorithm that estimates the absolute discrete Fourier transform (DFT) coefficient values for the fundamental DTMF frequencies with or without considering their second harmonic frequencies. The proposed KNN classifier model is configured in four different manners which differ in being trained with or without augmented data, as well as, with or without the inclusion of second harmonic frequency DFT coefficient values as features.

It is found that the model which is trained using the augmented data set and additionally includes the absolute DFT values of the second harmonic frequency values for the eight fundamental DTMF frequencies as the features, achieved the best performance with a macro classification F1 score of 0.980835, a five-fold stratified cross-validation accuracy of 98.47% and test data set detection accuracy of 98.1053%.

The generated DTMF signal has been classified and detected using the proposed KNN classifier which utilizes the DFT coefficient along with second harmonic frequencies for better classification. Additionally, the proposed KNN classifier has been compared with existing models to ascertain its superiority and proclaim its state-of-the-art performance.

The intelligent Central Traffic Control (CTC) system plays a vital role in establishing an intelligent high-speed railway (HSR) system. As the core of HSR transportation command, the intelligent CTC system is a new HSR dispatching command system that integrates the widely used CTC in China with the practical service requirements of intelligent dispatching. This paper aims to propose key technologies and applications for intelligent dispatching command in HSR in China.

This paper first briefly introduces the functions and configuration of the intelligent CTC system. Some new servers, terminals and interfaces are introduced, which are plan adjustment server/terminal, interface for automatic train operation (ATO), interface for Dynamic Monitoring System of Train Control Equipment (DMS), interface for Power Supervisory Control and Data Acquisition (PSCADA), interface for Disaster Monitoring, etc.

The key technologies applied in the intelligent CTC system include automatic adjustment of train operation plans, safety control of train routes and commands, traffic information data platform, integrated simulation of traffic dispatching and ATO function. These technologies have been applied in the Beijing-Zhangjiakou HSR, which commenced operations at the end of 2019. Implementing these key intelligent functions has improved the train dispatching command capacity, ensured the safe operation of intelligent HSR, reduced the labor intensity of dispatching operators and enhanced the intelligence level of China's dispatching system.

This paper provides further challenges and research directions for the intelligent dispatching command of HSR. To achieve the objectives, new measures need to be conducted, including the development of advanced technologies for intelligent dispatching command, coping with new requirements with the development of China's railway signaling system, the integration of traffic dispatching and train control and the application of AI and data-driven modeling and methods.