Search results

The rapid rise of large language models (LLMs) has propelled them to the forefront of applications in natural language processing (NLP). This paper aims to present a comprehensive examination of the research landscape in LLMs, providing an overview of the prevailing themes and topics within this dynamic domain.

Drawing from an extensive corpus of 198 records published between 1996 to 2023 from the relevant academic database encompassing journal articles, books, book chapters, conference papers and selected working papers, this study delves deep into the multifaceted world of LLM research. In this study, the authors employed the BERTopic algorithm, a recent advancement in topic modeling, to conduct a comprehensive analysis of the data after it had been meticulously cleaned and preprocessed. BERTopic leverages the power of transformer-based language models like bidirectional encoder representations from transformers (BERT) to generate more meaningful and coherent topics. This approach facilitates the identification of hidden patterns within the data, enabling authors to uncover valuable insights that might otherwise have remained obscure. The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology.

The analysis revealed four distinct clusters of topics in LLM research: “language and NLP”, “education and teaching”, “clinical and medical applications” and “speech and recognition techniques”. Each cluster embodies a unique aspect of LLM application and showcases the breadth of possibilities that LLM technology has to offer. In addition to presenting the research findings, this paper identifies key challenges and opportunities in the realm of LLMs. It underscores the necessity for further investigation in specific areas, including the paramount importance of addressing potential biases, transparency and explainability, data privacy and security, and responsible deployment of LLM technology.

This classification offers practical guidance for researchers, developers, educators, and policymakers to focus efforts and resources. The study underscores the importance of addressing challenges in LLMs, including potential biases, transparency, data privacy, and responsible deployment. Policymakers can utilize this information to shape regulations, while developers can tailor technology development based on the diverse applications identified. The findings also emphasize the need for interdisciplinary collaboration and highlight ethical considerations, providing a roadmap for navigating the complex landscape of LLM research and applications.

This study stands out as the first to examine the evolution of LLMs across such a long time frame and across such diversified disciplines. It provides a unique perspective on the key areas of LLM research, highlighting the breadth and depth of LLM’s evolution.

This paper presents a survey of research into interactive robotic systems for the purpose of identifying the state of the art capabilities as well as the extant gaps in this emerging field. Communication is multimodal. Multimodality is a representation of many modes chosen from rhetorical aspects for its communication potentials. The author seeks to define the available automation capabilities in communication using multimodalities that will support a proposed Interactive Robot System (IRS) as an AI mounted robotic platform to advance the speed and quality of military operational and tactical decision making.

This review will begin by presenting key developments in the robotic interaction field with the objective of identifying essential technological developments that set conditions for robotic platforms to function autonomously. After surveying the key aspects in Human Robot Interaction (HRI), Unmanned Autonomous System (UAS), visualization, Virtual Environment (VE) and prediction, the paper then proceeds to describe the gaps in the application areas that will require extension and integration to enable the prototyping of the IRS. A brief examination of other work in HRI-related fields concludes with a recapitulation of the IRS challenge that will set conditions for future success.

Using insights from a balanced cross section of sources from the government, academic, and commercial entities that contribute to HRI a multimodal IRS in military communication is introduced. Multimodal IRS (MIRS) in military communication has yet to be deployed.

Multimodal robotic interface for the MIRS is an interdisciplinary endeavour. This is not realistic that one can comprehend all expert and related knowledge and skills to design and develop such multimodal interactive robotic interface. In this brief preliminary survey, the author has discussed extant AI, robotics, NLP, CV, VDM, and VE applications that is directly related to multimodal interaction. Each mode of this multimodal communication is an active research area. Multimodal human/military robot communication is the ultimate goal of this research.

A multimodal autonomous robot in military communication using speech, images, gestures, VST and VE has yet to be deployed. Autonomous multimodal communication is expected to open wider possibilities for all armed forces. Given the density of the land domain, the army is in a position to exploit the opportunities for human–machine teaming (HMT) exposure. Naval and air forces will adopt platform specific suites for specially selected operators to integrate with and leverage this emerging technology. The possession of a flexible communications means that readily adapts to virtual training will enhance planning and mission rehearsals tremendously.

Interaction, perception, cognition and visualization based multimodal communication system is yet missing. Options to communicate, express and convey information in HMT setting with multiple options, suggestions and recommendations will certainly enhance military communication, strength, engagement, security, cognition, perception as well as the ability to act confidently for a successful mission.

The objective is to develop a multimodal autonomous interactive robot for military communications. This survey reports the state of the art, what exists and what is missing, what can be done and possibilities of extension that support the military in maintaining effective communication using multimodalities. There are some separate ongoing progresses, such as in machine-enabled speech, image recognition, tracking, visualizations for situational awareness, and virtual environments. At this time, there is no integrated approach for multimodal human robot interaction that proposes a flexible and agile communication. The report briefly introduces the research proposal about multimodal interactive robot in military communication.

Effective translation has become essential for seamless cross-cultural communication in an era of global interconnectedness. Translation management systems (TMS) have redefined the translation landscape, revolutionizing project management and execution. This study examines the attitudes of translation agencies and professional translators towards integrating and utilizing TMS, with a specific focus on Saudi Arabia.

The study's design was based on a thorough mixed-methods strategy that purposefully combined quantitative and qualitative procedures to create an array of findings. Through a survey involving 35 participants (both project managers and professional translators) and a series of interviews, this research explores the adoption of TMS, perceived benefits, influencing factors and future considerations. This integrated approach sought to investigate the nuanced perceptions of Saudi translation companies and expert translators about TMS. By combining the strengths of quantitative data's broad scopes and qualitative insights' depth, this mixed-methods approach sought to overcome the limitations of each method, ultimately resulting in a holistic understanding of the multifaceted factors shaping attitudes within Saudi Arabia's unique translation landscape.

Based on questionnaires and interviews, the study shows that 80% of participants were familiar with TMS, and 57% had adopted it in their work. Benefits included enhanced project efficiency, collaboration and quality assurance. Factors influencing adoption encompassed cost, compatibility and resistance to change. The study further delved into participants' demographic profiles and years of experience, with a notable concentration in the 6–10 years range. TMS adoption was linked to improved translation processes, and participants expressed interest in AI integration and mobile compatibility. Deployment models favored cloud-based solutions, and compliance with industry standards was deemed vital. The findings underscore the evolving nature of TMS adoption in Saudi Arabia, with diverse attitudes shaped by cultural influences, technological compatibility and awareness.

This research provides a holistic and profound perspective on the integration of TMS, fostering a more comprehensive understanding of the opportunities, obstacles and potential pathways to success. As the translation landscape continues to evolve, the findings from this study will serve as a valuable compass guiding practitioners and researchers towards effectively harnessing the power of technology for enhanced translation outcomes.

The present study is about generating metadata to enhance thematic transparency and facilitate research on interview collections at the Research Documentation Centre, Centre for Social Sciences (TK KDK) in Budapest. It explores the use of artificial intelligence (AI) in producing, managing and processing social science data and its potential to generate useful metadata to describe the contents of such archives on a large scale.

The authors combined manual and automated/semi-automated methods of metadata development and curation. The authors developed a suitable domain-oriented taxonomy to classify a large text corpus of semi-structured interviews. To this end, the authors adapted the European Language Social Science Thesaurus (ELSST) to produce a concise, hierarchical structure of topics relevant in social sciences. The authors identified and tested the most promising natural language processing (NLP) tools supporting the Hungarian language. The results of manual and machine coding will be presented in a user interface.

The study describes how an international social scientific taxonomy can be adapted to a specific local setting and tailored to be used by automated NLP tools. The authors show the potential and limitations of existing and new NLP methods for thematic assignment. The current possibilities of multi-label classification in social scientific metadata assignment are discussed, i.e. the problem of automated selection of relevant labels from a large pool.

Interview materials have not yet been used for building manually annotated training datasets for automated indexing of scientifically relevant topics in a data repository. Comparing various automated-indexing methods, this study shows a possible implementation of a researcher tool supporting custom visualizations and the faceted search of interview collections.

This purpose of this paper is to report on the development of an evidence-informed framework created to facilitate the formulation of generative artificial intelligence (GenAI) academic integrity policy responses for English medium instruction (EMI) higher education, responding to both the bespoke challenges for the sector and longstanding calls to define and disseminate quality implementation good practice.

A virtual nominal group technique engaged experts (n = 14) in idea generation, refinement and consensus building across asynchronous and synchronous stages. The resulting qualitative and quantitative data were analysed using thematic analysis and descriptive statistics, respectively.

The GenAI Academic Integrity Policy Development Blueprint for EMI Tertiary Education is not a definitive mandate but represents a roadmap of inquiry for reflective deliberation as institutions chart their own courses in this complex terrain.

If repeated with varying expert panellists, findings may vary to a certain extent; thus, further research with a wider range of stakeholders may be necessary for additional validation.

While grounded within the theoretical underpinnings of the field, the tool holds practical utility for stakeholders to develop bespoke policies and critically re-examine existing frameworks.

As texts produced by students using English as an additional language are at risk of being wrongly accused of GenAI-assisted plagiarism, owing to the limited efficacy of text classifiers such as Turnitin, the policy recommendations encapsulated in the blueprint aim to reduce potential bias and unfair treatment of students.

The novel blueprint represents a step towards bridging concerning gaps in policy responses worldwide and aims to spark discussion and further much-needed scholarly exploration to this end.

The application of artificial intelligence chatbots is an emerging trend in educational technology studies for its multi-faceted advantages. However, the existing studies rarely take a perspective of educational technology application to evaluate the application of chatbots to educational contexts. This study aims to bridge the research gap by taking an educational perspective to review the existing literature on artificial intelligence chatbots.

This study combines bibliometric analysis and citation network analysis: a bibliometric analysis through visualization of keyword, authors, organizations and countries and a citation network analysis based on literature clustering.

Educational applications of chatbots are still rising in post-COVID-19 learning environments. Popular research issues on this topic include technological advancements, students’ perception of chatbots and effectiveness of chatbots in different educational contexts. Originating from similar technological and theoretical foundations, chatbots are primarily applied to language education, educational services (such as information counseling and automated grading), health-care education and medical training. Diversifying application contexts demonstrate specific purposes for using chatbots in education but are confronted with some common challenges. Multi-faceted factors can influence the effectiveness and acceptance of chatbots in education. This study provides an extended framework to facilitate extending artificial intelligence chatbot applications in education.

The authors have to acknowledge that this study is subjected to some limitations. First, the literature search was based on the core collection on Web of Science, which did not include some existing studies. Second, this bibliometric analysis only included studies published in English. Third, due to the limitation in technological expertise, the authors could not comprehensively interpret the implications of some studies reporting technological advancements. However, this study intended to establish its research significance by summarizing and evaluating the effectiveness of artificial intelligence chatbots from an educational perspective.

This study identifies the publication trends of artificial intelligence chatbots in educational contexts. It bridges the research gap caused by previous neglection of treating educational contexts as an interconnected whole which can demonstrate its characteristics. It identifies the major application contexts of artificial intelligence chatbots in education and encouraged further extending of applications. It also proposes an extended framework to consider that covers three critical components of technological integration in education when future researchers and instructors apply artificial intelligence chatbots to new educational contexts.

In the COVID-19 era, sign language (SL) translation has gained attention in online learning, which evaluates the physical gestures of each student and bridges the communication gap between dysphonia and hearing people. The purpose of this paper is to devote the alignment between SL sequence and nature language sequence with high translation performance.

SL can be characterized as joint/bone location information in two-dimensional space over time, forming skeleton sequences. To encode joint, bone and their motion information, we propose a multistream hierarchy network (MHN) along with a vocab prediction network (VPN) and a joint network (JN) with the recurrent neural network transducer. The JN is used to concatenate the sequences encoded by the MHN and VPN and learn their sequence alignments.

We verify the effectiveness of the proposed approach and provide experimental results on three large-scale datasets, which show that translation accuracy is 94.96, 54.52, and 92.88 per cent, and the inference time is 18 and 1.7 times faster than listen-attend-spell network (LAS) and visual hierarchy to lexical sequence network (H2SNet) , respectively.

In this paper, we propose a novel framework that can fuse multimodal input (i.e. joint, bone and their motion stream) and align input streams with nature language. Moreover, the provided framework is improved by the different properties of MHN, VPN and JN. Experimental results on the three datasets demonstrate that our approaches outperform the state-of-the-art methods in terms of translation accuracy and speed.