Search results

According to the Indian Sign Language Research and Training Centre (ISLRTC), India has approximately 300 certified human interpreters to help people with hearing loss. This paper aims to address the issue of Indian Sign Language (ISL) sentence recognition and translation into semantically equivalent English text in a signer-independent mode.

This study presents an approach that translates ISL sentences into English text using the MobileNetV2 model and Neural Machine Translation (NMT). The authors have created an ISL corpus from the Brown corpus using ISL grammar rules to perform machine translation. The authors’ approach converts ISL videos of the newly created dataset into ISL gloss sequences using the MobileNetV2 model and the recognized ISL gloss sequence is then fed to a machine translation module that generates an English sentence for each ISL sentence.

As per the experimental results, pretrained MobileNetV2 model was proven the best-suited model for the recognition of ISL sentences and NMT provided better results than Statistical Machine Translation (SMT) to convert ISL text into English text. The automatic and human evaluation of the proposed approach yielded accuracies of 83.3 and 86.1%, respectively.

It can be seen that the neural machine translation systems produced translations with repetitions of other translated words, strange translations when the total number of words per sentence is increased and one or more unexpected terms that had no relation to the source text on occasion. The most common type of error is the mistranslation of places, numbers and dates. Although this has little effect on the overall structure of the translated sentence, it indicates that the embedding learned for these few words could be improved.

Sign language recognition and translation is a crucial step toward improving communication between the deaf and the rest of society. Because of the shortage of human interpreters, an alternative approach is desired to help people achieve smooth communication with the Deaf. To motivate research in this field, the authors generated an ISL corpus of 13,720 sentences and a video dataset of 47,880 ISL videos. As there is no public dataset available for ISl videos incorporating signs released by ISLRTC, the authors created a new video dataset and ISL corpus.

The current study aims to determine the viability of the tool developed by Abbas and Sarfraz (2018) to translate English speech and text to Pakistan Sign Language (PSL) with bilingual subtitles.

Focus group interviews of 30 teachers of a Pakistani private university were conducted; who used the PSL translation tool in their classrooms for lecture delivery and communication with the deaf students.

The findings of the study determined the viability of the developed tool and showed that it is helpful in teaching deaf students efficiently. With the availability of this tool, teachers are not dependent on human sign language (SL) interpreters in their classrooms.

Overall, this tool is an effective addition to educational technology for special education. Due to the lack of Sign Language (SL) understanding, learning resources and availability of human SL interpreters in Pakistan, institutions feel dependency and scarcity to educate deaf students in a classroom. Unimpaired people and especially teachers face problems communicating with deaf people to arrange one interpreter for a student(s) in multiple classes at the same time which creates a communication gap between a teacher and a deaf student.

The main objective of this article is to contribute to the field of accessibility in the teaching of sign language in the international panorama, examining its applicability, evaluation methods as well as the assistive technologies used to improve teaching experiences and the creation of new materials, proposing a theoretical framework that relates the teaching of sign language at different academic levels, the training of teachers, as well as parents, and the use of technology to achieve educational inclusion. It follows that the adoption of hybrid technology approaches, following universal design principles, can help to integrate access to education and sign language literacy.

The working method used to carry out this work consists of a systematic review of the scientific literature. This is a research project based on the recapitulation of information about sign language in the international panorama and the improvements used for its instruction. For this purpose, the well-known PRISMA (Moher et al., 2009) is used to synthesize the search carried out. A systematic review of the articles published in scientific journals about pedagogy in the teaching of sign language in the international field and technological innovation for sign language teaching has been carried out, incorporating different approaches and personal assessments. The first phase of the method consists of identifying and analyzing the articles published in scientific journals on the teaching of sign language on the international scene and the importance of new educational models with the incorporation of various didactic adaptations, evaluating the selected articles over a period of time from 2009 to 2021. Six steps were used in the systematic review study (Figure 1). First, Steps 1–4 were conducted in 2020 and 2021 as part of a doctoral research. A schematic summary of Steps 1–4 is presented below, followed by Steps 5 and 6, added later to the study after completion of Step 4. In the case of the first four steps they were conducted by two researchers: the thesis tutor and the doctoral student, and Steps 5 and 6 were conducted by the Ph.

To carry out the analysis of the results, the codification of the variables was carried out. The selected studies are characterized by their international context with a final selection of 39 studies have found several variables that affect the relationship between the teaching of sign language in the international arena and the use of technological innovations to adapt their teaching to students (Figure 4). In this section we present the technology grouped variables included in each factor and the possibilities of standardization and applicability of sign language teaching in the international panorama. Within these articles, the importance of defining training programs in sign language for teachers and the need to evaluate teaching programs is identified, with a focus on actions to improve school curricula to achieve linguistic standardization and inclusion in the academic environment, as well as their use at all levels of education. Therefore, professional practices and cooperation between institutions such as: associations of families of deaf students and educational institutions must be improved, making it possible to give a quality education. Within the exclusion criteria, the articles that do not use sign language teaching tools (n = 45) were subsequently discarded, followed by the articles that do not indicate any intervention in students with disabilities (n = 48), concluding with the articles that nonsign language disability education (n = 44). Subsequently, among those selected, the technology articles that do not speak about sign language were discarded (n = 32), as well as the studies that protect indigenous language but not sign language (n = 33) and, to conclude, the linguistic normalization articles but do not cite sign language (n = 37).

Communication is the element by which the authors can understand each other with the rest of the people around us, in the diversity of language, within non-verbal language, the authors find sign language, the language of deaf and mute people, of families, as a professional employee and nowadays, learned by many non-deaf and mute people to achieve a more inclusive and integrated society with all people. Every country has the right to have its own sign language, especially one that claims its culture and customs, through non-verbal communication with which to express multiple meanings, emotions and intentions. It is essential to know and apply the technological advances that are being developed, promoting the right to autonomy and the defense of the indigenous language as a cultural element of the intangible heritage of each country. The use of technology allows the democratization of culture and access to information regardless of where one lives in the world, in an increasingly globalized society in which communication plays a fundamental role. In the case of the global pandemic, it has forced us to the advancement of home education and the use of efficient digital tools to achieve it such as videoconferencing, in the field of disability there are still many limitations on this use by the various companies that develop them. Within the inclusive educational research the authors must emphasize the need for equality of tools and content for all types of students, especially in sign language. Large digital gaps have been generated in families with and without resources at international level, which also have a member with a disability, this is pointed out in the research mentioning the current situation of the American continent, as well as the search for improvement of the tools and platforms in which they are developed.

This paper seeks to show the special needs of deaf people to have a barrier‐free access to the internet and its services and benefit from it. It aims to give explanations why deaf people need sign language on the web as a replacement for acoustic and written content and to present today's solutions to realize it.

This is a comparison and confrontation of today's research on the topic, influenced by the author's opinion.

Deaf people need sign language on the web to have full access to acoustic and written content. Sign‐language‐videos with human interpreters are today's common solution. There is a lot of research and projects with avatar‐technologies to overcome the limits of sign‐language‐videos, but the possibilities of this solution are still restricted.

This paper seeks to draw attention to the special need of deaf people, their restrictions in reading and writing and why sign language is the crucial factor to include deaf people in the information society.

This paper confronts the actual solutions of the topic and shows their advantages and limits.

In the COVID-19 era, sign language (SL) translation has gained attention in online learning, which evaluates the physical gestures of each student and bridges the communication gap between dysphonia and hearing people. The purpose of this paper is to devote the alignment between SL sequence and nature language sequence with high translation performance.

SL can be characterized as joint/bone location information in two-dimensional space over time, forming skeleton sequences. To encode joint, bone and their motion information, we propose a multistream hierarchy network (MHN) along with a vocab prediction network (VPN) and a joint network (JN) with the recurrent neural network transducer. The JN is used to concatenate the sequences encoded by the MHN and VPN and learn their sequence alignments.

We verify the effectiveness of the proposed approach and provide experimental results on three large-scale datasets, which show that translation accuracy is 94.96, 54.52, and 92.88 per cent, and the inference time is 18 and 1.7 times faster than listen-attend-spell network (LAS) and visual hierarchy to lexical sequence network (H2SNet) , respectively.

In this paper, we propose a novel framework that can fuse multimodal input (i.e. joint, bone and their motion stream) and align input streams with nature language. Moreover, the provided framework is improved by the different properties of MHN, VPN and JN. Experimental results on the three datasets demonstrate that our approaches outperform the state-of-the-art methods in terms of translation accuracy and speed.

The purpose of this paper is to answer the question: in the British state's relationship with its diverse minority ethnic communities, how have politics framed administrative allocation of language support services? The dynamics of policy development are investigated, a tangible effect of the shift from unofficial pragmatic multiculturalism towards community cohesion/“Britishness” having been a government focus on English for speakers of other languages (ESOL) rather than translation/interpreting. This change has revealed a tension between the demands of identity and equality for minority ethnic people: respect for cultural identity requires provision of translation/interpreting while creating (political) equality between majority and minority communities entails the latter having access to the political language so placing an emphasis on ESOL.

An evidence synthesis is undertaken of policy documents relating to the British state's provision of language support services and data on the skill levels in English from government surveys.

The relative contribution of financial constraints and new policy/ideological positions to changes in the direction of policy and provision is assessed. With respect to the “new approach to ESOL”, this process of discretionary allocation that privileges policies of integration and community cohesion rather than language need itself is viewed against the inadequacies of the data currently available on levels of English language proficiency in providing the basis for making policy decisions and allocating resources.

The level of English language skills amongst Britain's minority ethnic groups and of government policy to address skill deficits has been substantially neglected. The paper provides a policy focus ahead of the release of the 2011 Census findings on language questions.

This study investigated the relationship between the public library and the Deaf community in the United States and how this can be addressed from a library management perspective. A review of literature showed that while resources on this subject exist, no evidence could be found of any prior studies directly involving, or based on input from the Deaf themselves. Literature was also examined for resources identifying elements of deafness and Deaf culture which may relate to use of the public library, as well as ethical practices and procedures which are desirable when conducting research on Deaf participants. A nationwide survey of adult members of the American Deaf community was undertaken. The survey investigated the extent to which the Deaf utilize the public library and its associated services. It also identified factors which serve as impediments to their use. Survey results indicated that while the majority of respondents rarely visit a public library, interest in books and Deaf literature collections is high. Interestingly the public library is not seen as a good place to meet other Deaf people but is seen as a friendly environment. Identified barriers to use include difficulties in communicating with library staff, absence of interpreted events, and building design. Areas of potential further study were identified.

Vocabulary learning is a difficult task for children without hearing ability. Absence of enough learning centers and effective learning tools aggravate the problem. Modern technology can be utilized fruitfully to find solutions to the learning difficulties experienced by the deaf. The purpose of this paper is to present SiLearn – a novel technology based tool for teaching/learning sign vocabulary.

The proposed mobile application can act as a visual dictionary for deaf people. SiLearn is equipped with features that can automatically detect both text and physical objects and convert them to their corresponding signs. For testing the effectiveness of the proposed mobile application quantitative analyses were done. Quantitative analysis is based on testing a class of 28 students belonging to St Clare Oral School for the Deaf, Kerala, India. This group consisted of 17 boys and 11 girls. Analysis was also done through questionnaire. Questionnaires were given to teachers, parents of deaf students learning sign language and other sign language learners.

Results indicate that as SiLearn is very effective in sign vocabulary development. It can enhance vocabulary learning rate considerably.

This is the first time that artificial intelligence (AI) based techniques are used for early stage sign language learning. SiLearn can equally be used by children, parents and teachers for learning sign language.

Conversational agents are natural language interaction interfaces designed to simulate conversation with a real person. This paper seeks to investigate current development and applications of these systems worldwide, while focusing on their availability in Canadian libraries. It aims to argue that it is both timely and conceivable for Canadian libraries to consider adopting conversational agents to enhance – not replace – face‐to‐face human interaction. Potential users include library web site tour guides, automated virtual reference and readers' advisory librarians, and virtual story‐tellers. To provide background and justification for this argument, the paper seeks to review agents from classic implementations to state‐of‐the‐art prototypes: how they interact with users, produce language, and control conversational behaviors.

The web sites of the 20 largest Canadian libraries were surveyed to assess the extent to which specific language‐related technologies are offered in Canada, including conversational agents. An exemplified taxonomy of four pragmatic purposes that conversational agents currently serve outside libraries – educational, informational, assistive, and socially interactive – is proposed and translated into library settings.

As of early 2010, artificially intelligent conversational systems have been found to be virtually non‐existent in Canadian libraries, while other innovative technologies proliferate (e.g. social media tools). These findings motivate the need for a broader awareness and discussion within the LIS community of these systems' applicability and potential for library purposes.

This paper is intended for reflective information professionals who seek a greater understanding of the issues related to adopting conversational agents in libraries, as this topic is scarcely covered in the LIS literature. The pros and cons are discussed, and insights offered into perceptions of intelligence (artificial or not) as well as the fundamentally social nature of human‐computer interaction.

Most industrial robots are still programmed using the typical teaching process, through the use of the robot teach pendant. This is a tedious and time‐consuming task that requires some technical expertise, and hence new approaches to robot programming are required. The purpose of this paper is to present a robotic system that allows users to instruct and program a robot with a high‐level of abstraction from the robot language.

The paper presents in detail a robotic system that allows users, especially non‐expert programmers, to instruct and program a robot just showing it what it should do, in an intuitive way. This is done using the two most natural human interfaces (gestures and speech), a force control system and several code generation techniques. Special attention will be given to the recognition of gestures, where the data extracted from a motion sensor (three‐axis accelerometer) embedded in the Wii remote controller was used to capture human hand behaviours. Gestures (dynamic hand positions) as well as manual postures (static hand positions) are recognized using a statistical approach and artificial neural networks.

It is shown that the robotic system presented is suitable to enable users without programming expertise to rapidly create robot programs. The experimental tests showed that the developed system can be customized for different users and robotic platforms.

The proposed system is tested on two different robotic platforms. Since the options adopted are mainly based on standards, it can be implemented with other robot controllers without significant changes. Future work will focus on improving the recognition rate of gestures and continuous gesture recognition.

The key contribution of this paper is that it offers a practical method to program robots by means of gestures and speech, improving work efficiency and saving time.

This paper presents an alternative to the typical robot teaching process, extending the concept of human‐robot interaction and co‐worker scenario. Since most companies do not have engineering resources to make changes or add new functionalities to their robotic manufacturing systems, this system constitutes a major advantage for small‐ to medium‐sized enterprises.