Abstract
Background: People suffering from hearing and speaking disabilities have a few ways of communicating with other people. One of these is to communicate through the use of sign language.
Objective: Developing a system for sign language recognition becomes essential for the deaf as well as a mute person. The recognition system acts as a translator between a disabled and an able person. This eliminates the hindrances in the exchange of ideas. Most of the existing systems are very poorly designed with limited support for the needs of their day to day facilities.
Methods: The proposed system embedded with gesture recognition capability has been introduced here, which extracts signs from a video sequence and displays them on screen. On the other hand, a speech to text, as well as text to speech system, is also introduced to further facilitate the grieved people. To get the best out of the human computer relationship, the proposed solution consists of various cutting-edge technologies and Machine Learning based sign recognition models, which have been trained by using Tensor Flow and Keras library.
Results: The proposed architecture works better than several gesture recognition techniques like background elimination and conversion to HSV because of the sharply defined image provided to the model for classification. The results of testing indicate reliable recognition systems with high accuracy that includes most of the essential and necessary features for any deaf and dumb person in his/her day to day tasks.
Conclusion: It is the need of current technological advances to develop reliable solutions which can be deployed to assist deaf and dumb people to adjust to normal life. Instead of focusing on a standalone technology, a plethora of them have been introduced in this proposed work. The proposed Sign Recognition System is based on feature extraction and classification. The trained model helps in the identification of different gestures.
Keywords: Tactile sign language, gesture recognition system, machine learning, speech to text, text to speech, technological aid.
Graphical Abstract
Call for Papers in Thematic Issues
Advanced Experimental, Computational Fluid Dynamics and Intelligent Computing Techniques on Complex Multiphase Flow Problems
Computational fluid dynamics (CFD) and Intelligent computing are very emerging technology in various industrial applications. Multiphase flow problems are very dominant in hydro as well as power plants, mining, marine, cementing, food processing, and ore-processing industries. Multiphase flows include gas-solid as well as liquid-solid flows. The solid like ores, ash, ...read more
Advanced materials for energy production, transmission, and utilization
Hydrogen storage and production materials: Developing high-performance hydrogen generation and storage materials, as well as researching the mechanism of hydrogen-material interaction. The emphasis for supercapacitors is on carbon-based materials derived from various biomass carbonization methods, as well as carbon-containing electrode materials such as metal sulfide, oxides, and other similar compounds. ...read more
Advancements in Machine Learning for Medical Applications in Material Science
The fusion of machine learning with medical applications and material science has ushered in a new era of innovation, offering transformative solutions to complex healthcare challenges. "Advancements in Machine Learning for Medical Applications in Material Science," a special issue, serves as a crucible for exploring the remarkable synergy between these ...read more
Computational Methods in Engineering
In recent decades, computational methods have revolutionized the field of engineering, playing a pivotal role in enhancing efficiency, accuracy, and innovation across various disciplines. This proposed thematic issue aims to explore and showcase the latest advancements, challenges, and applications of computational methods in engineering. As technology continues to evolve, computational ...read more
Related Books
Intelligent Technologies for Automated Electronic Systems
Modern Radio Signals Filtering Devices Methods, Technologies, & Structures
Functional Bio-based Materials for Regenerative Medicine: From Bench to Bedside (Part 2)
Mechanical Engineering Technologies and Applications
Multistage Interconnection Network Design for Engineers
Mechanical Engineering Technologies and Applications
Semi-rotary and Linear Actuators for Compressed Air Energy Storage and Energy Efficient Pneumatic Applications
Waste Valorization for Value-added Products
One-Dimensional Transient Flow in Pipelines Modelling and Simulation
Principles of Automation and Control
9