Academia.eduAcademia.edu

Figure 1 – uploaded by IJRASET Publication

See full PDFdownloadDownload figure
Depth sensors enable us to capture additional information to improve accuracy and/or processing time. Also, with recen improvement of GPU, CNNs have been employed to many computer vision problems. Therefore, we take advantage of a dept sensor and convolutional neural networks to achieve a real-time and accurate sign language recognition system [4]. In order t overcome the gap in communication caused by the difference in modes of communication, an interpreter is necessary to reduce th confusion. This research is an attempt to ease the communication between deaf and normal people. Sign language translation, burgeoning area of research, facilitates natural communication for those with hearing impairments. A hand gesture recognitio system provides deaf individuals with the means to communicate with verbal individuals independently, eliminating the need for a interpreter. Our research centres on developing a model that can accurately recognize Fingerspelling-based hand gestures, enablin the formation of complete words through the combination of each gesture. The gestures we aim to train are as given in the imag WAT ncxe

Figure 1 Depth sensors enable us to capture additional information to improve accuracy and/or processing time. Also, with recen improvement of GPU, CNNs have been employed to many computer vision problems. Therefore, we take advantage of a dept sensor and convolutional neural networks to achieve a real-time and accurate sign language recognition system [4]. In order t overcome the gap in communication caused by the difference in modes of communication, an interpreter is necessary to reduce th confusion. This research is an attempt to ease the communication between deaf and normal people. Sign language translation, burgeoning area of research, facilitates natural communication for those with hearing impairments. A hand gesture recognitio system provides deaf individuals with the means to communicate with verbal individuals independently, eliminating the need for a interpreter. Our research centres on developing a model that can accurately recognize Fingerspelling-based hand gestures, enablin the formation of complete words through the combination of each gesture. The gestures we aim to train are as given in the imag WAT ncxe

Related Figures (6)

In our research, initial attempts to find suitable datasets proved unsuccessful, as available datasets were not in the required raw imag format but rather in RGB values. Consequently, we opted to create our own dataset using the OpenCV library. In order to generate th dataset, collect various images of hand signs for that here we use open computer vision (open cv) library in python to detect objects First, we have to capture images for training and testing purpose we can capture those images through the webcam of the system[2] The process involved capturing approximately 100 images for each of the ASL symbols A, B, and C, ensuring the dataset me our specific needs.
In our research, initial attempts to find suitable datasets proved unsuccessful, as available datasets were not in the required raw imag format but rather in RGB values. Consequently, we opted to create our own dataset using the OpenCV library. In order to generate th dataset, collect various images of hand signs for that here we use open computer vision (open cv) library in python to detect objects First, we have to capture images for training and testing purpose we can capture those images through the webcam of the system[2] The process involved capturing approximately 100 images for each of the ASL symbols A, B, and C, ensuring the dataset me our specific needs.
See ———————— ee Video to Image Conversion is a pivotal step in sign language recognition, involving the extraction of frames from videos to produc till images, which are indispensable for training recognition models. Image quality is refined by denoising, contrast adjustment, an ‘esizing, tailored to the specific needs of the dataset we captured around 800 images of each of the symbol in ASL for trainin ourposes and around 200 images per symbol for testing purpose. First, we capture each frame shown by the webcam of our machin« In each frame we define a region of interest (ROD) which is denoted by a blue bounded square as shown in the image below. From th whole image we extracted our ROI which is RGB and convert it into grey scale Image. Finally, we apply our gaussian blur filter t ur image which helps us extracting various features of our image[17]. Features extracted from the images are meticulously labele with corresponding sign language glosses or spoken language translations, serving as target outputs for training and evaluating mod accuracy. Apply Gaussian Blur filter and threshold to the frame taken with open cv to get the processed image after featur >xtraction[2] Accurate hand detection and landmark identification precede dataset augmentation, where techniques like rotatiot ranslation, and flipping diversify hand poses. Extracted features are labeled with sign language glosses or translations, aidin supervised learning. These labeled datasets form the basis for training and evaluating sign language recognition models, ensurin ‘eliable communication accessibility for users, and highlighting the importance of video-to-image conversion in system developmen These meticulous processes culminate in a successful video-to-image transformation, ultimately enhancing accessibility an ‘facilitating improved communication for users worldwide.
See ———————— ee Video to Image Conversion is a pivotal step in sign language recognition, involving the extraction of frames from videos to produc till images, which are indispensable for training recognition models. Image quality is refined by denoising, contrast adjustment, an ‘esizing, tailored to the specific needs of the dataset we captured around 800 images of each of the symbol in ASL for trainin ourposes and around 200 images per symbol for testing purpose. First, we capture each frame shown by the webcam of our machin« In each frame we define a region of interest (ROD) which is denoted by a blue bounded square as shown in the image below. From th whole image we extracted our ROI which is RGB and convert it into grey scale Image. Finally, we apply our gaussian blur filter t ur image which helps us extracting various features of our image[17]. Features extracted from the images are meticulously labele with corresponding sign language glosses or spoken language translations, serving as target outputs for training and evaluating mod accuracy. Apply Gaussian Blur filter and threshold to the frame taken with open cv to get the processed image after featur >xtraction[2] Accurate hand detection and landmark identification precede dataset augmentation, where techniques like rotatiot ranslation, and flipping diversify hand poses. Extracted features are labeled with sign language glosses or translations, aidin supervised learning. These labeled datasets form the basis for training and evaluating sign language recognition models, ensurin ‘eliable communication accessibility for users, and highlighting the importance of video-to-image conversion in system developmen These meticulous processes culminate in a successful video-to-image transformation, ultimately enhancing accessibility an ‘facilitating improved communication for users worldwide.
This comprehensive approach promises to enhance usability and efficiency in overcoming existing constraints. TensorFlow has ar inbuilt function to calculate the cross entropy [9]. Additionally, the inclusion of word spell correction functionality enhances the precision of the model, rectifying potential errors and further refining the clarity of the conveyed message. By offering advancec features and robust functionality, our model enhances the communication experience for all users. The system is a vision-basec approach. All the signs are represented with bare hands and so it eliminates the problem of using any artificial devices fot interaction [17]. CNNs are inspired by the visual cortex of the human brain. The artificial neurons in a CNN will connect to a loca region of the visual field, called a receptive field. This is accomplished by performing discrete convolutions on the image with filter values as trainable weights. Multiple filters are applied for each channel, and together with the activation functions of the neurons they form feature maps. This is followed by a pooling scheme, where only the interesting information of the feature maps are poolec together [6].
This comprehensive approach promises to enhance usability and efficiency in overcoming existing constraints. TensorFlow has ar inbuilt function to calculate the cross entropy [9]. Additionally, the inclusion of word spell correction functionality enhances the precision of the model, rectifying potential errors and further refining the clarity of the conveyed message. By offering advancec features and robust functionality, our model enhances the communication experience for all users. The system is a vision-basec approach. All the signs are represented with bare hands and so it eliminates the problem of using any artificial devices fot interaction [17]. CNNs are inspired by the visual cortex of the human brain. The artificial neurons in a CNN will connect to a loca region of the visual field, called a receptive field. This is accomplished by performing discrete convolutions on the image with filter values as trainable weights. Multiple filters are applied for each channel, and together with the activation functions of the neurons they form feature maps. This is followed by a pooling scheme, where only the interesting information of the feature maps are poolec together [6].
Through these comprehensive features, the model contributes significantly to bridging communication gaps and facilitating seamless interaction for users with hearing impairments. PCA is a technique that allow to represent pictures as points during a low- dimensional space. If every image consists of 32x32 pixels whose values vary from zero to 255, then every image defines some points in 1024-dimensional space. If one tends to grab a sequence of pictures representing a gesture then this sequence can generate a sequence of points in space However, this set of points can sometimes lie on a low-dimensional sub-space inside the world 1024D space. The PCA algorithmic rule permits us to search out this sub space that sometimes consists of up to three dimensions. This enables us to examine the sequence of points representing the gesture [1].
Through these comprehensive features, the model contributes significantly to bridging communication gaps and facilitating seamless interaction for users with hearing impairments. PCA is a technique that allow to represent pictures as points during a low- dimensional space. If every image consists of 32x32 pixels whose values vary from zero to 255, then every image defines some points in 1024-dimensional space. If one tends to grab a sequence of pictures representing a gesture then this sequence can generate a sequence of points in space However, this set of points can sometimes lie on a low-dimensional sub-space inside the world 1024D space. The PCA algorithmic rule permits us to search out this sub space that sometimes consists of up to three dimensions. This enables us to examine the sequence of points representing the gesture [1].
In this research, a functional real time vision based American sign language recognition for Deaf and Dumb people have been developed for asl alphabets. We achieved final accuracy of 95.7% on our dataset. We are able to improve our prediction after implementing two layers of algorithms in which we verify and predict symbols which are more similar to each other. This way we are able to detect almost all the symbols provided that they are shown properly, there is no noise in the background and lighting is adequate.
In this research, a functional real time vision based American sign language recognition for Deaf and Dumb people have been developed for asl alphabets. We achieved final accuracy of 95.7% on our dataset. We are able to improve our prediction after implementing two layers of algorithms in which we verify and predict symbols which are more similar to each other. This way we are able to detect almost all the symbols provided that they are shown properly, there is no noise in the background and lighting is adequate.
Related topics:
Cross Cultural CommunicationHearing ImpairedHand Gestures
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved