Academia.eduAcademia.edu

Hand Gesture Recognition System

description287 papers
group2,196 followers
lightbulbAbout this topic
A Hand Gesture Recognition System is a technology that interprets human hand movements and gestures through computer vision and machine learning techniques, enabling interaction between users and devices by translating physical gestures into digital commands or actions.
lightbulbAbout this topic
A Hand Gesture Recognition System is a technology that interprets human hand movements and gestures through computer vision and machine learning techniques, enabling interaction between users and devices by translating physical gestures into digital commands or actions.

Key research themes

1. How can deep learning architectures be optimized for accurate and real-time hand gesture and sign language recognition?

This theme investigates the development and optimization of advanced deep learning models, such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Long Short-Term Memory networks (LSTMs), and hybrid architectures, to improve recognition accuracy, robustness, and real-time performance in hand gesture and sign language recognition. It matters because deep learning enables automatic feature extraction and temporal modeling crucial for recognizing complex gestures with high variation, thereby facilitating inclusive human-computer interaction and assistive technologies.

Key finding: Proposes a novel architecture combining CNNs for spatial feature extraction with RNNs (specifically LSTMs) for modeling temporal dependencies, achieving better accuracy and real-time processing capabilities for sign language... Read more
Key finding: Demonstrates the application of CNN architectures trained on hand landmark images to classify American Sign Language gestures with an emphasis on robust feature extraction such as angles and slopes between landmarks. The... Read more
Key finding: Introduces a combined speech-to-sign translation and hand gesture recognition system leveraging MediaPipe for real-time hand landmark detection and CNNs for image classification, implemented on Raspberry Pi. The system... Read more
Key finding: Develops a specialized CNN framework augmented with Regions of Interest (ROI) to simultaneously recognize ASL alphabets and associated emotions via hand gestures, achieving recognition rates above 92% for emotions and... Read more
Key finding: Analyzes the use of deep learning methods, particularly CNNs and RNNs, in recognizing Indian Sign Language (ISL), discussing how combining gesture and facial expression data enhances recognition robustness. The paper... Read more

2. What are the effective methodologies for capturing and preprocessing hand gesture data to improve recognition accuracy in vision- and sensor-based systems?

This theme centers on data acquisition, preprocessing techniques, and feature extraction methods essential for reliable and efficient hand gesture recognition. It encompasses the use of vision-based inputs such as RGB cameras, depth sensors, and landmark detection frameworks alongside sensor-based inputs like accelerometers and data gloves. Proper preprocessing and feature representation significantly reduce noise from illumination changes, complex backgrounds, and inter-user variability, thereby enhancing classification performance.

Key finding: Details comprehensive stages of hand gesture recognition including data acquisition (vision and sensor-based), preprocessing techniques like skin color segmentation and temporal segmentation, and feature extraction methods... Read more
Key finding: Categorizes hand gesture recognition into extraction methods, feature estimation, and classification phases emphasizing skin color segmentation for hand localization and tracking, supported by tools like Kalman filters. The... Read more
Key finding: Presents a system utilizing accelerometers to capture hand motion data and RF modules for wireless data transmission, followed by microcontroller-based signal processing for gesture recognition. The wearable system... Read more
Key finding: Analyzes three primary data collection approaches: instrumented gloves for detailed joint measurement, vision-based systems using cameras for natural interaction, and hybrid methods combining both. It discusses segmentation... Read more
Key finding: Develops a Raspberry Pi-based vision system employing AI for sign detection via camera input, translating recognized hand signs to voice and text outputs. The system circumvents costly and fragile sensor gloves by employing... Read more

3. How can hand gesture recognition be effectively applied in real-world assistive and interactive applications?

This theme explores the application of hand gesture recognition systems in diverse practical domains including assistive communication for the deaf and mute, human-computer interaction in virtual environments, security access control, and drone control. It focuses on how system design considerations address domain-specific requirements such as accuracy, real-time processing, user convenience, and hardware constraints to foster accessibility and enhance functionality.

Key finding: Proposes a glove-based system embedded with five flex sensors for recognizing eleven Arabic sign language letters used by mute patients in clinical diagnosis environments. The system translates recognized signs to audio... Read more
Key finding: Develops a vision-based hand gesture interface for manipulating 3D objects in virtual environments as an alternative to traditional peripherals (keyboard, mouse). It emphasizes natural, non-contact interaction, addressing... Read more
Key finding: Presents a complete gesture controlled drone system using real-time hand tracking with MediaPipe and TensorFlow neural networks deployed on Raspberry Pi. Achieves ~99% classification accuracy on an 8-gesture dataset and... Read more
Key finding: Integrates speech-to-sign language translation and hand gesture recognition into a Raspberry Pi system using MediaPipe and CNN models, enabling bidirectional communication for deaf-mute users with 94% recognition accuracy and... Read more
Key finding: Describes a portable assistive system using accelerometer-based gesture acquisition and RF communication to convert recognized hand gestures into speech and text output in real-time. Focused on enhancing communication for... Read more

All papers in Hand Gesture Recognition System

More than 20 years after presenting his first interpretation of the mosaic from the House of Aion in a paper entitled “Uwagi na temat mozaiki z Domu Aiona w Nea Paphos (Cypr)” (Meander 9/10, 1987, p. 421-438, in Polish, and translated to... more
In this era of touch screen devices, human machine interaction is a very important factor nowadays. Many devices are developed which can be operated without touching the system. So, in this project we are going to demonstrate how one can... more
—In this paper, a smart wireless wristband is proposed. The potential of innovative gesture based interactivity with connected lighting solutions is reviewed. The solution is intended to offer numerous benefits, in terms of ease of use,... more
Hand gesture recognition system received great attention in the recent few years because of its manifoldness applications and the ability to interact with machine efficiently through human computer interaction. In this paper a survey of... more
Kinect sensor is being used for the motion control of a mobile robot according to the movements of hands (gesture), as a ubiquitous human machine interface. The robot is in the form of a loader vehicle, which can be used for... more
Sign language is a tool used by deaf for communication. They use different gestures to express their thoughts and communicate to people. Each gestures or movement of the hand has a special assigned meaning. Previous studies were conducted... more
Gesture is the most primitive technique for conversation amongst human being. Today in the time of current day innovation gesture recognition affects the world differently, from the physically challenged individuals to robotic manage to... more
by Niaz Mohammad and 
1 more
Hand gestures can be used for natural and intuitive human-computer interaction. To achieve this goal, computers should be able to visually recognize hand gestures from video input. However, vision-based hand tracking and gesture... more
In this work, a vision-based approach is used to build a dynamic hand gesture recognition system. Various challenges such as complicated background, change in illumination and occlusion make the detection and tracking of hand difficult in... more
This ‘work in progress’ paper presents a framework, a analysis and a design of a set of mobile phone based prototypes. These prototypes have been used to evaluate mobile interaction in smart environments. Other work has shown that mobile... more
Sign language detection and recognition (SLDR) using computer vision is a very challenging task. In respect to Bangladesh, sign language users are around 2.4 million [16]. In this paper, we try to focus for communicating with those users... more
In this paper, we present a smart hand gesture recognition experimental set up for collaborative robots using a Faster R-CNN object detector to find the accurate position of the hands in the RGB images taken from a Kinect v2 camera. We... more
Hand detection is one of the most important and crucial step in human computer interaction environment. This paper presents a distance technique for hand detection based on depth image information get from Kinect sensor. Distance was used... more
Embodied image schemas are central to experientialist accounts of meaning-making. Research from several disciplines has evidenced their pervasiveness in motivating form and meaning in both literal and figurative expressions across diverse... more
Nowadays people are used to get daily information from Internet such as weather condition, news and financial information, among others. Though, in order to receiving these daily information, users have to repeat same mouse and... more
This dissertation presents the theory and application of Gesture Form Analysis, which systematises necessary processes of spatial conceptualisation for understanding a specific gesture type (pointing, drawing, representing etc.). Eight... more
Hand gestures and Deep Learning Strategies can be used to control a virtual robotic arm for real-time applications. A robotic arm, which is portable to carry various places and which that can be easily programmed to do any work similar to... more
With rapid development of 3-D applications & virtual environments in computer systems the need for a new type of interaction device arises. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction... more
Hand gesture is an innovative technique of interaction between human and computer. As compared to existing techniques, hand gesture technique has the advantage of being easy to use. By using this technique the traditional way of using... more
— Sign language recognition is one of the most growing fields of research today and it is the most natural way of communication for the people with hearing problems. A hand gesture recognition system can provide an opportunity for deaf... more
Dalam mempelajari bangun ruang seringkali pelajar Sekolah Dasar mengalami kesulitan pemahaman terhadap materi yang diberikan. Maka diperlukan suatu alat peraga interaktif dan menarik dalam bentuk aplikasi multimedia Pengenalan Bangun... more
Gesture Recognition pertains to the process which includes understanding and interpreting meaningful movements of the body parts such as arms, face, hands or head. It allows us to talk to the machines and use them with means other than... more
An increasing number of today's consumer devices such as mobile phones or tablet computers are equipped with various sensors. The extraction of useful information such as gestures from sensor-generated data based on mainstream imperative... more
This project present a real-time system to track and recognise hand gestures for interacting with the Web. This system is based on three main steps: hand segmentation, hand tracking and gesture recognition from hand features.
Hybrid image segmentation is proposed in this paper. The input image is firstly preprocessed in order to extract the features using Discrete Wavelet Transform (DWT) .The features are then fed to Fuzzy C-means algorithm which is... more
Abstract— We propose a new technique for recognition of dumb person hand gesture in real world environment. In this technique, the hand image containing the gesture is preprocessed and then hand region is segmented by convergent the RGB... more
The fundamental aim of the project is to develop a robotic arm that can be handled by a normal layman to complete the specific task according to the needs of the customers. In this proposed method, the system was designed and implemented,... more
A research area in Computer Vision focuses on the identification of articulated objects, such as human actions and movements of the hand, which can be used in human-computer interaction, surveillance, and other tracking systems. Two... more
The use of hand gesture recognition has been steadily growing in various human-computer interaction applications. Under realistic operating conditions, it has been shown that hand gesture recognition systems exhibit recognition rate... more
This issue (DOI: 10.13140/RG.2.2.13132.92807) includes the following articles; P1151705543, author="Tieling Chen", title="Detail Preserving Sorted Difference Filter", P1151738585, author="Vladimir A. Kulyukin", title="GreedyHaarSpiker: An... more
a Research Proposal  for a Human Computer Interaction System based on Hand Gesture Recognition to control the Computer
This paper presents a recognition system, which can be helpful for a blind person. Hand gesture recognition system and face recognition system has been implemented in this paper using which various tasks can be performed. Dynamic images... more
Dynamic gesture recognition has been studied actually for it big application in several areas such as virtual reality, games and sign language. But some problems have to be solved in computer applications, such as response time and... more
Today world is running behind the computer industries and pattern recognition is one of the important and vast fields of computer intelligence. Gesture recognition is one of the applications of Pattern recognition and further hand gesture... more
This article describes the development of DSP as the core of the face recognition system, on the basis of understanding the background, significance and current research situation at home and abroad of face recognition issue, having a... more
Hand gesture recognition can substitute the use of text-entry interface for human computer interaction. However, it is a challenging task to develop a virtual text-entry interface covering a large number of gesture-based characters. In... more
by Pablo Gil and 
1 more
This paper describes the development of a low-cost mini-robot that is controlled by visual gestures. The prototype allows a person with disabilities to perform visual inspections indoors and in domestic spaces. Such a device could be used... more
Hand gesture recognition for human computer interaction, being a natural way of human computer interaction, is an area of active research in computer vision and machine learning. This is an area with many different possible applications,... more
Gesture recognition represents the silent language that can be done with robots as well as they done to us, this overseas language ensures that everyone can understand the meaning of the gesturing as well as can reply and interact with.... more
The recently developed depth sensors such as Kinect have provided new potentials for human-computer interaction (HCI) and hand gestures are one of main parts in recent researches. Hand segmentation procedure is performed to acquire hand... more
Indian Sign Language (ISL) interpretation is the major research work going on to aid Indian deaf and dumb people. Considering the limitation of glove/sensor based approach, vision based approach was considered for ISL interpretation... more
by Tao Ma
A recent boom has been seen in 3D virtual worlds for entertainment, and this in turn has led to a surge of interest in their educational applications. Although booming development has been seen, most of them only strengthen the... more
The hand gesture input systems will be adopted for use in many applications anytime and anywhere. In this research, a stating notification when and where a user can start using hand gestures for input are focused. However existing devices... more
Hand gesture recognition for human computer interaction is an area of active research in computer vision and machine learning. The primary goal of gesture recognition research is to create a system, which can identify specific human... more
This paper presents a comparison of two real-time hand gesture recognition systems. One system utilizes a binocular stereo camera set-up while the other system utilizes a combination of a depth camera and an inertial sensor. The latter... more
This paper presents a framework for spotting and recognizing continuous human gestures. Skeleton based features are extracted from normalized human body coordinates to represent gestures. These features are then used to construct... more
The main aim of Sixth Sense Technology has always been the to reduce the distance between our physical world and digital world. This has been done in numerous ways. The purpose of this paper is to present one such ways of bringing close... more
Download research papers for free!