Please use this identifier to cite or link to this item: http://dspace.iitrpr.ac.in:8080/xmlui/handle/123456789/4449
Title: SBI-DHGR: Skeleton-based intelligent dynamic hand gestures recognition
Authors: Narayan, S
Mazumdar, A P
Vipparthi, S K
Keywords: Skeleton
Hand-gesture recognition
Multi-stream CNN architecture
Data augmentation
Palm joint contraction
Issue Date: 11-May-2024
Abstract: Abstract: Hand gesture recognition (HGR) plays a significant role in interpreting the meaning of sign language, human–computer interaction, and robot control. This paper proposes a real-time skeleton-based intelligent dynamic hand gesture recognition (SBI-DHGR) approach, which comprises three modules: Palm Centroid (PC), Data augmentation with the Tenet Effect, and Deep learning architecture. The palm Centroid (PC) module is introduced to identify the proposed palm center joint. Data augmentation with a tenet effect module is designed to improve the CNN model’s generalizability. Further, a novel deep learning model is proposed for temporal 3D-HGR by exploiting the capabilities of a multi-channel convolutional neural network (CNN) and long short-term memory (LSTM) recurrent network. The multi-channel CNN is introduced to learn the cardinal positions of hand joints by capturing the low, average, and high-level features. LSTM is embedded to learn the temporal characteristics of hand joints. The effectiveness of the SBI-DHGR framework is evaluated over five challenging datasets: SHREC-14, SHREC-28, DHG-14, DHG-28, and FPHA, by adopting person-dependent and person-independent validation setups.
URI: http://dspace.iitrpr.ac.in:8080/xmlui/handle/123456789/4449
Appears in Collections:Year-2023

Files in This Item:
File Description SizeFormat 
Full Text.pdf2.48 MBAdobe PDFView/Open    Request a copy


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.