A Transfer Learning Based Approach For American Sign Language Recognition Using Deep Convolutional Neural NetworkShow others and affiliations
2024 (English)In: Intelligent Computing and Optimization: Proceedings of the 7th International Conference on Intelligent Computing and Optimization 2023 (ICO2023), Volume 2 / [ed] Pandian Vasant; Vladimir Panchenko; Elias Munapo; Gerhard-Wilhelm Weber; J. Joshua Thomas; Rolly Intan; Mohammad Shamsul Arefin, Springer Science and Business Media Deutschland GmbH , 2024, p. 40-49Chapter in book (Refereed)
Abstract [en]
American Sign Language (ASL), a visual language utilizing hand gestures, facial expressions, and body movements, remains less recognized than spoken languages, resulting in communication challenges between deaf and hearing individuals. This pioneering research paper introduces an exceptionally effective method for ASL gesture recognition through image processing and computer vision. By capturing webcam images of users signing and applying advanced algorithms, the system extracts crucial features like hand position, shape, and movement to classify signs accurately. The image processing pipeline employs techniques like background subtraction, hand detection, tracking, and feature extraction, utilizing a self-prepared dataset of around 10,000 images. This holistic approach achieves an impressive average recognition accuracy of 99.2% for 26 ASL signs in real-time. This research has the potential to greatly enhance accessibility and the quality of life for the deaf and hard-of-hearing community.
Place, publisher, year, edition, pages
Springer Science and Business Media Deutschland GmbH , 2024. p. 40-49
Series
Lecture Notes in Networks and Systems, ISSN 2367-3370, E-ISSN 2367-3389 ; 1167
National Category
Computer Sciences
Research subject
Cyber Security
Identifiers
URN: urn:nbn:se:ltu:diva-111486DOI: 10.1007/978-3-031-73318-5_5Scopus ID: 2-s2.0-85215661555OAI: oai:DiVA.org:ltu-111486DiVA, id: diva2:1935725
Note
ISBN for host publication: 978-3-031-73317-8 (Print), 978-3-031-73318-5 (Online)
2025-02-072025-02-072025-10-21Bibliographically approved