The ultimate purpose of human existence is often considered to be finding happiness and satisfaction. People will live happily only when they communicate their feelings, emotions and opinions others. Furthermore, the, further right to freedom of expression is a fundamental right but people who suffer from hearing problems cannot communicate. This may lead to their isolation from societal activities. To address this issue, sign language came into existence, primarily to enable communication, education, employment and social inclusion. In this paper, an efficient methodology for American Sign Language (ASL) recognition using hand gestures is proposed. To find an efficient model, several experiments were conducted on ASL datasets which consisting of images, where each image represents signs for several words, alphabets, numbers, etc., Finally, the Multilayer Perceptron model with 2 hidden layers (1024,512) outperformed other models in terms of accuracy (99.3%) in static sign classification. These studies focused mainly on the recognition of legal words, as hearing people are unable to solve their legal issues because they cannot communicate effectively with their signs to the police or lawyers to raise their issues. In this methodology, the MediaPipe framework is used to extract landmarks from high quality sign-images, and pre-processing is done with normalization techniques, ensuring consistency in scale and orientation to generalize the model for various types of users in different environments. Experimental results demonstrated high classification accuracy, validated the model's performance and presented its potential for a range of practical applications in accessibility and human-computer interaction. A separate lightweight prototype was developed to evaluate optimal deployment models for real-time offline inference with quantized and non-quantized models on mobile hardware (CPU, GPU, and TPU) as additional work in this paper.
@article{n.v.2026,
author = {Muthu Lakshmi N.V. and Sunitha Kanipakam and Manjula K. and Prathyusha G.},
title = {{Real-Time American Sign Language Recognition on Edge Devices Using a Multilayer Perceptron}},
journal = {Journal of Innovative Image Processing},
volume = {8},
number = {1},
pages = {113-136},
year = {2026},
publisher = {Inventive Research Organization},
doi = {10.36548/jiip.2026.1.007},
url = {https://doi.org/10.36548/jiip.2026.1.007}
}
Copy Citation
- Sign Language, National Geographic Education, accessed January 10, 2026, https://education.nationalgeographic.org/resource/sign-language/.
- Seervai, H. M. Constitutional Law of India: A Critical Commentary with Supplement. 4th ed., Silver Jubilee Edition. New Delhi: Universal Law Publishing Co. Ltd. and Law & Justice Publishing Co., 2023.
- International Day of Sign Languages 2022, MIT Global Studies and Languages, accessed January 10, 2026, https://languages.mit.edu/international-day-of-sign-languages-2022.
- Dutta, Kusumika Krori, and Sunny Arokia Swamy Bellary. "Machine learning techniques for Indian sign language recognition." In 2017 international conference on current trends in computer, electrical, electronics and communication (CTCEEC), IEEE, 2017, 333-336.
- Cheok, Ming Jin, Zaid Omar, and Mohamed Hisham Jaward. "A Review Of Hand Gesture and Sign Language Recognition Techniques." International Journal of Machine Learning and Cybernetics 10, no. 1 (2019): 131-153.
- Rastgoo, Razieh, Kourosh Kiani, and Sergio Escalera. "Sign Language Recognition: A Deep Survey." Expert Systems with Applications 164 (2021): 113794.
- Chophuk, Ponlawat, and Kosin Chamnongthai. "Backhand-View-Based Continuous-Signed-Letter Recognition Using a Rewound Video Sequence and the Previous Signed-Letter Information." IEEE Access 9 (2021): 40187-40197.
- Buckley, Neil, Lewis Sherrett, and Emanuele Lindo Secco. "A CNN Sign Language Recognition System with Single & Double-Handed Gestures." In 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), IEEE, 2021, 1250-1253.
- AQ Mohammed, Adam, Yuan Gao, Zhilong Ji, Jiancheng Lv, M. D. Sajjatul Islam, and Yongsheng Sang. "Automatic 3D Skeleton-Based Dynamic Hand Gesture Recognition Using Multi-Layer Convolutional LSTM." In Proceedings of the 7th International Conference on Robotics and Artificial Intelligence, 2021, 8-14.
- Damdoo, Rina, and Ashutosh Gupta. "Gesture Controlled Interaction Using Hand Pose Model." International journal of health sciences I (2022): 10417-10427.
- Abdullahi, Sunusi Bala, and Kosin Chamnongthai. "American Sign Language Words Recognition Using Spatio-Temporal Prosodic and Angle Features: A Sequential Learning Approach." IEEE Access 10 (2022): 15911-15923.
- Adaloglou, Nikolas, Theocharis Chatzis, Ilias Papastratis, Andreas Stergioulas, Georgios Th Papadopoulos, Vassia Zacharopoulou, George J. Xydopoulos, Klimnis Atzakas, Dimitris Papazachariou, and Petros Daras. "A Comprehensive Study on Deep Learning-Based Methods for Sign Language Recognition." IEEE transactions on multimedia 24 (2021): 1750-1762.
- Kothadiya, Deep, Chintan Bhatt, Krenil Sapariya, Kevin Patel, Ana-Belén Gil-González, and Juan M. Corchado. "Deepsign: Sign Language Detection and Recognition Using Deep Learning." Electronics 11, no. 11 (2022): 1780.
- Bose Duraimutharasan, Navaneetha Krishna, and Kumaravelu Sangeetha. "Machine Learning and Vision Based Techniques for Detecting and Recognizing Indian Sign Language." Revue d'Intelligence Artificielle 37, no. 5 (2023).
- Kumar, Chatikam Raj. "Machine Learning-Based Gesture Recognition for Communication with the Deaf and Dumb Prasanthi Yavanamandha1, Bodduru Keerthana2, Penmetsa Jahnavi3, Koduganti Venkata Rao4 and." Int. J. Exp. Res. Rev 34 (2023): 26-35.
- Kumar, Rupesh, Ashutosh Bajpai, and Ayush Sinha. "Mediapipe and CNNS For Real-Time Asl Gesture Recognition." arXiv preprint arXiv:2305.05296 (2023).
- Srivastava, Palak, Bramah Hazela, Shikha Singh, Pallavi Asthana, Deependra Pandey, Kamlesh Kumar Singh, and Vineet Singh. "Interpretation of Sign Language Using Machine Learning." In 2024 Second International Conference Computational and Characterization Techniques in Engineering & Sciences (IC3TES), IEEE, 2024, 1-7.
- Josef, Antonio, and Gede Putra Kusuma. "Alphabet Recognition in Sign Language Using Deep Learning Algorithm with Bayesian Optimization." Revue d'Intelligence Artificielle 38, no. 3 (2024).
- Kumar, Mukesh, Chandradeep Bhatt, Shrestha Manori, Rahul Khati, Teekam Singh, and Taranath NL. "Sign Language Recognition by LSTM-Driven Speech Synthesis." In 2024 Second International Conference on Advances in Information Technology (ICAIT), vol. 1, IEEE, 2024, 1-6.
- Jana, Urmi, Subhashish Paul, and Dinabhandhu Bhandari. "Real-Time Caption Generation for the American Sign Language Using YOLO and LSTM." In 2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems (ICITEICS), IEEE, 2024, 1-4.
- Fertl, Elfi, Encarnación Castillo, Georg Stettinger, Manuel P. Cuéllar, and Diego P. Morales. "Hand Gesture Recognition on Edge Devices: Sensor Technologies, Algorithms, and Processing Hardware." Sensors (Basel, Switzerland) 25, no. 6 (2025): 1687.
- Riya Awalkar, Aditi Sah, Renuka Barahate, Yash Kharche, Ashwini Magar (2025), Silent Expressions: Two-Handed Indian Sign Language Recognition Using MediaPipe and Machine Learning. International Journal of Innovative Science and Research Technology (IJISRT) IJISRT25MAR598, 587-595.
- Donepudi, Swapna, K. N. Divya, Reemasen Tungala, and Sirisha Thammisetty. "A Sign Language Recognition System for Understanding Actions of Speech-Impaired-Individuals." In 2025 7th International Conference on Intelligent Sustainable Systems (ICISS), IEEE, 2025, 1303-1310.