Journal of Ubiquitous Computing and Communication Technologies
IRO Journals
Volume 6 — Issue 1 — March 2024

Virtual Painting through Hand Gestures: A Machine Learning Approach

https://doi.org/10.36548/jucct.2024.1.004
R. Shanthi
Assistant Professor, Department of Computer Applications, B.S. Abdur Rahman Crescent Institute of Science and Technology, Chennai, India
S. Abdul Azeez
Department of Computer Applications, B.S. Abdur Rahman Crescent Institute of Science and Technology, Chennai, India
N. Deepak Kumar
Department of Computer Applications, B.S. Abdur Rahman Crescent Institute of Science and Technology, Chennai, India
PDF
PDF

How to Cite

Shanthi, R., S. Abdul Azeez, and N. Deepak Kumar. 2024. “Virtual Painting through Hand Gestures: A Machine Learning Approach”. Journal of Ubiquitous Computing and Communication Technologies 6 (1): 39-49. https://doi.org/10.36548/jucct.2024.1.004.
ACM ACS APA ABNT Chicago Harvard IEEE MLA Turabian Vancouver AMA

Download Citation

Endnote/Zotero/Mendeley (RIS) BibTeX

Keywords

— Virtual painting
— Hand gesture recognition
— Gesture-based interaction
— Computer vision
— Machine Learning
— Human-computer interaction
Published: 30-04-2024

Abstract

The hand gesture paint application represents an innovative venture in the realm of computer vision, harnessing the capabilities of the MediaPipe library and OpenCV to develop a sophisticated painting tool driven by hand gestures. By leveraging these powerful frameworks, the application enables users to express their creativity through intuitive gestures captured by a webcam. At its core, the work seeks to redefine the conventional painting experience by providing users with a seamless interface controlled entirely by hand movements. Through the integration of the MediaPipe library and OpenCV, users can effortlessly draw, erase, and switch between various drawing tools, all with the fluidity of natural hand gestures. By eliminating the need for traditional input devices, the hand gesture paint application offers a novel approach to digital art creation, empowering users to engage directly with their canvas in a more intuitive and immersive manner. Through this innovative blend of technology and creativity, the application opens up new avenues for artistic expression, inviting users to explore the boundless possibilities of digital painting through the simple movement of their hands.

References

  1. Wang, Y., Chen, J., & Li, X. (2020). Hand Gesture Recognition for Virtual Painting. In 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 315-319). IEEE.
  2. Lee, S., Park, H., & Park, J. (2019). Real-time Hand Gesture Recognition for Virtual Painting Application. In 2019 16th International Conference on Ubiquitous Robots (UR) (pp. 269-273). IEEE.
  3. Yu, Y., Zhang, H., & Luo, J. (2020). Real-time Hand Gesture Recognition System for Virtual Painting Based on Deep Learning. In 2020 2nd International Conference on Computer Science, Artificial Intelligence and Communication (CSAIC) (pp. 104-108). IEEE.
  4. Liu, Z., Xu, C., & Wu, Q. (2018). A Novel Hand Gesture Recognition System for Virtual Painting Applications. In 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO) (pp. 1427-1432). IEEE.
  5. Zheng, Y., Zhao, H., & Wang, Y. (2019). Real-time Hand Gesture Recognition System for Virtual Painting Based on Convolutional Neural Network. In 2019 International Conference on Image, Vision and Computing (ICIVC) (pp. 1123-1127). IEEE.
  6. Wang, Y., Song, L., & Li, X. (2021). Real-time Hand Gesture Recognition System for Virtual Painting Based on Transfer Learning. In 2021 IEEE International Conference on Robotics and Automation (ICRA) (pp. 467-472). IEEE.
  7. Choi, J., Kim, J., & Lee, H. (2020). Virtual Painting System using Hand Gesture Recognition Technology. In 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 275-279). IEEE.
  8. Chen, X., Chen, Y., & Zhang, L. (2019). A Novel Virtual Painting System Based on Hand Gesture Recognition. In 2019 International Conference on Mechatronics and Control Engineering (ICMCE) (pp. 434-439). IEEE.
  9. Li, Q., Li, Z., & Zhang, Y. (2018). Real-time Hand Gesture Recognition for Virtual Painting Using Adaptive Segmentation. In 2018 3rd International Conference on Computer Science and Application Engineering (CSAE) (pp. 567-571). IEEE.
  10. Park, S., Kim, Y., & Lee, D. (2017). A Real-time Virtual Painting System Based on Hand Gesture Recognition Using Neural Networks. In 2017 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 156-160). IEEE.
  11. Dardas, Nasser H., and Nicolas D. Georganas. "Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques." IEEE Transactions on Instrumentation and measurement 60, no. 11 (2011): 3592-3607.
  12. Khelil, Bassem, Hamid Amiri, T. Chen, F. Kammüller, I. Nemli, and C. W. Probst. "Hand gesture recognition using leap motion controller for recognition of arabic sign language." In 3rd International conference ACECS, vol. 16, pp. 233-238. 2016.
  13. Ye, Weina, and Yuhui Li. "Design and Research of Digital Media Art Display Based on Virtual Reality and Augmented Reality." Mobile Information Systems 2022 (2022).
  14. Eisendle, Carmen, Christine Schnappinger, Karin Guminski and Andreas Martin Butz. “Design and Evaluation of an Interactive Children's Book.” Message Understanding Conference (2007).
  15. Kothgassner, O. D., Goreis, A., Kafka, J. X., Van Eickels, R. L., Plener, P. L., & Felnhofer, A. (2019). Virtual reality exposure therapy for posttraumatic stress disorder (PTSD): a meta-analysis. European journal of psychotraumatology, 10(1), 1654782.
  16. Nitin Kumar, R., Makkena Vaishnavi, K. R. Gayatri, Venigalla Prashanthi, and M. Supriya. "Air writing recognition using mediapipe and opencv." In International Conference on Ubiquitous Computing and Intelligent Information Systems, pp. 447-454. Singapore: Springer Nature Singapore, 2021.
  17. Li, Zhu, Kang Lu, Miao Cai, Xiaoli Liu, Yanwen Wang, and Jiayu Yang. "An Automatic Evaluation Method for Parkinson's Dyskinesia Using Finger Tapping Video for Small Samples." Journal of Medical and Biological Engineering 42, no. 3 (2022): 351-363.