Simulation of Eye Tracking Control based Electric Wheelchair Construction by Image Segmentation Algorithm
PDF
PDF

How to Cite

Tesfamikael, Hadish Habte, Adam Fray, Israel Mengsteab, Adonay Semere, and Zebib Amanuel. 2021. “Simulation of Eye Tracking Control Based Electric Wheelchair Construction by Image Segmentation Algorithm”. Journal of Innovative Image Processing 3 (1): 21-35. https://doi.org/10.36548/jiip.2021.1.003.

Keywords

  • Electric wheelchair
  • image processing technique

Abstract

In this fast-paced world, it is very challenging for the elderly and disabled population to move independently to their desire places at any convenient time. Fortunately, some of the people have good eyesight and physically strong to take care of their survival. Nevertheless, Electric wheelchair (EWC) can provide them a better lifestyle with commendable confidence. At the same time, the hand, head and voice recognition-based EWC meet many limitations. Despite, the eye-tracking-based EWC provides a better smartness in their lifestyle. This research article discusses better accuracy achievement and minimizes the delay response time in the proposed system. The proposed eye-tracking EWC is differed from another existing system with good validation parameters of the controller and it introduces edge detection to identify the eye pupil position in the face. The proposed method includes a PID controller to control the DC motor, which in turn controls the rotation of wheel in EWC. This research article is mainly focused on the cost-effectiveness and improvement in the system performance. The display system is mounted in front of the sitting position of EWC users. The camera captures eye pupil position and it determines the direction of the EWC movement by controlling DC motor with the help of a PID controller. When derivative (D) control is used in the proposed system, the system response is quite faster and it reduces the delay time between the user and system reaction. This pupil of eye position is determined by a canny edge detector, which provides good results when compared with other edge detection approaches. Object detection in front of the EWC is an added advantage of the proposed system. The proposed article integrates all the activities and measures the system performance. The proposed model achieves an accuracy of about 90% and response time is least compared with the existing methods.

References

J. Kim et al., “The Tongue Enables Computer and Wheelchair Control for People with Spinal Cord Injury”, Science Translational Medicine, Vol 5, Issue 213, 27 November 2013.

S. D. Suryawanshi, J. S. Chitode and S. S. Pethakar, “Voice Operated Intelligent Wheelchair”, International Journal of Advanced Research in Computer Science and Software Engineering (IJARCSSE), Volume 3, Issue 5, pp. 487 – 490, May, 2013

S. Paulose, M.P.F. Anooda, G. Mohan, M. S. Sajana and K. A. Anupama, “Automatic Wheelchair using Gesture Recognition Along with Room Automation”, Transactions on Engineering and Sciences, Vol. 2, Issue 5, pp. 40 - 43, May 2014.

Zandi, A.S.; Quddus, A.; Prest, L.; Comeau, F.J.E. Non-Intrusive Detection of Drowsy Driving Based on Eye Tracking Data. Transp. Res. Rec. J. Transp. Res. Board 2019, 2673, 247–257.[CrossRef]

Zhang, J.; Yang, Z.; Deng, H.; Yu, H.; Ma, M.; Xiang, Z. Dynamic Visual Measurement of Driver Eye Movements. Sensors 2019, 19, 2217.[CrossRef][PubMed]

Strobl, M.A.R.; Lipsmeier, F.; Demenescu, L.R.; Gossens, C.; Lindemann, M.; De Vos, M. Look me in the eye: Evaluating the accuracy of smartphone-based eye tracking for potential application in autism spectrum disorder research. Biomed. Eng. Online 2019, 18, 51.[CrossRef][PubMed]

Shishido, E.; Ogawa, S.; Miyata, S.; Yamamoto, M.; Inada, T.; Ozaki, N. Application of eye trackers for understanding mental disorders: Cases for schizophrenia and autism spectrum disorder. Neuropsychopharmacol. Rep. 2019, 39, 72–77.[CrossRef]

Cruz, R.; Souza, V.; Filho, T.B.; Lucena, V. Electric Powered Wheelchair Command by Information Fusion from Eye Tracking and BCI. In Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 11–13 January 2019.

Jafar, F.; Fatima, S.F.; Mushtaq, H.R.; Khan, S.; Rasheed, A.; Sadaf, M. Eye Controlled Wheelchair Using Transfer Learning. In Proceedings of the 2019 International Symposium on Recent Advances in Electrical Engineering (RAEE), Islamabad, Pakistan, 28–29 August 2019.

Deshpande, S.; Adhikary, S.D.; Arvindekar, S.; Jadhav, S.S.; Rathod, B. Eye Monitored Wheelchair Control for People Suffering from Quadriplegia. Univers. Rev. 2019, 8, 141–145.

Majaranta, P.; Bulling, A. Eye Tracking and Eye-Based Human–Computer Interaction. In Human–Computer Interaction Series; Springer Science and Business Media LLC: London, UK, 2014; pp. 39–65.

Harezlak, K.; Kasprowski, P. Application of eye tracking in medicine: A survey, research issues and challenges. Comput. Med. Imaging Graph. 2018, 65, 176–190.[CrossRef]

Liu, T.-L.; Fan, C.-P. Visible-light wearable eye gaze tracking by gradients-based eye center location and head movement compensation with IMU. In Proceedings of the 2018 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, 12–14 January 2018.

Robbins, S.; McEldowney, S.; Lou, X.; Nister, D.; Steedly, D.; Miller, Q.S.C.; Bohn, D.D.; Terrell, J.P.; Goris, A.C.; Ackerman, N. Eye-Tracking System Using a Freeform Prism and Gaze-Detection Light. U.S. Patent 10,228,561, 12 March 2019.

Sasaki, M.; Nagamatsu, T.; Takemura, K. Screen corner detection using polarization camera for cross-ratio based gaze estimation. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, Denver, CO, USA, 25–28 June 2019.

Holland, J. Eye Tracking: Biometric Evaluations of Instructional Materials for Improved Learning. Int. J Educ. Pedag. Sci. 2019, 13, 1001–1008.

Rabhi, Y.; Mrabet, M.; Fnaiech, F. A facial expression controlled wheelchair for people with disabilities. Comput. Methods Programs Biomed. 2018, 165, 89–105.[CrossRef]

Arai, K.; Mardiyanto, R.; Nopember, K.I.T.S. A Prototype of ElectricWheelchair Controlled by Eye-Only for Paralyzed User. J. Robot. Mechatron. 2011, 23, 66–74.[CrossRef]

Mani, N.; Sebastian, A.; Paul, A.M.; Chacko, A.; Raghunath, A. Eye controlled electric wheel chair. Int. J. Adv. Res. Electr. Electron. Instrum. Eng. 2015, 4.[CrossRef]

Gautam, G.; Sumanth, G.; Karthikeyan, K.; Sundar, S.; Venkataraman, D. Eye movement based electronic wheel chair for physically challenged persons. Int. J. Sci. Technol. Res. 2014, 3, 206–212.

Patel, S.N.; Prakash, V.; Narayan, P.S. Autonomous camera based eye controlled wheelchair system using raspberry-pi. In Proceedings of the 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India, 19–20 March 2015.

Chacko, J.K.; Oommen, D.; Mathew, K.K.; Sunny, N.; Babu, N. Microcontroller based EOG guided wheelchair. Int. J. Med. Health Pharm. Biomed. Eng. 2013, 7, 409–412.

Hickson, S.; Dufour, N.; Sud, A.; Kwatra, V.; Essa, I. Eyemotion: Classifying Facial Expressions in VR Using Eye-Tracking Cameras. In Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Village, HI, USA, 7–11 January 2019.

C. -. Tyan and P. P. Wang, "Image processing-enhancement, filtering and edge detection using the fuzzy logic approach,"[Proceedings 1993] Second IEEE International Conference on Fuzzy Systems, San Francisco, CA, USA, 1993, pp. 600-605 vol.1, doi: 10.1109/FUZZY.1993.327420.