Abstract
Recently, Virtual rehabilitation has recently emerged as a contemporary option to treating chronic, handicapped, or mobility-impaired patients using virtual reality, augmented reality, and motion capture technology. Using a virtual environment, patients are able to work out in accordance with their treatment plan. This study provides a PoseNet-based in-home rehabilitation telemedicine system with integrated statistical computation allowing clinicians to assess a patient's recovery progress. Using a smartphone camera, patients may undertake rehabilitation activities at home. The angular motions of the patients' elbows and knees are detected and tracked using the PoseNet skeleton-tracking technology. The estimated elbow and other feature poses are recorded during the completion process of rehabilitation activities in front of the mobile camera. Finally, additional performance measurements are gathered and analysed in order to better understand how well the system works.
References
M. Oquab, L. Bottou, I. Laptev, and J. Sivic. “Learning and transferring mid-level image representations using convolutional neural networks” In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1717–1724. IEEE, 2014.
A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson. “CNN features off-the-shelf: an astounding baseline for recognition” In Computer Vision and Pattern Recognition Workshops (CVPRW), 2014 IEEE Conference on, pages 512–519. IEEE, 2014.
N. S¨underhauf, F. Dayoub, S. Shirazi, B. Upcroft, and M. Milford. “On the performance of convnet features for place recognition” arXiv preprint arXiv:1501.04158, 2015.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. “Going deeper with convolutions” arXiv preprint arXiv:1409.4842, 2014.
Uddin, S.M.; Rahman, A.; Ansari, E.U. COMPARISON OF SOME STATISTICAL FORECASTING TECHNIQUES WITH GMDH PREDICTOR: A CASE STUDY. J. Mech. Eng. 2018, 47, 16–21.
Dengen, N.; Haviluddin; Andriyani, L.; Wati, M.; Budiman, E.; Alameka, F. Medicine Stock Forecasting Using Least Square Method. In Proceedings of the 2018 2nd East Indonesia Conference on Computer and Information Technology (EIConCIT), Makassar, Indonesia, 6–7 November 2018.[CrossRef]
Mandery, C.; Terlemez, O.; Do, M.; Vahrenkamp, N.; Asfour, T. The KIT Whole-Body Human Motion Database. In Proceedings of the 2015 International Conference on Advanced Robotics (ICAR), Istanbul, Turkey, 27–31 July 2015; pp. 329–336.
The Chien Hoang; Ha Trang Dang; Viet Dung Nguyen. Kinect-Based Virtual Training System for Rehabilitation. In Proceedings of the 2017 International Conference on System Science and Engineering (ICSSE), Ho Chi Minh City, Vietnam, 21–23 July 2017; pp. 53–56.
Shapi’i, A.; Bahari, N.N.; Arshad, H.; Zin, N.A.M.; Mahayuddin, Z.R. Rehabilitation Exercise Game Model for Post-Stroke Using Microsoft Kinect Camera. In Proceedings of the 2015 2nd International Conference on Biomedical Engineering (ICoBE), Penang, Malaysia, 30–31 March 2015.
Shapi’i, A.; Arshad, H.; Baharuddin, M.S.; Mohd Sarim, H. Serious Games for Post- Stroke Rehabilitation Using Microsoft Kinect. Int. J. Adv. Sci. Eng. Inf. Technol. 2018, 8, 1654–1661.
Wosik, J.; Fudim, M.; Cameron, B.; Gellad, Z.F.; Cho, A.; Phinney, D.; Curtis, S.; Roman, M.; Poon, E.G.; Ferranti, J.; et al. Telehealth Transformation: COVID-19 and the Rise of Virtual Care. J. Am. Med Inform. Assoc. 2020, 27, 957–962.
Bate, N.J.; Xu, S.C.; Pacilli, M.; Roberts, L.J.; Kimber, C.; Nataraja, R.M. Effect of the COVID-19 Induced Phase of Massive Telehealth Uptake on End-User Satisfaction. Intern. Med. J. 2021, 51, 206–214.
Plappert, Matthias, Christian Mandery and Tamim Asfour. “The KIT Motion-Language Dataset.” Big data 4 4 (2016): 236-252.
Chen, Yu, Chunhua Shen, Xiu-Shen Wei, Lingqiao Liu, and Jian Yang. "Adversarial posenet: A structure-aware convolutional network for human pose estimation." In Proceedings of the IEEE International Conference on Computer Vision, pp. 1212- 1221. 2017.
Chou, Chia-Jung, Jui-Ting Chien, and Hwann-Tzong Chen. "Self adversarial training for human pose estimation." In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 17-30. IEEE, 2018.
Peng, Xi, Zhiqiang Tang, Fei Yang, Rogerio S. Feris, and Dimitris Metaxas. "Jointly optimize data augmentation and network training: Adversarial data augmentation in human pose estimation." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2226-2234. 2018.
Yang, Wei, Wanli Ouyang, Hongsheng Li, and Xiaogang Wang. "End-to-end learning of deformable mixture of parts and deep convolutional neural networks for human pose estimation." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3073-3082. 2016.
Chu, Xiao, Wanli Ouyang, Hongsheng Li, and Xiaogang Wang. "Structured feature learning for pose estimation." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4715-4723. 2016.
Ke, Lipeng, Ming-Ching Chang, Honggang Qi, and Siwei Lyu. "Multi-scale structure- aware network for human pose estimation." In Proceedings of the european conference on computer vision (ECCV), pp. 713-728. 2018.
Tang, Wei, Pei Yu, and Ying Wu. "Deeply learned compositional models for human pose estimation." In Proceedings of the European conference on computer vision (ECCV), pp. 190-206. 2018.
Tang, Wei, and Ying Wu. "Does learning specific features for related parts help human pose estimation?." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1107-1116. 2019.
Tay, E.L.; Wong, C.P. A Cross-Sectional Survey of Rehabilitation Service Provision for Children with Brain Injury in Selangor, Malaysia. Disabil. CBR Incl. Dev. 2018, 29, 45–58.
Nitta, Y.; Murayama, Y. Privacy-Aware Remote Monitoring System by Skeleton Recognition. In Proceedings of the 52nd Hawaii International Conference on System Sciences, Maui, HI, USA, 8–11 January 2019.
Zhen, Jianan, Qi Fang, Jiaming Sun, Wentao Liu, Wei Jiang, Hujun Bao, and Xiaowei Zhou. "Smap: Single-shot multi-person absolute 3d pose estimation." In European Conference on Computer Vision, pp. 550-566. Springer, Cham, 2020.
Ce Zheng, Matias Mendieta, Pu Wang, Aidong Lu, and Chen Chen. 2021. A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Pose. arXiv preprint arXiv:2111.12696 (2021).