Journal of Soft Computing Paradigm
IRO Journals
Volume 3 — Issue 2 — June 2021

An Efficient Dimension Reduction based Fusion of CNN and SVM Model for Detection of Abnormal Incident in Video Surveillance

https://doi.org/10.36548/jscp.2021.2.001
Rajesh Sharma
Computer Vision and Robotics, ASTU, Adama
Akey Sungheetha
Data Science, ASTU, Adama,
PDF
PDF

How to Cite

Sharma, Rajesh, and Akey Sungheetha. 2021. “An Efficient Dimension Reduction Based Fusion of CNN and SVM Model for Detection of Abnormal Incident in Video Surveillance”. Journal of Soft Computing Paradigm 3 (2): 55-69. https://doi.org/10.36548/jscp.2021.2.001.
ACM ACS APA ABNT Chicago Harvard IEEE MLA Turabian Vancouver AMA

Download Citation

Endnote/Zotero/Mendeley (RIS) BibTeX

Keywords

— Deep learning
— video surveillance
Published: 10-05-2021

Abstract

Performing dimensionality reduction in the camera captured images without any loss is remaining as a big challenge in image processing domain. Generally, camera surveillance system is consuming more volume to store video files in the memory. The normally used video stream will not be sufficient for all the sectors. The abnormal conditions should be analyzed carefully for identifying any crime or mistakes in any type of industries, companies, shops, etc. In order to make it comfortable to analyze the video surveillance within a short time period, the storage of abnormal conditions of the video pictures plays a very significant role. Searching unusual events in a day can be incorporated into the existing model, which will be considered as a supreme benefit of the proposed model. The massive video stream is compressed in preprocessing the proposed learning method is the key of our proposed algorithm. The proposed efficient deep learning framework is based on intelligent anomaly detection in video surveillance in a continuous manner and it is used to reduce the time complexity. The dimensionality reduction of the video captured images has been done by preprocessing the learning process. The proposed pre-trained model is used to reduce the dimension of the extracted image features in a sequence of video frames that remain as the valuable and anomalous events in the frame. The selection of special features from each frame of the video and background subtraction process can reduce the dimension in the framework. The proposed method is a combination of CNN and SVM architecture for the detection of abnormal conditions at video surveillance with the help of an image classification procedure. This research article compares various methods such as background subtraction (BS), temporal feature extraction (TFE), and single classifier classification methods.

References

  1. A. A. Chaaraoui, P. Climent-Perez, and F. Fl ´ orez-Revuelta. ´ Silhouette-based human action recognition using sequences of key poses. Pattern Recognition Letters, 34(15):1799– 1807, 2013.
  2. X. Cui, Q. Liu, M. Gao, and D. N. Metaxas. Abnormal detection using interaction energy potentials. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3161–3167. IEEE, 2011.
  3. J.-X. Zhong, N. Li, W. Kong, S. Liu, T. H. Li, and G. Li, "Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 1237-1246.
  4. T. Wang, M. Qiao, A. Zhu, Y. Niu, C. Li, and H. Snoussi, "Abnormal event detection via covariance matrix for optical flow based feature," Multimedia Tools and Applications, vol. 77, pp. 17375-17395, 2018.
  5. K.-W. Cheng, Y.-T. Chen, and W.-H. Fang, "Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation," IEEE Transactions on Image Processing, vol. 24, pp. 5288-5301, 2015.
  6. D. Xu, Y. Yan, E. Ricci, and N. Sebe, "Detecting anomalous events in videos by learning deep representations of appearance and motion," Computer Vision and Image Understanding, vol. 156, pp. 117- 127, 2017.
  7. K.-W. Cheng, Y.-T. Chen, and W.-H. Fang, "An efficient subsequence search for video anomaly detection and localization," Multimedia Tools and Applications, vol. 75, pp. 15101-15122, 2016.
  8. T. Zhang, W. Jia, B. Yang, J. Yang, X. He, and Z. Zheng, "MoWLD: a robust motion image descriptor for violence detection," Multimedia Tools and Applications, vol. 76, pp. 1419-1438, 2017.
  9. W. Li, V. Mahadevan, and N. Vasconcelos, "Anomaly detection and localization in crowded scenes," IEEE transactions on pattern analysis and machine intelligence, vol. 36, pp. 18-32, 2013.
  10. I. Al Ridhawi, S. Otoum, M. Aloqaily, Y. Jararweh, and T. Baker, "Providing secure and reliable communication for next generation networks in smart cities," Sustainable Cities and Society, vol. 56, p. 102080, 2020.
  11. C. Lu, J. Shi, and J. Jia, "Abnormal event detection at 150 fps in matlab," in Proceedings of the IEEE international conference on computer vision, 2013, pp. 2720-2727.
  12. H.Wang, A. Kl¨aser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3169–3176. IEEE, 2011.
  13. P. Doll´ar, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pages 65–72. IEEE, 2005.
  14. D. Weinland, R. Ronfard, and E. Boyer. Motion history volumes for free viewpoint action recognition. In Workshop on modeling People and Human Interaction (PHI’05), 2005.
  15. R. Mehran, A. Oyama, and M. Shah, "Abnormal crowd behavior detection using social force model," in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 935-942.
  16. J. Kim and K. Grauman, "Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates," in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 2921-2928.
  17. W. Li, V. Mahadevan, and N. Vasconcelos, "Anomaly detection and localization in crowded scenes," IEEE transactions on pattern analysis and machine intelligence, vol. 36, pp. 18-32, 2013.
  18. Y. Cong, J. Yuan, and J. Liu, "Sparse reconstruction cost for abnormal event detection," in CVPR 2011, 2011, pp. 3449-3456.
  19. M. A. Alsmirat, I. Obaidat, Y. Jararweh, and M. Al-Saleh, "A security framework for cloud-based video surveillance system," Multimedia Tools and Applications, vol. 76, pp. 22787-22802, 2017.
  20. C. Lu, J. Shi, and J. Jia, "Abnormal event detection at 150 fps in matlab," in Proceedings of the IEEE international conference on computer vision, 2013, pp. 2720-2727.
  21. J. Zhang, Y. Kalantidis, M. Rohrbach, M. Paluri, A. Elgammal, and M. Elhoseiny, "Large-scale visual relationship understanding," in Proceedings of the AAAI Conference on Artificial Intelligence, 2019, pp. 9185-9194.
  22. C. He, J. Shao, and J. Sun, "An anomaly-introduced learning method for abnormal event detection," Multimedia Tools and Applications, vol. 77, pp. 29573-29588, 2018.
  23. W. Sultani, C. Chen, and M. Shah, "Real-world anomaly detection in surveillance videos," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 6479-6488.
  24. Y. Zhu and S. Newsam, "Motion-Aware Feature for Improved Video Anomaly Detection," arXiv preprint arXiv:1907.10211, 2019.
  25. W. Luo, W. Liu, and S. Gao, "A revisit of sparse coding based anomaly detection in stacked rnn framework," in Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 341- 349.
  26. M. Sabokrou, M. Fayyaz, M. Fathy, and R. Klette, "Deep-cascade: Cascading 3d deep neural networks for fast anomaly detection and localization in crowded scenes," IEEE Transactions on Image Processing, vol. 26, pp. 1992-2004, 2017.
  27. Y. S. Chong and Y. H. Tay, "Abnormal event detection in videos using spatiotemporal autoencoder," in International Symposium on Neural Networks, 2017, pp. 189-196.
  28. K. Muhammad, T. Hussain, M. Tanveer, G. Sannino, and V. H. C. de Albuquerque, "Cost-Effective Video Summarization using Deep CNN with Hierarchical Weighted Fusion for IoT Surveillance Networks," IEEE Internet of Things Journal, vol. 7, pp. 4455-4463, May 2020.
  29. M. Hasan, J. Choi, J. Neumann, A. K. Roy-Chowdhury, and L. S. Davis, "Learning temporal regularity in video sequences," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 733-742.
  30. W. Luo, W. Liu, and S. Gao, "Remembering history with convolutional lstm for anomaly detection," in 2017 IEEE International Conference on Multimedia and Expo (ICME), 2017, pp. 439-444.
  31. W. Liu, W. Luo, D. Lian, and S. Gao, "Future frame prediction for anomaly detection–a new baseline," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 6536- 6545.
  32. F. Landi, C. G. Snoek, and R. Cucchiara, "Anomaly Locality in Video Surveillance," arXiv preprint arXiv:1901.10364, 2019.
  33. Y. Yu, T. Zhao, M. Wang, K. Wang, and L. He, "Uni-OPU: An FPGA-Based Uniform Accelerator for Convolutional and Transposed Convolutional Networks," IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2020.
  34. A. Ullah, J. Ahmad, K. Muhammad, M. Sajjad, and S. W. Baik, "Action recognition in video sequences using deep bi-directional LSTM with CNN features," IEEE Access, vol. 6, pp. 1155-1166, 2017.
  35. M. Al-Smadi, O. Qawasmeh, M. Al-Ayyoub, Y. Jararweh, and B. Gupta, "Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews," Journal of computational science, vol. 27, pp. 386-393, 2018.
  36. J. Shao, C.-C. Loy, K. Kang, and X. Wang, "Slicing convolutional neural network for crowd video understanding," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 5620-5628.