Abstract
Usage of multimedia data is increasing drastically every day, so being able to manage and effectively retrieve information based on its content has become important. A content-based video retrieval (CBVR) system retrieves video data based on visual content. This paper presents a CBVR system that uses visual descriptors, including Motion Boundary Histogram (MBH) temporal features, along with RGB codes and GLCM spatial features. By analysing the optical flow derivatives, MBH features are extracted from each frame to detect shot transitions and identify key frames that summarize the video content. From the keyframes, multiple features are extracted for dataset videos in the offline process and for the query video in the online process. To reduce redundancy and improve retrieval accuracy, feature selection is performed on the feature vector using various optimization algorithms, such as BPSO, BGWO, BWOA, and BCHOA. The performance of the system is tested on sample videos from the UCF50 dataset. The comparison between query and dataset videos is evaluated by computing cosine similarity. The retrieval performance and computational efficiency of the proposed CBVR framework are compared with existing methods by achieving a compression ratio of 0.9701, an F1 score of 0.859, a precision of 0.972 and a recall rate of 0.770.
References
- Sun, Maojin. "An Intelligent Retrieval Method for Audio and Video Content: Deep Learning Technology Based on Artificial Intelligence." IEEE Access 12 (2024): 123430-123446.
- Adly, Ahmad Sedky, Islam Hegazy, Taha ElArif, and M. S. Abdelwahab. "Development of an Effective Bootleg Videos Retrieval System as a Part of Content-Based Video Search Engine." Int. J. Comput. 21, no. 2 (2022): 214-227.
- Hussain, Altaf, Mehtab Ahmad, Tariq Hussain, and Ijaz Ullah. "Efficient Content Based Video Retrieval System by Applying AlexNet on Key Frames." ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal 11, no. 2 (2022): 207.
- Yoon, Hyeok, and Ji-Hyeong Han. "Content-based Video Retrieval with Prototypes of Deep Features." IEEE Access 10 (2022): 30730-30742.
- Thomas, Sinnu Susan, Sumana Gupta, and Venkatesh K. Subramanian. "Context Driven Optimized Perceptual Video Summarization and Retrieval." IEEE transactions on circuits and systems for video technology 29, no. 10 (2018): 3132-3145.
- Palanivelu, Nitish, Nishita Jagdale, Nishith Dubey, and Bharati Jagtap. "Content Based Video Retrieval Using Deep Learning." (2024). 1-20,
- Gornale, Shivanand S., Ashvini K. Babaleshwar, and Pravin L. Yannawar. "Analysis and Detection of Content Based Video Retrieval." Int. J. Image, Graph. Signal Process 11, no. 3 (2019): 43.
- Liu, Yumeng, and Aina Sui. "Research on Feature Dimensionality Reduction in Content Based Public Cultural Video Retrieval." In 2018 IEEE/ACIS 17th International Conference on Computer and Information Science (ICIS), IEEE, 2018, 718-722.
- TShami, Tareq M., Ayman A. El-Saleh, Mohammed Alswaitti, Qasem Al-Tashi, Mhd Amen Summakieh, and Seyedali Mirjalili. "Particle Swarm Optimization: A Comprehensive Survey." Ieee Access 10 (2022): 10031-10061.
- Too, Jingwei, and Abdul Rahim Abdullah. "Opposition Based Competitive Grey Wolf Optimizer for EMG Feature Selection." Evolutionary Intelligence 14, no. 4 (2021): 1691-1705.
- Too, Jingwei, Abdul Rahim Abdullah, Norhashimah Mohd Saad, Nursabillilah Mohd Ali, and Weihown Tee. "A New Competitive Binary Grey Wolf Optimizer to Solve the Feature Selection Problem in EMG Signals Classification." Computers 7, no. 4 (2018): 58.
- Too, Jingwei, Majdi Mafarja, and Seyedali Mirjalili. "Spatial Bound Whale Optimization Algorithm: An Efficient High-Dimensional Feature Selection Approach." Neural Computing and Applications 33, no. 23 (2021): 16229-16250.
- Ayeche, Farid, and Adel Alti. "Efficient Feature Selection in High Dimensional Data Based on Enhanced Binary Chimp Optimization Algorithms and Machine Learning." Human-Centric Intelligent Systems 3, no. 4 (2023): 558-587.
- Chavate, Shrikant, and Ravi Mishra. "An Efficient Approach for Shot Boundary Detection in Presence of Illumination Effects using Fusion of Transforms." International Journal of Engineering Trends and Technology 70, no. 4 (2022): 418-432.
- Kar, Tejaswini, Priyadarshi Kanungo, Sachi Nandan Mohanty, Sven Groppe, and Jinghua Groppe. "Video Shot-Boundary Detection: Issues, Challenges and Solutions." Artificial Intelligence Review 57, no. 4 (2024): 104.
- Halim, Benoughidene Abdel and Titouna Faiza. “Shot Boundary Detection: Fundamental Concepts and Survey.” Conference on Innovative Trends in Computer Science (2019).
- Asha, D., and Y. Madhavee Latha. "Content-Based Video Shot Boundary Detection Using Multiple Haar Transform Features." In Soft Computing and Signal Processing: Proceedings of ICSCSP 2018, Volume 1, Singapore: Springer Singapore, 2019, 703-713.
- Fan, Min, Qi Han, Xi Zhang, Yaling Liu, Huan Chen, and Yaqian Hu. "Human Action Recognition Based on Dense Sampling of Motion Boundary and Histogram of Motion Gradient." In 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS), IEEE, 2018, 1033-1038.
- Ma, Zhihao, Tianyu Wang, Sheng Xu, Xinxing Mu, Qiang Wang, and Qingqiang Guo. "Moving Object Detection Based on Farneback Optical Flow." In 2023 42nd Chinese Control Conference (CCC), IEEE, 2023, 7350-7355.
- Asha. D and Y. Madhavee Latha., "Content-Based VSBD Technique Using DWT-HOG Features and Particle Swarm Optimization for Thresholding," 2025 International Conference on Intelligent Communication Networks and Computational Techniques (ICICNCT), Bidar, India, 2025, 1-5.
- Benco, Miroslav, Patrik Kamencay, Martina Radilova, Robert Hudec, and Martin Sinko. "The Comparison of Color Texture Features Extraction Based on 1D GLCM with Deep Learning Methods." In 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), IEEE, 2020, 285-289.
- Jia, Weikuan, Meili Sun, Jian Lian, and Sujuan Hou. "Feature Dimensionality Reduction: A Review." Complex & Intelligent Systems 8, no. 3 (2022): 2663-2693.
- Chandrashekar, Girish, and Ferat Sahin. "A Survey on Feature Selection Methods." Computers & electrical engineering 40, no. 1 (2014): 16-28.
- Reddy, Kishore K., and Mubarak Shah. "Recognizing 50 Human Action Categories of Web Videos." Machine vision and applications 24, no. 5 (2013): 971-981.

Journal of Innovative Image Processing