Extraction of key frames is an essential and significant stage in any video analysis application, aimed at describing the video content precisely by removing the redundancy. An optimized key frame extraction technique based on the Binary Butterfly Optimization Algorithm (BBOA) is introduced. Here, the extraction of Color Coherent Vector (CCV) features from each frame of the video and the application of the BBOA algorithm for minimising redundancy and maximising diversity between the frames is carried out. The process is applied iteratively until the precise number of frames is selected. Further, the system is extended by proposing a Content-Based Video Retrieval (CBVR) system using the selected key frames, extracting multiple features from Grey Level Run Length Matrix (GLRLM) texture features and Dual Tree- Complex Wavelet Transform (DT-CWT) shape descriptors along with CCV features. Due to the multiple features, the feature vector size is huge, so to reduce its dimension, a hybrid Binary Particle Swarm Optimization-Butterfly Optimization Algorithm (PSO-BOA) feature selection method is applied. The experiment was conducted on the UCF101 dataset, and our proposed system outperformed with a compression rate, precision, recall rate, F1 score, and FRR of 0.985, 0.913, 0.78, 0.836, and 0.965, respectively, demonstrating the effectiveness of using the hybrid Optimization algorithm in improving the efficiency of the CBVR system.
@article{d.2025,
author = {Asha D. and Madhavee Latha Y.},
title = {{An Optimized Key Frame Extraction Technique for Content-Based Video Retrieval Using Hybrid PSO-BOA}},
journal = {Journal of Innovative Image Processing},
volume = {7},
number = {4},
pages = {1398-1414},
year = {2025},
publisher = {Inventive Research Organization},
doi = {10.36548/jiip.2025.4.017},
url = {https://doi.org/10.36548/jiip.2025.4.017}
}
Copy Citation
- Rajeshwari, D., and C. Victoria Priscilla. "An Enhanced Spatio-Temporal Human Detected Keyframe Extraction." International journal of electrical and computer engineering systems 14, no. 9 (2023): 985-992.
- Zhong, Qi, Yuan Zhang, Jinguo Zhang, Kaixuan Shi, Yang Yu, and Chang Liu. "Key Frame Extraction Algorithm of Motion Video Based on Priori." IEEE Access 8 (2020): 174424-174436.
- Mallick, Ajay Kumar, and Sushanta Mukhopadhyay. "Video Retrieval Based on Motion Vector Key Frame Extraction and Spatial Pyramid Matching." In 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), IEEE, 2019, 687-692.
- Hussain, Altaf, Mehtab Ahmad, Tariq Hussain, and Ijaz Ullah. "Efficient Content Based Video Retrieval System by Applying AlexNet on Key Frames." ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal 11, no. 2 (2022): 207.
- Kar, Tejaswini, Priyadarshi Kanungo, Sachi Nandan Mohanty, Sven Groppe, and Jinghua Groppe. "Video Shot-Boundary Detection: Issues, Challenges and Solutions." Artificial Intelligence Review 57, no. 4 (2024): 104.
- Thomas, Sinnu Susan, Sumana Gupta, and Venkatesh K. Subramanian. "Context Driven Optimized Perceptual Video Summarization and Retrieval." IEEE transactions on circuits and systems for video technology 29, no. 10 (2018): 3132-3145.
- Hamad, Sumaya, Ahmeed Suliman Farhan, and Doaa Yaseen Khudhur. "Content Based Video Retrieval Using Discrete Cosine Transform." Indones. J. Electr. Eng. Comput. Sci 21, no. 2 (2020): 839-845.
- Arora, Sankalap, and Satvir Singh. "Butterfly Optimization Algorithm: A Novel Approach for Global Optimization." Soft computing 23, no. 3 (2019): 715-734.
- Chen, Chao, Yuting Wan, Ailong Ma, Liangpei Zhang, and Yanfei Zhong. "A Decomposition-Based Multi objective Clonal Selection Algorithm for Hyperspectral Image Feature Selection." IEEE Transactions on Geoscience and Remote Sensing 60 (2022): 1-16.
- Keleş, Mümine Kaya, and Ümit Kiliç. "Binary Black Widow Optimization Approach for Feature Selection." IEEE Access 10 (2022): 95936-95948.
- Shami, Tareq M., Ayman A. El-Saleh, Mohammed Alswaitti, Qasem Al-Tashi, Mhd Amen Summakieh, and Seyedali Mirjalili. "Particle Swarm Optimization: A Comprehensive Survey." IEEE Access 10 (2022): 10031-10061.
- Su, Hongjun, Qian Du, Genshe Chen, and Peijun Du. "Optimized Hyperspectral Band Selection Using Particle Swarm Optimization." IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7, no. 6 (2014): 2659-2670.
- Harjoko, Agus. "Dataset Feature Reduction Using Independent Component Analysis with Contrast Function of Particle Swarm Optimization on Hyperspectral Image Classification." In 2016 2nd International Conference on Science in Information Technology (ICSITech), IEEE, 2016, 285-290.
- Zhang, Mengjian, Daoyin Long, Tao Qin, and Jing Yang. "A Chaotic Hybrid Butterfly Optimization Algorithm with Particle Swarm Optimization for High-Dimensional Optimization Problems." Symmetry 12, no. 11 (2020): 1800.
- Ghaleb, Sanaa AA, Mumtazimah Mohamad, Waheed Ali HM Ghanem, Abdullah B. Nasser, Mohamed Ghetas, Akibu Mahmoud Abdullahi, Sami Abdulla Mohsen Saleh, Humaira Arshad, Abiodun Esther Omolara, and Oludare Isaac Abiodun. "Feature Selection by Multi Objective Optimization: Application to Spam Detection System by Neural Networks and Grasshopper Optimization Algorithm." IEEE Access 10 (2022): 98475-98489.
- Salmi, Meryem, and Bachir Boucheham. "Content Based Image Retrieval Based on Cell Color Coherence Vector (Cell-CCV)." In 2014 4th International Symposium ISKO-Maghreb: Concepts and Tools for knowledge Management (ISKO-Maghreb), IEEE, 2014, 1-5.
- Saadizadeh, Saman. "Breast Cancer Detection in Thermal Images Using GLRLM Algorithm." In 2021 International Conference on Electrical, Communication, and Computer Engineering (ICECCE), IEEE, 2021, 1-6.
- Shrikant Chavate, Ravi Mishra. "An Efficient Approach for Shot Boundary Detection in Presence of Illumination Effects using Fusion of Transforms," International Journal of Engineering Trends and Technology, vol. 70, no. 4, (2022): 418-432, https://doi.org/10.14445/22315381/IJETT-V70I4P236.
- Selesnick, Ivan W., Richard G. Baraniuk, and Nick C. Kingsbury. "The Dual-Tree Complex Wavelet Transform." IEEE signal processing magazine 22, no. 6 (2005): 123-151.
- Soomro, Khurram, Amir Roshan Zamir, and Mubarak Shah. "Ucf101: A dataset of 101 Human Actions Classes from Videos in the Wild." arXiv preprint arXiv:1212.0402 (2012).
- Sun, Maojin. "An intelligent Retrieval Method for Audio and Video Content: Deep Learning Technology Based on Artificial Intelligence." IEEE Access (2024).