Abstract
Innovative agricultural technologies increasingly utilize artificial intelligence (AI) and machine learning to enhance productivity and precision. Among these advancements, Convolutional Neural Networks (CNNs) have demonstrated significant promise in image classification tasks across various domains, including agriculture. However, the classification of Tikog leaves a culturally significant raw material used in the banig weaving industry in the Philippines has not been explored using CNNs with feature engineering. This study developed and optimized a feature-engineered CNN model for Tikog leaf classification by integrating Lab color space representation, data augmentation, autoencoder-based feature extraction, mean-max pooling, and dropout regularization. A total sample size of 500 standard-quality and 500 substandard-quality Tikog leaf images was augmented to generate 3,000 training images and 500 validation samples. Among the 27 CNN configurations tested, four models demonstrated superior performance, with Case 12 emerging as the best. This model achieved training and validation accuracies of 94.23% and 96.83%, F1-scores of 94.35% and 96.87%, ROC/AUC scores of 98.18% and 99.40%, and low sum of squared errors (SSE) values (173, 19). Case 12 exhibited excellent generalizability, high classification performance, and computational efficiency, making it the most effective model for deployment in real-world Tikog quality assessment. The study advances both technological innovation and the preservation of indigenous knowledge through intelligent systems.
References
Al-Sabaawi, Aiman, Hassan M. Ibrahim, Zinah Mohsin Arkah, Muthana Al-Amidie, and Laith Alzubaidi. "Amended convolutional neural network with global average pooling for image classification." In International conference on intelligent systems design and applications, Cham: Springer International Publishing, 2020, 171-180.
Arunachalam, A. R. "A survey on deep learning feature extraction techniques." In AIP Conference Proceedings, vol. 2282, no. 1. AIP Publishing, 2020.
Banig. (2013). Retrieved from Explore Basey, Samar Philippines Website: https://evsukraymarabut.wordpress.com/the-famous-banig-in-baseysamar/
Berahmand, Kamal, Fatemeh Daneshfar, Elaheh Sadat Salehi, Yuefeng Li, and Yue Xu. "Autoencoders and their applications in machine learning: a survey." Artificial Intelligence Review 57, no. 2 (2024): 28.
Bharadiya, J. "Convolutional neural networks for image classification." International Journal of Innovative Science and Research Technology 8, no. 5 (2023): 673-677.
Burroughs, Sonya J., Balakrishna Gokaraju, Kaushik Roy, and Luu Khoa. "Deepfakes detection in videos using feature engineering techniques in deep learning convolution neural network frameworks." In 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), IEEE, 2020, 1-4.
Chatterjee, Rajesh Kumar, Md Amir Khusru Akhtar, and Dinesh K. Pradhan. "Classification and Identification of Objects in Images Using CNN." In International Conference on Artificial Intelligence and Data Science, pp. 16-26. Cham: Springer Nature Switzerland, 2021.
Chen, Shuangshuang, and Wei Guo. "Auto-encoders in deep learning—a review with new perspectives." Mathematics 11, no. 8 (2023): 1777.
Chen, Zhi, Jiang Duan, Li Kang, and Guoping Qiu. "Class-imbalanced deep learning via a class-balanced ensemble." IEEE transactions on neural networks and learning systems 33, no. 10 (2021): 5626-5640.
Duboue, Pablo. The art of feature engineering: essentials for machine learning. Cambridge University Press, 2020.
Fayyad, Usama M., Gregory Piatetsky-Shapiro, and Padhraic Smyth. "Knowledge Discovery and Data Mining: Towards a Unifying Framework." In KDD, vol. 96, 1996, 82-88.
Gholamalinezhad, Hossein, and Hossein Khosravi. "Pooling methods in deep neural networks, a review." arXiv preprint arXiv:2009.07485 (2020).
Gonçalves, Caroline Barcelos, Jefferson R. Souza, and Henrique Fernandes. "CNN architecture optimization using bio-inspired algorithms for breast cancer detection in infrared images." Computers in Biology and Medicine 142 (2022): 105205.
Gulzar, Yonis. "Fruit image classification model based on MobileNetV2 with deep transfer learning technique." Sustainability 15, no. 3 (2023): 1906.
Gulzar, Yonis. "Enhancing soybean classification with modified inception model: A transfer learning approach." Emirates Journal of Food & Agriculture (EJFA) 36, no. 1 (2024).
Gunarathna, M., and R. M. K. T. Rathmayaa. "A review on feature extraction techniques for plant disease classification." In Proc. ICACT, 2020, 118-120.
Gupta, Kavita. "Systematic Review of Contemporary Breast Cancer Detection Techniques Using Machine Learning." In 2024 7th International Conference on Contemporary Computing and Informatics (IC3I), vol. 7, IEEE, 2024, 338-344.
Kishore, Jaydeep, and Snehasis Mukherjee. "Impact of autotuned fully connected layers on performance of self-supervised models for image classification." Machine Intelligence Research 21, no. 6 (2024): 1201-1213.
LeCun, Yann, Léon Bottou, Yoshua Bengio, and Patrick Haffner. "Gradient-based learning applied to document recognition." Proceedings of the IEEE 86, no. 11 (2002): 2278-2324.
Li, Chao, Yi Yang, Min Feng, Srimat Chakradhar, and Huiyang Zhou. "Optimizing memory efficiency for deep convolutional neural networks on GPUs." In SC'16: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, IEEE, 2016, 633-644.
Lim, Hyun-il. "A study on dropout techniques to reduce overfitting in deep neural networks." In Advanced Multimedia and Ubiquitous Engineering: MUE-FutureTech 2020, Springer Singapore, 2021, 133-139.
Limonova, Elena, Alexander Sheshkus, and Dmitry Nikolaev. "Computational optimization of convolutional neural networks using separated filters architecture." International Journal of Applied Engineering Research 11, no. 11 (2016): 7491-7494.
Liu, Zhuang, Zhiqiu Xu, Joseph Jin, Zhiqiang Shen, and Trevor Darrell. "Dropout reduces underfitting." In International Conference on Machine Learning, PMLR, 2023, 22233-22248.
Mahbod, Amirreza, Gerald Schaefer, Chunliang Wang, Georg Dorffner, Rupert Ecker, and Isabella Ellinger. "Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification." Computer methods and programs in biomedicine 193 (2020): 105475.
Manaswi, Navin Kumar, and Navin Kumar Manaswi. "Understanding and working with Keras." Deep learning with applications using Python: Chatbots and face, object, and speech recognition with TensorFlow and Keras (2018): 31-43.
Masci, Jonathan, Ueli Meier, Dan Cireşan, and Jürgen Schmidhuber. "Stacked convolutional auto-encoders for hierarchical feature extraction." In Artificial neural networks and machine learning–ICANN 2011: 21st international conference on artificial neural networks, espoo, Finland, June 14-17, 2011, proceedings, part i 21, Springer Berlin Heidelberg, 2011, 52-59.
Tripathi, Milan. "Analysis of convolutional neural network based image classification techniques." Journal of Innovative Image Processing (JIIP) 3, no. 02 (2021): 100-117.
Mumuni, Alhassan, and Fuseini Mumuni. "Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods." Knowledge and Information Systems (2025): 1-51.
NarasingaRao, M. R., V. Venkatesh Prasad, P. Sai Teja, Md Zindavali, and O. Phanindra Reddy. "A survey on prevention of overfitting in convolution neural networks using machine learning techniques." International Journal of Engineering and Technology (UAE) 7, no. 2.32 (2018): 177-180.
Noh, Hyeonwoo, Tackgeun You, Jonghwan Mun, and Bohyung Han. "Regularizing deep neural networks by noise: Its interpretation and optimization." Advances in neural information processing systems 30 (2017).
Özdem, Kevser, Çağın Özkaya, Yılmaz Atay, Emrah Çeltikçi, Alp Börcek, Umut Demirezen, and Şeref Sağıroğlu. "A ga-based cnn model for brain tumor classification." In 2022 7th International Conference on Computer Science and Engineering (UBMK), IEEE, 2022, 418-423.
Patel, Heena, and Kishor P. Upla. "for Hyperspectral Image Classification." In Computer Vision Applications: Third Workshop, WCVA 2018, Held in Conjunction with ICVGIP 2018, Hyderabad, India, December 18, 2018, Revised Selected Papers, vol. 1019, Springer Nature, 2019,115.
Peng, Min, Yunxiang Liu, Asad Khan, Bilal Ahmed, Subrata K. Sarker, Yazeed Yasin Ghadi, Uzair Aslam Bhatti, Muna Al-Razgan, and Yasser A. Ali. "Crop monitoring using remote sensing land use and land change data: Comparative analysis of deep learning methods using pre-trained CNN models." Big Data Research 36 (2024): 100448.
Prasad, Rai Sachindra. "Retracted: Performance Comparison of HSV and L* a* b* Spaces in Thought Form Image Analysis." In 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE), IEEE, 2017, 310-316.
Qin, Jiaohua, Wenyan Pan, Xuyu Xiang, Yun Tan, and Guimin Hou. "A biological image classification method based on improved CNN." Ecological Informatics 58 (2020): 101093.
Rizvi, Shahriyar Masud, Ab Al-Hadi Ab Rahman, Usman Ullah Sheikh, Kazi Ahmed Asif Fuad, and Hafiz Muhammad Faisal Shehzad. "Computation and memory optimized spectral domain convolutional neural network for throughput and energy-efficient inference." Applied Intelligence 53, no. 4 (2023): 4499-4523.
Rochmawanti, Ovy, and Fitri Utaminingrum. "Chest x-ray image to classify lung diseases in different resolution size using densenet-121 architectures." In Proceedings of the 6th International Conference on Sustainable Information Engineering and Technology, 2021, 327-331.
Safhi, Hicham Moad, Bouchra Frikh, and Brahim Ouhbi. "Assessing reliability of big data knowledge discovery process." Procedia computer science 148 (2019): 30-36.
Saini, Manisha, Preeti Gupta, and Harvinder Kaur. "Comprehensive Study of Indexing Techniques Used for Extracting CNN Features." In 2023 5th International Conference on Inventive Research in Computing Applications (ICIRCA), IEEE, 2023, 59-65.
Sangineto, Enver, Moin Nabi, Dubravko Culibrk, and Nicu Sebe. "Self paced deep learning for weakly supervised object detection." IEEE transactions on pattern analysis and machine intelligence 41, no. 3 (2018): 712-725.
Setyawan, Thomas Agung, Setyo Aji Riwinanto, Arif Nursyahid, and Ari Sriyanto Nugroho. "Comparison of hsv and lab color spaces for hydroponic monitoring system." In 2018 5th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), IEEE, 2018, 347-352.
Sharma, Anu, and Dharmender Kumar. "Hyperparameter Optimization in CNN: A Review." In 2023 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), IEEE, 2023., 237-242.
Shirke, V., R. Walika, and L. Tambade. "Drop: a simple way to prevent neural network by overfitting." Int. J. Res. Eng. Sci. Manag 1 (2018): 2581-5782.
Sornam, M., Kavitha Muthusubash, and V. Vanitha. "A survey on image classification and activity recognition using deep convolutional neural network architecture." In 2017 ninth international conference on advanced computing (ICoAC), IEEE, 2017, 121-126.
Tian, Bing, Liang Li, Yansheng Qu, and Li Yan. "Video object detection for tractability with deep learning method." In 2017 Fifth International Conference on Advanced Cloud and Big Data (CBD), IEEE, 2017.
Vietz, Hannes, Tristan Rauch, Andreas Löcklin, Nasser Jazdi, and Michael Weyrich. "A methodology to identify cognition gaps in visual recognition applications based on convolutional neural networks." In 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE), IEEE, 2021.
Wojciuk, Mikolaj, Zaneta Swiderska-Chadaj, Krzysztf Siwek, and Arkadiusz Gertych. "The role of hyperparameter optimization in fine-tuning of cnn models." Available at SSRN 4087642 (2022).
Yadav, P., Madur, N., Dongare, Y., Rajopadhye, V., & Salatogi, S. (2022). Review on Case Study of Image Classification. International Journal of Advanced Research in Science, Communication and Technology, 2(6), https://ijarsct.co.in/Paper5094.pdf, 683-687.
Zafar, Afia, Muhammad Aamir, Nazri Mohd Nawi, Ali Arshad, Saman Riaz, Abdulrahman Alruban, Ashit Kumar Dutta, and Sultan Almotairi. "A comparison of pooling methods for convolutional neural networks." Applied Sciences 12, no. 17 (2022): 8643.
Zhang, Jianyu, and Léon Bottou. "Fine-tuning with Very Large Dropout." arXiv preprint arXiv:2403.00946 (2024).
Zhang, Minghua, Yunfang Wu, Weikang Li, and Wei Li. "Learning universal sentence representations with mean-max attention autoencoder." arXiv preprint arXiv:1809.06590 (2018).
Zhang, Wei, Chuanhao Li, Gaoliang Peng, Yuanhang Chen, and Zhujun Zhang. "A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load." Mechanical systems and signal processing 100 (2018): 439-453.