Abstract
Feature selection is a dimensionality reduction technique that identifies relevant features while discarding irrelevant and redundant ones. Traditional feature selection methods require the entire feature space to be known in advance, making them suitable for static datasets. However, in real-world applications such as healthcare monitoring, sensor networks, and image analysis, new features are generated at different time intervals. In dynamic feature streams, the entire feature space is not known beforehand. To address this challenge, this paper proposes Adaptive Group Feature Stream Selection (AGFS), an online feature selection framework for dynamic feature streams. The proposed framework extends the Alpha-Investing algorithm from processing features individually to processing features that arrive in randomly sized groups. It employs a multi-stage processing approach. First, variance filtering removes constant features. Next, Alpha-Investing-based statistical testing selects relevant feature groups. A group-size capping mechanism is introduced to prevent larger feature groups from being discarded during statistical testing. Within each selected group, features are ranked using feature-class correlation, and redundant features are removed using correlation-based redundancy removal. A data-driven threshold, computed from feature-class correlation observed so far, is introduced to help prevent unnecessary elimination of complementary features. An adaptive wealth mechanism rewards the selection of informative features. Experiments conducted on six benchmark datasets using a K-Nearest Neighbours classifier with 5-fold cross-validation, demonstrate that the proposed framework achieves higher average classification accuracy (87.36%) while maintaining a competitive number of selected features compared to existing feature selection methods. The proposed approach is also validated across multiple classifiers and its consistency across classifiers is reported.References
- Dhillon, Paramveer, Dean Foster, and Lyle Ungar. ”Feature Selection Using Multiple Streams.” In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, JMLR Workshop and Conference Proceedings, 2010, 153-160.
- AlNuaimi, Noura, Mohammad Mehedy Masud, Mohamed Adel Serhani, and Nazar Zaki. ”Streaming Feature Selection Algorithms for Big Data: A Survey.” Applied Computing and Informatics 18, no. 1-2 (2022): 113-135.
- Peng, Hanchuan, Fuhui Long, and Chris Ding. ”Feature Selection Based on Mutual Information Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy.” IEEE Transactions on pattern analysis and machine intelligence 27, no. 8 (2005): 1226-1238.
- Villa-Blanco, Carlos, Concha Bielza, and Pedro Larrañaga. ”Feature Subset Selection for Data and Feature Streams: A Review: C. Villa-Blanco et al.” Artificial Intelligence Review 56, no. Suppl 1 (2023): 1011-1062.
- Zaman, Ezzatul Akmal Kamaru, Azlinah Mohamed, and Azlin Ahmad. ”Feature Selection for Online Streaming High-Dimensional Data: A State-of-the-Art Review.” Applied Soft Computing 127 (2022): 109355.
- Perkins, Simon, and James Theiler. ”Online Feature Selection Using Grafting.” In Proceedings of the 20th International Conference on Machine Learning (ICML-03), 2003, 592-599.
- Zhou, Jing, Dean Foster, Robert Stine, and Lyle Ungar. ”Streaming Feature Selection Using Alpha-Investing.” In Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, 2005, 384-393.
- Wu, Xindong, Kui Yu, Hao Wang, and Wei Ding. ”Online Streaming Feature Selection.” In Proceedings of the 27th international conference on machine learning (ICML-10), 2010, 1159-1166.
- Wu, Xindong, Kui Yu, Wei Ding, Hao Wang, and Xingquan Zhu. ”Online Feature Selection with Streaming Features.” IEEE transactions on pattern analysis and machine intelligence 35, no. 5 (2012): 1178-1192.
- Yu, Kui, Xindong Wu, Wei Ding, and Jian Pei. ”Scalable and Accurate Online Feature Selection for Big Data.” ACM Transactions on Knowledge Discovery from Data (TKDD) 11, no. 2 (2016): 1-39.
- Zhou, Peng, Shu Zhao, Yuanting Yan, and Xindong Wu. ”Online Scalable Streaming Feature Selection via Dynamic Decision.” ACM Transactions on Knowledge Discovery from Data (TKDD) 16, no. 5 (2022): 1-20.
- Almusallam, Naif, Zahir Tari, Jeffrey Chan, Adil Fahad, Abdulatif Alabdulatif, and Mohammed Al-Naeem. ”Towards an Unsupervised Feature Selection Method for Effective Dynamic Features.” IEEE Access 9 (2021): 77149-77163.
- Yan, Xuyang, Abdollah Homaifar, Mrinmoy Sarkar, Benjamin Lartey, and Kishor Datta Gupta. ”An Online Unsupervised Streaming Features Selection Through Dynamic Feature Clustering.” IEEE Transactions on Artificial Intelligence 4, no. 5 (2022): 1281-1292.
- Simon, Noah, Jerome Friedman, Trevor Hastie, and Robert Tibshirani. ”A Sparse-Group Lasso.” Journal of computational and graphical statistics 22, no. 2 (2013): 231-245.
- Li, Haiguang, Xindong Wu, Zhao Li, and Wei Ding. ”Group Feature Selection with Streaming Features.” In 2013 IEEE 13th International Conference on Data Mining, IEEE, 2013, 1109-1114.
- Wang, Jing, Meng Wang, Peipei Li, Luoqi Liu, Zhongqiu Zhao, Xuegang Hu, and Xindong Wu. ”Online Feature Selection with Group Structure Analysis.” IEEE Transactions on Knowledge and Data Engineering 27, no. 11 (2015): 3029-3041.
- Yan, Huyong, Feilong Chen, Jia Chen, and Zhao Li. ”OS2FSG: Online Sparse Streaming Feature Selection via Gaussian Copula.” Neurocomputing (2026): 134273.
- Hochma, Yael, and Mark Last. ”Fast Online Feature Selection in Streaming Data.” Machine Learning 114, no. 1 (2025): 1.
- Vivek, Yelleti, Vadlamani Ravi, and P. Radha Krishna. ”Online Feature Subset Selection for Mining Feature Streams in Big Data via Incremental Learning and Evolutionary Computation.” Swarm and Evolutionary Computation 94 (2025): 101896.
- Duan, Zhangling, Tianci Li, Zhaolong Ling, Xingyu Wu, Jingye Yang, and Zhaohong Jia. ”Fair streaming feature selection.” Neurocomputing 624 (2025): 129394.
- Peduzzi, Peter, John Concato, Elizabeth Kemper, Theodore R. Holford, and Alvan R. Feinstein. ”A Simulation Study of the Number of Events Per Variable in Logistic Regression Analysis.” Journal of clinical epidemiology 49, no. 12 (1996): 1373-1379.
- Vittinghoff, Eric, and Charles E. McCulloch. ”Relaxing the Rule of Ten Events Per Variable in Logistic and Cox Regression.” American journal of epidemiology 165, no. 6 (2007): 710-718.
- Guyon, Isabelle, Steve Gunn, Asa Ben-Hur, and Gideon Dror. ”Result Analysis of the Nips 2003 Feature Selection Challenge.” Advances in neural information processing systems 17 (2004).
- OpenML. ”Hiva, Leukemia, and Lung Cancer Datasets.” OpenML. Hiva, Dataset ID 1039; Leukemia, Dataset ID 1104; Lung Cancer, Dataset ID 45093.
- Meidan, Yair, Michael Bohadana, Yael Mathov, Yisroel Mirsky, Asaf Shabtai, Dominik Breitenbacher, and Yuval Elovici. ”N-baiot—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders.” IEEE Pervasive Computing 17, no. 3 (2018): 12-22.

Journal of Trends in Computer Science and Smart Technology