Abstract
High-performance computing (HPC) involves leveraging parallel data processing to enhance computer performance and handle difficult tasks. HPC meets these aims by pooling computing capacity, enabling efficient, reliable, and prompt execution of even complex programs according to user demands and expectations. The rapid growth of HPDA in many sectors has led to the extension of the HPC market into new territory. HPC as well as Big Data systems differ not just in terms of technology but also in ecosystems. Extensive research in this sector has led to the emergence of various Big Data analytics models in recent years. As Big Data analytics spreads across several fields, new challenges about the usefulness of analytical paradigms also emerge. This article discusses the key analytical models, as well as the difficulties and challenges associated with high-performance data analytics. This research work aims to identify the factors influencing the integration of HPC with big data, including present and future trends. The study also proposes an architecture for big data with HPC convergence based on design principles.
References
https://www.geekboots.com/story/parallel-computing-and-its-advantage-and-disadvantage
https://www.purestorage.com/it/knowledge/what-is-an-hpc-cluster.html
Wu, Y., Xiang, Y., Ge, J., & Muller, P. (2018). High-Performance Computing for Big Data Processing. Future Generation Computer Systems, 88, 693–695. doi:10.1016/j.future.2018.07.054
Robey, Robert, and Yuliana Zamora. Parallel and high performance computing. Simon and Schuster, 2021.
https://www.hpe.com/in/en/what-is/high-performance-computing.html
Yin, Fei, and Feng Shi. "A Comparative Survey of Big Data Computing and HPC: From a Parallel Programming Model to a Cluster Architecture." International Journal of Parallel Programming 50, no. 1 (2022): 27-64.
LIAO, Wei-keng, and Alok CHOUDHARY. "High performance big data clustering." Cloud Computing and Big Data 23 (2013): 192.
Bautista Villalpando, Luis Eduardo, Alain April, and Alain Abran. "Performance analysis model for big data applications in cloud computing." Journal of Cloud Computing 3, no. 1 (2014): 1-20.
Abid, Mohamed Riduan. "HPC (high-performance the computing) for big data on cloud: Opportunities and challenges." International Journal of Computer Theory and Engineering 8, no. 5 (2016): 423.
Al Shehri, Waleed, Maher Khemakhem, F. Eassa, A. Basuhail, and F. E. Eassa. "Evaluation of high-performance computing techniques for big data applications." Science International 31, no. 1 (2019): 149-163.
Navaux, Philippe Olivier Alexandre, Arthur Francisco Lorenzon, and Matheus da Silva Serpa. "Challenges in high-performance computing." Journal of the Brazilian Computer Society 29, no. 1 (2023): 51-62.
Usman, Sardar, Rashid Mehmood, and Iyad Katib. "Big data and hpc convergence for smart infrastructures: A review and proposed architecture." Smart Infrastructure and Applications: Foundations for Smarter Cities and Societies (2020): 561-586.
Xenopoulos, Peter, Jamison Daniel, Michael Matheson, and Sreenivas Sukumar. "Big data analytics on HPC architectures: Performance and cost." In 2016 IEEE International Conference on Big Data (Big Data), pp. 2286-2295. IEEE, 2016