IRO Journals
Journal of Ubiquitous Computing and Communication Technologies

Carbon-aware Cloud Resource Scheduling Using Reinforcement Learning for Energy Efficiency Data Centers

Open Access
Published: 27 July, 2026
Pages: 233-247
  • Kirupavathy P. , Kirupavathy P.
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
  • Hareeni C. , Hareeni C.
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
  • Jayashri K. , Jayashri K.
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
  • Jenifer Thangam S. Jenifer Thangam S.
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
    Department of Artificial Intelligence and Data Science, Velammal Institute of Technology, Chennai, India
view PDF
view PDF

How to Cite

P., Kirupavathy, Hareeni C., Jayashri K., and Jenifer Thangam S. 2026. “Carbon-Aware Cloud Resource Scheduling Using Reinforcement Learning for Energy Efficiency Data Centers”. Journal of Ubiquitous Computing and Communication Technologies 8 (3): 233-47. https://doi.org/10.36548/jucct.2026.3.005.
ACM ACS APA ABNT Chicago Harvard IEEE MLA Turabian Vancouver AMA

Download Citation

Endnote/Zotero/Mendeley (RIS) BibTeX

Keywords

Carbon-Aware Scheduling
Reinforcement Learning
Cloud Computing
Energy Efficiency
Data Centers
Green Computing
Carbon Intensity

Abstract

Due to the rapid development of cloud computing services, today's data centers are consuming much more energy and emitting much higher levels of carbon dioxide into the atmosphere compared to earlier years, thus requiring the development of sustainable solutions for resource management in the cloud. In this paper, an approach called Carbon Aware Cloud Resource Scheduling based on the use of Reinforcement Learning is presented. The proposed approach includes workload demand, resource utilization, and carbon intensity values in its decision making process in order to allocate workloads efficiently and minimize environmental impact caused by cloud computing services. The reinforcement learning algorithm trains the RL agent to find the optimal strategies for workload scheduling that involve execution of workloads, postponing their execution, migrating them from one location to another and re-allocation of resources. The results from experimental evaluation indicate that the suggested framework successfully reduces the carbon emission level up to 30% and energy cost level to around 24%, respectively, in comparison with traditional scheduling methods, without lowering the SLA compliance rate down to 98.4% and workload starvation level up to 0.3%. The analysis proves that the combination of carbon awareness and reinforcement learning helps to create an intelligent, adaptive, and ecologically sustainable system for managing cloud resources.

References

  1. Yu, Chuanzhao, Youshan Liu, Chunjiang Zhang, And Weiming Shen. "Multi-Agent Deep Reinforcement Learning for Low-Carbon Flexible Job Shop Scheduling with Variable Sublots." Robotics and Computer-Integrated Manufacturing 2026, Vol 98: 103180.
  2. Mencaroni, Andrea, Robbert Reijnen, Yingqian Zhang, And Dieter Claeys. "Online Parameter Control for Carbon-Aware Scheduling Using Deep Reinforcement Learning." In Beta Symposium 2024.
  3. Sarkar, Soumyendu, Avisek Naug, Antonio Guillen, Vineet Gundecha, Ricardo Luna Gutiérrez, Sahand Ghorbanpour, Sajad Mousavi, Ashwin Ramesh Babu, Desik Rengarajan, And Cullen Bash. "Hierarchical Multi-Agent Framework for Carbon-Efficient Liquid-Cooled Data Center Clusters." In Proceedings of The AAAI Conference On Artificial Intelligence 2025, Vol. 39, No. 28: 29694-29696.
  4. Chen YT, Luo LL, Guo DK Et Al. Carbon-Aware Energy Cost Optimization of Data Analytics Across Geo-Distributed Data Centers. Journal of Computer Science and Technology 2025, Vol 40: 654−670.
  5. Jayanetti, Amanda, Saman Halgamuge, And Rajkumar Buyya. "Multi-Agent Deep Reinforcement Learning Framework for Renewable Energy-Aware Workflow Scheduling On Distributed Cloud Data Centers." IEEE Transactions On Parallel and Distributed Systems 2024, Vol 35, No. 4: 604-615.
  6. Yan, Dongxiang, Mo-Yuen Chow, And Yue Chen. "Low-Carbon Operation of Data Centers with Joint Workload Sharing and Carbon Allowance Trading." IEEE Transactions On Cloud Computing 2024, Vol 12, No. 2: 750-761.
  7. Burmeister, Sascha Christian, Daniela Guericke, And Guido Schryen. "A Two-Level Approach for Multi-Objective Flexible Job Shop Scheduling and Energy Procurement." Cleaner Energy Systems 2025, Vol 10: 100178.
  8. Wang, Zhixue, Maowei He, Ji Wu, Hanning Chen, And Yang Cao. "An Improved MOEA/D for Low-Carbon Many-Objective Flexible Job Shop Scheduling Problem." Computers & Industrial Engineering 2024, Vol 188: 109926.
  9. Prioli, Joao Paulo Jacomini, Nur Banu Altinpulluk, Jeremy L. Rickli, And Murat Yildirim. "Self-Adaptive Production Performance Monitoring Framework Under Different Operating Regimes." Journal of Manufacturing Systems 2025, Vol 80: 380-394.
  10. Fan, Jiaxin, Chunjiang Zhang, Shichen Tian, Weiming Shen, And Liang Gao. "Flexible Job-Shop Scheduling Problem with Variable Lot-Sizing: An Early Release Policy-Based Matheuristic." Computers & Industrial Engineering 2024, Vol 193: 110290.