Green HPC: Carbon-Aware Scheduling in Cloud Data Centers
DOI:
https://doi.org/10.63282/3050-922X.IJERET-V4I2P111Keywords:
Green Computing, High-Performance Computing (HPC), Cloud Data Centers, Carbon-Aware Scheduling, Energy Efficiency, Renewable EnergyAbstract
High-Performance Computing (HPC) has become a major force in scientific research, financial modeling, artificial intelligence and large-scale data analytics. Nevertheless, the growth of cloud-based HPC has led to severe environmental issues, particularly in terms of energy use and carbon emissions from hyperscale data centres. The paper explores HPC scheduling approaches to carbon consciousness under cloud configurations; attention is on the minimization of the Greenhouse Gas (GHG) emissions and achieving the associated systems performance and Service-Level Agreements (SLAs). It reviews recent approaches in green computing, discusses issues of incorporating renewable energy sources as they relate to scheduling policies and outlines a research approach that integrates workload prediction, carbon-intensity forecasting and multi-objective optimization. Simulation results indicate that this will reduce carbon emissions by 20-40 percent with minimal effect on the time of job completion. We examine the tradeoffs between energy efficiency and performance, as well as carbon consciousness, in the context of the rising prominence of sustainability metrics in the management of cloud data centres
References
[1] Garg, S. K., Yeo, C. S., Anandasivam, A., & Buyya, R. (2009). Energy-efficient scheduling of HPC applications in cloud computing environments. arXiv preprint arXiv:0909.1146.
[2] Renugadevi, T., Geetha, K., Muthukumar, K., & Geem, Z. W. (2020). Optimized energy cost and carbon emission-aware virtual machine allocation in sustainable data centers. Sustainability, 12(16), 6383.
[3] Wu, C. M., Chang, R. S., Chan, H. Y.: A Green energy efficient scheduling algorithm using the DVFS technique for cloud datacenters. Future Gener. Comput. Syst. 37, 141–147 (2014)
[4] Sîrbu, A., & Babaoglu, O. (2018). A data‐driven approach to modeling power consumption for a hybrid supercomputer. Concurrency and Computation: Practice and Experience, 30(9), e4410.
[5] Koomey, J.: Growth in Data Center Electricity Use 2005 to 2010. A Report by Analytical Press, Completed at the Request of the New York Times, p. 9 (2011).
[6] Marra, O., Mirto, M., Cafaro, M., & Giovanni, A. (2011). Green Computing and Power Saving in HPC data centers. CMCC Research Paper, (121).
[7] Chhabra, A., Singh, G., & Kahlon, K. S. (2021). Performance-aware energy-efficient parallel job scheduling in HPC grid using nature-inspired hybrid meta-heuristics. Journal of Ambient Intelligence and Humanized Computing, 12(2), 1801-1835.
[8] Barroso, L. A., & Hölzle, U. (2007). The case for energy-proportional computing. Computer, 40(12), 33-37.
[9] Aksanli, B., Venkatesh, J., Zhang, L., & Rosing, T. (2011, October). Utilizing green energy prediction to schedule mixed batch and service jobs in data centers. In Proceedings of the 4th workshop on power-aware computing and systems (pp. 1-5).
[10] Radovanović, A., Koningstein, R., Schneider, I., Chen, B., Duarte, A., Roy, B., ... & Cirne, W. (2022). Carbon-aware computing for datacenters. IEEE Transactions on Power Systems, 38(2), 1270-1280.
[11] Zhao, D., & Zhou, J. (2022). An energy and carbon-aware algorithm for renewable energy usage maximization in distributed cloud data centers. Journal of Parallel and Distributed Computing, 165, 156-166.
[12] Yang, L. T., & Guo, M. (2006). High-performance computing: paradigm and infrastructure. John Wiley & Sons.
[13] Zapater, M., Sanchez, C., Ayala, J. L., Moya, J. M., & Risco-Martín, J. L. (2012). Ubiquitous green computing techniques for high-demand applications in smart environments. Sensors, 12(8), 10659-10677.
[14] Green, R. C., Wang, L., & Alam, M. (2013). Applications and trends of high performance computing for electric power systems: Focusing on smart grid. IEEE Transactions on Smart Grid, 4(2), 922-931.
[15] Yu, J. J. (2010). Green scheduling and its solution. Advanced Materials Research, 139, 1415-1418.
[16] Buyya, R., Beloglazov, A., Abawajy, J.H.: Energy efficient management of data center resources for Cloud computing: a vision, architectural elements, and open challenges. In: International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), 2 vols., 12–15 July 2010, Las Vegas, Nevada, USA, pp. 6–20 (2010).
[17] Ren, C., Wang, D., Urgaonkar, B., & Sivasubramaniam, A. (2012, August). Carbon-aware energy capacity planning for datacenters. In 2012, IEEE 20th International Symposium on modeling, Analysis and Simulation of Computer and Telecommunication Systems (pp. 391-400). IEEE.
[18] Jeannot, E., & Zilinskas, J. (Eds.). (2014). High-performance Computing on Complex Environments. John Wiley & Sons.
[19] Xu, Z., Chi, X., & Xiao, N. (2016). High-performance computing environment: a review of twenty years of experiments in China. National Science Review, 3(1), 36-48.
[20] Aghimien, E. I., Aghimien, L. M., Petinrin, O. O., & Aghimien, D. O. (2021). High-Performance Computing for Computational Modelling in the Built Environment–Related Studies: A Scientometric Review. Journal of Engineering, Design and Technology, 19(5), 1138-1157.
[21] Pappula, K. K., & Rusum, G. P. (2020). Custom CAD Plugin Architecture for Enforcing Industry-Specific Design Standards. International Journal of AI, BigData, Computational and Management Studies, 1(4), 19-28. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V1I4P103
[22] Rahul, N. (2020). Optimizing Claims Reserves and Payments with AI: Predictive Models for Financial Accuracy. International Journal of Emerging Trends in Computer Science and Information Technology, 1(3), 46-55. https://doi.org/10.63282/3050-9246.IJETCSIT-V1I3P106
[23] Enjam, G. R., & Chandragowda, S. C. (2020). Role-Based Access and Encryption in Multi-Tenant Insurance Architectures. International Journal of Emerging Trends in Computer Science and Information Technology, 1(4), 58-66. https://doi.org/10.63282/3050-9246.IJETCSIT-V1I4P107
[24] Pappula, K. K. (2021). Modern CI/CD in Full-Stack Environments: Lessons from Source Control Migrations. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 2(4), 51-59. https://doi.org/10.63282/3050-9262.IJAIDSML-V2I4P106
[25] Pedda Muntala, P. S. R. (2021). Prescriptive AI in Procurement: Using Oracle AI to Recommend Optimal Supplier Decisions. International Journal of AI, BigData, Computational and Management Studies, 2(1), 76-87. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V2I1P108
[26] Rahul, N. (2021). AI-Enhanced API Integrations: Advancing Guidewire Ecosystems with Real-Time Data. International Journal of Emerging Research in Engineering and Technology, 2(1), 57-66. https://doi.org/10.63282/3050-922X.IJERET-V2I1P107
[27] Enjam, G. R., Chandragowda, S. C., & Tekale, K. M. (2021). Loss Ratio Optimization using Data-Driven Portfolio Segmentation. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 2(1), 54-62. https://doi.org/10.63282/3050-9262.IJAIDSML-V2I1P107
[28] Rusum, G. P., & Pappula, K. K. (2022). Federated Learning in Practice: Building Collaborative Models While Preserving Privacy. International Journal of Emerging Research in Engineering and Technology, 3(2), 79-88. https://doi.org/10.63282/3050-922X.IJERET-V3I2P109
[29] Pappula, K. K. (2022). Containerized Zero-Downtime Deployments in Full-Stack Systems. International Journal of AI, BigData, Computational and Management Studies, 3(4), 60-69. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V3I4P107
[30] Jangam, S. K., & Pedda Muntala, P. S. R. (2022). Role of Artificial Intelligence and Machine Learning in IoT Device Security. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(1), 77-86. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I1P108
[31] Pedda Muntala, P. S. R. (2022). Detecting and Preventing Fraud in Oracle Cloud ERP Financials with Machine Learning. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(4), 57-67. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I4P107
[32] Rahul, N. (2022). Optimizing Rating Engines through AI and Machine Learning: Revolutionizing Pricing Precision. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(3), 93-101. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I3P110
[33] Enjam, G. R., & Tekale, K. M. (2022). Predictive Analytics for Claims Lifecycle Optimization in Cloud-Native Platforms. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(1), 95-104. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I1P110
