Energy Efficient Scheduling Methods for Computational Grids and Clouds
DOI:
https://doi.org/10.26636/jtit.2017.1.651Keywords:
batch scheduling, cloud computing, energy efficient, grids, power consumption, resource allocationAbstract
This paper presents an overview of techniques developed to improve energy efficiency of grid and cloud computing. Power consumption models and energy usage profiles are presented together with energy efficiency measuring methods. Modeling of computing dynamics is discussed from the viewpoint of system identification theory, indicating basic experiment design problems and challenges. Novel approaches to cluster and network-wide energy usage optimization are surveyed, including multi-level power and software control systems, energy-aware task scheduling, resource allocation algorithms and frameworks for backbone networks management. Software-development techniques and tools are also presented as a new promising way to reduce power consumption at the computing node level. Finally, energy-aware control mechanisms are presented. In addition, this paper introduces the example of batch scheduler based on ETC matrix approach.
Downloads
References
[1] K. H. Kim, A. Beloglazov, and R. Buyya, “Power-aware provisioning of cloud resources for real-time services”, in Proc. 7th Int. Worksh. on Middleware for Grids, Clouds and e-Science MGC’09, Urbana Champaign, IL, USA, 2009, pp. 1:1–1:6 (doi: 10.1145/1657120.1657121).
View in Google Scholar
[2] A. Beloglazov and R. Buyya, “Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers”, in Proc. 8th Int. Worksh. on Middleware for Grids, Clouds and e-Science MGC’10, Bangalore, India, 2010, pp. 4:1–4:6 (doi: 10.1145/1890799.1890803).
View in Google Scholar
[3] X. Fan, W.-D. Weber, and L. A. Barroso, “Power provisioning for a warehouse-sized computer”, in Proc. 34th Ann. Int. Symp. on Comp. Architec. ISCA’07, San Diego, CA, USA, 2007, pp. 13–23.
View in Google Scholar
[4] E. Pinheiro, R. Bianchini, E. Carrera, and T. Heath, “Load balancing and unbalancing for power and performance in cluster-based systems”, in Proc. of the Worksh. on Compilers and Operat. Syst. for Low Power COLP’01, Barcelona, Spain, 2001, pp. 182–195.
View in Google Scholar
[5] A. Beloglazov, J. Abawajy, and R. Buyya, “Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing”, Future Gener. Comput. Syst., vol. 28, no. 5, pp. 755–768, 2012.
View in Google Scholar
[6] R. Nathuji and K. Schwan, “VirtualPower: Coordinated power management in virtualized enterprise systems”, in Proc. 21st ACM SIGOPS Symposium on Operat. Syst. Principles SOSP’07, Stevenson, WA, USA, 2007, pp. 265–278.
View in Google Scholar
[7] D. Kusic, J. O. Kephart, J. E. Hanson, N. Kandasamy, and G. Jiang, “Power and performance management of virtualized computing environments via lookahead control”, Cluster Comput., vol. 12, no. 1, pp. 1–15, 2009.
View in Google Scholar
[8] G. Dhiman, K. Mihic, and T. Rosing, “A system for online power prediction in virtualized environments using Gaussian mixture models”, in Proc. 47th Design Autom. Conf. DAC’10, Anaheim, CA, USA, 2010, pp. 807–812.
View in Google Scholar
[9] A. Hameed et al., “A survey and taxonomy on energy-efficient resource allocation techniques for cloud computing systems”, Computing, vol. 98, no. 7, pp. 751–774, 2016.
View in Google Scholar
[10] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach. Englewood Cliffs: Prentice-Hall, 1995.
View in Google Scholar
[11] R. Kaur and P. Luthra, “Load balancing in cloud computing”, in Proc. of Int. Conf. on Recent Trends in Inform., Telecom. and Comput. ITC ’12, Bangalore, India, 2012.
View in Google Scholar
[12] D. Grzonka, J. Kołodziej, J. Tao, and S. U. Khan, “Artificial neural network support to monitoring of the evolutionary-driven security-aware scheduling in computational distributed environments”, Future Gener. Comput. Syst., vol. 51, no. C, pp. 72–86, 2015.
View in Google Scholar
[13] P. Fibich, L. Matyska, and H. Rudová, “Model of grid scheduling problem”, in Proc. Worksh. on Explor. Plann. and Schedul. for Web Services, Grid and Autonomic Comput., Pittsburgh, PA, USA, 2005, pp. 17–24.
View in Google Scholar
[14] D. Klusáček and H. Rudová, “Efficient grid scheduling through the incremental schedule-based approach”, Computat. Intell., vol. 27, no. 1, pp. 4–22, 2011.
View in Google Scholar
[15] J. Kołodziej et al., “Hierarchical genetic-based grid scheduling with energy optimization”, Cluster Comput., vol. 16, no. 3, pp. 591–609, 2013.
View in Google Scholar
[16] C. Cai, L. Wang, S. U. Khan, and J. Tao, “Energy-aware high performance computing: A taxonomy study”, in Proc. 2011 IEEE 17th Int. Conf. on Parallel and Distrib. Syst. ICPADS 2011, Tainan, Taiwan, 2011, pp. 953–958.
View in Google Scholar
[17] J. Kołodziej, Evolutionary Hierarchical Multi-Criteria Metaheuristics for Scheduling in Large-Scale Grid Systems. Studies in Computational Intelligence, vol. 419. Springer, 2012.
View in Google Scholar
[18] J. R. Anette, W. A. Banu, and Shriram, “A taxonomy and survey of scheduling algorithms in cloud: Based on task dependency”, Int. J. of Comp. Appl., vol. 82, no. 15, pp. 20–26, 2013.
View in Google Scholar
[19] J. Kołodziej, S. U. Khan, and F. Xhafa, “Genetic algorithms for energy-aware scheduling in computational grids”, in Proc. Int. Conf. on P2P, Parallel, Grid, Cloud and Internet Comput. 3PGCIC 2011, Barcelona, Spain, 2011, pp. 17–24.
View in Google Scholar
[20] S. Ali, H. J. Siegel, M. Maheswaran, D. Hensgen, and S. Ali, “Task execution time modeling for heterogeneous computing systems”, in Proc. 9th Heterogen. Comput. Worksh. HCW 2000 (Cat. No. PR00556), Cancun, Mexico, 2000, pp. 185–199 (doi: 10.1109/HCW.2000.843743).
View in Google Scholar
[21] D. Kliazovich, P. Bouvry, and S. U. Khan, “DENS: Data center energy-efficient network-aware scheduling”, in Int. Conf. on Green Comput. & Commun. GreenCom 2010 and IEEE/ACM Int. Conf. on Cyber, Physical & Social Comput. CPSCom 2010, Hangzhou, China, 2010, pp. 69–75 (doi: 10.1109/GreenCom-CPSCom.2010.31).
View in Google Scholar
[22] Y. Mhedheb et al., “Load and thermal-aware VM scheduling on the cloud”, in Algorithms and Architectures for Parallel Processing: 13th International Conference, ICA3PP 2013, Vietri sul Mare, Italy, Dec. 18–20, 2013, Proceedings, Part II, R. Aversa, J. Kołodziej, J. Zhang, F. Amato, and F. Giancarlo, Eds. Springer, 2013, pp. 101–114.
View in Google Scholar
[23] C. Ghribi, M. Hadji, and D. Zeghlache, “Energy-efficient VM scheduling for cloud data centers: Exact allocation and migration algorithms”, in Proc. 13th IEEE/ACM Int. Symp. on Cluster, Cloud, and Grid Comput. CCGrid 2013, Delft, The Netherlands, 2013, pp. 671–678.
View in Google Scholar
[24] C. Ghribi and D. Zeghlache, “Exact and heuristic graph-coloring for energy-efficient advance cloud resource reservation”, in Proc. IEEE 7th Int. Conf. on Cloud Comput. CLOUD 2014, Anchorage, AK, USA, 2014, pp. 112–119.
View in Google Scholar
[25] A. Beloglazov, “Energy-efficient management of virtual machines in data centers for cloud computing”, Ph.D. thesis, The University of Melbourne, 2013 [Online]. Available: http://beloglazov.info/thesis.pdf
View in Google Scholar
[26] A. Beloglazov and R. Buyya, “OpenStack Neat: A framework for dynamic and energy-efficient consolidation of virtual machines in OpenStack clouds”, Concurr. Comput.: Pract. Exper., vol. 27, no. 5, pp. 1310–1333, 2015 (doi: 10.1002/CPE.3314).
View in Google Scholar
[27] A. Iqbal, C. Pattinson, and A. L. Kor, “Managing energy efficiency in the cloud computing environment using SNMPv3: A quantitative analysis of processing and power usage”, in Proc. IEEE 14th Int. Conf. Dependable, Autonom. & Secure Comput., 14th Int. Conf. Pervasive Intell. & Comput., 2nd Int. Conf. Big Data Intell. & Comput., and Cyber Sci. and Technol. Congr. DASC/PiCom/DataCom/ CyberSciTech, Auckland, New Zealand, 2016, pp. 239–244 (doi: 10.1109/DASC-PICom-DataCom-CyberSciTec.2016.60).
View in Google Scholar
[28] H. Goudarzi, M. Ghasemazar, and M. Pedram, “SLA-based optimization of power and migration cost in cloud computing”, in Proc. 12th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Comput. CCGrid 2012, Ottawa, Canada, 2012, pp. 172–179.
View in Google Scholar
[29] A. Beloglazov and R. Buyya, “Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers”, Concurr. Comput.: Pract. Exper., vol. 24, no. 13, pp. 1397–1420, 2012 (doi: 10.1002/CPE.1867).
View in Google Scholar
[30] R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya, “CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms”, Softw. Pract. Exper., vol. 41, no. 1, pp. 23–50, 2011.
View in Google Scholar
[31] J. Kołodziej, F. Xhafa, L. Barolli, and V. Kolici, “A taxonomy of data scheduling in data grids and data centers: Problems and intelligent resolution techniques”, in Proc. Int. Conf. on Emerging Intell. Data and Web Technol. EIDWT 2011, Tirana, Albania, 2011, pp. 63–71 (doi: 10.1109/EIDWT.2011.20).
View in Google Scholar
[32] L. Wang et al., “Energy-aware parallel task scheduling in a cluster”, Future Gener. Comput. Syst., vol. 29, no. 7, pp. 1661–1670, 2013.
View in Google Scholar
[33] A. Jakóbik, D. Grzonka, and F. Palmieri, “Non-deterministic security-driven meta scheduler for distributed cloud organizations”, Simul. Modell. Practice and Theory, Elsevier, Nov. 2016 (doi: 10.1016/j.simpat.2016.10.011).
View in Google Scholar
[34] A. Jakóbik, D. Grzonka, J. Kołodziej, and H. González-Vélez, “Towards secure non-deterministic meta-scheduling for clouds”, in Proc. 30th Eur. Conf. on Modell. and Simul. ECMS 2016, Regensburg, Germany, 2016, pp. 596–602 (doi: 10.7148/2016-0596).
View in Google Scholar
[35] A. Jakóbik, “Big data security”, in Resource Management for Big Data Platforms: Algorithms, Modelling, and High-Performance Computing Techniques, F. Pop, J. Kołodziej, and B. Di Martino, Eds. Springer, 2016, pp. 241–261.
View in Google Scholar
Downloads
Submitted
Published
Issue
Section
License
Copyright (c) 2017 Journal of Telecommunications and Information Technology

This work is licensed under a Creative Commons Attribution 4.0 International License.