Energy-aware service allocation
2012, Future Generation …
Abstract
In this paper we study the problem of energy-aware resource allocation for hosting long-term services or on-demand compute jobs in clusters, e.g., deployed as part of computing infrastructures. We formalize the problem as three constrained optimization problems: maximize job performance under power consumption constraints, minimize power consumption under job performance constraints, and optimize a linear combination of power consumption and job performance. These problems are NP-hard but, given an instance, a bound on the optimal solution can be computed via a rational linear program. We propose polynomial heuristics for all three problems. Simulation experiments show that in all three cases some heuristics can achieve results close to optimal, i.e., lead to good job performance while conserving energy.
References (27)
- U. E. P. Agency, Report to Congress on Server and Data Center Energy Efficiency, http://repositories.cdlib.org/lbnl/LBNL-363E/ (August 2007).
- W. Huang, J. Liu, B. Abali, D. K. Panda, A case for high performance computing with virtual machines, in: Proc. of the 20th Annual Intl. Conf. on Supercomput- ing, 2006, pp. 125-134.
- B. Urgaonkar, P. Shenoy, T. Roscoe, Resource Over- booking and Application Profiling in Shared Hosting Platforms, SIGOPS Oper. Syst. Rev. 36 (SI) (2002) 239-254.
- K. Shen, H. Tang, T. Yang, L. Chu, Integrated Re- source Management for Cluster-based Internet Services, in: Proc. of the 5th Symposium on Operating Systems Design and Implementation, 2002.
- B. Urgaonkar, P. Shenoy, A. Chandra, P. Goyal, T. Wood, Agile dynamic provisioning of multi-tier In- ternet applications, ACM Trans. Auton. Adapt. Syst. 3 (1) (2008) 1-39.
- D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, A. Kemper, An integrated approach to re- source pool management: Policies, efficiency and qual- ity metrics, in: Proc. of the IEEE Intnl. Conf. on De- pendable Systems and Networks, 2008, pp. 326-335.
- A. Karve, T. Kimbrel, G. Pacifici, M. Spreitzer, M. Steinder, M. Sviridenko, A. Tantawi, Dynamic Placement for Clustered Web Applications, in: Pro- ceedings of the 15th International Conference on the World Wide Web, 2006, pp. 595-604.
- D. Carrera, M. Steinder, I. Whalley, J. Torres, E. Ayguadé, Utility-based placement of dynamic web applications with fairness goals, in: IEEE Network Op- erations and Management Symposium, 2008, pp. 9-16.
- M. Stillwell, D. Schanzenbach, F. Vivien, H. Casanova, Resource allocation algorithms for virtualized ser- vice hosting platforms, Journal of Parallel and Dis- tributed ComputingIn press (Digital Object Identifier: 10.1016/j.jpdc.2010.05.006).
- X. Fan, W.-D. Weber, L. A. Barroso, Power provision- ing for a warehouse-sized computer, in: Proceedings of the 34th annual international symposium on Computer architecture, ISCA '07, ACM, 2007, pp. 13-23.
- M. Stillwell, F. Vivien, H. Casanova, Dynamic Frac- tional Resource Scheduling for HPC Workloads, in: Proc. of the 24th IEEE Intl. Parallel & Distributed Pro- cessing Symp., 2010.
- D. Borgetto, G. Da Costa, J.-M. Pierson, A. Sayah, Energy-Aware Resource Allocation, in: Proc. of the Energy Efficient Grids, Clouds and Clusters Workshop (E2GC2), IEEE, 2009, p. (electronic medium).
- Gnu linear programming kit. URL http://www.gnu.org/software/glpk/
- IBM ILOG CPLEX (2010). URL http://www-01.ibm.com/software/integration/optimization/cplex-optimization-studio/
- M. A. Bender, S. Chakrabarti, S. Muthukrishnan, Flow and Stretch Metrics for Scheduling Continuous Job Streams, in: Proc. of the Symp. On Discrete Algo- rithms, 1998, pp. 270-279.
- A. Legrand, A. Su, F. Vivien, Minimizing the Stretch when Scheduling Flows of Divisible Requests, J. of Scheduling 11 (5) (2008) 381-404.
- D. Careglio, G. Da Costa, R. Kat, A. Mendelson, J.- M. Pierson, Y. Sazeides, Hardware leverages for energy reduction in large scale distributed systems, Tech. rep. (2010).
- Y. Kamitsos, L. L. H. Andrew, H. Kim, M. Chiang, Optimal Sleep Patterns for Serving Delay Tolerant Jobs, in: ACM eEnergy, University of Passau, Ger- many, 2010. URL http://netlab.caltech.edu/lachlan/abstract/eEnergySleep.pdf
- D. Niyato, S. Chaisiri, L. B. Sung, Optimal power management for server farm to support green com- puting, in: CCGRID '09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Clus- ter Computing and the Grid, IEEE Computer So- ciety, Washington, DC, USA, 2009, pp. 84-91. doi:http://dx.doi.org/10.1109/CCGRID.2009.89.
- R. Ge, X. Feng, K. W. Cameron, Performance- constrained distributed dvs scheduling for sci- entific applications on power-aware clusters, in: SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing, IEEE Computer Society, Washington, DC, USA, 2005, p. 34. doi:http://dx.doi.org/10.1109/SC.2005.57.
- M. Etinski, J. Corbalan, J. Labarta, M. Valero, A. Veidenbaum, Power-aware load balancing of large scale mpi applications, in: IPDPS '09: Proceed- ings of the 2009 IEEE International Symposium on Parallel&Distributed Processing, IEEE Computer Society, Washington, DC, USA, 2009, pp. 1-8. doi:http://dx.doi.org/10.1109/IPDPS.2009.5160973.
- V. Petrucci, O. Loques, D. Mossé, A Dynamic Opti- mization Model for Power and Performance Manage- ment of Virtualized Clusters, in: ACM eEnergy, Uni- versity of Passau, Germany, 2010.
- V. Petrucci, O. Loques, D. Mossé, A frame- work for dynamic adaptation of power-aware server clusters, in: SAC '09: Proceedings of the 2009 ACM symposium on Applied Computing, ACM, New York, NY, USA, 2009, pp. 1034-1039. doi:http://doi.acm.org/10.1145/1529282.1529509.
- F. Hermenier, X. Lorca, J.-M. Menaud, G. Muller, J. Lawall, Entropy: a Consolidation Manager for Clus- ters, Research Report RR-6639, INRIA (2008). URL http://hal.inria.fr/inria-00320204/en/
- J. L. Berral, ĺñigo Goiri, R. Nou, F. Julià, J. Guitart, R. Gavaldà, J. Torres, Towards energy-aware schedul- ing in data centers using machine learning, in: ACM eEnergy, University of Passau, Germany, 2010.
- M. Hoyer, K. Schröder, W. Nebel, Statistical static ca- pacity management in virtualized data centers support- ing fine grained QoS specification, in: ACM eEnergy, University of Passau, Germany, 2010.
- K. Le, R. Bianchini, M. Martonosi, T. D. Nguyen, Cost- and energy-aware load distribution across data centers, in: HotPower'09 : Workshop on Power Aware Comput- ing and Systems, 2009.