Optimizing Datacenter Operations with Practical Complexity

演讲人: Henry (Hong) Xu University of Toronto
时间: 2013-03-07 11:00-2013-03-07 12:00

The unprecedented growth of mega datacenters, in which hundreds of thousands of machines are assembled to process a massive amount of data for Internet-scale services, has been driving the evolution of computing. Designing algorithms to optimize datacenter operations is thus imperative. At the same time, the scale of the infrastructure calls for novel approaches to reduce the complexity of the solutions in order to make them practical.

In this talk, I present two stories that, in different ways, resolve the tussle between optimality and practicality in designing algorithms for datacenters. First, for a single datacenter, I present Anchor, a resource management system that effectively allocates server resources to virtual machines. Instead of being optimal, Anchor is designed to be flexible and practical, and uses a unified mechanism to support diverse allocation policies expressed by operators and tenants. It abstracts performance goals as preferences, and uses a novel stable matching algorithm to solve the matching problem efficiently. In the second part of the talk, I will cover my study of workload management for multiple datacenters distributed over the wide area, where it is possible to go for both optimality and practicality. I propose a temperature aware approach, where requests can be directed to cooler locations with better cooling efficiency to reduce the cooling energy consumption. A novel distributed algorithm is developed to solve the large-scale optimization problem with faster convergence compared to traditional methods.


Henry (Hong) Xu is a PhD candidate in the Department of Electrical and Computer Engineering, University of Toronto. His research interests include cloud computing, datacenters, and computer networks. His research focuses on using mathematical modeling to explore and drive the design of large-scale computer systems, with an objective of improving performance with practical complexity. He is also interested in problems at the intersection of networking and economics. He received his M.A.Sc in Electrical and Computer Engineering from the University of Toronto in 2010, and his B.Engr in Information Engineering with First Class Honor from The Chinese University of Hong Kong in 2007.