DATE: Thursday, October 31, 2013
TIME: Noon - 1:00 pm
PLACE: GHC 6115
SPEAKERS: John Wilkes, Google
TITLE: Omega: flexible, scalable schedulers for large compute clusters and the abstract still?
ABSTRACT:
Increasing scale and the need for rapid response to changing requirements are hard to meet with current monolithic cluster scheduler architectures. This restricts the rate at which new features can be deployed, decreases efficiency and utilization, and will eventually limit cluster growth. We present a novel approach to address these needs using parallelism, shared state, and lock-free optimistic concurrency control. We compare this approach to existing cluster scheduler designs, evaluate how much interference between schedulers occurs and how much it matters in practice, present some techniques to alleviate it, and finally discuss a use case highlighting the advantages of our approach -- all driven by real-life Google production workloads.
FURTHER READING:
Omega: flexible, scalable schedulers for large compute clusters. Malte Schwarzkopf (University of Cambridge Computer Laboratory), Andy Konwinski (University of California Berkeley), Michael Abd-el-Malek and John Wilkes (Google Inc.) Proc. EuroSys'13 (Prague), April 2013./
BIO:
John Wilkes has been at Google since 2008, where he is working on cluster management and infrastructure services. He is interested in far too many aspects of distributed systems, but a recurring theme has been technologies that allow systems to manage themselves. In his spare time he continues, stubbornly, trying to learn how to blow glass. http://e-wilkes.com/john
SDI / ISTC SEMINAR QUESTIONS?
Karen Lindenfelser, 86716, or visit www.pdl.cmu.edu/SDI/