Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Thursday, August 20 • 11:00am - 11:40am
Challenges in Optimizing Job Scheduling On Mesos - Alex Gaudio, Sailthru

Sign up or log in to save this to your schedule and see who's attending!

As a distributed systems kernel, Mesos solves complex scheduling problems. These problems include: Bin Packing of tasks given resource constraints; Dominant Resource Allocation to prioritize Framework offers; user-defined optimistic or pessimistic Scheduler algorithms. When job allocation stops working properly, we see Framework starvation, dead locks, underutilization and other issues. In this talk, Alex Gaudio will present a unique interpretation of task scheduling on Mesos. By drawing on his experiences building Mesos Frameworks and infrastructure for Sailthru's Data Science team, he will provide attendees with ways to fundamentally question how they use Mesos, and offer practical advice to improve sub-optimal usage patterns.

Speakers
avatar for Alex Gaudio

Alex Gaudio

Senior Data Scientist and Engineer, Sailthru
Alex Gaudio is a Senior Data Scientist and Engineer at Sailthru, where he builds machine learning algorithms and distributed data pipelines on Mesos. He is the primary developer of Relay.Mesos, an intelligent auto-scaler for Mesos that functions like a thermostat. He also develops Stolos, a tool to manage task dependencies represented as a Directed Acyclic Multi-Graph using distributed queues. In his free time, Alex loves to build hardware... Read More →


Thursday August 20, 2015 11:00am - 11:40am
Willow

Attendees (44)