Transcript Request Form

Disability Accommodation?

On March 3rd, 2017 Zico Kolter hosted a virtual seminar titled "Task Based End-to-end Learning in Stochastic Optimization" as part of the Computational Sustainability Virtual Seminars. Kolter's research focuses on machine learning and optimization, with a specific focus on applications in smart energy systems.

In this talk, Kolter presents recent work in learning predictive models for use in stochastic optimization settings. In these domains, the goal of a probabilistic model is not merely to generate "accurate" predictions of the future, but also to make predictions that will result in an effective policy when integrated into decision-making processes. These two goals may seem well-aligned, but they often differ to a surprising degree when models do not reflect the true underlying system (the norm rather than the exception in machine learning). To address this challenge, we develop a technique we refer to as task-based end-to-end learning. The main idea is to update the predictive model itself through the task-specific loss, by differentiating through the policy decisions, in order to directly improve the policy performance under the true distribution of interest. This in turn requires techniques for differentiating through the solution of general optimization problems, a task for which we develop the algorithms and an efficient implementation. We apply this method to the task of scheduling generation under uncertain demand and ramping constraints, and shows that it can significantly outperform a naive maximum likelihood approach.