Workshop on ML for Systems at NeurIPS 2020, December 12th, Zoomville
Workshop on ML for Systems at NeurIPS '20, Dec 12th


Time Section
09:00Opening Remarks
09:15Invited Speaker 1: Christina Delimitrou
09:50Invited Speaker 2: Ed Chi
10:40Contributed Talks:
11:30Invited Speaker 3: Bryan Catanzaro
12:05"Lunch" Break / Live Interactions
13:00Contributed Talks:
13:50Invited Speaker 4: Benoit Steiner - Value Function Based Performance Optimization of Deep Learning Workloads
14:25Contributed Talks:
15:30Invited Speaker 5: Justin Gottschlich
16:05Contributed Talks:
17:05Invited Speaker 6: Kunle Olukotun

What to expect

Compute requirements are growing at an exponential rate1, and optimizing these computer systems often involves complex high-dimensional combinatorial problems. Yet, current methods rely heavily on heuristics. Very recent work has outlined a broad scope where machine learning vastly outperforms these traditional heuristics, including scheduling2,12,15, data structure design3,9, graph clustering and partioning7,16, microarchitecture4, compilers5,8, memory management13, circuit design7,10, chip floor planning14, and the control of warehouse scale computing systems6. In order to continue to scale these computer systems, new learning approaches are needed. The goal of this workshop is to develop novel machine learning methods to optimize and accelerate software and hardware systems.

The main objective of this workshop is to expand upon this recent work and build a community focused on using machine learning in computer architecture and systems problems. We seek to improve the state of the art in the areas where learning has already proven to perform better than traditional heuristics, as well as expand to new areas throughout the system stack such as hardware/circuit design and operating/runtime systems.

We expect this year to improve the state of the art in areas where learning has already proven to outperform traditional heuristics. We also expect to expand into new areas throughout the systems stack, such as computer architecture and operating/runtime systems, and incorporate new ML topics like relational learning. Given that the community is larger than last year, for NeurIPS 2020, we intend to foster more discussion through breakout sessions. The interdisciplinary nature of this area makes NeurIPS an ideal venue for this workshop.

By forming a community of academic and industrial researchers who are excited about this area, we seek to build towards intelligent, self optimizing systems and answer questions such as: How do we generate and share high quality datasets that span the layers of the system stack? Which learned representations best represent code performance and runtime? Which simulators and simulation methodologies provide a tractable proving ground techniques like reinforcement learning?

To this end, the target audience for this workshop includes a wide variety of attendees from state-of-the-art researchers in machine learning to domain experts in computer systems design. We have invited a broad set of expert speakers to present the potential for impact of combining deep learning research with computer systems. We hope that by providing a formal venue for researchers from both fields to meet and interact, that the result will include both fundamental research in ML as well as real-world impact to computer systems design and implementation.

The workshop hosted 6 speakers and we invited researchers to submit relevant papers through our call for papers. The speakers, and potentially other relevant stakeholders, were invited to participate in a panel discussion to end the workshop.

Organizing Committee

Steering Committee

Program Committee

  • Yaroslav Bulatov, DiUX
  • Andrew Gibiansky, Voicery
  • Saad Godil, NVIDIA
  • Anna Goldie, Google Brain
  • Rama Govindaraju, Google
  • Safeen Huda, Google
  • Arpith Jacob, Google
  • Joe Jiang, Google
  • Neel Kant, NVIDIA
  • Martin Loncaric
  • Martin Maas, Google
  • Sadhika Malladi, Princeton
  • Azalia Mirhoseini, Google Brain
  • Azade Nazi, Google Brain
  • Jonathan Raiman, NVIDIA/Paris-Saclay
  • Rajarshi Roy, NVIDIA
  • Herman Schmit, Google
  • Shubho Sengupta, Facebook AI Research
  • Narges Shahidi, Google
  • Tatiana Shpeisman, Google
  • Ebrahim Songhori, Google
  • Suvinay Subramanian, Google
  • John Whaley, UnifyID Inc
  • Qiumin Xu, Google
  • Xinlei Xu, NYU
  • Neeraja Yadwadkar, Stanford University
  • Dan Zhang, Google Brain
  • Yanqi Zhou, Google

Contact Us

Contact us at