Workshop on ML for Systems at NeurIPS 2023, December 16, New Orleans Convention Center, 9:00AM-5:00PM, Room 211-213
Workshop on ML for Systems at NIPS 2018 Date December 8th, 2018


Chris Lattner

Keynote Speaker

Chris Lattner is the co-founder and CEO of Modular AI. He cofounded the LLVM Compiler infrastructure, the Clang compiler, the Swift programming language, the MLIR compiler infrastructure, the CIRCT project (applying MLIR to hardware design), and have contributed to many other commercial and open source projects at Apple, Tesla, Google, and SiFive. Previously, Chris led the Engineering and Product teams at SiFive, the Google TensorFlow team, the Tesla Autopilot team, and worked for Apple managing the Developer Tools department.

William Dally

Dr. Bill Dally brings extensive expertise in circuit design, high performance computing, and machine learning. Dally is the SVP of Research at NVIDIA, which he joined as a chief scientist in 2009. Previously, Dally led research teams as a professor at Stanford for 12 years and MIT for 11 years. He co-founded two companies. He is a member of the National Academy of Engineering, a Fellow of the American Academy of Arts & Sciences, a Fellow of the IEEE and the ACM, and has received the ACM Eckert-Mauchly Award, the IEEE Seymour Cray Award, and the ACM Maurice Wilkes award. He has published over 250 papers, holds over 120 issued patents, and is an author of four textbooks.

Atlas Wang

Professor Zhangyang "Atlas" Wang is an associate professor at UT Austin, where he holds the Temple Foundation Endowed Faculty Fellowship #7, in the Chandra Family Department of Electrical and Computer Engineering. He is also a faculty member of UT Computer Science (GSC) and the Oden Institute CSEM program. Wang directs AI Research and Technology at Picsart part time. Wang is a recipient of numerous awards, including NSF CAREER, IEEE AI's 10 To Watch, and Google Research Scholar awards.

What To Expect

The ML for Systems workshop presents cutting-edge work on ML in computer systems and aims to develop a unified methodology for the field.

Machine Learning (ML) for Systems describes the application of machine learning techniques to problems related to computer systems. By leveraging supervised learning and reinforcement learning (RL) approaches, machine learning can replace longstanding heuristics that currently drive many of these systems. This includes a wide range of topics, including multi-objective tasks such as designing new data structures 1, integrated circuits 2, 3, or design verification 20, 21, as well as implementing control algorithms for applications such as compilers 12, 13, 19, databases 8, memory management 9, 10, or ML frameworks 11. While the systems community increasingly recognizes the importance of ML in solving a variety of different systems problems 23, ML for Systems remains an emerging area without widely established best practices, methods and strategies for the application of state-of-the-art machine learning techniques 22. The goal of this workshop is to provide an interdisciplinary venue for ML and Systems experts to push this boundary and start new directions within the ML for Systems area.

Workshop Direction

In previous 6 editions, we showcased specific approaches and frameworks to solve problems, bringing together researchers and practitioners at NeurIPS from both the ML and systems communities. While breaking new grounds, we encouraged collaborations and development in a broad range of ML for Systems works, many later published in top-tier conferences 11, 13, 14, 15, 16, 17, 18. This year, we plan to continue this path while encouraging work in key emerging areas such as Large Language Model (LLM) training and serving, and unifying benchmarks on key problems such as scheduling and compiling through a competition.

Recently, the rise of Large Language Models (LLMs) has presented new opportunities and challenges within the domain of computer systems. Our community is well-positioned to produce science and stimulate discussion for adapting to the new paradigm, especially how LLMs can be used to solve systems problems, and using ML to address systems issues that emerge from LLM training and serving. Additionally, as the field matures, we emphasize on keeping the research open, and the science reproducible. To that end, we are supplementing our main program with a competition track to crystallize the field’s progress.

Workshop Goals

NeurIPS provides a unique opportunity to bring together systems researchers and researchers from other sub-areas of ML who had not previously considered applying their techniques in a computer systems context. We see the goal of our workshop as solving the following two objectives:

  • Opening up connections between research areas that were not previously considered, connecting the ML and Systems communities, growing the scope of ML for Systems work and unlocking new research opportunities.
  • Developing best practices, methodologies and benchmarks for the ML for Systems field.

To build commonalities on the topic of LLMs interacting with computational systems, we specifically include seminal talks on emerging trends on training and serving LLMs from seasoned researchers and practitioners as a part of our invited speakers. Our call for papers also includes topics at the intersection of Systems and LLMs.

Competition Track

This year, we introduced an auxiliary competition track to showcase state-of-the-art capabilities under open benchmarks. We hoped that the first iteration of the competition will serve as an initiative to encourage industrial sharing ML for systems data.

Our Kaggle competition on ML model runtime prediction just completed, with 792 participants on 616 teams! We received a total of 10,507 submission entries from 66 countries. The solutions from the competitors cover an impressive range of models and feature transformations, which yield impressive gains over our baseline model. Thank you all for participating in this competition and congratulations to the winners!

Call for Papers

We invite researchers to submit relevant papers through our call for papers. Our program include contributed speakers and poster sessions from selected works.

Organizing Committee

Competition Committee

  • Bryan Perozzi, Google Research, @phanein
  • Phitchaya Mangpo Phothilimthana, Google DeepMind, LinkedIn
  • Sami Abu-el-haija, Google Research, @abu_usc

Steering Committee

Contact Us

Contact us at