Workshop on ML for Systems at NeurIPS 2024, December 15, Vancouver Convention Center
Workshop on ML for Systems at NIPS 2018 Date December 8th, 2018

Speakers

Jeff Dean

Keynote Speaker

Exciting Directions in Machine Learning for Computer Systems

Jeff Dean joined Google in mid-1999, and is currently Google's Chief Scientist, focusing on AI advances for Google DeepMind and Google Research. His areas of focus include machine learning and AI and applications of AI to problems that help billions of people in societally beneficial ways. Jeff co-founded Google Brain and is a co-designer and implementer of Tensorflow, MapReduce, BigTable and Spanner. He has been involved in several ML for Systems projects, including Learned Index Structures and ML for chip floorplanning.

What To Expect

The ML for Systems workshop presents cutting-edge work on ML in computer systems and aims to develop a unified methodology for the field.

Machine Learning (ML) for Systems describes the application of machine learning techniques to problems related to computer systems. By leveraging supervised learning and reinforcement learning (RL) approaches, machine learning can replace longstanding heuristics that currently drive many of these systems. This includes a wide range of topics, including multi-objective tasks such as designing new data structures 1, integrated circuits 2, 3, or design verification 20, 21, as well as implementing control algorithms for applications such as compilers 12, 13, 19, databases 8, memory management 9, 10, or ML frameworks 11. While the systems community increasingly recognizes the importance of ML in solving a variety of different systems problems 23, ML for Systems remains an emerging area without widely established best practices, methods and strategies for the application of state-of-the-art machine learning techniques 22. The goal of this workshop is to provide an interdisciplinary venue for ML and Systems experts to push this boundary and start new directions within the ML for Systems area.

Workshop Direction

In previous 6 editions, we showcased specific approaches and frameworks to solve problems, bringing together researchers and practitioners at NeurIPS from both the ML and systems communities. While breaking new grounds, we encouraged collaborations and development in a broad range of ML for Systems works, many later published in top-tier conferences 11, 13, 14, 15, 16, 17, 18. This year, we plan to continue this path while encouraging work in key emerging areas such as Large Language Model (LLM) training and serving, and unifying benchmarks on key problems such as scheduling and compiling through a competition.

Recently, the rise of Large Language Models (LLMs) has presented new opportunities and challenges within the domain of computer systems. Our community is well-positioned to produce science and stimulate discussion for adapting to the new paradigm, especially how LLMs can be used to solve systems problems, and using ML to address systems issues that emerge from LLM training and serving. Additionally, as the field matures, we emphasize on keeping the research open, and the science reproducible. To that end, we are supplementing our main program with a competition track to crystallize the field’s progress.

Workshop Goals

NeurIPS provides a unique opportunity to bring together systems researchers and researchers from other sub-areas of ML who had not previously considered applying their techniques in a computer systems context. We see the goal of our workshop as solving the following two objectives:

  • Opening up connections between research areas that were not previously considered, connecting the ML and Systems communities, growing the scope of ML for Systems work and unlocking new research opportunities.
  • Developing best practices, methodologies and benchmarks for the ML for Systems field.

To build commonalities on the topic of LLMs interacting with computational systems, we specifically include seminal talks on emerging trends on training and serving LLMs from seasoned researchers and practitioners as a part of our invited speakers. Our call for papers also includes topics at the intersection of Systems and LLMs.

Call for Papers

We invite researchers to submit relevant papers through our call for papers. Our program include contributed speakers and poster sessions from selected works.

Organizing Committee

Steering Committee

Contact Us

Contact us at mlforsystems@googlegroups.com.