AutoGluon 1.2: Advancing AutoML with Foundational Models and LLM Agents
Automated machine learning (AutoML) offers the promise of translating raw data into accurate predictions without the need for significant human effort, expertise, and manual experimentation. In this workshop, we introduce AutoGluon, a state-of-the-art and easy-to-use AutoML framework. We will emphasize how foundational models can streamline and enhance AutoML performance. Specifically, we will discuss our TabPFN-Mix and Chronos foundational model families for tabular and time series data, respectively.
We will introduce the real-world problems that AutoGluon can help you solve within three lines of code and the fundamental techniques adopted in the toolkit. Rather than diving deep into the mechanisms underlining each individual ML model, we emphasize on how you can take advantage of a diverse collection of models to build an automated ML pipeline.
Additionally, we will present AutoGluon-Assistant (AG-A), which advances AutoGluon’s automation from three lines of code to zero. AG-A allows users to solve supervised tabular learning problems using only natural language descriptions. By integrating the natural language understanding capabilities of large language models (LLMs) with AutoGluon’s advanced AutoML features, AG-A delivers highly accurate and competitive ML solutions based solely on the data and a natural language description of the problem.
Join us at NeurIPS 2024 in West Ballroom C of the Vancouver Convention Center on Tuesday, December 10th at 12:00 noon PST.
Schedule
There will be a 5 min QA at the end of each section. A link to the slides will be provided prior to the talk.
| Topic | Speaker | Duration (CST timezone) | Links | Cheatsheet | |
|---|---|---|---|---|---|
| Introduction + AutoGluon Tabular | Nick Erickson | 12:00PM – 12:30PM | slides, tabular tutorial, docs |  |
|
| AutoGluon Assistant | Boran Han | 12:30PM – 12:45PM | slides, AG-A tutorial, docs | ||
| AutoGluon TimeSeries | Abdul Fatir Ansari | 12:45PM – 01:15PM | slides, timeseries quick start, chronos tutorial, docs |  |
|
| AutoGluon Multimodal | Shuai Zhang | 01:15PM – 01:30PM | slides, multimodal tutorial, docs |  |
|
| Additional QA + Feedback | All speakers | TBD |
Section Outline and Materials
AutoGluon Tabular
- AutoML Basics: Discussion of core AutoML principles
- History of competition ML and how it influenced the design of modern AutoML systems
- Discussion of model combination strategies (stacking, bagging, model aggregation)
- Constraint satisfaction and engineering for a performance envelope (accuracy, speed, compute resources)
- Benchmark comparisons showcasing the advancement of AutoML systems in recent years both compared to earlier AutoML systems and human data scientists
- AutoGluon’s performance and adoption on live kaggle competitions in 2024
- New TabPFN-Mix model and parallel model fit support
AutoGluon Assistant
- Overview of AutoGluon Assistant (AG-A) with zero line of code
- Performance of AG-A on Kaggle Competitions
- AG-A design with LLM and AutoGluon
- Installation, Tutorials and Demo of AG-A
AutoGluon TimeSeries
- Introduction to time series forecasting
- Local models, global models and pretrained models
- Discussion on Chronos model
- New Chronos-Bolt model and zero-shot results
- Discussion on how pretrained models like Chronos improve the speed-accuracy Pareto frontier
- Chronos in AutoGluon v1.2: zero-shot inference, fine-tuning and covariates support
AutoGluon Multimodal
- WIP
Hands-on Notebooks
Checkout the AutoGluon Website and get started!