2024-10-09-salinas24a.md

title	software	openreview	abstract	layout	series	publisher	issn	id	month	tex_title	firstpage	lastpage	page	order	cycles	bibtex_author	author	date	address	container-title	volume	genre	issued	pdf	extras
TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications	https://github.com/autogluon/tabrepo	03V2bjfsFC	We introduce TabRepo, a new dataset of tabular model evaluations and predictions. TabRepo contains the predictions and metrics of 1206 models evaluated on 200 regression and classification datasets. We illustrate the benefit of our datasets in multiple ways. First, we show that it allows to perform analysis such as comparing Hyperparameter Optimization against current AutoML systems while also considering ensembling at no cost by using precomputed model predictions. Second, we show that our dataset can be readily leveraged to perform transfer-learning. In particular, we show that applying standard transfer-learning techniques allows to outperform current state-of-the-art tabular systems in accuracy, runtime and latency.	inproceedings	Proceedings of Machine Learning Research	PMLR	2640-3498	salinas24a	0	TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications	19/1	30	19/1-30	19	false	Salinas, David and Erickson, Nick	given family David Salinas given family Nick Erickson	2024-10-09		Proceedings of the Third International Conference on Automated Machine Learning	256	inproceedings	date-parts 2024 10 9	https://raw.githubusercontent.com/mlresearch/v256/main/assets/salinas24a/salinas24a.pdf