Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/74125
Título: | A Comparison of AutoML Tools for Machine Learning, Deep Learning and XGBoost |
Autor(es): | Ferreira, Luís Pilastri, André Luiz Martins, Carlos Manuel Pires, Pedro Miguel Cortez, Paulo |
Palavras-chave: | Automated Deep Learning (AutoDL) Automated Machine Learning (AutoML) Benchmarking Neural Architecture Search (NAS) Software Supervised Learning Classification Regression |
Data: | Jul-2021 |
Editora: | Institute of Electrical and Electronics Engineers (IEEE) |
Revista: | IEEE International Joint Conference on Neural Networks (IJCNN) |
Citação: | Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2021), paper N-1274, Virtual Event, July, 2021 (8 pages), IEEE, ISBN 978-0-7381-3366-9 |
Resumo(s): | This paper presents a benchmark of supervised Automated Machine Learning (AutoML) tools. Firstly, we an- alyze the characteristics of eight recent open-source AutoML tools (Auto-Keras, Auto-PyTorch, Auto-Sklearn, AutoGluon, H2O AutoML, rminer, TPOT and TransmogrifAI) and describe twelve popular OpenML datasets that were used in the benchmark (divided into regression, binary and multi-class classification tasks). Then, we perform a comparison study with hundreds of computational experiments based on three scenarios: General Machine Learning (GML), Deep Learning (DL) and XGBoost (XGB). To select the best tool, we used a lexicographic approach, considering first the average prediction score for each task and then the computational effort. The best predictive results were achieved for GML, which were further compared with the best OpenML public results. Overall, the best GML AutoML tools obtained competitive results, outperforming the best OpenML models in five datasets. These results confirm the potential of the general-purpose AutoML tools to fully automate the Machine Learning (ML) algorithm selection and tuning. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/74125 |
ISBN: | 978-0-7381-3366-9 |
DOI: | 10.1109/IJCNN52387.2021.9534091 |
ISSN: | 2161-4393 |
Versão da editora: | https://ieeexplore.ieee.org/document/9534091 |
Arbitragem científica: | yes |
Acesso: | Acesso aberto |
Aparece nas coleções: |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
automl_ijcnn.pdf | 217,55 kB | Adobe PDF | Ver/Abrir |
Este trabalho está licenciado sob uma Licença Creative Commons