Kernel and Acquisition Function Setup for Bayesian Optimization of Gradient Boosting Hyperparameters
[ 1 ] Instytut Automatyki, Robotyki i Inżynierii Informatycznej, Wydział Elektryczny, Politechnika Poznańska | [ P ] employee
2018
chapter in monograph / paper
english
- binary classification
- Gradient Boosting
- hyperparameters
- Bayesian Optimization
- Gaussian Process
- kernel function
- acquisition function
- bank credit scoring
EN The application scenario investigated in the paper is the bank credit scoring based on a Gradient Boosting classifier. It is shown how one may exploit hyperparameter optimization based on the Bayesian Optimization paradigm. All the evaluated methods are based on the Gaussian Process model, but differ in terms of the kernel and the acquisition function. The main purpose of the research presented herein is to confirm experimentally that it is reasonable to tune both the kernel function and the acquisition function in order to optimize Bayesian Gradient Boosting hyperparameters. Moreover, the paper provides results indicating that, at least in the investigated application scenario, the superiority of some of the evaluated Bayesian Optimization methods over others strongly depends on the amount of the optimization budget.
14.02.2018
297 - 306
20
WoS (15)