Two new decomposition algorithms for training bound-constrained support vector machines
2015
scientific article
english
- decomposition algorithm
- support vector machine
- quadratic programming
- global convergence
EN Bound-constrained Support Vector Machine(SVM) is one of the state-of-art model for binary classification. The decomposition method is currently one of the major methods for training SVMs, especially when the nonlinear kernel is used. In this paper, we proposed two new decomposition algorithms for training bound-constrained SVMs. Projected gradient algorithm and interior point method are combined together to solve the quadratic subproblem efficiently. The main difference between the two algorithms is the way of choosing working set. The first one only uses first order derivative information of the model for simplicity. The second one incorporate part of second order information into the process of working set selection, besides the gradient. Both algorithms are proved to be global convergent in theory. New algorithms is compared with the famous package BSVM. Numerical experiments on several public data sets validate the efficiency of the proposed methods.
67 - 86
CC BY-NC-ND (attribution - noncommercial - no derivatives)
public
15