A novel formulation of orthogonal polynomial kernel functions for SVM classifiers: The Gegenbauer family.

•A novel formulation of orthogonal kernels for SVM classifiers is presented.•The harmful Annihilation and Explosion effects are identified and resolved.•The Gegenbauer family of orthogonal kernels is introduced and evaluated.•Gegenbauer achieves similar accuracy to the RBF kernel and better generalization.