Fuzzy hyperparameters update in a second order optimization

arXiv:2403.15416v1 Announce Type: new
Abstract: This research will present a hybrid approach to accelerate convergence in a second order optimization. An online finite difference approximation of the diagonal Hessian matrix will be introduced, along with fuzzy inferencing of several hyperparameters. Competitive results have been achieved

abstract approximation arxiv convergence cs.ai cs.lg difference hybrid hybrid approach inferencing math.oc matrix optimization research results type update will