AbstractIn this talk, I will give a brief introduction to convergence acceleration algorithms. First, I will provide a concise overview of the research context and the current state of convergence acceleration algorithms. Subsequently, I will present a method known as the kernel methodology for constructing convergence acceleration algorithms, based on which I propose a novel acceleration algor...
AbstractNesterov's accelerated gradient descent (NAG) is one of the milestones in the history of first-order algorithms. Until recently, it was not successfully uncovered by the high-resolution differential equation framework in [Shi et al., 2021] that the mechanism behind the acceleration phenomenon is due to the gradient correction term. Along this way, I present some recent advances about th...