Maxima vs Minima and Global vs Local in Machine learning

Maxima vs Minima and Global vs Local in Machine learning

Maxima vs Minima and Global vs Local in Machine learning   You might have heard or read the statement that goes something like “The algorithm might get stuck at one of the local minima and not converge to the global minimum”. But what exactly does it mean? I’ll explain the concept of maxima, minima, local and global. Additionally I’ll be covering how calculus makes it possible to identify these points. I’ll explain the concepts for functions of single variable because they are easy to visualize. However, they extend to multivariate cases. Let us start with a few definitions.   Global Maximum:…