Perceptron Is Not SGD: A Better Interpretation Through Pseudogradients
Author(s): Francesco Orabona, Ph.D. Actual conversation with my wife (Image from xkcd.com) There is a popular interpretation of the Perceptron as a stochastic (sub)gradient descent procedure. I even found slides online with this idea. The thought of so many young minds twisted by these …