Perceptron Is Not SGD: A Better Interpretation Through Pseudogradients
Author(s):ย Francesco Orabona, Ph.D. Actual conversation with my wife (Image fromย xkcd.com) There is a popular interpretation of the Perceptron as a stochastic (sub)gradient descent procedure. I even found slides online with this idea. The thought of so many young minds twisted by these …