Little experiment to understand how different optimizers behave in various valleys during gradient descent. created the complete visualization .(from scratch, JS) • 5 classic surfaces (bowl, saddle, Himmelblau, Rosenbrock, wavy) • 4 optimizers from scratch: SGD, Momentum, RMSProp, Adam • “Optimizer race” 4 balls descending the same surface at once • All math verified (39 tests), no ML libraries Try it: https://ajithpinninti.github.io/gradient-descent-visualizer/ Video explanation: https://distilbook.com/share/c46a0854 Source: https://github.com/ajithpinninti/gradient-descent-visualizer submitted by /u/ajithpinninti
Originally posted by u/ajithpinninti on r/ArtificialInteligence
You must log in or # to comment.