/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

 theorydish.blog
Backpropagation Chain Rule - Theory Dish
| | newvick.com
Understanding Backpropagation Newvick's blog
5.0 parsecs away

Travel
| | I've been working my way through Andrej Karpathy's 'spelled-out intro to backpropagation', and this post is my recap of how backpropagation works.
| | jingnanshi.com
Automatic Differentiation: Forward and Reverse
3.9 parsecs away

Travel
| | Tutorial on automatic differentiation
| | windowsontheory.org
Yet another backpropagation tutorial - Windows On Theory
1.8 parsecs away

Travel
| | (Updated and expanded 12/17/2021) I am teaching deep learning this week in Harvard's CS 182 (Artificial Intelligence) course. As I'm preparing the back-propagation lecture, Preetum Nakkiran told me about Andrej Karpathy's awesome micrograd package which implements automatic differentiation for scalar variables in very few lines of code. I couldn't resist using this to show how...
| | blog.otoro.net
Neural Network Evolution Playground with Backprop NEAT |
11.5 parsecs away

Travel
| [AI summary] This article describes a project that combines genetic algorithms, NEAT (NeuroEvolution of Augmenting Topologies), and backpropagation to evolve neural networks for classification tasks. The key components include: 1) Using NEAT to evolve neural networks with various activation functions, 2) Applying backpropagation to optimize the weights of these networks, and 3) Visualizing the results of the evolved networks on different datasets (e.g., XOR, two circles, spiral). The project also includes a web-based demo where users can interact with the system, adjust parameters, and observe the evolution process. The author explores how the genetic algorithm can discover useful features (like squaring inputs) without human intervention, and discusses the ...