/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

dustintran.com
| | fa.bianp.net

The Langevin algorithm is a simple and powerful method to sample from a probability distribution. It's a key ingredient of some machine learning methods such as diffusion models and differentially private learning. In this post, I'll derive a simple convergence analysis of this method in the special case when the ...
2.4 parsecs

Travel
| |
| | michael-lewis.com

This is a short summary of some of the terminology used in machine learning, with an emphasis on neural networks. I've put it together primarily to help my own understanding, phrasing it largely in non-mathematical terms. As such it may be of use to others who come from more of a programming than a mathematical background.
2.8 parsecs

Travel
| |
| | bdtechtalks.com

Gradient descent is the main technique for training machine learning and deep learning models. Read all about it.
1.7 parsecs

Travel
| |
| | matt.might.net

[AI summary] This text explains how a single perceptron can learn basic Boolean functions like AND, OR, and NOT, but fails to learn the non-linearly separable XOR function. This limitation led to the development of modern artificial neural networks (ANNs). The transition from single perceptrons to ANNs involves three key changes: 1) Adding multiple layers of perceptrons to create Multilayer Perceptron (MLP) networks, enabling modeling of complex non-linear relationships. 2) Introducing non-linear activation functions like sigmoid, tanh, and ReLU to allow networks to learn non-linear functions. 3) Implementing backpropagation and gradient descent algorithms for efficient training of multilayer networks. These changes allow ANNs to overcome the limitations of ...
8.7 parsecs

Travel
|