|
You are here |
marc-b-reynolds.github.io | ||
| | | | |
fa.bianp.net
|
|
| | | | | The Langevin algorithm is a simple and powerful method to sample from a probability distribution. It's a key ingredient of some machine learning methods such as diffusion models and differentially private learning. In this post, I'll derive a simple convergence analysis of this method in the special case when the ... | |
| | | | |
tomhazledine.com
|
|
| | | | | When working with LLM embeddings, it is often important to be able to compare them. Cosine similarity is the recommended way to do this. | |
| | | | |
peterbloem.nl
|
|
| | | | | [AI summary] The pseudo-inverse is a powerful tool for solving matrix equations, especially when the inverse does not exist. It provides exact solutions when they exist and least squares solutions otherwise. If multiple solutions exist, it selects the one with the smallest norm. The pseudo-inverse can be computed using the singular value decomposition (SVD), which is numerically stable and handles cases where the matrix does not have full column rank. The SVD approach involves computing the SVD of the matrix, inverting the non-zero singular values, and then reconstructing the pseudo-inverse using the modified SVD components. This method is preferred due to its stability and ability to handle noisy data effectively. | |
| | | | |
blog.scottlogic.com
|
|
| | | Recently I've been learning about Neural Networks and how they work. In this blog post I write a simple introduction in to some of the core concepts of a basic layered neural network. | ||