/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.
You are here

teddykoker.com
| | comsci.blog

In this tutorial, we will implement transformers step-by-step and understand their implementation. There are other great tutorials on the implementation of transformers, but they usually dive into the complex parts too early, like they directly start implementing additional parts like masks and multi-head attention, but it is not very intuitional without first building the core part of the transformers.
2.8 parsecs

Travel
| |
| | sigmoidprime.com

An exploration of Transformer-XL, a modified Transformer optimized for longer context length.
3.0 parsecs

Travel
| |
| | nlp.seas.harvard.edu

The Annotated Transformer
1.7 parsecs

Travel
| |
| | www.danieldjohnson.com

Writeup for my first major machine learning project.
12.0 parsecs

Travel
|