Explore >> Select a destination

You are here

 comsci.blog
Transformers Unfolded: A Layered Approach to Implementation | ML and robotics notes
| | teddykoker.com
NLP from Scratch: Annotated Attention | Teddy Koker
2.7 parsecs away

Travel
| | This post is the first in a series of articles about natural language processing (NLP), a subfield of machine learning concerning the interaction between computers and human language. This article will be focused on attention, a mechanism that forms the backbone of many state-of-the art language models, including Googles BERT (Devlin et al., 2018), and OpenAIs GPT-2 (Radford et al., 2019).
| | sigmoidprime.com
Transformer-XL: A Memory-Augmented Transformer
1.3 parsecs away

Travel
| | An exploration of Transformer-XL, a modified Transformer optimized for longer context length.
| | nlp.seas.harvard.edu
The Annotated Transformer
1.7 parsecs away

Travel
| | The Annotated Transformer
| | sebastianraschka.com
Finetuning Large Language Models On A Single GPU Using Gradient Accumulation | Sebastian Raschka, PhD
9.7 parsecs away

Travel
| Previously, I shared an article using multi-GPU training strategies to speed up the finetuning of large language models. Several of these strategies include...