Explore >> Select a destination
|
You are here 
|
transformer-circuits.pub | ||
| | | | |
goodfire.ai
|
|
| | | | | Goodfire is an AI research company building practical interpretability tools for safe and reliable generative models. | |
| | | | |
haifengl.wordpress.com
|
|
| | | | | Generative artificial intelligence (GenAI), especially ChatGPT, captures everyone's attention. The transformerbased large language models (LLMs), trained on a vast quantity of unlabeled data at scale, demonstrate the ability to generalize to many different tasks. To understand why LLMs are so powerful, we will deep dive into how they work in this post. LLM Evolutionary Tree... | |
| | | | |
thesephist.com
|
|
| | | | | [AI summary] The text provides an in-depth overview of research on sparse autoencoders (SAEs) applied to embeddings for automated interpretability. It discusses methods for analyzing and manipulating embeddings, including feature extraction, gradient-based optimization, and visualization tools. The work emphasizes the importance of understanding model representations to improve human-computer interaction with information systems. Key components include: 1) Automated interpretability prompts for generating feature labels, 2) Feature gradients implementation for optimizing embeddings to match desired feature dictionaries, and 3) Visualizations of feature spaces and embedding transformations. The text also includes FAQs addressing the use of embeddings over lan... | |
| | | | |
iamtrask.github.io
|
|
| | | A machine learning craftsmanship blog. | ||
