/explore
|
You are here 
|
www.jasonwei.net | ||
| | | | |
www.yitay.net
This blog post discusses some cutting edge perspectives on emergent abilities, scaling architectures and large language models. |
|
| | | | | ||
| | | | |
www.alignmentforum.org
On March 29th, DeepMind published a paper, "Training Compute-Optimal Large Language Models", that shows that essentially everyone -- OpenAI, DeepMind... |
|
| | | | | ||
| | | | |
deepmind.google
We ask the question: "What is the optimal model size and number of training tokens for a given compute budget?" To answer this question, we train models of various sizes and with various numbers... |
|
| | | | | ||
| | | | |
www.yitay.net
Releasing the new open source Flan-UL2 20B model. |
|
| | | |||
