Outer Web | Explore

/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.

You are here		www.alignmentforum.org New Scaling Laws for Large Language Models - AI Alignment Forum
\|	\|	www.lesswrong.com New Scaling Laws for Large Language Models - LessWrong	0.0 parsecs away Travel
\|	\|	On March 29th, DeepMind published a paper, "Training Compute-Optimal Large Language Models", that shows that essentially everyone -- OpenAI, DeepMind...	0.0 parsecs away Travel
\|	\|	deepmind.google An empirical analysis of compute-optimal large language model training - Google DeepMind	0.9 parsecs away Travel
\|	\|	We ask the question: "What is the optimal model size and number of training tokens for a given compute budget?" To answer this question, we train models of various sizes and with various numbers...	0.9 parsecs away Travel
\|	\|	blog.moonglow.ai Three Kuhnian Revolutions in ML Training	1.9 parsecs away Travel
\|	\|	Parameters and data. These are the two ingredients of training ML models. The total amount of computation ("compute") you need to do to train a model is proportional to the number of parameters multiplied by the amount of data (measured in "tokens"). Four years ago, it was well-known that if	1.9 parsecs away Travel
\|	\|	www.bennadel.com Working Code Podcast - Episode 201: LLM's vs Stack Overflow	21.9 parsecs away Travel
\|		Ben Nadel and the crew talk Large Language Models (LLMs) and their impact on sites like Stack Overflow.	21.9 parsecs away Travel