Outer Web | Explore

/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.

You are here		simonwillison.net Could you train a ChatGPT-beating model for $85,000 and run it in a browser?
\|	\|	deepmind.google An empirical analysis of compute-optimal large language model training - Google DeepMind	1.2 parsecs away Travel
\|	\|	We ask the question: "What is the optimal model size and number of training tokens for a given compute budget?" To answer this question, we train models of various sizes and with various numbers...	1.2 parsecs away Travel
\|	\|	blog.moonglow.ai Three Kuhnian Revolutions in ML Training	1.8 parsecs away Travel
\|	\|	Parameters and data. These are the two ingredients of training ML models. The total amount of computation ("compute") you need to do to train a model is proportional to the number of parameters multiplied by the amount of data (measured in "tokens"). Four years ago, it was well-known that if	1.8 parsecs away Travel
\|	\|	www.danieldemmel.me What are Large Language Models and how to run open ones on your device	1.8 parsecs away Travel
\|	\|	Part two of the series Building applications using embeddings vector search and Large Language Models	1.8 parsecs away Travel
\|	\|	bryanbrattlof.com You, Me & Machines... Learning « Bryan Brattlof	11.2 parsecs away Travel
\|		Developing our first neural network with Keras	11.2 parsecs away Travel