/explore
|
You are here 
|
www.alexirpan.com | ||
| | | | |
evjang.com
This blog post outlines a key engineering principle I've come to believe strongly in for building general AI systems with deep learning. This principle guides my present-day research tastes and day-to-day design choices in building large-scale, general-purpose ML systems. Discoveries around Neural Scaling Laws, unsupervised pretraining on Internet-scale datasets, and other work on Foundation Models have pointed to a simple yet exciting narrative for making progress in Machine Learning: Large amounts of d... |
|
| | | | | ||
| | | | |
gwern.net
On GPT-3: meta-learning, scaling, implications, and deep theory. The scaling hypothesis: neural nets absorb data & compute, generalizing and becoming more Bayesian as problems get harder, manifesting new abilities even at trivial-by-global-standards-scale. The deep learning revolution has begun as foretold. |
|
| | | | | ||
| | | | |
www.lesswrong.com
It'll take until ~2050 to repeat the level of scaling that pretraining compute is experiencing this decade, as increasing funding can't sustain the c... |
|
| | | | | ||
| | | | |
blog.darkwolfsolutions.com
April 19, 2023 Episode 5 The Impact of AI on the IT and Cybersecurity Consulting Industry: Adaptation, Challenges and Opportunities Introduction The rapid development and integration of artificial intelligence (AI) technologies have far-reaching implications for various industries. One sector |
|
| | | |||
