Explore >> Select a destination

You are here

 hpc-ai.com
Enhanced MoE Parallelism, Open-source MoE Model Training Can Be 9 Times More Efficient
| | pytorch.org
Introducing PyTorch Fully Sharded Data Parallel (FSDP) API | PyTorch
3.0 parsecs away

Travel
| | Recent studies have shown that large model training will be beneficial for improving model quality. During the last 3 years, model size grew 10,000 times from BERT with 110M parameters to Megatron-2 with one trillion. However, training large AI models is not easy-aside from the need for large amounts of computing resources, software engineering complexity is also challenging. PyTorch has been working on building tools and infrastructure to make it easier.
| | torch.ch
Torch | Training and investigating Residual Nets
2.5 parsecs away

Travel
| | Torch is a scientific computing framework for LuaJIT.
| | syncedreview.com
65-Billion-Parameter Large Model Pretraining Accelerated by 38%, Best Practices for Building LLaMA-like Base Models Open-Sour...
3.2 parsecs away

Travel
| | Global technology companies are scrambling to enter the AI large model competition by building models similar to ChatGPT/GPT-4. Consequently, the amount of financing, mergers, and acquisitions obtained by AIGC-related companies has reached record highs. However, an extremely high cost accompanies the skyrocketing popularity of AI models, with a single pre-training typically requiring millions of dollars.
| | web.navan.dev
Creating a Custom Image Classifier using Tensorflow 2.x and Keras for Detecting Malaria
21.6 parsecs away

Travel
| Tutorial on creating an image classifier model using TensorFlow which detects malaria