/explore
Category: artificial-intelligence |
|||
| | | | |
ujjwalkarn.me
|
|
| | | | | An Artificial Neural Network (ANN) is acomputational modelthat is inspired by the way biological neuralnetworks inthe human brain process information. Artificial Neural Networks have generated a lot ofexcitement in Machine Learning research and industry, thanks to many breakthrough results in speech recognition, computer vision and text processing. In this blog post we will try to... | |
| | | | |
peterbloem.nl
|
|
| | | | | [AI summary] The text provides an in-depth overview of the Transformer architecture, its evolution, and its applications. It begins by introducing the Transformer as a foundational model for sequence modeling, highlighting its ability to handle long-range dependencies through self-attention mechanisms. The text then explores various extensions and improvements, such as the introduction of positional encodings, the development of models like Transformer-XL and Sparse Transformers to address the quadratic complexity of attention, and the use of techniques like gradient checkpointing and half-precision training to scale up model size. It also discusses the generality of the Transformer, its potential in multi-modal learning, and its future implications across d... | |
| | | | |
hpc-ai.com
|
|
| | | We are delighted to announce a comprehensive upgrade to the ColossalAI-MoE module, which is specifically designed to enhance MoE models. This upgrade aims to assist users in training and deploying expert models efficiently and stably. | ||
Refresh the page to see new links for this category.