Explore >> Select a destination

You are here

 sefiks.com
Softplus as a Neural Networks Activation Function - Sefik Ilkin Serengil
| | tylerneylon.com
A Visual Exploration of Random Neural Networks
11.7 parsecs away

Travel
| |
| | serengil.wordpress.com
Sigmoid Function as Neural Network Activation Function - Sefik Ilkin Serengil
2.8 parsecs away

Travel
| | Sigmoid function (aka logistic function) is moslty picked up as activation functionin neural networks.Because its derivative is easy to demonstrate. It produces output in scale of [0 ,1] whereas input is meaningful between [-5, +5]. Out of this range produces same outputs.In this post, we'll mention the proof of the derivative calculation. Sigmoid function is...
| | sander.ai
Slides for my talk at the Deep Learning London meetup - Sander Dieleman
11.4 parsecs away

Travel
| | Slides for my talk at the Deep Learning London meetup
| | bdtechtalks.com
Machine learning: What is the transformer architecture? - TechTalks
73.5 parsecs away

Travel
| The transformer model has become one of the main highlights of advances in deep learning and deep neural networks.