Outer Web | Explore

/explore

Click through on any links that interest you or select the planets on the right to continue exploring the Outer Web.

You are here		qchu.wordpress.com Gradient descent \| Annoying Precision
\|	\|	dustintran.com Comparing elastic net to stochastic gradient descent for GLMs \| Dustin Tran	5.3 parsecs away Travel
\|	\|	The elastic net [3] provides a regularized objective function that meets a compromise between the two extremes of Lasso [2] and ridge regression. It takes in...	5.3 parsecs away Travel
\|	\|	xcorr.net Adagrad - eliminating learning rates in stochastic gradient descent - xcorr: AI & neuro	4.2 parsecs away Travel
\|	\|	Earlier, I discussed how I had no luck using second-order optimization methods on a convolutional neural net fitting problem, and some of the reasons why stochastic gradient descent works well on this class of problems. Stochastic gradient descent is not a plug-and-play optimization algorithm; it requires messing around with the step size hyperparameter, forcing you...	4.2 parsecs away Travel
\|	\|	fa.bianp.net Hyperparameter optimization with approximate gradient	4.0 parsecs away Travel
\|	\|	MathJax.Hub.Config({ extensions: ["tex2jax.js"], jax: ["input/TeX", "output/HTML-CSS"], tex2jax: { inlineMath: [ ['$','$'], ["\$","\$"] ], displayMath: [ ['$$','$$'], ["\\[","\\]"] ], processEscapes: true }, TeX: { equationNumbers: { autoNumber: "AMS" }, Macros: { RR: "{\\mathbb{R}}", argmin: "{\\mathop{\\mathrm{arg\\,min}}}", bold: ["{\\bf #1}",1] } }, "HTML-CSS": { availableFonts: ["TeX"] } }); TL;DR: I describe a method for hyperparameter optimization by gradient descent. Most machine ...	4.0 parsecs away Travel
\|	\|	swethatanamala.github.io NLP - Summary of Sequence to Sequence with Neural Networks · Swetha's Blog	11.9 parsecs away Travel
\|		The authors developed a straightforward application of the Long Short-Term Memory (LSTM) architecture which can solve English to French translation.	11.9 parsecs away Travel