Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Posts

Good Initialization for Alternating Minimization

2 minute read

Published: October 26, 2018

This short post is on the importance of having proper initialization while using alternating minimization for two variables, such that the objective function under consideration is convex in each variable individually but not jointly convex with respect to both the variables.

Extreme Value Theory (EVT) for Limiting Distributions of Extreme Events

2 minute read

Published: October 04, 2018

This short post contains a few references for the relatively unknown (in my opinion) EVT among people who aren’t statisticians but use it heavily (such as in machine learning).

Recent Advances in Non-Convex Optimization for Deep Learning

8 minute read

Published: September 15, 2018

This post contains a summary of recent advances in non-convex optimization in deep learning, discussing about the optimality of local minima for several models, the issue of saddle points and modifications to stochastic gradient descent which are robust to saddle points.

Theoretical Research in Deep Learning

6 minute read

Published: September 12, 2018

This post contains some guidelines (gathered from self experience and also from some highly experienced people) for doing theoretical research in deep learning (and machine learning in general), strictly for newbies!