Abstract
One of the core objectives of machine learning is to learn useful represen- tations. A simple idea that has not been explored in many fields is to train representation-learning functions to maximize mutual information between its inputs and outputs. This idea is powerful because it enables learning features in an unsupervised manner. Unsupervised learning is extremely important in tasks w…