All posts by mpcousineau

CNN Part 2: Optimization and Backpropagation

For the second reading group on the Stanford University Convolutional Neural Networks class, we went through the following slides:

Take-home message:

In practice, use rectified linear or maxout activation functions, which are both piecewise linear. The bigger the network, the better, but regularization might be required.

CNN Part 1: Linear Classification

For this first reading group on the Stanford University Convolutional Neural Networks class, we went through the following slides:

Take-home message:

There are two loss functions commonly used: the softmax and the SVM. In order to optimize the weights and train effectively, we will want to minimize the chosen loss function during training.

planes

Image Representation

Introduction by Zhiming:

Because we will take the CNN course from Stanford University, this reading group will only focus on the shallow image representation, not the deep learning part. The goal of this reading group is to understand the basic idea about Bag of Words, how to import the spatial information to BoW, some advanced encoding methods (VLAD, Improved Fisher Vector), and some SVM kernels.
Continue reading Image Representation

roc_pr_space

Understanding the ROC and PR spaces

Introduction by SĂ©bastien:

For this first reading group, I propose to go to the basics. The objective is to be able to read ROC and PR plots in order to interpret them correctly. There a thousands of papers about the evaluation of classifiers. It would be impossible to have all the knowledge in a single reading group, so I decided to focus on classifiers with two classes, and putting the emphasis mostly on the signification of the points in these spaces, and also on what can arrive to the classifiers they represent if they are combined or tuned. Curves are also a little bit addressed. The distribution of the readings I propose is the following. I only selected papers published after the year 2000. Moreover, most of the selected papers have been cited nearly one thousand times.
Continue reading Understanding the ROC and PR spaces