CNN Part 6: Transfer Learning

For the sixth reading group on the Stanford University Convolutional Neural Networks class, we went through the following slides:

Take-home message:

  • The middle layers and depth of a CNN is important.
  • Transfer learning is helpful with small to medium datasets.
  • Rule of thumb:
Similar dataset Different dataset
Little data Use Linear Classifier on top layer You’re in trouble…
Try linear classifier from different stages
Lots of data Finetune a few layers Finetune a larger number of layers

Leave a Reply

Your email address will not be published. Required fields are marked *