For the sixth reading group on the Stanford University Convolutional Neural Networks class, we went through the following slides:
- The middle layers and depth of a CNN is important.
- Transfer learning is helpful with small to medium datasets.
- Rule of thumb:
|Similar dataset||Different dataset|
|Little data||Use Linear Classifier on top layer||You’re in trouble…
Try linear classifier from different stages
|Lots of data||Finetune a few layers||Finetune a larger number of layers|