博文

A Further Search About Icing on the Cake

图片
A Further Search About Icing on the Cake 1.Introduction about Icing on the Cake The  paper named   Icing on the Cake: An Easy and Quick Post-Learning Method You Can Try After Deep Learning  ( https://arxiv.org/abs/1807.06540 ) The method named “Icing on the Cake” enhances the accuracies of image classification problems in deep learnings by an easy and quick way. (“Icing on the cake” in the paper is called for short “ICK”) Here is the procedure below: Step-1: Train a deep neural network as usual. Step-2: Extract features from the layer just before the final classifier as estimation. Step-3: Train only the final layer again by the extracted features. Step-4: Put the final classifier back to the original network. It is not very rare that it takes a week or so to train deep neural networks. However, since “Icing on the Cake” is just to train the final layer only, it does not take time. It is done in about five minutes or so. It is really icing on the