fedorzh commented on issue #9185: Gluon provided ResNet does not get desirable accuracy on CIFAR10 URL: https://github.com/apache/incubator-mxnet/issues/9185#issuecomment-357390658 Here is the command I used to train ResNet from tornadomeet: `python -u train_resnet.py --data-dir data/cifar10 --data-type cifar10 --depth 20 --batch-size 64 --num-examples 50000 --gpus=0` If you dig into the code, you can see that for this configuration, the model is not very deep. Moreover, besides horizontal flip and pad=4 with fill, there is no data augmentation (and you do mean and other normalization). This model after 10 epochs achieves accuracy of ~80% (I omit batch-level lines) and with 100 iterations gets much further: ``` INFO:root:Epoch[10] Resetting Data Iterator INFO:root:Epoch[10] Time cost=24.303 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0011.params" INFO:root:Epoch[10] Validation-accuracy=0.825040 INFO:root:Epoch[10] Validation-cross-entropy=0.515972 INFO:root:Epoch[11] Resetting Data Iterator INFO:root:Epoch[11] Time cost=24.302 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0012.params" INFO:root:Epoch[11] Validation-accuracy=0.814988 INFO:root:Epoch[11] Validation-cross-entropy=0.543225 INFO:root:Epoch[12] Resetting Data Iterator INFO:root:Epoch[12] Time cost=24.323 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0013.params" INFO:root:Epoch[12] Validation-accuracy=0.802946 INFO:root:Epoch[12] Validation-cross-entropy=0.599473 INFO:root:Epoch[13] Resetting Data Iterator INFO:root:Epoch[13] Time cost=24.274 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0014.params" INFO:root:Epoch[13] Validation-accuracy=0.791003 INFO:root:Epoch[13] Validation-cross-entropy=0.622668 INFO:root:Epoch[14] Resetting Data Iterator INFO:root:Epoch[14] Time cost=24.259 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0015.params" INFO:root:Epoch[14] Validation-accuracy=0.835888 INFO:root:Epoch[14] Validation-cross-entropy=0.491702 INFO:root:Epoch[15] Resetting Data Iterator INFO:root:Epoch[15] Time cost=24.292 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0016.params" INFO:root:Epoch[15] Validation-accuracy=0.817974 INFO:root:Epoch[15] Validation-cross-entropy=0.576660 INFO:root:Epoch[16] Resetting Data Iterator INFO:root:Epoch[16] Time cost=24.292 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0017.params" INFO:root:Epoch[16] Validation-accuracy=0.826035 INFO:root:Epoch[16] Validation-cross-entropy=0.509782 INFO:root:Epoch[17] Resetting Data Iterator INFO:root:Epoch[17] Time cost=24.290 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0018.params" INFO:root:Epoch[17] Validation-accuracy=0.809315 INFO:root:Epoch[17] Validation-cross-entropy=0.580771 INFO:root:Epoch[18] Resetting Data Iterator INFO:root:Epoch[18] Time cost=24.304 INFO:root:Saved checkpoint to "model/resnet-cifar10-20-0-0019.params" INFO:root:Epoch[18] Validation-accuracy=0.830016 INFO:root:Epoch[18] Validation-cross-entropy=0.522997 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
