[GitHub] thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm
thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm URL: https://github.com/apache/incubator-mxnet/pull/9420#issuecomment-368721069 @7oud I think 8 is too small for bn, you can try larger bz like 16, 32. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm
thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm URL: https://github.com/apache/incubator-mxnet/pull/9420#issuecomment-368715232 @7oud how about your batch size? bn seems to prefer large batch size. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm
thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm URL: https://github.com/apache/incubator-mxnet/pull/9420#issuecomment-368714220 @tornadomeet Is there a simple way to set all use_global_status=True as finetuning. I know one way is to set use_global_status=True for each bn layer seperately when adding nn.BatchNorm. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm
thbupt commented on issue #9420: add use_global_stats in nn.BatchNorm URL: https://github.com/apache/incubator-mxnet/pull/9420#issuecomment-368417931 @7oud I have the same question. I think use_global_stats=True should be used as you finetune some pretrained model such as ResNet, VGG. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
