HuichuanLiu commented on issue #11149: Unreasonable performance of resnext models provided in model_zoo, evaluated by score.py URL: https://github.com/apache/incubator-mxnet/issues/11149#issuecomment-396106250 1. I used the incubator-mxnet/example/image-classification/score.py, where incubator-mxnet/example/image-classification/common/modelzoo.download_model() is called, with url explicitly given in codes: ``` _base_model_url = 'http://data.mxnet.io/models/' _default_model_info = { 'imagenet1k-inception-bn': {'symbol':_base_model_url+'imagenet/inception-bn/Inception-BN-symbol.json', 'params':_base_model_url+'imagenet/inception-bn/Inception-BN-0126.params'}, 'imagenet1k-resnet-18': {'symbol':_base_model_url+'imagenet/resnet/18-layers/resnet-18-symbol.json', 'params':_base_model_url+'imagenet/resnet/18-layers/resnet-18-0000.params'}, 'imagenet1k-resnet-34': {'symbol':_base_model_url+'imagenet/resnet/34-layers/resnet-34-symbol.json', 'params':_base_model_url+'imagenet/resnet/34-layers/resnet-34-0000.params'}, 'imagenet1k-resnet-50': {'symbol':_base_model_url+'imagenet/resnet/50-layers/resnet-50-symbol.json', 'params':_base_model_url+'imagenet/resnet/50-layers/resnet-50-0000.params'}, 'imagenet1k-resnet-101': {'symbol':_base_model_url+'imagenet/resnet/101-layers/resnet-101-symbol.json', 'params':_base_model_url+'imagenet/resnet/101-layers/resnet-101-0000.params'}, 'imagenet1k-resnet-152': {'symbol':_base_model_url+'imagenet/resnet/152-layers/resnet-152-symbol.json', 'params':_base_model_url+'imagenet/resnet/152-layers/resnet-152-0000.params'}, 'imagenet1k-resnext-50': {'symbol':_base_model_url+'imagenet/resnext/50-layers/resnext-50-symbol.json', 'params':_base_model_url+'imagenet/resnext/50-layers/resnext-50-0000.params'}, 'imagenet1k-resnext-101': {'symbol':_base_model_url+'imagenet/resnext/101-layers/resnext-101-symbol.json', 'params':_base_model_url+'imagenet/resnext/101-layers/resnext-101-0000.params'}, 'imagenet1k-resnext-101-64x4d': {'symbol':_base_model_url+'imagenet/resnext/101-layers/resnext-101-64x4d-symbol.json', 'params':_base_model_url+'imagenet/resnext/101-layers/resnext-101-64x4d-0000.params'}, 'imagenet11k-resnet-152': {'symbol':_base_model_url+'imagenet-11k/resnet-152/resnet-152-symbol.json', 'params':_base_model_url+'imagenet-11k/resnet-152/resnet-152-0000.params'}, 'imagenet11k-place365ch-resnet-152': {'symbol':_base_model_url+'imagenet-11k-place365-ch/resnet-152-symbol.json', 'params':_base_model_url+'imagenet-11k-place365-ch/resnet-152-0000.params'}, 'imagenet11k-place365ch-resnet-50': {'symbol':_base_model_url+'imagenet-11k-place365-ch/resnet-50-symbol.json', 'params':_base_model_url+'imagenet-11k-place365-ch/resnet-50-0000.params'}, } In short, it's http://data.mxnet.io/models/imagenet/resnext/101-layers/resnext-101-64x4d-symbol.json and http://data.mxnet.io/models/imagenet/resnext/101-layers/resnext-101-64x4d-0000.params 2. Also tried to implement gluon from params http://data.dmlc.ml/models/imagenet/resnext/101-layers/resnext-101-64x4d-0000.params and symbo.json http://data.dmlc.ml/models/imagenet/resnext/101-layers/resnext-101-64x4d-symbol.json from the homepage model_zoo, whichi also ended with approximately ~47%. Both converted gluon and the original module. ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services