vdantu commented on issue #14563: Performance decrease with pypi's mxnet==1.4.0 (Mac) URL: https://github.com/apache/incubator-mxnet/issues/14563#issuecomment-507047547 @fhieber : I see this issue persisted with 1.4.0 and 1.4.1. But, 1.5.0 (pre release) seems to have similar performance to 1.3.1 ## 1.5.0 (pre-release) ``` [INFO:sockeye.training] Epoch[0] Batch [600] Speed: 1349.35 samples/sec 13709.44 tokens/sec 84.33 updates/sec perplexity=1.420409 [INFO:sockeye.training] Epoch[1] Batch [650] Speed: 1306.41 samples/sec 13534.45 tokens/sec 81.65 updates/sec perplexity=1.390872 [INFO:sockeye.training] Epoch[1] Batch [700] Speed: 1287.37 samples/sec 12976.67 tokens/sec 80.46 updates/sec perplexity=1.368012 ``` ## 1.3.1 ``` ... [INFO:sockeye.training] Epoch[1] Batch [1050] Speed: 1396.45 samples/sec 14355.49 tokens/sec 87.28 updates/sec perplexity=1.031028 [INFO:sockeye.training] Epoch[1] Batch [1100] Speed: 1576.58 samples/sec 16207.22 tokens/sec 98.54 updates/sec perplexity=1.022231 [INFO:sockeye.training] Epoch[1] Batch [1150] Speed: 1556.92 samples/sec 15880.62 tokens/sec 97.31 updates/sec perplexity=1.026734 [INFO:sockeye.training] Epoch[1] Batch [1200] Speed: 1563.64 samples/sec 15824.06 tokens/sec 97.73 updates/sec perplexity=1.038476 ... ``` ## 1.4.1 ``` ... [INFO:sockeye.training] Epoch[0] Batch [300] Speed: 959.48 samples/sec 9863.49 tokens/sec 59.97 updates/sec perplexity=1.883570 [INFO:sockeye.training] Epoch[0] Batch [350] Speed: 950.11 samples/sec 9691.12 tokens/sec 59.38 updates/sec perplexity=1.747596 [INFO:sockeye.training] Epoch[0] Batch [400] Speed: 937.03 samples/sec 9670.12 tokens/sec 58.56 updates/sec perplexity=1.647115 [INFO:sockeye.training] Epoch[0] Batch [450] Speed: 958.23 samples/sec 9735.66 tokens/sec 59.89 updates/sec perplexity=1.575914 [INFO:sockeye.training] Epoch[0] Batch [500] Speed: 918.91 samples/sec 9446.44 tokens/sec 57.43 updates/sec perplexity=1.512286 ... ``` We can probably close this issue after the release of 1.5.0.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
