ThomasDelteil commented on issue #10817: Static memory allocation for cached_op
URL: https://github.com/apache/incubator-mxnet/pull/10817#issuecomment-396701926
 
 
   @piiswrong I have mixed results with this PR. Did you benchmark your code?
   I am running this notebook: 
https://github.com/ilkarman/DeepLearningFrameworks/blob/master/notebooks/Gluon_MultiGPU.ipynb
   
   It is DenseNet121 running on multilabel classification task on multigpu. 
Batches are fixed shapes (N, 3, 224, 224)
   
   Here are my results:
   - baseline:
   `static_shape=False, static_alloc=False `-> **8min28**
   
   - Supposedly most optimized, is slowest by far
   `static_shape=True, static_alloc=True` -> **9min32**
   
   - only static_alloc, ~speed slightly faster but within normal variations
   `static_shape=False, static_alloc=True` -> **8min25**
   
   - only static_shape, based on docs this shouldn't be possible because:
   ```
               Must also
               set static_alloc to True. Change of input shapes is still allowed
               but slower. 
   ```
   No warning or error was thrown. ~speed slightly faster and outside of normal 
variations.
   `static_shape=True, static_alloc=False` -> **8min23**
   
   
   @marcoabreu 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to