ThomasDelteil commented on issue #10817: Static memory allocation for cached_op
   @piiswrong I have mixed results with this PR. Did you benchmark your code?
   I am running this notebook:
   It is DenseNet121 running on multilabel classification task on multigpu. 
Batches are fixed shapes (N, 3, 224, 224)
   Here are my results:
   - baseline:
   `static_shape=False, static_alloc=False `-> **8min28**
   - Supposedly most optimized, is slowest by far
   `static_shape=True, static_alloc=True` -> **9min32**
   - only static_alloc, ~speed slightly faster but within normal variations
   `static_shape=False, static_alloc=True` -> **8min25**
   - only static_shape, based on docs this shouldn't be possible because:
               Must also
               set static_alloc to True. Change of input shapes is still allowed
               but slower. 
   No warning or error was thrown. ~speed slightly faster and outside of normal 
   `static_shape=True, static_alloc=False` -> **8min23**

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

Reply via email to