sandeep-krishnamurthy commented on issue #14977: Add an utility for operator 
benchmarks
URL: https://github.com/apache/incubator-mxnet/pull/14977#issuecomment-494964987
 
 
   > I just had a discussion w/ @sandeep-krishnamurthy and we agreed that: 1. 
the ideal state should be the automated approach that uses the data types from 
op registry to generate default values for performance testing, and also allow 
users to override and test for specific settings. 2. current approach won't 
help towards that goal since the automated approach would render the current 
approach in this PR mostly obsolete.
   
   Also, to clarify, the current approach does not block the evolution of this 
tool towards automated approach. Because, at the end of the day, we still need 
to have utilities to run an operator, capture results, present it in consumable 
format. The way I was seeing it was - when we automate few of the operator 
benchmarks, we just delete them from the current explicit calls till then we 
still have it.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to