tqchen commented on issue #15465: [RFC] Integrate TVM into Apache MXNet
URL: 
https://github.com/apache/incubator-mxnet/issues/15465#issuecomment-509712700
 
 
   Re: Threadpool
   
   Technically it is easy to drop in openmp as a threadpool backend of TVM. It 
is just not the default one. Historically tvm defaulted to openmp then evolved 
its own version of thread pool for better perf. The current thread pool already 
has accepts the OMP env variable, making it consistent with the omp settings.
   
   Most of the operators touched so far are single threaded so won’t be 
affected by the discussion.
   
   Given the current discussion, we could have the runtime in Mxnet default to 
omp if we see it is necessary, for end to end inference on Embedded devices 
like android, I would still recommend to use tvm’s Threadpool 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to