[ 
https://issues.apache.org/jira/browse/MXNET-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392392#comment-16392392
 ] 

Patric Zhao commented on MXNET-11:
----------------------------------

It's a good idea. 

Currently, the most of OP can be executed by multithread. So, I guess the 
multithread inference is in the different level, such as model parallel.

[~cjolivier01] , would you mind elaborate? Let me try if anything I can work on 
it :)

 

> Multithreaded Inference
> -----------------------
>
>                 Key: MXNET-11
>                 URL: https://issues.apache.org/jira/browse/MXNET-11
>             Project: Apache MXNet
>          Issue Type: Epic
>          Components: MXNet Engine
>            Reporter: Chris Olivier
>            Priority: Major
>              Labels: inference
>
> Add the ability to do multithreaded inference without using fork() or using 
> multiple copies of a given model



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to