[
https://issues.apache.org/jira/browse/MXNET-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392392#comment-16392392
]
Patric Zhao commented on MXNET-11:
----------------------------------
It's a good idea.
Currently, the most of OP can be executed by multithread. So, I guess the
multithread inference is in the different level, such as model parallel.
[~cjolivier01] , would you mind elaborate? Let me try if anything I can work on
it :)
> Multithreaded Inference
> -----------------------
>
> Key: MXNET-11
> URL: https://issues.apache.org/jira/browse/MXNET-11
> Project: Apache MXNet
> Issue Type: Epic
> Components: MXNet Engine
> Reporter: Chris Olivier
> Priority: Major
> Labels: inference
>
> Add the ability to do multithreaded inference without using fork() or using
> multiple copies of a given model
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]