[
https://issues.apache.org/jira/browse/MXNET-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392433#comment-16392433
]
Chris Olivier commented on MXNET-11:
------------------------------------
Currently, it is not possible to create two graphs which share the same
parameters (weights, biases, etc) — without creating two distinct copies of the
parameters — and start running inference on the two graphs in parallel. This is
a common use-case, especially since for many models, we won’t reach 100% CPU
utilization on a single graph.
Currently the only way to accomplish this by forking the process, but that
approach also has a lot of drawbacks, as you can imagine, as isn’t suitable for
most use-cases.
> Multithreaded Inference
> -----------------------
>
> Key: MXNET-11
> URL: https://issues.apache.org/jira/browse/MXNET-11
> Project: Apache MXNet
> Issue Type: Epic
> Components: MXNet Engine
> Reporter: Chris Olivier
> Priority: Major
> Labels: inference
>
> Add the ability to do multithreaded inference without using fork() or using
> multiple copies of a given model
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
