Re: New Java Inference API

2018-09-04 Thread Naveen Swamy
this proposal is missing many of the offline discussions that happened and subsequent changes. @andrewfayres: Please update the wiki(may be you forgot to publish the changes) On Tue, Sep 4, 2018 at 11:11 AM Qing Lan wrote: > Hi All, > > Here is an update for the Java Inference API design doc

New Java Inference API

2018-09-04 Thread Qing Lan
Hi All, Here is an update for the Java Inference API design doc on CWIKI: https://cwiki.apache.org/confluence/display/MXNET/MXNet+Java+Inference+API. Currently, MXNet Java bindings is an extension of MXNet Scala API that allow users to use Java to do inference on MXNet. Users will be able to

Re: New Java Inference API

2018-05-10 Thread kellen sunderland
Hey Andrew, thanks for the write-up. I think having a Java binding will be very useful for enterprise users. Doc looks good but two things I'm curious about: How are you planning to handle thread safe inference? It'll be great if you can hide the complexity of dealing with dispatch threading

New Java Inference API

2018-05-09 Thread Andrew Ayres
Hi all, There has been a lot of interest expressed in having a Java API for doing inference. The general idea is that after training a model using python, users would like to be able to load the model for inference inside their existing production eco-system. We've begun exploring a few options