Re: Request for comments - Keras-MXNet as submodule in MXNet

[Yao Wang]

-1 Creating Keras as submodule of MXNet will provide users a feeling that
MXNet depends on Keras. Keras is a frontend library which can be supported
by various different backend framework. It would be better to add backend
framework as Keras's submodule(Keras depends on MXNet) rather than opposite.

Best,
Yao

2018-03-23 11:44 GMT-07:00 Xingjian SHI :

> -1. I think we should wait until it's merged into keras-team/keras. The
> repo is still not mature enough.
>
>
> Best,
>
> Xingjian
>
>
> 
> From: sandeep krishnamurthy 
> Sent: Friday, March 23, 2018 1:49 PM
> To: dev@mxnet.incubator.apache.org
> Subject: Request for comments - Keras-MXNet as submodule in MXNet
>
> Hello MXNet Community,
>
> Along with Lai, Karan and other MXNet contributors, I am working on adding
> MXNet backend for Keras. Currently supporting around ~70% of Keras APIs
> across CNNs and RNNs.
> https://github.com/deep-learning-tools/keras/tree/keras2_mxnet_backend
> [https://avatars0.githubusercontent.com/u/32447491?s=400=4] github.com/deep-learning-tools/keras/tree/keras2_mxnet_backend>
>
> deep-learning-tools/keras tools/keras/tree/keras2_mxnet_backend>
> github.com
> keras - Deep Learning library for Python. Runs on TensorFlow, Theano, or
> CNTK.
>
>
>
>
> We wanted to gather the community feedback on the proposal for including
> this keras-mxnet package as a submodule in Apache MXNet. This will enable
> providing the Keras interface for MXNet users. MXNet users can choose Keras
> interface for building their Neural Networks in Symbolic Mode (Ex:
> mx.keras).
>
> *Advantages:*
>
> 1. Keras is widely popular interface that many DL practitioners are
> familiar. By including keras interface within MXNet natively, we enable
> many users to use MXNet with 0 learning curve.
>
> 2.  Adding as submodule and exposing natively within MXNet pip package,
> would greatly enhance user experience and get more users as compared to
> releasing a fork repository independently.
>
> 3. Why submodule? - Helps in easily managing with patching the latest
> parent keras-team/keras developments and releases. Thereby helping us
> provide users the core keras experience. Operational management.
>
> 4. Other minor advantages - Operational maintenance, pip, CI and quality
> control.
>
> Please do share your comments on the proposal.
>
> Best,
> Sandeep
>
> *Note: *We tried merging with keras-team/keras and we created a PR
>  as well. However, due to
> multiple design incompatibility challenges, we need significant re-work on
> MXNet Module, KVStore, Optimizers to address keras-team design concerns.
> Since, we are adhering to keras API interface exposed to users, we are
> planning release on the forked repo for now. More details on the design
> challenges and workaround tried -
> https://docs.google.com/document/d/1Vn5ip5MzCKcN29KCCnwjB2d59y-
> VevdLrdn_eNd3nE4/edit?usp=sharing
>

Re: Broken Links in Documentation

[Yao Wang]

For the torch links, all torch supports have been removed in this PR:
https://github.com/apache/incubator-mxnet/pull/9072/files
It might because the master is not rebuilt.

2018-01-16 10:53 GMT-08:00 santhosh karuhatty :

> Hello All,
>
> I need help for these 2 broken links.
>
>1. Need the right link locations for the torch_function and torch_module
>below.
>
>  URL -  https://mxnet.incubator.apache.org/versions/master/
> how_to/torch.html
>
>  Broken Links
>
> ─ https://github.com/dmlc/mxnet/blob/master/example/torch/
> torch_function.py
> (HTTP_404)
>
> ─ https://github.com/dmlc/mxnet/blob/master/example/torch/torch_module.py
> (HTTP_404)
>
>
> 2. The edu link below is not available. Need to fix the verbiage and the
> reference link to the right one.
>
>  URL -
> https://mxnet.incubator.apache.org/api/python/
> optimization/optimization.html
>
>   Broken Links
>
> ─ *http://cs229.stanford.edu/proj2015/054_report.pdf*
>  (HTTP_404)
>
>
>
> Owners for the above sections, please take a look and fix them.
>
>
> Thanks,
>
>
> -Santhosh
>

Data Pipeline Intermediate Representation in MXNet/NNVM

[Yao Wang]

Hi,

Tensorflow has a transform package
https://github.com/tensorflow/transform which
is capable of export a data preprocessing pipeline to a tensorflow graph,
which can be incorporated into network graph. This package provides a neat
way to manage data pipeline together with network graph, since these data
process graph can be easily reused by other developers. Also I think we can
get some performance improvement by using computation graph for data
process rather than imperative processing for large data stream?

Currently in MXNet, if I want to do the similar thing, I need to pack the
code(most time python script) directly with network graph files. This
method has some issues:
1. Potential security issue. If I wrote the processing codes and I am the
only person use it, it's fine. However, if someone else wants to reuse it
in their application, they need to check the code to make sure there is no
security issue. It is not quite portable for reusing.

2. It is bind to specific language. Usually it's easier to develop deep
learning application using python, but if my production environment doesn't
have python environment, I need to either setup python environment or
rewrite this script with the language supported by my production
environment.

Any thought about supporting data pipeline IR in MXNet/NNVM?

Data Pipeline Intermediate Representation in MXNet/NNVM

[Yao Wang]

Hi,

Tensorflow has a transform package https://github.com/tensorflow/transform
which is capable of export a data preprocessing pipeline to a tensorflow
graph, which can be incorporated into network graph. This package provides
a neat way to manage data pipeline together with network graph, since these
data process graph can be easily reused by other developers. Also I think
we can get some performance improvement by using computation graph for data
process rather than imperative processing for large data stream?

Currently in MXNet, if I want to do the similar thing, I need to pack the
code(most time python script) directly with network graph files. This
method has some issues:
1. Potential security issue. If I wrote the processing codes and I am the
only person use it, it's fine. However, if someone else wants to reuse it
in their application, they need to check the code to make sure there is no
security issue. It is not quite portable for reusing.

2. It is bind to specific language. Usually it's easier to develop deep
learning application using python, but if my production environment doesn't
have python environment, I need to either setup python environment or
rewrite this script with the language supported by my production
environment.

Any thought about supporting data pipeline IR in MXNet/NNVM?

Re: MXNet site questions

[Yao Wang]

I just talked with apache guy to enable github issue. For apache
information on the website, currently we have apache incubator disclaimer
on as home page footer. Also we’ll have source package, PGP, SHA and MD5
links to apache pages. Would you like to add anything here?



> We need to ask Apache infrastructure team about GitHub issue and website
> permission.
> Currently most images on website are stored under dmlc/web-data repo and a
> few on data.mxnet.io. Also need to ask apache if we want to move them to
> somewhere apache controls. Maybe another repo similar to web-data to store
> all website related static resources.
>
> 2017-08-25 19:26 GMT-07:00 Henri Yandell  >:
>
>> * Could Issues be turned on for the site so we can report site issues?
>> * How does one go about getting permission to the site?
>> * Apache footer needed (Copyright/trademarks statement)
>> * Need to add some links to Apache pages (Foundation page, Sponsors,
>> ApacheCon jump to mind)
>> * The logo is being pulled from mxnet.io
>>
>
>

Re: MXNet site questions

[Yao Wang]

We need to ask Apache infrastructure team about GitHub issue and website
permission.
Currently most images on website are stored under dmlc/web-data repo and a
few on data.mxnet.io. Also need to ask apache if we want to move them to
somewhere apache controls. Maybe another repo similar to web-data to store
all website related static resources.

2017-08-25 19:26 GMT-07:00 Henri Yandell :

> * Could Issues be turned on for the site so we can report site issues?
> * How does one go about getting permission to the site?
> * Apache footer needed (Copyright/trademarks statement)
> * Need to add some links to Apache pages (Foundation page, Sponsors,
> ApacheCon jump to mind)
> * The logo is being pulled from mxnet.io
>