Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-10 Thread Sheng Zha
nt: Wednesday, April 10, 2019 1:34 PM > To: dev@mxnet.incubator.apache.org > Subject: Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and > memory planning pass > > Agreed with Tianqi that we could have better implementation once we have > better tvm nnvm v2 integ

RE: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-10 Thread Lv, Tao A
why I sent out > > this proposal to get more ideas from the community. > > > > > > -tao > > > > -Original Message- > > From: Skalicky, Sam [mailto:sska...@amazon.com.INVALID] > > Sent: Wednesday, April 10, 2019 2:24 AM > > To: dev@m

Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Junru Shao
r` to a `default` backend on CPU. And I totally > > agree with you that we need think more about the software architecture > for > > maintainability, testability and readability - that's why I sent out this > > proposal to get more ideas from the community. > > > &g

Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Tianqi Chen
cture for > maintainability, testability and readability - that's why I sent out this > proposal to get more ideas from the community. > > > -tao > > -Original Message- > From: Skalicky, Sam [mailto:sska...@amazon.com.INVALID] > Sent: Wednesday, April 10, 2

Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Junru Shao
esday, April 10, 2019 11:03 AM > > To: dev@mxnet.incubator.apache.org > > Subject: RE: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType > and > > memory planning pass > > > > > > Thank you Tianqi and Sam for the kind suggestions. > > >

RE: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Zhao, Patric
ainability, testability and readability - that's why I sent out this > proposal > to get more ideas from the community. > > > -tao > > -Original Message- > From: Skalicky, Sam [mailto:sska...@amazon.com.INVALID] > Sent: Wednesday, April 10, 2019 2:24 AM &

RE: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Lv, Tao A
2019 2:24 AM To: dev@mxnet.incubator.apache.org Subject: Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass I agree with Tianqi. We should let MKLDNN partitipate in memory planning by first having a separate NNVM pass and then using that info in the regular memory

Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Skalicky, Sam
I agree with Tianqi. We should let MKLDNN partitipate in memory planning by first having a separate NNVM pass and then using that info in the regular memory planning phase. Its starting to sound like MKLDNN should be treated like an accelerator rather than an operator library. As it has explici

Re: [MXNET 2.0 Wishlist] [DISCUSS] Refine the InferStorageType and memory planning pass

2019-04-09 Thread Tianqi Chen
The layout transformation should really be a separate optimization pass rather than memory planning. As is done in the TVM stack. If we want to do a clean slate solution, I would recommend looking into that instead. TIanqi On Tue, Apr 9, 2019 at 1:46 AM Lv, Tao A wrote: > > > Hi dev, > > > > As