Re: Proposal for subgraph based the graph optimization and quantization

2018-10-15 Thread kellen sunderland
Nice Patric, thanks for the effort.  2x faster on mobilenet is a great
result.

On Mon, Oct 15, 2018, 7:37 AM Zhao, Patric  wrote:

> Updates for this proposal:
>
> The most important step (op fusion and quantization) of this proposal is
> merged into master.
>
> We're very happy that this is the first backend enabled by subgraph
> features and the CPU performance are significantly improved, such as 2X
> boosts for MobileNet.
>
> Next step, we will update the doc/examples and continuously improve the
> performance and usability for MKL-DNN backend.
>
> Very thanks the great supports from Haibin, Sheng, Jun, Da and other
> reviewers.
>
> Highly appreciate for your comments and feedbacks :)
>
> The doc for your refer (doc is under the review):
>
> https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6
>
>
> https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md
>
>
> Thanks,
>
> --Patric
>
>
> > -Original Message-
> > From: Zhao, Patric [mailto:patric.z...@intel.com]
> > Sent: Thursday, October 4, 2018 6:57 AM
> > To: 'dev@mxnet.incubator.apache.org' 
> > Cc: 'Zheng, Da' ; 'Jun Wu' ; Ye,
> > Jason Y ; Lin, Haibin 
> > Subject: RE: Proposal for subgraph based the graph optimization and
> > quantization
> >
> > Sent again and our PR are submitted (in 22 days ago).
> >
> > Please help take a review in case you're interested in :)
> > https://github.com/apache/incubator-mxnet/pull/12530
> >
> > Thanks the great suggestions from Jun, Da, Haibin and other committers.
> >
> > BR,
> >
> > --Patric
> >
> >
> > From: Zhao, Patric
> > Sent: Wednesday, August 15, 2018 10:51 AM
> > To: dev@mxnet.incubator.apache.org
> > Cc: Zheng, Da ; Jun Wu ; Ye,
> > Jason Y 
> > Subject: Proposal for subgraph based the graph optimization and
> > quantization
> >
> > Hi MXNet owners and committers,
> >
> > A new proposal is posted in the wiki for the graph optimization and
> > quantization approach.
> > https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat
> > ion+and+Quantization+based+on+subgraph+and+MKL-DNN
> >
> > Really thanks for the supports from Zheng Da and Wu Jun.
> >
> > Any feedbacks are highly appreciated :)
> >
> > BR,
> >
> > --Patric
>


RE: Proposal for subgraph based the graph optimization and quantization

2018-10-14 Thread Zhao, Patric
Updates for this proposal:

The most important step (op fusion and quantization) of this proposal is merged 
into master. 

We're very happy that this is the first backend enabled by subgraph features 
and the CPU performance are significantly improved, such as 2X boosts for 
MobileNet. 

Next step, we will update the doc/examples and continuously improve the 
performance and usability for MKL-DNN backend.

Very thanks the great supports from Haibin, Sheng, Jun, Da and other reviewers.

Highly appreciate for your comments and feedbacks :)

The doc for your refer (doc is under the review): 
https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6

https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md


Thanks,

--Patric


> -Original Message-
> From: Zhao, Patric [mailto:patric.z...@intel.com]
> Sent: Thursday, October 4, 2018 6:57 AM
> To: 'dev@mxnet.incubator.apache.org' 
> Cc: 'Zheng, Da' ; 'Jun Wu' ; Ye,
> Jason Y ; Lin, Haibin 
> Subject: RE: Proposal for subgraph based the graph optimization and
> quantization
> 
> Sent again and our PR are submitted (in 22 days ago).
> 
> Please help take a review in case you're interested in :)
> https://github.com/apache/incubator-mxnet/pull/12530
> 
> Thanks the great suggestions from Jun, Da, Haibin and other committers.
> 
> BR,
> 
> --Patric
> 
> 
> From: Zhao, Patric
> Sent: Wednesday, August 15, 2018 10:51 AM
> To: dev@mxnet.incubator.apache.org
> Cc: Zheng, Da ; Jun Wu ; Ye,
> Jason Y 
> Subject: Proposal for subgraph based the graph optimization and
> quantization
> 
> Hi MXNet owners and committers,
> 
> A new proposal is posted in the wiki for the graph optimization and
> quantization approach.
> https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat
> ion+and+Quantization+based+on+subgraph+and+MKL-DNN
> 
> Really thanks for the supports from Zheng Da and Wu Jun.
> 
> Any feedbacks are highly appreciated :)
> 
> BR,
> 
> --Patric


RE: Proposal for subgraph based the graph optimization and quantization

2018-10-03 Thread Zhao, Patric
Sent again and our PR are submitted (in 22 days ago).

Please help take a review in case you're interested in :)
https://github.com/apache/incubator-mxnet/pull/12530

Thanks the great suggestions from Jun, Da, Haibin and other committers.

BR,

--Patric


From: Zhao, Patric
Sent: Wednesday, August 15, 2018 10:51 AM
To: dev@mxnet.incubator.apache.org
Cc: Zheng, Da ; Jun Wu ; Ye, Jason Y 

Subject: Proposal for subgraph based the graph optimization and quantization

Hi MXNet owners and committers,

A new proposal is posted in the wiki for the graph optimization and 
quantization approach.
https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimization+and+Quantization+based+on+subgraph+and+MKL-DNN

Really thanks for the supports from Zheng Da and Wu Jun.

Any feedbacks are highly appreciated :)

BR,

--Patric