Re: Proposal for subgraph based the graph optimization and quantization
Nice Patric, thanks for the effort. 2x faster on mobilenet is a great result. On Mon, Oct 15, 2018, 7:37 AM Zhao, Patric wrote: > Updates for this proposal: > > The most important step (op fusion and quantization) of this proposal is > merged into master. > > We're very happy that this is the first backend enabled by subgraph > features and the CPU performance are significantly improved, such as 2X > boosts for MobileNet. > > Next step, we will update the doc/examples and continuously improve the > performance and usability for MKL-DNN backend. > > Very thanks the great supports from Haibin, Sheng, Jun, Da and other > reviewers. > > Highly appreciate for your comments and feedbacks :) > > The doc for your refer (doc is under the review): > > https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6 > > > https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md > > > Thanks, > > --Patric > > > > -Original Message- > > From: Zhao, Patric [mailto:patric.z...@intel.com] > > Sent: Thursday, October 4, 2018 6:57 AM > > To: 'dev@mxnet.incubator.apache.org' > > Cc: 'Zheng, Da' ; 'Jun Wu' ; Ye, > > Jason Y ; Lin, Haibin > > Subject: RE: Proposal for subgraph based the graph optimization and > > quantization > > > > Sent again and our PR are submitted (in 22 days ago). > > > > Please help take a review in case you're interested in :) > > https://github.com/apache/incubator-mxnet/pull/12530 > > > > Thanks the great suggestions from Jun, Da, Haibin and other committers. > > > > BR, > > > > --Patric > > > > > > From: Zhao, Patric > > Sent: Wednesday, August 15, 2018 10:51 AM > > To: dev@mxnet.incubator.apache.org > > Cc: Zheng, Da ; Jun Wu ; Ye, > > Jason Y > > Subject: Proposal for subgraph based the graph optimization and > > quantization > > > > Hi MXNet owners and committers, > > > > A new proposal is posted in the wiki for the graph optimization and > > quantization approach. > > https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat > > ion+and+Quantization+based+on+subgraph+and+MKL-DNN > > > > Really thanks for the supports from Zheng Da and Wu Jun. > > > > Any feedbacks are highly appreciated :) > > > > BR, > > > > --Patric >
RE: Proposal for subgraph based the graph optimization and quantization
Updates for this proposal: The most important step (op fusion and quantization) of this proposal is merged into master. We're very happy that this is the first backend enabled by subgraph features and the CPU performance are significantly improved, such as 2X boosts for MobileNet. Next step, we will update the doc/examples and continuously improve the performance and usability for MKL-DNN backend. Very thanks the great supports from Haibin, Sheng, Jun, Da and other reviewers. Highly appreciate for your comments and feedbacks :) The doc for your refer (doc is under the review): https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6 https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md Thanks, --Patric > -Original Message- > From: Zhao, Patric [mailto:patric.z...@intel.com] > Sent: Thursday, October 4, 2018 6:57 AM > To: 'dev@mxnet.incubator.apache.org' > Cc: 'Zheng, Da' ; 'Jun Wu' ; Ye, > Jason Y ; Lin, Haibin > Subject: RE: Proposal for subgraph based the graph optimization and > quantization > > Sent again and our PR are submitted (in 22 days ago). > > Please help take a review in case you're interested in :) > https://github.com/apache/incubator-mxnet/pull/12530 > > Thanks the great suggestions from Jun, Da, Haibin and other committers. > > BR, > > --Patric > > > From: Zhao, Patric > Sent: Wednesday, August 15, 2018 10:51 AM > To: dev@mxnet.incubator.apache.org > Cc: Zheng, Da ; Jun Wu ; Ye, > Jason Y > Subject: Proposal for subgraph based the graph optimization and > quantization > > Hi MXNet owners and committers, > > A new proposal is posted in the wiki for the graph optimization and > quantization approach. > https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat > ion+and+Quantization+based+on+subgraph+and+MKL-DNN > > Really thanks for the supports from Zheng Da and Wu Jun. > > Any feedbacks are highly appreciated :) > > BR, > > --Patric
RE: Proposal for subgraph based the graph optimization and quantization
Sent again and our PR are submitted (in 22 days ago). Please help take a review in case you're interested in :) https://github.com/apache/incubator-mxnet/pull/12530 Thanks the great suggestions from Jun, Da, Haibin and other committers. BR, --Patric From: Zhao, Patric Sent: Wednesday, August 15, 2018 10:51 AM To: dev@mxnet.incubator.apache.org Cc: Zheng, Da ; Jun Wu ; Ye, Jason Y Subject: Proposal for subgraph based the graph optimization and quantization Hi MXNet owners and committers, A new proposal is posted in the wiki for the graph optimization and quantization approach. https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimization+and+Quantization+based+on+subgraph+and+MKL-DNN Really thanks for the supports from Zheng Da and Wu Jun. Any feedbacks are highly appreciated :) BR, --Patric
Proposal for subgraph based the graph optimization and quantization
Hi MXNet owners and committers, A new proposal is posted in the wiki for the graph optimization and quantization approach. https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimization+and+Quantization+based+on+subgraph+and+MKL-DNN Really thanks for the supports from Zheng Da and Wu Jun. Any feedbacks are highly appreciated :) BR, --Patric