Re: [RESULT][LAZY VOTE] Next MXNet release

2018-11-06 Thread Sheng Zha
I'd like to propose that we expedite the 1.4.0 release slightly as there
doesn't seem to be a rule that prevents a minor release from happening at
the same time of a patch release. This would shorten the time it takes for
new features to reach users. Proposed revision to the timeline:
- Code freeze: 11/9
- Release published: 11/22

If there's no issue about both the proposal and new timeline, I'd be happy
to manage 1.4.0 release as release manager.

-sz

On Thu, Nov 1, 2018 at 7:56 AM Steffen Rochel 
wrote:

> There have been no objections, so lazy vote passed.
> Anton volunteered to manage the 1.3.1 release and Naveen will support him
> as co-manager to handle the release tasks requiring committer powers.
> Please support Anton for a smooth 1.3.1 release process.
>
> I'm still looking for volunteers to manage / co-manage the 1.4.0 release.
>
> Regards,
> Steffen
>
> On Sun, Oct 28, 2018 at 7:33 PM Steffen Rochel 
> wrote:
>
> > I calling a lazy vote to release MXNet
> > 1.3.1 (patch release) and 1.4.0 (minor relase).
> >
> > Release content: release proposal page
> > <
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
> >
> >
> > Target milestones:
> > *1.3.1*
> >
> >- Code Freeze: 10/31
> >- Release published: 11/13
> >
> > *1.4.0:*
> >
> >- Code Freeze: 11/13
> >- Release published: 12/13 (if possible announce during NIPS)
> >
> >
> > The vote will be open until Wednesday October 31, 2018 8.00pm PDT.
> >
> > Regards,
> > Steffen
> >
> > On Fri, Oct 26, 2018 at 7:56 AM Steffen Rochel 
> > wrote:
> >
> >> During the Hangout on Wednesday multiple release proposals have been
> >> discussed. I summarized discussion here
> >> <
> https://cwiki.apache.org/confluence/display/MXNET/Hangout+October+24th+2018+8am+and+5pm+PDT>
> and
> >> updated the release proposal page
> >> <
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
> >
> >> .
> >> Please review, provide feedback and propose changes.
> >> I plan to start a lazy vote on Sunday regarding the release proposal.
> >>
> >> Calling for volunteers to manage the 1.3.1 and 1.4.0 release.
> >>
> >> Regards,
> >> Steffen
> >>
> >> On Tue, Oct 9, 2018 at 7:20 AM kellen sunderland <
> >> kellen.sunderl...@gmail.com> wrote:
> >>
> >>> Hey Steffen,
> >>>
> >>> Recommend these be merged into patch release:
> >>>
> >>> https://github.com/apache/incubator-mxnet/pull/12631
> >>> https://github.com/apache/incubator-mxnet/pull/12603
> >>> https://github.com/apache/incubator-mxnet/pull/12499
> >>>
> >>> -Kellen
> >>>
> >>> On Tue, Oct 2, 2018 at 7:17 AM Zhao, Patric 
> >>> wrote:
> >>>
> >>> > Thanks to let us know this discussion.
> >>> > Because we don't have enough bandwidth to track the different
> sources,
> >>> > like discussion forum.
> >>> >
> >>> > I think the best way is to open issue in the github so that we can
> >>> > answer/solve the issue in time :)
> >>> >
> >>> > Thanks,
> >>> >
> >>> > --Patric
> >>> >
> >>> > > -Original Message-
> >>> > > From: Afrooze, Sina [mailto:sina@gmail.com]
> >>> > > Sent: Tuesday, October 2, 2018 1:14 AM
> >>> > > To: dev@mxnet.incubator.apache.org
> >>> > > Cc: Ye, Jason Y ; Zai, Alexander
> >>> > > ; Zheng, Da 
> >>> > > Subject: Re: [Discuss] Next MXNet release
> >>> > >
> >>> > > This post suggests there is a regression from 1.1.0 to 1.2.1
> related
> >>> to
> >>> > > MKLDNN integration:
> >>> https://discuss.mxnet.io/t/mxnet-1-2-1-module-get-
> >>> > > outputs/1882
> >>> > >
> >>> > > The error is related to MKLDNN layout not being converted back to
> >>> MXNet
> >>> > > layout in some operator: " !IsMKLDNNData() We can’t generate TBlob
> >>> for
> >>> > > MKLDNN data. Please use Reorder2Default() to generate a new NDArray
> >>> > > first"
> >>> > >
> >>> > > Sina
> >>> > >
> >>> > >
> >>> > >
> >>> > >
> >>> > > On 9/30/18, 6:55 PM, "Steffen Rochel" 
> >>> wrote:
> >>> > >
> >>> > > Thanks Patrick.
> >>> > > Updated roadmap and next release content.
> >>> > >
> >>> > > Patrick - suggest to send a reminder to review the design doc
> and
> >>> > collect
> >>> > > feedback.
> >>> > > Are there still known issues or gaps before we declare MKL-DNN
> >>> > > integration
> >>> > > as GA?
> >>> > >
> >>> > > Regards,
> >>> > > Steffen
> >>> > >
> >>> > > On Sat, Sep 29, 2018 at 1:31 AM Zhao, Patric <
> >>> patric.z...@intel.com>
> >>> > > wrote:
> >>> > >
> >>> > > > Thanks, Steffen.
> >>> > > >
> >>> > > > Regarding the next release note, two items from our side:
> >>> > > >
> >>> > > > 1. (-remove) MKL-DNN integration is done. I think we can
> remove
> >>> > this
> >>> > > item.
> >>> > > > 2. (+add) MKL-DNN based graph optimization and quantization
> by
> >>> > > subgraph
> >>> > > > Design doc:
> >>> > > >
> >>> > >
> >>> https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimiz
> >>> > > ation+and+Quantization+based+on+subgraph+and+M

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Sheng Zha
Similar to the two PRs that Haibin suggested, 12992 introduces new interface 
for controlling determinism, which is better suited for minor release.

I think other than lack of release manager to drive 1.4.0 release, there’s no 
reason we cannot do two releases (1.4.0 & 1.3.1) at the same time. I’m willing 
to help with the 1.4.0 release to make these new features available one month 
sooner, if there’s no other concern.

-sz

> On Nov 6, 2018, at 3:30 PM, Lin Yuan  wrote:
> 
> Hi Anton,
> 
> Thanks for helping the release.
> The following PRs are needed by customers who want to use deterministic
> CUDNN convolution algorithms:
> 
> https://github.com/apache/incubator-mxnet/pull/12992
> https://github.com/apache/incubator-mxnet/pull/13049
> 
> Thanks!
> 
> Lin
> 
> 
> On Tue, Nov 6, 2018 at 1:51 PM Aaron Markham 
> wrote:
> 
>> Hi Anton,
>> I have the following suggestions for fixes to include in 1.3.1. These each
>> have updates to files that will impact docs generation for the 1.3.x
>> version of the website's Python API docs:
>> 
>> https://github.com/apache/incubator-mxnet/pull/12879
>> https://github.com/apache/incubator-mxnet/pull/12871
>> https://github.com/apache/incubator-mxnet/pull/12856
>> 
>> Thanks,
>> Aaron
>> 
>>> On Tue, Nov 6, 2018 at 1:29 PM Lai Wei  wrote:
>>> 
>>> Hi Anton,
>>> 
>>> Thanks for driving this, I would like to include the following fix in
>>> 1.3.1:
>>> Allow infer shape partial on foreach operator:
>>> https://github.com/apache/incubator-mxnet/pull/12471
>>> 
>>> Keras-MXNet needs this functionality to infer shape partially
>>> on foreach operator. (Used in RNN operators)
>>> 
>>> Thanks a lot!
>>> 
>>> 
>>> Best Regards
>>> Lai Wei
>>> 
>>> 
>>> 
>>> On Tue, Nov 6, 2018 at 10:44 AM Haibin Lin 
>>> wrote:
>>> 
 Hi Naveen and Anton,
 
 Thanks for pointing that out. You are right that these are not critical
 fixes. Putting them in 1.4.0 is more appropriate. PRs are closed.
 
 Best,
 Haibin
 
 On Tue, Nov 6, 2018 at 7:35 AM Naveen Swamy 
>> wrote:
 
> Please note that this is a patch release(1.3.1) to address critical
 bugs!,
> For everything else please wait for 1.4.0 which is planned very
>> shortly
> after 1.3.1
> 
>> On Nov 6, 2018, at 7:17 AM, Anton Chernov 
>>> wrote:
>> 
>> The following PR's have been created so far:
>> 
>> Infer dtype in SymbolBlock import from input symbol (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13117
>> 
>> [MXNET-953] Fix oob memory read (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13118
>> 
>> [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13119
>> 
>> [MXNET-922] Fix memleak in profiler (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13120
>> 
>> Set correct update on kvstore flag in dist_device_sync mode
>> (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13121
>> 
>> update mshadow (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13122
>> 
>> CudnnFind() usage improvements (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13123
>> 
>> Fix lazy record io when used with dataloader and multi_worker > 0
> (v1.3.x)
>> https://github.com/apache/incubator-mxnet/pull/13124
>> 
>> 
>> As stated previously I would be rather opposed to have following
>> PR's
 it
> in
>> the patch release:
>> 
>> Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
>> https://github.com/apache/incubator-mxnet/pull/13129
>> 
>> sample_like operators (#13034) v1.3.x
>> https://github.com/apache/incubator-mxnet/pull/13130
>> 
>> 
>> Best
>> Anton
>> 
>> вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
>> 
>>> Hi Haibin,
>>> 
>>> I have a few comments regarding the proposed performance
>> improvement
>>> changes.
>>> 
>>> CUDNN support for LSTM with projection & clipping
>>> https://github.com/apache/incubator-mxnet/pull/13056
>>> 
>>> There is no doubt that this change brings value, but I don't see
>> it
 as a
>>> critical bug fix. I would rather leave it for the next major
>>> release.
>>> 
>>> sample_like operators
>>> https://github.com/apache/incubator-mxnet/pull/13034
>>> 
>>> Even if it's related to performance, this is an addition of
> functionality
>>> and I would also push this to be in the next major release only.
>>> 
>>> 
>>> Best
>>> Anton
>>> 
>>> 
>>> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
>>> 
 Hi Patric,
 
 This change was listed in the 'PR candidates suggested for
> consideration
 for v1.3.1 patch release' section [1].
 
 You are right, I also think that this is not a critical hotfix
>>> change
 that should be included in

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Lin Yuan
Hi Anton,

Thanks for helping the release.
The following PRs are needed by customers who want to use deterministic
CUDNN convolution algorithms:

https://github.com/apache/incubator-mxnet/pull/12992
https://github.com/apache/incubator-mxnet/pull/13049

Thanks!

Lin


On Tue, Nov 6, 2018 at 1:51 PM Aaron Markham 
wrote:

> Hi Anton,
> I have the following suggestions for fixes to include in 1.3.1. These each
> have updates to files that will impact docs generation for the 1.3.x
> version of the website's Python API docs:
>
> https://github.com/apache/incubator-mxnet/pull/12879
> https://github.com/apache/incubator-mxnet/pull/12871
> https://github.com/apache/incubator-mxnet/pull/12856
>
> Thanks,
> Aaron
>
> On Tue, Nov 6, 2018 at 1:29 PM Lai Wei  wrote:
>
> > Hi Anton,
> >
> > Thanks for driving this, I would like to include the following fix in
> > 1.3.1:
> > Allow infer shape partial on foreach operator:
> > https://github.com/apache/incubator-mxnet/pull/12471
> >
> > Keras-MXNet needs this functionality to infer shape partially
> > on foreach operator. (Used in RNN operators)
> >
> > Thanks a lot!
> >
> >
> > Best Regards
> > Lai Wei
> >
> >
> >
> > On Tue, Nov 6, 2018 at 10:44 AM Haibin Lin 
> > wrote:
> >
> > > Hi Naveen and Anton,
> > >
> > > Thanks for pointing that out. You are right that these are not critical
> > > fixes. Putting them in 1.4.0 is more appropriate. PRs are closed.
> > >
> > > Best,
> > > Haibin
> > >
> > > On Tue, Nov 6, 2018 at 7:35 AM Naveen Swamy 
> wrote:
> > >
> > > > Please note that this is a patch release(1.3.1) to address critical
> > > bugs!,
> > > > For everything else please wait for 1.4.0 which is planned very
> shortly
> > > > after 1.3.1
> > > >
> > > > > On Nov 6, 2018, at 7:17 AM, Anton Chernov 
> > wrote:
> > > > >
> > > > > The following PR's have been created so far:
> > > > >
> > > > > Infer dtype in SymbolBlock import from input symbol (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13117
> > > > >
> > > > > [MXNET-953] Fix oob memory read (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13118
> > > > >
> > > > > [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13119
> > > > >
> > > > > [MXNET-922] Fix memleak in profiler (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13120
> > > > >
> > > > > Set correct update on kvstore flag in dist_device_sync mode
> (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13121
> > > > >
> > > > > update mshadow (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13122
> > > > >
> > > > > CudnnFind() usage improvements (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13123
> > > > >
> > > > > Fix lazy record io when used with dataloader and multi_worker > 0
> > > > (v1.3.x)
> > > > > https://github.com/apache/incubator-mxnet/pull/13124
> > > > >
> > > > >
> > > > > As stated previously I would be rather opposed to have following
> PR's
> > > it
> > > > in
> > > > > the patch release:
> > > > >
> > > > > Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
> > > > > https://github.com/apache/incubator-mxnet/pull/13129
> > > > >
> > > > > sample_like operators (#13034) v1.3.x
> > > > > https://github.com/apache/incubator-mxnet/pull/13130
> > > > >
> > > > >
> > > > > Best
> > > > > Anton
> > > > >
> > > > > вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
> > > > >
> > > > >> Hi Haibin,
> > > > >>
> > > > >> I have a few comments regarding the proposed performance
> improvement
> > > > >> changes.
> > > > >>
> > > > >> CUDNN support for LSTM with projection & clipping
> > > > >> https://github.com/apache/incubator-mxnet/pull/13056
> > > > >>
> > > > >> There is no doubt that this change brings value, but I don't see
> it
> > > as a
> > > > >> critical bug fix. I would rather leave it for the next major
> > release.
> > > > >>
> > > > >> sample_like operators
> > > > >> https://github.com/apache/incubator-mxnet/pull/13034
> > > > >>
> > > > >> Even if it's related to performance, this is an addition of
> > > > functionality
> > > > >> and I would also push this to be in the next major release only.
> > > > >>
> > > > >>
> > > > >> Best
> > > > >> Anton
> > > > >>
> > > > >>
> > > > >> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
> > > > >>
> > > > >>> Hi Patric,
> > > > >>>
> > > > >>> This change was listed in the 'PR candidates suggested for
> > > > consideration
> > > > >>> for v1.3.1 patch release' section [1].
> > > > >>>
> > > > >>> You are right, I also think that this is not a critical hotfix
> > change
> > > > >>> that should be included into the 1.3.1 patch release.
> > > > >>>
> > > > >>> Thus I'm not making any further efforts to bring it in.
> > > > >>>
> > > > >>> Best
> > > > >>> Anton
> > > > >>>
> > > > >>> [1]
> > > > >>>
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
> > > > >>

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Aaron Markham
Hi Anton,
I have the following suggestions for fixes to include in 1.3.1. These each
have updates to files that will impact docs generation for the 1.3.x
version of the website's Python API docs:

https://github.com/apache/incubator-mxnet/pull/12879
https://github.com/apache/incubator-mxnet/pull/12871
https://github.com/apache/incubator-mxnet/pull/12856

Thanks,
Aaron

On Tue, Nov 6, 2018 at 1:29 PM Lai Wei  wrote:

> Hi Anton,
>
> Thanks for driving this, I would like to include the following fix in
> 1.3.1:
> Allow infer shape partial on foreach operator:
> https://github.com/apache/incubator-mxnet/pull/12471
>
> Keras-MXNet needs this functionality to infer shape partially
> on foreach operator. (Used in RNN operators)
>
> Thanks a lot!
>
>
> Best Regards
> Lai Wei
>
>
>
> On Tue, Nov 6, 2018 at 10:44 AM Haibin Lin 
> wrote:
>
> > Hi Naveen and Anton,
> >
> > Thanks for pointing that out. You are right that these are not critical
> > fixes. Putting them in 1.4.0 is more appropriate. PRs are closed.
> >
> > Best,
> > Haibin
> >
> > On Tue, Nov 6, 2018 at 7:35 AM Naveen Swamy  wrote:
> >
> > > Please note that this is a patch release(1.3.1) to address critical
> > bugs!,
> > > For everything else please wait for 1.4.0 which is planned very shortly
> > > after 1.3.1
> > >
> > > > On Nov 6, 2018, at 7:17 AM, Anton Chernov 
> wrote:
> > > >
> > > > The following PR's have been created so far:
> > > >
> > > > Infer dtype in SymbolBlock import from input symbol (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13117
> > > >
> > > > [MXNET-953] Fix oob memory read (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13118
> > > >
> > > > [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13119
> > > >
> > > > [MXNET-922] Fix memleak in profiler (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13120
> > > >
> > > > Set correct update on kvstore flag in dist_device_sync mode (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13121
> > > >
> > > > update mshadow (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13122
> > > >
> > > > CudnnFind() usage improvements (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13123
> > > >
> > > > Fix lazy record io when used with dataloader and multi_worker > 0
> > > (v1.3.x)
> > > > https://github.com/apache/incubator-mxnet/pull/13124
> > > >
> > > >
> > > > As stated previously I would be rather opposed to have following PR's
> > it
> > > in
> > > > the patch release:
> > > >
> > > > Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
> > > > https://github.com/apache/incubator-mxnet/pull/13129
> > > >
> > > > sample_like operators (#13034) v1.3.x
> > > > https://github.com/apache/incubator-mxnet/pull/13130
> > > >
> > > >
> > > > Best
> > > > Anton
> > > >
> > > > вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
> > > >
> > > >> Hi Haibin,
> > > >>
> > > >> I have a few comments regarding the proposed performance improvement
> > > >> changes.
> > > >>
> > > >> CUDNN support for LSTM with projection & clipping
> > > >> https://github.com/apache/incubator-mxnet/pull/13056
> > > >>
> > > >> There is no doubt that this change brings value, but I don't see it
> > as a
> > > >> critical bug fix. I would rather leave it for the next major
> release.
> > > >>
> > > >> sample_like operators
> > > >> https://github.com/apache/incubator-mxnet/pull/13034
> > > >>
> > > >> Even if it's related to performance, this is an addition of
> > > functionality
> > > >> and I would also push this to be in the next major release only.
> > > >>
> > > >>
> > > >> Best
> > > >> Anton
> > > >>
> > > >>
> > > >> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
> > > >>
> > > >>> Hi Patric,
> > > >>>
> > > >>> This change was listed in the 'PR candidates suggested for
> > > consideration
> > > >>> for v1.3.1 patch release' section [1].
> > > >>>
> > > >>> You are right, I also think that this is not a critical hotfix
> change
> > > >>> that should be included into the 1.3.1 patch release.
> > > >>>
> > > >>> Thus I'm not making any further efforts to bring it in.
> > > >>>
> > > >>> Best
> > > >>> Anton
> > > >>>
> > > >>> [1]
> > > >>>
> > >
> >
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
> > > >>>
> > > >>>
> > > >>> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
> > > >>>
> > >  Hi Anton,
> > > 
> > >  Thanks for looking into the MKL-DNN PR.
> > > 
> > >  As my understanding of cwiki (
> > > 
> > >
> >
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
> > >  ),
> > >  these features will go into 1.4 rather than patch release of
> 1.3.1.
> > > 
> > >  Feel free to correct me :)
> > > 
> > >  Thanks,
> > > 
> > >  --Patric
> > > 
> > > > -Original Message-
> > > > From: Anton Chernov [mailto:mech

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Lai Wei
Hi Anton,

Thanks for driving this, I would like to include the following fix in
1.3.1:
Allow infer shape partial on foreach operator:
https://github.com/apache/incubator-mxnet/pull/12471

Keras-MXNet needs this functionality to infer shape partially
on foreach operator. (Used in RNN operators)

Thanks a lot!


Best Regards
Lai Wei



On Tue, Nov 6, 2018 at 10:44 AM Haibin Lin  wrote:

> Hi Naveen and Anton,
>
> Thanks for pointing that out. You are right that these are not critical
> fixes. Putting them in 1.4.0 is more appropriate. PRs are closed.
>
> Best,
> Haibin
>
> On Tue, Nov 6, 2018 at 7:35 AM Naveen Swamy  wrote:
>
> > Please note that this is a patch release(1.3.1) to address critical
> bugs!,
> > For everything else please wait for 1.4.0 which is planned very shortly
> > after 1.3.1
> >
> > > On Nov 6, 2018, at 7:17 AM, Anton Chernov  wrote:
> > >
> > > The following PR's have been created so far:
> > >
> > > Infer dtype in SymbolBlock import from input symbol (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13117
> > >
> > > [MXNET-953] Fix oob memory read (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13118
> > >
> > > [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13119
> > >
> > > [MXNET-922] Fix memleak in profiler (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13120
> > >
> > > Set correct update on kvstore flag in dist_device_sync mode (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13121
> > >
> > > update mshadow (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13122
> > >
> > > CudnnFind() usage improvements (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13123
> > >
> > > Fix lazy record io when used with dataloader and multi_worker > 0
> > (v1.3.x)
> > > https://github.com/apache/incubator-mxnet/pull/13124
> > >
> > >
> > > As stated previously I would be rather opposed to have following PR's
> it
> > in
> > > the patch release:
> > >
> > > Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
> > > https://github.com/apache/incubator-mxnet/pull/13129
> > >
> > > sample_like operators (#13034) v1.3.x
> > > https://github.com/apache/incubator-mxnet/pull/13130
> > >
> > >
> > > Best
> > > Anton
> > >
> > > вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
> > >
> > >> Hi Haibin,
> > >>
> > >> I have a few comments regarding the proposed performance improvement
> > >> changes.
> > >>
> > >> CUDNN support for LSTM with projection & clipping
> > >> https://github.com/apache/incubator-mxnet/pull/13056
> > >>
> > >> There is no doubt that this change brings value, but I don't see it
> as a
> > >> critical bug fix. I would rather leave it for the next major release.
> > >>
> > >> sample_like operators
> > >> https://github.com/apache/incubator-mxnet/pull/13034
> > >>
> > >> Even if it's related to performance, this is an addition of
> > functionality
> > >> and I would also push this to be in the next major release only.
> > >>
> > >>
> > >> Best
> > >> Anton
> > >>
> > >>
> > >> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
> > >>
> > >>> Hi Patric,
> > >>>
> > >>> This change was listed in the 'PR candidates suggested for
> > consideration
> > >>> for v1.3.1 patch release' section [1].
> > >>>
> > >>> You are right, I also think that this is not a critical hotfix change
> > >>> that should be included into the 1.3.1 patch release.
> > >>>
> > >>> Thus I'm not making any further efforts to bring it in.
> > >>>
> > >>> Best
> > >>> Anton
> > >>>
> > >>> [1]
> > >>>
> >
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
> > >>>
> > >>>
> > >>> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
> > >>>
> >  Hi Anton,
> > 
> >  Thanks for looking into the MKL-DNN PR.
> > 
> >  As my understanding of cwiki (
> > 
> >
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
> >  ),
> >  these features will go into 1.4 rather than patch release of 1.3.1.
> > 
> >  Feel free to correct me :)
> > 
> >  Thanks,
> > 
> >  --Patric
> > 
> > > -Original Message-
> > > From: Anton Chernov [mailto:mecher...@gmail.com]
> > > Sent: Tuesday, November 6, 2018 3:11 AM
> > > To: d...@mxnet.apache.org
> > > Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1
> > patch
> > > release
> > >
> > > It seems that there is a problem porting following changes to the
> >  v1.3.x
> > > release branch:
> > >
> > > Implement mkldnn convolution fusion and quantization
> > > https://github.com/apache/incubator-mxnet/pull/12530
> > >
> > > MKL-DNN Quantization Examples and README
> > > https://github.com/apache/incubator-mxnet/pull/12808
> > >
> > > The bases are different.
> > >
> > > I would need help from authors of these changes to make a backpo

Re: [DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread Lin Yuan
Kellen and Pedro,

Thanks for your pointers. I am not an expert in CI but one naive speedup I
can see is that if the PR only contains *.md file, then skip the build and
testing cycles. This can make documentation/correction easier and save
computation resource for other needed tests. Any side effect there?

Thanks,

Lin


Re: [DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread kellen sunderland
There's some documentation summarizing what we've discussed in the past on
this site:
https://cwiki.apache.org/confluence/display/MXNET/CI+Runtime+Improvements

On Tue, Nov 6, 2018 at 10:56 AM Pedro Larroy 
wrote:

> It has been raised but there are practical complications about introducing
> an additional layer of logic for skipping CI in some scenarios.
>
> How many of these PRs do we have which will justify investing human effort
> on optimizing an automated process?
> How much effort shall it be dedicated to this logic that can be invested
> somewhere else?
>
> If you have a proposal, you are welcome to explain.
>
> Pedro.
>
> On Tue, Nov 6, 2018 at 7:09 PM Lin Yuan  wrote:
>
> > Dear Community,
> >
> > I recently submitted a few small PRs with only changes in README files.
> > However, I noticed they still triggered the full cycle of CI including
> > build and test on all platforms.
> >
> > Do we have a plan to speed up this process, maybe skipping non-code
> related
> > PRs in CI? Sorry, if this topic has been raised earlier and if not I
> > appreciate any comments.
> >
> > Cheers,
> >
> > Lin
> >
>


Re: [DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread Pedro Larroy
It has been raised but there are practical complications about introducing
an additional layer of logic for skipping CI in some scenarios.

How many of these PRs do we have which will justify investing human effort
on optimizing an automated process?
How much effort shall it be dedicated to this logic that can be invested
somewhere else?

If you have a proposal, you are welcome to explain.

Pedro.

On Tue, Nov 6, 2018 at 7:09 PM Lin Yuan  wrote:

> Dear Community,
>
> I recently submitted a few small PRs with only changes in README files.
> However, I noticed they still triggered the full cycle of CI including
> build and test on all platforms.
>
> Do we have a plan to speed up this process, maybe skipping non-code related
> PRs in CI? Sorry, if this topic has been raised earlier and if not I
> appreciate any comments.
>
> Cheers,
>
> Lin
>


Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Haibin Lin
Hi Naveen and Anton,

Thanks for pointing that out. You are right that these are not critical
fixes. Putting them in 1.4.0 is more appropriate. PRs are closed.

Best,
Haibin

On Tue, Nov 6, 2018 at 7:35 AM Naveen Swamy  wrote:

> Please note that this is a patch release(1.3.1) to address critical bugs!,
> For everything else please wait for 1.4.0 which is planned very shortly
> after 1.3.1
>
> > On Nov 6, 2018, at 7:17 AM, Anton Chernov  wrote:
> >
> > The following PR's have been created so far:
> >
> > Infer dtype in SymbolBlock import from input symbol (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13117
> >
> > [MXNET-953] Fix oob memory read (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13118
> >
> > [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13119
> >
> > [MXNET-922] Fix memleak in profiler (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13120
> >
> > Set correct update on kvstore flag in dist_device_sync mode (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13121
> >
> > update mshadow (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13122
> >
> > CudnnFind() usage improvements (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13123
> >
> > Fix lazy record io when used with dataloader and multi_worker > 0
> (v1.3.x)
> > https://github.com/apache/incubator-mxnet/pull/13124
> >
> >
> > As stated previously I would be rather opposed to have following PR's it
> in
> > the patch release:
> >
> > Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
> > https://github.com/apache/incubator-mxnet/pull/13129
> >
> > sample_like operators (#13034) v1.3.x
> > https://github.com/apache/incubator-mxnet/pull/13130
> >
> >
> > Best
> > Anton
> >
> > вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
> >
> >> Hi Haibin,
> >>
> >> I have a few comments regarding the proposed performance improvement
> >> changes.
> >>
> >> CUDNN support for LSTM with projection & clipping
> >> https://github.com/apache/incubator-mxnet/pull/13056
> >>
> >> There is no doubt that this change brings value, but I don't see it as a
> >> critical bug fix. I would rather leave it for the next major release.
> >>
> >> sample_like operators
> >> https://github.com/apache/incubator-mxnet/pull/13034
> >>
> >> Even if it's related to performance, this is an addition of
> functionality
> >> and I would also push this to be in the next major release only.
> >>
> >>
> >> Best
> >> Anton
> >>
> >>
> >> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
> >>
> >>> Hi Patric,
> >>>
> >>> This change was listed in the 'PR candidates suggested for
> consideration
> >>> for v1.3.1 patch release' section [1].
> >>>
> >>> You are right, I also think that this is not a critical hotfix change
> >>> that should be included into the 1.3.1 patch release.
> >>>
> >>> Thus I'm not making any further efforts to bring it in.
> >>>
> >>> Best
> >>> Anton
> >>>
> >>> [1]
> >>>
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
> >>>
> >>>
> >>> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
> >>>
>  Hi Anton,
> 
>  Thanks for looking into the MKL-DNN PR.
> 
>  As my understanding of cwiki (
> 
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
>  ),
>  these features will go into 1.4 rather than patch release of 1.3.1.
> 
>  Feel free to correct me :)
> 
>  Thanks,
> 
>  --Patric
> 
> > -Original Message-
> > From: Anton Chernov [mailto:mecher...@gmail.com]
> > Sent: Tuesday, November 6, 2018 3:11 AM
> > To: d...@mxnet.apache.org
> > Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1
> patch
> > release
> >
> > It seems that there is a problem porting following changes to the
>  v1.3.x
> > release branch:
> >
> > Implement mkldnn convolution fusion and quantization
> > https://github.com/apache/incubator-mxnet/pull/12530
> >
> > MKL-DNN Quantization Examples and README
> > https://github.com/apache/incubator-mxnet/pull/12808
> >
> > The bases are different.
> >
> > I would need help from authors of these changes to make a backport
> PR.
> >
> > @ZhennanQin, @xinyu-intel would you be able to assist me and create
> the
> > corresponding PR's?
> >
> > Without proper history and domain knowledge I would not be able to
>  create
> > them by my own in reasonable amount of time, I'm afraid.
> >
> > Best regards,
> > Anton
> >
> > пн, 5 нояб. 2018 г. в 19:45, Anton Chernov :
> >
> >>
> >> As part of:
> >>
> >> Implement mkldnn convolution fusion and quantization
> >> https://github.com/apache/incubator-mxnet/pull/12530
> >>
> >> I propose to add the examples and documentation PR as well:
> >>
> >> MKL-DNN Quantization

Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-11-06 Thread Marco de Abreu
Hi,

the PR has just been merged. Thank you, Sheng! Travis is now only running
compilation on Travis for Mac OS X and we are no longer running tests.

The issue to track this case is available at [1].

Best regards,
Marco

[1]: https://github.com/apache/incubator-mxnet/issues/13136

On Tue, Nov 6, 2018 at 4:46 PM kellen sunderland <
kellen.sunderl...@gmail.com> wrote:

> Looks good to me.  Sorry this couldn't work out for the community.
>
> On Tue, Nov 6, 2018, 7:24 AM Marco de Abreu
> 
> > Hello,
> >
> > the PR is available at
> > https://github.com/apache/incubator-mxnet/pull/13137.
> > I'd appreciate a review and merge.
> >
> > Best regards,
> > Marco
> >
> > On Tue, Nov 6, 2018 at 12:01 AM Marco de Abreu <
> > marco.g.ab...@googlemail.com>
> > wrote:
> >
> > > Sorry, wrong link. The right link is:
> > > https://issues.apache.org/jira/browse/INFRA-17216
> > >
> > > -Marco
> > >
> > > On Mon, Nov 5, 2018 at 11:59 PM Marco de Abreu <
> > > marco.g.ab...@googlemail.com> wrote:
> > >
> > >> Hello,
> > >>
> > >> thanks everybody for taking part in this experiment around Travis CI.
> > >> Unfortunately, our concerns about the stability of Travis were
> confirmed
> > >> and the number of timeouts has increased since we added Python CPU
> > tests.
> > >>
> > >> While the tests are marked as non-blocking, they confuse an increasing
> > >> number of users and make them concerned that they might have made a
> > >> breaking change in their contribution.
> > >>
> > >> I'm currently in discussion with Apache Infra to improve this
> situation
> > >> [1], but as an immediate action to improve the user experience, I
> would
> > >> like to propose the reduction of the executed workload on Travis by
> > rolling
> > >> back to the previous state which does not run Python CPU tests. There
> > have
> > >> been discussions around excluding certain long-running tests, but I'm
> > >> afraid that assessing the tests and adding proper filtering could take
> > some
> > >> time. Instead, I would like to go back to only running compilation
> > until we
> > >> found a long-term solution.
> > >>
> > >> We have been receiving requests from other contributors who would like
> > to
> > >> add more workload to the Travis CI. Thus, I think that we should work
> > on a
> > >> long-term solution to resolve these constraints once and for all.
> > >>
> > >> Tomorrow, I will review further datapoints, have additional
> > conversations
> > >> with Apache Infra and discuss the idea with a few other contributors.
> If
> > >> nobody objects, I would then like to create the PR and kindly request
> a
> > >> fellow-committer to then merge that configuration change in order to
> > >> increase the stability of our CI.
> > >>
> > >> Thanks for your understanding.
> > >>
> > >> Best regards,
> > >> Marco
> > >>
> > >> [1]: https://issues.apache.org/jira/browse/INFRA-16884
> > >>
> > >> On Wed, Sep 19, 2018 at 4:22 PM Marco de Abreu <
> > >> marco.g.ab...@googlemail.com> wrote:
> > >>
> > >>> Hey,
> > >>>
> > >>> as of https://github.com/apache/incubator-mxnet/pull/12550, Python
> CPU
> > >>> tests for Mac have been enabled in Travis. The first passing run is
> > >>> available at
> > >>>
> >
> https://travis-ci.org/apache/incubator-mxnet/builds/430566392?utm_source=github_status&utm_medium=notification
> > >>> .
> > >>>
> > >>> As stated before, we will keep the status at not-required until we
> are
> > >>> sure the system is stable.
> > >>>
> > >>> Again, thanks to Kellen for his efforts to get Travis up and running!
> > >>>
> > >>> Best regards,
> > >>> Marco
> > >>>
> > >>> On Wed, Sep 19, 2018 at 5:09 AM Hagay Lupesko 
> > wrote:
> > >>>
> >  Bravo indeed!
> >  Awesome work Kellen and Marco!
> > 
> >  On Tue, Sep 18, 2018 at 7:56 PM Lin Yuan 
> wrote:
> > 
> >  > Bravo! This is a very important piece in CI. Thanks Kellen and
> Marco
> >  to
> >  > implement it quickly.
> >  >
> >  >
> >  > Lin
> >  >
> >  > On Tue, Sep 18, 2018, 4:18 PM Marco de Abreu
> >  >  wrote:
> >  >
> >  > > Kellen has fixed the one bug in our build system and thus, there
> >  are no
> >  > > outstanding tests :)
> >  > >
> >  > > Exactly, it will run on branch and PR validation.
> >  > >
> >  > > Best regards,
> >  > > Marco
> >  > >
> >  > > sandeep krishnamurthy  schrieb am
> >  Di., 18.
> >  > > Sep. 2018, 19:32:
> >  > >
> >  > > > This is awesome. Thanks a lot Kellen and Marco. With this work
> >  > complete,
> >  > > we
> >  > > > will have MXNet Python tests running for Mac on Travis CI, for
> > PR
> >  and
> >  > > > Branch builds?
> >  > > > Thank you for working on fixing the tests and making it run as
> >  part of
> >  > > > Travis CI for Mac platform. Is there any Github issue or Jira
> >  where we
> >  > > can
> >  > > > see disabled / tests that needs to be fixed for Mac? This
> might
> > be
> >  > usef

[DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread Lin Yuan
Dear Community,

I recently submitted a few small PRs with only changes in README files.
However, I noticed they still triggered the full cycle of CI including
build and test on all platforms.

Do we have a plan to speed up this process, maybe skipping non-code related
PRs in CI? Sorry, if this topic has been raised earlier and if not I
appreciate any comments.

Cheers,

Lin


Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-11-06 Thread kellen sunderland
Looks good to me.  Sorry this couldn't work out for the community.

On Tue, Nov 6, 2018, 7:24 AM Marco de Abreu
 Hello,
>
> the PR is available at
> https://github.com/apache/incubator-mxnet/pull/13137.
> I'd appreciate a review and merge.
>
> Best regards,
> Marco
>
> On Tue, Nov 6, 2018 at 12:01 AM Marco de Abreu <
> marco.g.ab...@googlemail.com>
> wrote:
>
> > Sorry, wrong link. The right link is:
> > https://issues.apache.org/jira/browse/INFRA-17216
> >
> > -Marco
> >
> > On Mon, Nov 5, 2018 at 11:59 PM Marco de Abreu <
> > marco.g.ab...@googlemail.com> wrote:
> >
> >> Hello,
> >>
> >> thanks everybody for taking part in this experiment around Travis CI.
> >> Unfortunately, our concerns about the stability of Travis were confirmed
> >> and the number of timeouts has increased since we added Python CPU
> tests.
> >>
> >> While the tests are marked as non-blocking, they confuse an increasing
> >> number of users and make them concerned that they might have made a
> >> breaking change in their contribution.
> >>
> >> I'm currently in discussion with Apache Infra to improve this situation
> >> [1], but as an immediate action to improve the user experience, I would
> >> like to propose the reduction of the executed workload on Travis by
> rolling
> >> back to the previous state which does not run Python CPU tests. There
> have
> >> been discussions around excluding certain long-running tests, but I'm
> >> afraid that assessing the tests and adding proper filtering could take
> some
> >> time. Instead, I would like to go back to only running compilation
> until we
> >> found a long-term solution.
> >>
> >> We have been receiving requests from other contributors who would like
> to
> >> add more workload to the Travis CI. Thus, I think that we should work
> on a
> >> long-term solution to resolve these constraints once and for all.
> >>
> >> Tomorrow, I will review further datapoints, have additional
> conversations
> >> with Apache Infra and discuss the idea with a few other contributors. If
> >> nobody objects, I would then like to create the PR and kindly request a
> >> fellow-committer to then merge that configuration change in order to
> >> increase the stability of our CI.
> >>
> >> Thanks for your understanding.
> >>
> >> Best regards,
> >> Marco
> >>
> >> [1]: https://issues.apache.org/jira/browse/INFRA-16884
> >>
> >> On Wed, Sep 19, 2018 at 4:22 PM Marco de Abreu <
> >> marco.g.ab...@googlemail.com> wrote:
> >>
> >>> Hey,
> >>>
> >>> as of https://github.com/apache/incubator-mxnet/pull/12550, Python CPU
> >>> tests for Mac have been enabled in Travis. The first passing run is
> >>> available at
> >>>
> https://travis-ci.org/apache/incubator-mxnet/builds/430566392?utm_source=github_status&utm_medium=notification
> >>> .
> >>>
> >>> As stated before, we will keep the status at not-required until we are
> >>> sure the system is stable.
> >>>
> >>> Again, thanks to Kellen for his efforts to get Travis up and running!
> >>>
> >>> Best regards,
> >>> Marco
> >>>
> >>> On Wed, Sep 19, 2018 at 5:09 AM Hagay Lupesko 
> wrote:
> >>>
>  Bravo indeed!
>  Awesome work Kellen and Marco!
> 
>  On Tue, Sep 18, 2018 at 7:56 PM Lin Yuan  wrote:
> 
>  > Bravo! This is a very important piece in CI. Thanks Kellen and Marco
>  to
>  > implement it quickly.
>  >
>  >
>  > Lin
>  >
>  > On Tue, Sep 18, 2018, 4:18 PM Marco de Abreu
>  >  wrote:
>  >
>  > > Kellen has fixed the one bug in our build system and thus, there
>  are no
>  > > outstanding tests :)
>  > >
>  > > Exactly, it will run on branch and PR validation.
>  > >
>  > > Best regards,
>  > > Marco
>  > >
>  > > sandeep krishnamurthy  schrieb am
>  Di., 18.
>  > > Sep. 2018, 19:32:
>  > >
>  > > > This is awesome. Thanks a lot Kellen and Marco. With this work
>  > complete,
>  > > we
>  > > > will have MXNet Python tests running for Mac on Travis CI, for
> PR
>  and
>  > > > Branch builds?
>  > > > Thank you for working on fixing the tests and making it run as
>  part of
>  > > > Travis CI for Mac platform. Is there any Github issue or Jira
>  where we
>  > > can
>  > > > see disabled / tests that needs to be fixed for Mac? This might
> be
>  > useful
>  > > > if we can call for contributions.
>  > > >
>  > > > Best,
>  > > > Sandeep
>  > > >
>  > > >
>  > > > On Tue, Sep 18, 2018 at 9:51 AM Marco de Abreu
>  > > >  wrote:
>  > > >
>  > > > > Hey everyone,
>  > > > >
>  > > > > we are about to enable Python tests for Mac. The outstanding
>  bugs
>  > have
>  > > > been
>  > > > > fixed by Kellen and we're just waiting for the PRs to pass.
>  We'll
>  > send
>  > > a
>  > > > > separate email as soon as they are enabled.
>  > > > >
>  > > > > Additionally, we had a small problem that Travis runs got
>  aborted i

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Naveen Swamy
Please note that this is a patch release(1.3.1) to address critical bugs!, For 
everything else please wait for 1.4.0 which is planned very shortly after 1.3.1

> On Nov 6, 2018, at 7:17 AM, Anton Chernov  wrote:
> 
> The following PR's have been created so far:
> 
> Infer dtype in SymbolBlock import from input symbol (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13117
> 
> [MXNET-953] Fix oob memory read (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13118
> 
> [MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13119
> 
> [MXNET-922] Fix memleak in profiler (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13120
> 
> Set correct update on kvstore flag in dist_device_sync mode (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13121
> 
> update mshadow (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13122
> 
> CudnnFind() usage improvements (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13123
> 
> Fix lazy record io when used with dataloader and multi_worker > 0 (v1.3.x)
> https://github.com/apache/incubator-mxnet/pull/13124
> 
> 
> As stated previously I would be rather opposed to have following PR's it in
> the patch release:
> 
> Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
> https://github.com/apache/incubator-mxnet/pull/13129
> 
> sample_like operators (#13034) v1.3.x
> https://github.com/apache/incubator-mxnet/pull/13130
> 
> 
> Best
> Anton
> 
> вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :
> 
>> Hi Haibin,
>> 
>> I have a few comments regarding the proposed performance improvement
>> changes.
>> 
>> CUDNN support for LSTM with projection & clipping
>> https://github.com/apache/incubator-mxnet/pull/13056
>> 
>> There is no doubt that this change brings value, but I don't see it as a
>> critical bug fix. I would rather leave it for the next major release.
>> 
>> sample_like operators
>> https://github.com/apache/incubator-mxnet/pull/13034
>> 
>> Even if it's related to performance, this is an addition of functionality
>> and I would also push this to be in the next major release only.
>> 
>> 
>> Best
>> Anton
>> 
>> 
>> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
>> 
>>> Hi Patric,
>>> 
>>> This change was listed in the 'PR candidates suggested for consideration
>>> for v1.3.1 patch release' section [1].
>>> 
>>> You are right, I also think that this is not a critical hotfix change
>>> that should be included into the 1.3.1 patch release.
>>> 
>>> Thus I'm not making any further efforts to bring it in.
>>> 
>>> Best
>>> Anton
>>> 
>>> [1]
>>> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
>>> 
>>> 
>>> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
>>> 
 Hi Anton,
 
 Thanks for looking into the MKL-DNN PR.
 
 As my understanding of cwiki (
 https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
 ),
 these features will go into 1.4 rather than patch release of 1.3.1.
 
 Feel free to correct me :)
 
 Thanks,
 
 --Patric
 
> -Original Message-
> From: Anton Chernov [mailto:mecher...@gmail.com]
> Sent: Tuesday, November 6, 2018 3:11 AM
> To: d...@mxnet.apache.org
> Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch
> release
> 
> It seems that there is a problem porting following changes to the
 v1.3.x
> release branch:
> 
> Implement mkldnn convolution fusion and quantization
> https://github.com/apache/incubator-mxnet/pull/12530
> 
> MKL-DNN Quantization Examples and README
> https://github.com/apache/incubator-mxnet/pull/12808
> 
> The bases are different.
> 
> I would need help from authors of these changes to make a backport PR.
> 
> @ZhennanQin, @xinyu-intel would you be able to assist me and create the
> corresponding PR's?
> 
> Without proper history and domain knowledge I would not be able to
 create
> them by my own in reasonable amount of time, I'm afraid.
> 
> Best regards,
> Anton
> 
> пн, 5 нояб. 2018 г. в 19:45, Anton Chernov :
> 
>> 
>> As part of:
>> 
>> Implement mkldnn convolution fusion and quantization
>> https://github.com/apache/incubator-mxnet/pull/12530
>> 
>> I propose to add the examples and documentation PR as well:
>> 
>> MKL-DNN Quantization Examples and README
>> https://github.com/apache/incubator-mxnet/pull/12808
>> 
>> 
>> Best regards,
>> Anton
>> 
>> пн, 5 нояб. 2018 г. в 19:02, Anton Chernov :
>> 
>>> Dear MXNet community,
>>> 
>>> I will be the release manager for the upcoming 1.3.1 patch release.
>>> Naveen will be co-managing the release and providing help from the
>>> committers side.
>>> 
>>> The following dates have been set:
>>> 
>>> Co

Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-11-06 Thread Marco de Abreu
Hello,

the PR is available at https://github.com/apache/incubator-mxnet/pull/13137.
I'd appreciate a review and merge.

Best regards,
Marco

On Tue, Nov 6, 2018 at 12:01 AM Marco de Abreu 
wrote:

> Sorry, wrong link. The right link is:
> https://issues.apache.org/jira/browse/INFRA-17216
>
> -Marco
>
> On Mon, Nov 5, 2018 at 11:59 PM Marco de Abreu <
> marco.g.ab...@googlemail.com> wrote:
>
>> Hello,
>>
>> thanks everybody for taking part in this experiment around Travis CI.
>> Unfortunately, our concerns about the stability of Travis were confirmed
>> and the number of timeouts has increased since we added Python CPU tests.
>>
>> While the tests are marked as non-blocking, they confuse an increasing
>> number of users and make them concerned that they might have made a
>> breaking change in their contribution.
>>
>> I'm currently in discussion with Apache Infra to improve this situation
>> [1], but as an immediate action to improve the user experience, I would
>> like to propose the reduction of the executed workload on Travis by rolling
>> back to the previous state which does not run Python CPU tests. There have
>> been discussions around excluding certain long-running tests, but I'm
>> afraid that assessing the tests and adding proper filtering could take some
>> time. Instead, I would like to go back to only running compilation until we
>> found a long-term solution.
>>
>> We have been receiving requests from other contributors who would like to
>> add more workload to the Travis CI. Thus, I think that we should work on a
>> long-term solution to resolve these constraints once and for all.
>>
>> Tomorrow, I will review further datapoints, have additional conversations
>> with Apache Infra and discuss the idea with a few other contributors. If
>> nobody objects, I would then like to create the PR and kindly request a
>> fellow-committer to then merge that configuration change in order to
>> increase the stability of our CI.
>>
>> Thanks for your understanding.
>>
>> Best regards,
>> Marco
>>
>> [1]: https://issues.apache.org/jira/browse/INFRA-16884
>>
>> On Wed, Sep 19, 2018 at 4:22 PM Marco de Abreu <
>> marco.g.ab...@googlemail.com> wrote:
>>
>>> Hey,
>>>
>>> as of https://github.com/apache/incubator-mxnet/pull/12550, Python CPU
>>> tests for Mac have been enabled in Travis. The first passing run is
>>> available at
>>> https://travis-ci.org/apache/incubator-mxnet/builds/430566392?utm_source=github_status&utm_medium=notification
>>> .
>>>
>>> As stated before, we will keep the status at not-required until we are
>>> sure the system is stable.
>>>
>>> Again, thanks to Kellen for his efforts to get Travis up and running!
>>>
>>> Best regards,
>>> Marco
>>>
>>> On Wed, Sep 19, 2018 at 5:09 AM Hagay Lupesko  wrote:
>>>
 Bravo indeed!
 Awesome work Kellen and Marco!

 On Tue, Sep 18, 2018 at 7:56 PM Lin Yuan  wrote:

 > Bravo! This is a very important piece in CI. Thanks Kellen and Marco
 to
 > implement it quickly.
 >
 >
 > Lin
 >
 > On Tue, Sep 18, 2018, 4:18 PM Marco de Abreu
 >  wrote:
 >
 > > Kellen has fixed the one bug in our build system and thus, there
 are no
 > > outstanding tests :)
 > >
 > > Exactly, it will run on branch and PR validation.
 > >
 > > Best regards,
 > > Marco
 > >
 > > sandeep krishnamurthy  schrieb am
 Di., 18.
 > > Sep. 2018, 19:32:
 > >
 > > > This is awesome. Thanks a lot Kellen and Marco. With this work
 > complete,
 > > we
 > > > will have MXNet Python tests running for Mac on Travis CI, for PR
 and
 > > > Branch builds?
 > > > Thank you for working on fixing the tests and making it run as
 part of
 > > > Travis CI for Mac platform. Is there any Github issue or Jira
 where we
 > > can
 > > > see disabled / tests that needs to be fixed for Mac? This might be
 > useful
 > > > if we can call for contributions.
 > > >
 > > > Best,
 > > > Sandeep
 > > >
 > > >
 > > > On Tue, Sep 18, 2018 at 9:51 AM Marco de Abreu
 > > >  wrote:
 > > >
 > > > > Hey everyone,
 > > > >
 > > > > we are about to enable Python tests for Mac. The outstanding
 bugs
 > have
 > > > been
 > > > > fixed by Kellen and we're just waiting for the PRs to pass.
 We'll
 > send
 > > a
 > > > > separate email as soon as they are enabled.
 > > > >
 > > > > Additionally, we had a small problem that Travis runs got
 aborted if
 > > > > multiple commits were done in a short timeframe. While this is
 > > acceptable
 > > > > for PRs, this causes our branch jobs to also fail. An examples
 is
 > > > available
 > > > > at [1]. In order to cope with this, I have asked Apache Infra to
 > > disable
 > > > > cancellation of concurrent jobs. They agreed to this, but
 reminded us
 > > > that
 > > > > they might turn it back on if w

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Anton Chernov
The following PR's have been created so far:

Infer dtype in SymbolBlock import from input symbol (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13117

[MXNET-953] Fix oob memory read (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13118

[MXNET-969] Fix buffer overflow in RNNOp (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13119

[MXNET-922] Fix memleak in profiler (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13120

Set correct update on kvstore flag in dist_device_sync mode (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13121

update mshadow (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13122

CudnnFind() usage improvements (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13123

Fix lazy record io when used with dataloader and multi_worker > 0 (v1.3.x)
https://github.com/apache/incubator-mxnet/pull/13124


As stated previously I would be rather opposed to have following PR's it in
the patch release:

Gluon LSTM Projection and Clipping Support (#13055) v1.3.x
https://github.com/apache/incubator-mxnet/pull/13129

sample_like operators (#13034) v1.3.x
https://github.com/apache/incubator-mxnet/pull/13130


Best
Anton

вт, 6 нояб. 2018 г. в 16:06, Anton Chernov :

> Hi Haibin,
>
> I have a few comments regarding the proposed performance improvement
> changes.
>
> CUDNN support for LSTM with projection & clipping
> https://github.com/apache/incubator-mxnet/pull/13056
>
> There is no doubt that this change brings value, but I don't see it as a
> critical bug fix. I would rather leave it for the next major release.
>
> sample_like operators
> https://github.com/apache/incubator-mxnet/pull/13034
>
> Even if it's related to performance, this is an addition of functionality
> and I would also push this to be in the next major release only.
>
>
> Best
> Anton
>
>
> вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :
>
>> Hi Patric,
>>
>> This change was listed in the 'PR candidates suggested for consideration
>> for v1.3.1 patch release' section [1].
>>
>> You are right, I also think that this is not a critical hotfix change
>> that should be included into the 1.3.1 patch release.
>>
>> Thus I'm not making any further efforts to bring it in.
>>
>> Best
>> Anton
>>
>> [1]
>> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
>>
>>
>> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
>>
>>> Hi Anton,
>>>
>>> Thanks for looking into the MKL-DNN PR.
>>>
>>> As my understanding of cwiki (
>>> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
>>> ),
>>> these features will go into 1.4 rather than patch release of 1.3.1.
>>>
>>> Feel free to correct me :)
>>>
>>> Thanks,
>>>
>>> --Patric
>>>
>>> > -Original Message-
>>> > From: Anton Chernov [mailto:mecher...@gmail.com]
>>> > Sent: Tuesday, November 6, 2018 3:11 AM
>>> > To: d...@mxnet.apache.org
>>> > Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch
>>> > release
>>> >
>>> > It seems that there is a problem porting following changes to the
>>> v1.3.x
>>> > release branch:
>>> >
>>> > Implement mkldnn convolution fusion and quantization
>>> > https://github.com/apache/incubator-mxnet/pull/12530
>>> >
>>> > MKL-DNN Quantization Examples and README
>>> > https://github.com/apache/incubator-mxnet/pull/12808
>>> >
>>> > The bases are different.
>>> >
>>> > I would need help from authors of these changes to make a backport PR.
>>> >
>>> > @ZhennanQin, @xinyu-intel would you be able to assist me and create the
>>> > corresponding PR's?
>>> >
>>> > Without proper history and domain knowledge I would not be able to
>>> create
>>> > them by my own in reasonable amount of time, I'm afraid.
>>> >
>>> > Best regards,
>>> > Anton
>>> >
>>> > пн, 5 нояб. 2018 г. в 19:45, Anton Chernov :
>>> >
>>> > >
>>> > > As part of:
>>> > >
>>> > > Implement mkldnn convolution fusion and quantization
>>> > > https://github.com/apache/incubator-mxnet/pull/12530
>>> > >
>>> > > I propose to add the examples and documentation PR as well:
>>> > >
>>> > > MKL-DNN Quantization Examples and README
>>> > > https://github.com/apache/incubator-mxnet/pull/12808
>>> > >
>>> > >
>>> > > Best regards,
>>> > > Anton
>>> > >
>>> > > пн, 5 нояб. 2018 г. в 19:02, Anton Chernov :
>>> > >
>>> > >> Dear MXNet community,
>>> > >>
>>> > >> I will be the release manager for the upcoming 1.3.1 patch release.
>>> > >> Naveen will be co-managing the release and providing help from the
>>> > >> committers side.
>>> > >>
>>> > >> The following dates have been set:
>>> > >>
>>> > >> Code Freeze: 31st October 2018
>>> > >> Release published: 13th November 2018
>>> > >>
>>> > >> Release notes have been drafted here [1].
>>> > >>
>>> > >>
>>> > >> * Known issues
>>> > >>
>>> > >> Update MKL-DNN dependency
>>> > >> https://github.com/apache/incubator-mxnet/pull/12953
>>> > >>
>>> > >> This PR hasn't been merged even to master yet. Requires additional
>>> > >> d

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Anton Chernov
Hi Haibin,

I have a few comments regarding the proposed performance improvement
changes.

CUDNN support for LSTM with projection & clipping
https://github.com/apache/incubator-mxnet/pull/13056

There is no doubt that this change brings value, but I don't see it as a
critical bug fix. I would rather leave it for the next major release.

sample_like operators
https://github.com/apache/incubator-mxnet/pull/13034

Even if it's related to performance, this is an addition of functionality
and I would also push this to be in the next major release only.


Best
Anton


вт, 6 нояб. 2018 г. в 15:55, Anton Chernov :

> Hi Patric,
>
> This change was listed in the 'PR candidates suggested for consideration
> for v1.3.1 patch release' section [1].
>
> You are right, I also think that this is not a critical hotfix change that
> should be included into the 1.3.1 patch release.
>
> Thus I'm not making any further efforts to bring it in.
>
> Best
> Anton
>
> [1]
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates
>
>
> вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :
>
>> Hi Anton,
>>
>> Thanks for looking into the MKL-DNN PR.
>>
>> As my understanding of cwiki (
>> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
>> ),
>> these features will go into 1.4 rather than patch release of 1.3.1.
>>
>> Feel free to correct me :)
>>
>> Thanks,
>>
>> --Patric
>>
>> > -Original Message-
>> > From: Anton Chernov [mailto:mecher...@gmail.com]
>> > Sent: Tuesday, November 6, 2018 3:11 AM
>> > To: d...@mxnet.apache.org
>> > Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch
>> > release
>> >
>> > It seems that there is a problem porting following changes to the v1.3.x
>> > release branch:
>> >
>> > Implement mkldnn convolution fusion and quantization
>> > https://github.com/apache/incubator-mxnet/pull/12530
>> >
>> > MKL-DNN Quantization Examples and README
>> > https://github.com/apache/incubator-mxnet/pull/12808
>> >
>> > The bases are different.
>> >
>> > I would need help from authors of these changes to make a backport PR.
>> >
>> > @ZhennanQin, @xinyu-intel would you be able to assist me and create the
>> > corresponding PR's?
>> >
>> > Without proper history and domain knowledge I would not be able to
>> create
>> > them by my own in reasonable amount of time, I'm afraid.
>> >
>> > Best regards,
>> > Anton
>> >
>> > пн, 5 нояб. 2018 г. в 19:45, Anton Chernov :
>> >
>> > >
>> > > As part of:
>> > >
>> > > Implement mkldnn convolution fusion and quantization
>> > > https://github.com/apache/incubator-mxnet/pull/12530
>> > >
>> > > I propose to add the examples and documentation PR as well:
>> > >
>> > > MKL-DNN Quantization Examples and README
>> > > https://github.com/apache/incubator-mxnet/pull/12808
>> > >
>> > >
>> > > Best regards,
>> > > Anton
>> > >
>> > > пн, 5 нояб. 2018 г. в 19:02, Anton Chernov :
>> > >
>> > >> Dear MXNet community,
>> > >>
>> > >> I will be the release manager for the upcoming 1.3.1 patch release.
>> > >> Naveen will be co-managing the release and providing help from the
>> > >> committers side.
>> > >>
>> > >> The following dates have been set:
>> > >>
>> > >> Code Freeze: 31st October 2018
>> > >> Release published: 13th November 2018
>> > >>
>> > >> Release notes have been drafted here [1].
>> > >>
>> > >>
>> > >> * Known issues
>> > >>
>> > >> Update MKL-DNN dependency
>> > >> https://github.com/apache/incubator-mxnet/pull/12953
>> > >>
>> > >> This PR hasn't been merged even to master yet. Requires additional
>> > >> discussion and merge.
>> > >>
>> > >> distributed kvstore bug in MXNet
>> > >> https://github.com/apache/incubator-mxnet/issues/12713
>> > >>
>> > >> > When distributed kvstore is used, by default gluon.Trainer doesn't
>> > >> > work
>> > >> with mx.optimizer.LRScheduler if a worker has more than 1 GPU. To be
>> > >> more specific, the trainer updates once per GPU, the LRScheduler
>> > >> object is shared across GPUs and get a wrong update count.
>> > >>
>> > >> This needs to be fixed. [6]
>> > >>
>> > >>
>> > >> * Changes
>> > >>
>> > >> The following changes will be ported to the release branch, per [2]:
>> > >>
>> > >> Infer dtype in SymbolBlock import from input symbol [3]
>> > >> https://github.com/apache/incubator-mxnet/pull/12412
>> > >>
>> > >> [MXNET-953] Fix oob memory read
>> > >> https://github.com/apache/incubator-mxnet/pull/12631
>> > >>
>> > >> [MXNET-969] Fix buffer overflow in RNNOp
>> > >> https://github.com/apache/incubator-mxnet/pull/12603
>> > >>
>> > >> [MXNET-922] Fix memleak in profiler
>> > >> https://github.com/apache/incubator-mxnet/pull/12499
>> > >>
>> > >> Implement mkldnn convolution fusion and quantization (MXNet Graph
>> > >> Optimization and Quantization based on subgraph and MKL-DNN
>> > proposal
>> > >> [4])
>> > >> https://github.com/apache/incubator-mxnet/pull/12530
>> > >>
>> > >> Following items (test cases) should be already par

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Anton Chernov
Hi Patric,

This change was listed in the 'PR candidates suggested for consideration
for v1.3.1 patch release' section [1].

You are right, I also think that this is not a critical hotfix change that
should be included into the 1.3.1 patch release.

Thus I'm not making any further efforts to bring it in.

Best
Anton

[1]
https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release#PR_candidates


вт, 6 нояб. 2018 г. в 1:14, Zhao, Patric :

> Hi Anton,
>
> Thanks for looking into the MKL-DNN PR.
>
> As my understanding of cwiki (
> https://cwiki.apache.org/confluence/display/MXNET/Project+Proposals+for+next+MXNet+Release
> ),
> these features will go into 1.4 rather than patch release of 1.3.1.
>
> Feel free to correct me :)
>
> Thanks,
>
> --Patric
>
> > -Original Message-
> > From: Anton Chernov [mailto:mecher...@gmail.com]
> > Sent: Tuesday, November 6, 2018 3:11 AM
> > To: d...@mxnet.apache.org
> > Subject: Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch
> > release
> >
> > It seems that there is a problem porting following changes to the v1.3.x
> > release branch:
> >
> > Implement mkldnn convolution fusion and quantization
> > https://github.com/apache/incubator-mxnet/pull/12530
> >
> > MKL-DNN Quantization Examples and README
> > https://github.com/apache/incubator-mxnet/pull/12808
> >
> > The bases are different.
> >
> > I would need help from authors of these changes to make a backport PR.
> >
> > @ZhennanQin, @xinyu-intel would you be able to assist me and create the
> > corresponding PR's?
> >
> > Without proper history and domain knowledge I would not be able to create
> > them by my own in reasonable amount of time, I'm afraid.
> >
> > Best regards,
> > Anton
> >
> > пн, 5 нояб. 2018 г. в 19:45, Anton Chernov :
> >
> > >
> > > As part of:
> > >
> > > Implement mkldnn convolution fusion and quantization
> > > https://github.com/apache/incubator-mxnet/pull/12530
> > >
> > > I propose to add the examples and documentation PR as well:
> > >
> > > MKL-DNN Quantization Examples and README
> > > https://github.com/apache/incubator-mxnet/pull/12808
> > >
> > >
> > > Best regards,
> > > Anton
> > >
> > > пн, 5 нояб. 2018 г. в 19:02, Anton Chernov :
> > >
> > >> Dear MXNet community,
> > >>
> > >> I will be the release manager for the upcoming 1.3.1 patch release.
> > >> Naveen will be co-managing the release and providing help from the
> > >> committers side.
> > >>
> > >> The following dates have been set:
> > >>
> > >> Code Freeze: 31st October 2018
> > >> Release published: 13th November 2018
> > >>
> > >> Release notes have been drafted here [1].
> > >>
> > >>
> > >> * Known issues
> > >>
> > >> Update MKL-DNN dependency
> > >> https://github.com/apache/incubator-mxnet/pull/12953
> > >>
> > >> This PR hasn't been merged even to master yet. Requires additional
> > >> discussion and merge.
> > >>
> > >> distributed kvstore bug in MXNet
> > >> https://github.com/apache/incubator-mxnet/issues/12713
> > >>
> > >> > When distributed kvstore is used, by default gluon.Trainer doesn't
> > >> > work
> > >> with mx.optimizer.LRScheduler if a worker has more than 1 GPU. To be
> > >> more specific, the trainer updates once per GPU, the LRScheduler
> > >> object is shared across GPUs and get a wrong update count.
> > >>
> > >> This needs to be fixed. [6]
> > >>
> > >>
> > >> * Changes
> > >>
> > >> The following changes will be ported to the release branch, per [2]:
> > >>
> > >> Infer dtype in SymbolBlock import from input symbol [3]
> > >> https://github.com/apache/incubator-mxnet/pull/12412
> > >>
> > >> [MXNET-953] Fix oob memory read
> > >> https://github.com/apache/incubator-mxnet/pull/12631
> > >>
> > >> [MXNET-969] Fix buffer overflow in RNNOp
> > >> https://github.com/apache/incubator-mxnet/pull/12603
> > >>
> > >> [MXNET-922] Fix memleak in profiler
> > >> https://github.com/apache/incubator-mxnet/pull/12499
> > >>
> > >> Implement mkldnn convolution fusion and quantization (MXNet Graph
> > >> Optimization and Quantization based on subgraph and MKL-DNN
> > proposal
> > >> [4])
> > >> https://github.com/apache/incubator-mxnet/pull/12530
> > >>
> > >> Following items (test cases) should be already part of 1.3.0:
> > >>
> > >> [MXNET-486] Create CPP test for concat MKLDNN operator
> > >> https://github.com/apache/incubator-mxnet/pull/11371
> > >>
> > >> [MXNET-489] MKLDNN Pool test
> > >> https://github.com/apache/incubator-mxnet/pull/11608
> > >>
> > >> [MXNET-484] MKLDNN C++ test for LRN operator
> > >> https://github.com/apache/incubator-mxnet/pull/11831
> > >>
> > >> [MXNET-546] Add unit test for MKLDNNSum
> > >> https://github.com/apache/incubator-mxnet/pull/11272
> > >>
> > >> [MXNET-498] Test MKLDNN backward operators
> > >> https://github.com/apache/incubator-mxnet/pull/11232
> > >>
> > >> [MXNET-500] Test cases improvement for MKLDNN on Gluon
> > >> https://github.com/apache/incubator-mxnet/pull/10921
> > >>
> > >> Set correct update on kvstore f

Requesting Access for SLACK

2018-11-06 Thread Gavin M. Bell
Hello,

I would like to please have access to slack for MXNet.

-- 
Sincerely,
Gavin M. Bell

 "Never mistake a clear view for a short distance."
  -Paul Saffo


Re: Apache MXNet Workshop in ODSC

2018-11-06 Thread Hagay Lupesko
This is awesome Naveen and Sandeep!
+1 to encourage the community to spread the word and raise awareness of
MXNet.

On a similar note, I recently had the opportunity to introduce MXNet in two
occasions:
- Conducting an MXNet workshop in the Nordics ML Summit conference
: “Emotion recognition in images:
from an idea to a model in production with MXNet” (deck
,
code ).
  100+ people attended the workshop, most were not familiar with MXNet - so
it was a net gain!
- Vandana, Sandeep and I did a technical lecture at SJSU to CS students:
"What is deep learning and why you should care" (deck
),
including a coding session with MXNet to train a sentiment analysis model.
The students were very engaged, and it was great.

Introducing MXNet and showing how it can be useful for both practitioners
and newbies is super important for the growth of MXNet and the community,
and is also a fun experience for the presenter - I'd encourage folks to
actively advocate MXNet.

Cheers,
Hagay


On Sun, Nov 4, 2018 at 9:56 AM Naveen Swamy  wrote:

> Hey guys,
>
> I wanted to let you know that I and Sandeep conducted a Hands on workshop
> in ODSC, SF on November 1st, I conducted a similar session in London last
> month.  This session had 30 attendees join us and the response was positive
> and engaging especially for the fact that they could try out MXNet and see
> a trained model. I covered some basics of DL and CNN, and conducted a
> exercise of transfer learning a Facial Emotion Recognition model using a
> VGG13 pre-trained model from GluonCV. Sandeep covered NLP concepts and an
> exercise on training a sentiment analysis model using GluonNLP pre-trained
> embedding/model.
>
> The notebooks are here: https://github.com/TalkAI/apache-mxnet-odsc-2018
>
> Slides are here:
> https://www.slideshare.net/apachemxnet/apache-mxnet-odsc-west-2018
>
> I also want to encourage you to participate in spreading the word about
> MXNet by conducting workshops and/or present how you solve your business
> problem using Apache MXNet in breakout sessions.
>
> If you have feedback or questions please reach out to me.
>
> Thanks, Naveen
>