Re: [Announce] Upcoming Apache MXNet (incubating) 1.4.0 release

2018-11-15 Thread Anton Chernov
I'd like to remind everyone that 'code freeze' would mean cutting a v1.4.x
release branch and all following fixes would need to be backported.
Development on master can be continued as usual.

Best
Anton

ср, 14 нояб. 2018 г. в 6:04, Steffen Rochel :

> Dear MXNet community,
> the agreed plan was to establish code freeze for 1.4.0 release today. As
> the 1.3.1 patch release is still ongoing I suggest to post-pone the code
> freeze to Friday 16th November 2018.
>
> Sergey Kolychev has agreed to act as co-release manager for all tasks which
> require committer privileges. If anybody is interested to volunteer as
> release manager - now is the time to speak up. Otherwise I will manage the
> release.
>
> Regards,
> Steffen
>


Re: MXNet - Gluon - Audio

2018-11-15 Thread Gaurav Gireesh
Hi Lai!
Thank you for your comments!
Below are the answers to your comments/queries:
1) That's a good suggestion. However, I have added an example in the Pull
request related to this:
https://github.com/apache/incubator-mxnet/pull/13241/commits/eabb68256d8fd603a0075eafcd8947d92e7df27f
.
I would be happy to include a dataset similar to MNIST to support that. I
have come across an example dataset used in tensor flow speech
related example here
. This
could be included.

2) Thank you for the suggestion, I shall look into the FFT operator that
you have pointed out. However, there are other kind of features like, mfcc,
mels and so on which are popular in audio data feature extraction, which
will find utility if implemented. I am not sure if we have operators for
this.

3) The references look good too. I shall look into them. Thank you for
bringing them into my notice.

Regards,
Gaurav

On Tue, Nov 13, 2018 at 11:22 AM Lai Wei  wrote:

> Hi Gaurav,
>
> Thanks for starting this. I see the PR is out
> , left some initial
> reviews, good work!
>
> In addition to Sandeep's queries, I have the following:
> 1. Can we include some simple classic audio dataset for users to directly
> import and try out? like MNIST in vision. (e.g.:
> http://pytorch.org/audio/datasets.html#yesno)
> 2. Librosa provides some good audio feature extractions, we can use it for
> now. But it's slow as you have to do conversions between ndarray and numpy.
> In the long term, can we make transforms to use mxnet operators and change
> your transforms to hybrid blocks? For example, mxnet FFT
> <
> https://mxnet.apache.org/api/python/ndarray/contrib.html?highlight=fft#mxnet.ndarray.contrib.fft
> >
> operator
> can be used in a hybrid block transformer, which will be a lot faster.
>
> Some additional references on users already using mxnet on audio, we should
> aim to make it easier and automate the file load/preprocess/transform
> process.
> 1. https://github.com/chen0040/mxnet-audio
> 2. https://github.com/shuokay/mxnet-wavenet
>
> Looking forward to seeing this feature out.
> Thanks!
>
> Best Regards
>
> Lai
>
>
> On Tue, Nov 13, 2018 at 9:09 AM sandeep krishnamurthy <
> sandeep.krishn...@gmail.com> wrote:
>
> > Thanks, Gaurav for starting this initiative. The design document is
> > detailed and gives all the information.
> > Starting to add this in "Contrib" is a good idea while we expect a few
> > rough edges and cleanups to follow.
> >
> > I had the following queries:
> > 1. Is there any analysis comparing LibROSA with other libraries? w.r.t
> > features, performance, community usage in audio data domain.
> > 2. What is the recommendation of LibROSA dependency? Part of MXNet PyPi
> or
> > ask the user to install if required? I prefer the latter, similar to
> > protobuf in ONNX-MXNet.
> > 3. I see LibROSA is a fully Python-based library. Are we getting blocked
> on
> > the dependency for future use cases when we want to make transformations
> as
> > operators and allow for cross-language support?
> > 4. In performance design considerations, with lazy=True / False the
> > performance difference is too scary ( 8 minutes to 4 hours!!) This
> requires
> > some more analysis. If we known turning a flag off/on has 24X performance
> > degradation, should we need to provide that control to user? What is the
> > impact of this on Memory usage?
> > 5. I see LibROSA has ISC license (
> > https://github.com/librosa/librosa/blob/master/LICENSE.md) which says
> free
> > to use with same license notification. I am not sure if this is ok. I
> > request other committers/mentors to suggest.
> >
> > Best,
> > Sandeep
> >
> > On Fri, Nov 9, 2018 at 5:45 PM Gaurav Gireesh 
> > wrote:
> >
> > > Dear MXNet Community,
> > >
> > > I recently started looking into performing some simple sound
> multi-class
> > > classification tasks with Audio Data and realized that as a user, I
> would
> > > like MXNet to have an out of the box feature which allows us to load
> > audio
> > > data(at least 1 file format), extract features( or apply some common
> > > transforms/feature extraction) and train a model using the Audio
> Dataset.
> > > This could be a first step towards building and supporting APIs similar
> > to
> > > what we have for "vision" related use cases in MXNet.
> > >
> > > Below is the design proposal :
> > >
> > > Gluon - Audio Design Proposal
> > > 
> > >
> > > I would highly appreciate your taking time to review and provide
> > feedback,
> > > comments/suggestions on this.
> > > Looking forward to your support.
> > >
> > >
> > > Best Regards,
> > >
> > > Gaurav Gireesh
> > >
> >
> >
> > --
> > Sandeep Krishnamurthy
> >
>


Re: [VOTE] Release Apache MXNet (incubating) version 1.3.1.rc0

2018-11-15 Thread Steffen Rochel
+1 build on MacOS Sierra following instructions on
https://cwiki.apache.org/confluence/display/MXNET/MXNet+Developer+Setup+on+Mac
and run one training test.

On Tue, Nov 13, 2018 at 2:34 PM Carin Meier  wrote:

> +1 - Clojure package tested fine with Scala jars
>
> On Mon, Nov 12, 2018 at 6:53 PM Anton Chernov  wrote:
>
> > Dear MXNet community,
> >
> > This is the vote to release Apache MXNet (incubating) version 1.3.1.
> Voting
> > will start now, on Monday the 12th of November 2018 and close on 14:00
> > Thursday the 15th of November 2018, Pacific Time (PT).
> >
> > Link to release notes:
> > https://cwiki.apache.org/confluence/x/eZGzBQ
> >
> > Link to release candidate 1.3.1.rc0:
> > https://github.com/apache/incubator-mxnet/releases/tag/1.3.1.rc0
> >
> > Link to source and signatures on apache dist server:
> > https://dist.apache.org/repos/dist/dev/incubator/mxnet/1.3.1.rc0/
> >
> > Link to scala packages on the staging repo:
> >
> > * CPU
> >
> >
> https://repository.apache.org/content/repositories/snapshots/org/apache/mxnet/mxnet-full_2.11-osx-x86_64-cpu/1.3.1-SNAPSHOT/
> >
> > * GPU
> >
> >
> https://repository.apache.org/content/repositories/snapshots/org/apache/mxnet/mxnet-full_2.11-linux-x86_64-gpu/1.3.1-SNAPSHOT/
> >
> > Please remember to TEST first before voting accordingly:
> > +1 = approve
> > +0 = no opinion
> > -1 = disapprove (provide reason)
> >
> >
> > Best regards,
> > Anton
> >
>


Re: [VOTE] Release Apache MXNet (incubating) version 1.3.1.rc0

2018-11-15 Thread kellen sunderland
Thanks for organizing the release Anton and for testing Carin and Steffen.
Lots of great fixes in this release.  As we don't have the required 3
committers I'd suggest extending the vote for a few days.

I tested the following on MacOS 10.13, High Sierra:

INCUBATING IN RELEASE FILE: check.
LICENSE check.
NOTICE check.
SIGNATURE check.
HASH check.
DISCLAIMER check.
SOURCE COMPILES VIA MAKEFILE check.
SOURCE COMPILES VIA CMAKE check.
C++ TESTS PASS fail
Two tests failing for me.
Build with flags: cmake -DUSE_CUDA=0 -DUSE_CUDNN=0 -DUSE_OPENMP=0
-DUSE_OPENCV=0 ..
Ran c++ tests with exclusions: ./tests/mxnet_unit_tests
--gtest_filter=-GpuTopology.*
Result:
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] ACTIVATION_PERF.ExecuteBidirectional
[  FAILED  ] ACTIVATION_PERF.TimingCPU

PYHTON UNIT TESTS PASS check.

Not sure if the test failures are a regression so I'm +0 (non-binding)

On Thu, Nov 15, 2018 at 5:43 PM Steffen Rochel 
wrote:

> +1 build on MacOS Sierra following instructions on
>
> https://cwiki.apache.org/confluence/display/MXNET/MXNet+Developer+Setup+on+Mac
> and run one training test.
>
> On Tue, Nov 13, 2018 at 2:34 PM Carin Meier  wrote:
>
> > +1 - Clojure package tested fine with Scala jars
> >
> > On Mon, Nov 12, 2018 at 6:53 PM Anton Chernov 
> wrote:
> >
> > > Dear MXNet community,
> > >
> > > This is the vote to release Apache MXNet (incubating) version 1.3.1.
> > Voting
> > > will start now, on Monday the 12th of November 2018 and close on 14:00
> > > Thursday the 15th of November 2018, Pacific Time (PT).
> > >
> > > Link to release notes:
> > > https://cwiki.apache.org/confluence/x/eZGzBQ
> > >
> > > Link to release candidate 1.3.1.rc0:
> > > https://github.com/apache/incubator-mxnet/releases/tag/1.3.1.rc0
> > >
> > > Link to source and signatures on apache dist server:
> > > https://dist.apache.org/repos/dist/dev/incubator/mxnet/1.3.1.rc0/
> > >
> > > Link to scala packages on the staging repo:
> > >
> > > * CPU
> > >
> > >
> >
> https://repository.apache.org/content/repositories/snapshots/org/apache/mxnet/mxnet-full_2.11-osx-x86_64-cpu/1.3.1-SNAPSHOT/
> > >
> > > * GPU
> > >
> > >
> >
> https://repository.apache.org/content/repositories/snapshots/org/apache/mxnet/mxnet-full_2.11-linux-x86_64-gpu/1.3.1-SNAPSHOT/
> > >
> > > Please remember to TEST first before voting accordingly:
> > > +1 = approve
> > > +0 = no opinion
> > > -1 = disapprove (provide reason)
> > >
> > >
> > > Best regards,
> > > Anton
> > >
> >
>