Re: C++ api issue labeling

2018-06-22 Thread Lin Yuan
I agree with Hagay. Using "Backend" as label makes it much easier to track. "C++" label only describes the language used in implementation, "Backend" better describes the nature of the work (let's assume we change the backend implementation from C++ to other languages in the future). Lin On

Consolidating developer guide in one place (cwiki preferred)

2018-08-14 Thread Lin Yuan
Dear MXNet community, As a developer, I noticed we have some developer guide scattered in different websites (mxnet.io, cwiki): E.g. How to Create New Operators (Layers): [ https://mxnet.incubator.apache.org/faq/new_op.html] A Guide to Implementing Sparse Operators in MXNet Backend [

Enabling shared filter in JIRA

2018-08-14 Thread Lin Yuan
Dear MXNet Community, As we are trying to create our Scrum board on JIRA, I noticed that we do not have the permission to create shared filter, even as an administrator. This has limited us to create scrum boards for different components of the project. I will really appreciate if someone in the

Re: Consolidating developer guide in one place (cwiki preferred)

2018-08-21 Thread Lin Yuan
developer-focused content be > > placed on the wiki. > > > > On Tue, Aug 14, 2018 at 10:40 AM, Lin Yuan wrote: > > > > > Dear MXNet community, > > > > > > As a developer, I noticed we have some developer guide scattered in > > > different websites

Re: Updating MXNet's Cub

2018-08-28 Thread Lin Yuan
+1 On Tue, Aug 28, 2018 at 12:39 AM Hagay Lupesko wrote: > Thanks for the feedback Chris. Will follow up. > > On Fri, Aug 24, 2018 at 10:53 AM Chris Olivier > wrote: > > > +1 for pointing to NVidia's repo for the newer Cub and subsequent > versions. > > > > On Fri, Aug 24, 2018 at 10:01 AM

Re: build from source instructions

2018-08-28 Thread Lin Yuan
Aaron, I agree the installation page is very confusing to me. When I first tried to build MXNet from source on MacOS, I was totally confused about the instruction. Why was it vastly different from building from source on Linux given these two OS have similar shell commands. I feel the automatic

Re: build from source instructions

2018-08-28 Thread Lin Yuan
being more confusing than helpful. It's > > difficult to debug any issues when the entire instruction is to run a > > single script. - Sina > > > > > > > > On 8/28/18, 9:46 AM, "Lin Yuan" wrote: > > > > Aaron, > > > >

Propose to discontinue supporting Apache MXNet on Windows 7

2018-08-28 Thread Lin Yuan
Dear Community, Currently, our MXNet installation guide for Windows does not work for Windows 7. e.g. Microsoft Visual Studio 2015 is not supported on Windows 7 . In addition,

Re: MXNet developer setup on Mac with VSCode for develop, test and debug

2018-07-20 Thread Lin Yuan
t started with MXNet easily. > > > > On Wed, Jul 18, 2018 at 1:04 PM, Lin Yuan wrote: > > > > > Hi Aaron, > > > > > > This doc is for development on Mac. It is not intended for Windows > users. > > > Maybe we can start a different thread to d

Re: [VOTE] Subscribe dev@ to Github Activities

2018-07-17 Thread Lin Yuan
+1, I think they are very relevant to dev and as Aaron said we can always set up personalized filter. On Tue, Jul 17, 2018 at 9:21 AM Aaron Markham wrote: > +1, I don't read your emails anyways. Just kidding. I think it would be > good to see the action, even if I eventually have to setup

Re: MXNet developer setup on Mac with VSCode for develop, test and debug

2018-07-18 Thread Lin Yuan
Thanks for the well-written document! As a new MXNet developer, I have found it very helpful. Lin On Wed, Jul 18, 2018 at 10:50 AM sandeep krishnamurthy wrote: > Hello Community, > > > > As a MXNet contributor, I had issues and took me some time on getting > hands-on with MXNet codebase, being

Re: MXNet developer setup on Mac with VSCode for develop, test and debug

2018-07-18 Thread Lin Yuan
nd was trying > to use VS2017 Community Edition and MKL. I went to MKL after OpenBLAS > wasn't installing/building. > > On 7/18/18, 10:59 AM, "Lin Yuan" wrote: > > Thanks for the well-written document! As a new MXNet developer, I have > found it very

Re: [LAZY VOTE] Consolidating developer guide in one place (cwiki preferred)

2018-09-04 Thread Lin Yuan
(cwiki). > > > > > > Note: Permissions on cwiki is currently not well managed with many people > > having full admin rights to edit/create/delete pages. Should be fine for > > now, but, when we start accumulating many documents and resources, we > > should prob

Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-09-05 Thread Lin Yuan
Hi Kellen, Many thanks for your and Marco's effort! I think this is a very crucial piece to improve MXNet stability. To add some data points: 1) Customers using CoreML to MXNet converter were blocked for a while because the converter was broken and no unit test was in place to detect that. 2)

Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-09-05 Thread Lin Yuan
d. We are using the travis image xcode9.4 which > > is based on MacOS 10.13. > > > > On Wed, Sep 5, 2018 at 6:40 PM Lin Yuan wrote: > > > > > Hi Kellen, > > > > > > Many thanks for your and Marco's effort! I think this is a very crucial > > > pie

Re: Propose to discontinue supporting Apache MXNet on Windows 7

2018-08-30 Thread Lin Yuan
nirudh Acharya < > > anirudhk...@gmail.com> > > > > wrote: > > > > > > > > > +1 for discontinuing. > > > > > > > > > > On Tue, Aug 28, 2018 at 4:11 PM Navee

Re: Propose to discontinue supporting Apache MXNet on Windows 7

2018-08-30 Thread Lin Yuan
< > > > > kellen.sunderl...@gmail.com> wrote: > > > > > > > > > +1 (non-binding) > > > > > > > > > > On Wed, Aug 29, 2018, 1:18 AM Anirudh Acharya < > > > anirudhk...@gmail.com> > > > > > wro

Re: [VOTE] Release MXNet version 1.2.1.RC1

2018-07-12 Thread Lin Yuan
+1 Built on Windows server. Ran unittests. Works as expected. On Thu, Jul 12, 2018 at 8:01 AM sandeep krishnamurthy < sandeep.krishn...@gmail.com> wrote: > +1 > > Built from source. Tested on CPU and GPU with Keras-MXNet (ResNet and LSTM > examples), works as expected. > > Best, > Sandeep > > On

Re: [DISCUSS] Subscribe dev@ to Github Activities?

2018-07-12 Thread Lin Yuan
+1 On Thu, Jul 12, 2018 at 12:26 PM Anirudh Acharya wrote: > +1 > > On Thu, Jul 12, 2018 at 11:51 AM Piyush Ghai > wrote: > > > +1 > > > On Jul 12, 2018, at 11:50 AM, Tianqi Chen > > wrote: > > > > > > +1 > > > > > > On Thu, Jul 12, 2018 at 11:10 AM, Sheng Zha > wrote: > > > > > >> Hi all, >

Re: Horovod-MXNet Integration

2018-11-02 Thread Lin Yuan
Hi Mu, Darren (@yuxihu ) and I have been working on releasing MXNet-Horovod integration in production. We have made some changes on both MXNet and Horovod sides. The changes on MXNet side have mostly been merged and we are working to merge code to horovod repo. We will

Re: Coverity scan

2018-11-02 Thread Lin Yuan
Anton, Yes, I did a scan using Coverity on MXNet a few months ago. It did show some memory issues. I was later buried by other work with higher priority and would definitely like to see Coverity (or any other better memory scan) tool to be run regularly on MXNet backend. Let me know if you want

Re: [Discussion] Recognise Reviewers, Besides Committers and PMC

2018-10-20 Thread Lin Yuan
+1 sounds like a great idea. We also need a mechanism to identify “good reviewers”. Maybe we can count the number of :thumsup: in each review. Or any other better way? On Fri, Oct 19, 2018 at 8:22 PM Tianqi Chen wrote: > Dear MXNet Community: > > There is a great discussion going on in terms of

[DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread Lin Yuan
Dear Community, I recently submitted a few small PRs with only changes in README files. However, I noticed they still triggered the full cycle of CI including build and test on all platforms. Do we have a plan to speed up this process, maybe skipping non-code related PRs in CI? Sorry, if this

Catch divide-by-zero floating number exception in backend

2018-11-08 Thread Lin Yuan
Dear MXNet Community, I recently found the NaN errors sometimes could be due to some divide-by-zero float number bugs in engine backend. However, by default, such an exception will not be thrown. I added a signal trap to catch this error (https://github.com/apache/incubator-mxnet/pull/13190) and

[Question] Difference between "Feature" and "Feature request" labels in Github

2018-11-13 Thread Lin Yuan
Dear Community, I often see there are "Feature" and "Feature request" labels in Github issues. May I know the difference? If they are meant to be the same thing, can we only keep one of them? Thanks, Lin

Re: [DISCUSS] Speedup non-code PR in CI

2018-11-06 Thread Lin Yuan
Kellen and Pedro, Thanks for your pointers. I am not an expert in CI but one naive speedup I can see is that if the PR only contains *.md file, then skip the build and testing cycles. This can make documentation/correction easier and save computation resource for other needed tests. Any side

Re: [Announce] Upcoming Apache MXNet (incubating) 1.3.1 patch release

2018-11-06 Thread Lin Yuan
Hi Anton, Thanks for helping the release. The following PRs are needed by customers who want to use deterministic CUDNN convolution algorithms: https://github.com/apache/incubator-mxnet/pull/12992 https://github.com/apache/incubator-mxnet/pull/13049 Thanks! Lin On Tue, Nov 6, 2018 at 1:51 PM

Re: [Question] Difference between "Feature" and "Feature request" labels in Github

2018-11-13 Thread Lin Yuan
22a5732e61f6fba1f89ac8@%3Cdev.mxnet.apache.org%3E > > > > We need someone with committer privileges to fix it. > > > > > > Thanks > > Anirudh > > > > > > > > On Tue, Nov 13, 2018 at 4:36 PM Lin Yuan wrote: > > > >

Re: CUDNN algorithm selection failure

2018-10-01 Thread Lin Yuan
elated to resource usage / allocation / leak in the worst case. > > Could be that there was not enough memory GPU memory at the time of test > execution. But I'm just speculating, hence my original question. > > Pedro. > > On Mon, Oct 1, 2018 at 8:16 PM Lin Yuan wrote: > &g

Re: CUDNN algorithm selection failure

2018-10-01 Thread Lin Yuan
Hi Pedro, I also got this failure in my PR http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11742/27/pipeline I was not able to identify the root cause of it from changelist. Are you suggesting there is some flakiness in the master branch too? Thanks,

Re: Propose to discontinue supporting Apache MXNet on Windows 7

2018-09-03 Thread Lin Yuan
in the > > > > > sense > > > > > > > that it would be easy to maintain for mxnet devs and allow > us > > > to use > > > > > > modern > > > > > > > cpp on older windows machines without using vs 2013(which I > >

Re: [LAZY VOTE] Consolidating developer guide in one place (cwiki preferred)

2018-09-26 Thread Lin Yuan
at 1:55 PM Lin Yuan wrote: > +1 > > On Tue, Sep 4, 2018 at 1:46 PM Aaron Markham > wrote: > >> I'd like to call for a lazy vote on this before proceeding. Already had >> some +1s but let's be sure. >> >> The vote is to move developer guide inf

Re: [LAZY VOTE] Consolidating developer guide in one place (cwiki preferred)

2018-09-28 Thread Lin Yuan
of these > epics. > > Cheers, > Aaron > > On Wed, Sep 26, 2018, 00:02 Lin Yuan wrote: > > > Hi Aaron, > > > > Do we have a resolution for this proposal yet? Recently, there have been > > many asks for a better documentation for MXNet developers. I thin

Re: [DISCUSS] Use modernized C++11 range loops uniformly throughout the project

2018-09-28 Thread Lin Yuan
+1 Using range-based for-loop whenever possible improves code readability and makes code less prone to human error. I did some preliminary research on Google and did not find any complaint about its performance drawback. Here is one piece from StackOverflow for reference:

Re: [Annoucement] New Committer -- Iblis Lin

2019-01-05 Thread Lin Yuan
Welcome Iblis, Great to see a good Julia support in MXNet! Lin On Sat, Jan 5, 2019 at 12:32 PM Marco de Abreu wrote: > Welcome Iblis, > > great to have you on board! > > -Marco > > Am Sa., 5. Jan. 2019, 21:13 hat Carin Meier > geschrieben: > > > Please join me in welcoming Iblis Lin as a new

Re: Apache MXNet v1.4.0 release status

2019-01-15 Thread Lin Yuan
Hi Steffen, I would like to ask to include one more PR for 1.4.0.rc1: https://github.com/apache/incubator-mxnet/pull/13845 This PR exports exception handling API of MXNet. It is needed by Horovod with MXNet integration to elegantly throw exception at Python level rather than a C++ abort.

Re: [Annoucement] New Committer -- Da Zheng

2018-12-17 Thread Lin Yuan
Congrats! On Mon, Dec 17, 2018 at 9:19 AM Steffen Rochel wrote: > Congratulation Da! > > On Mon, Dec 17, 2018 at 9:02 AM Tianqi Chen wrote: > > > Dear Community: > > > > Please join me to welcome Da Zheng as a new committer of the MXNet. > > > > Da is the main author of MKL-DNN integration and

[Question] UI change policy in MXNet

2018-12-20 Thread Lin Yuan
Dear Community, As a contributor, I would like to know the current policy for updating UI of an operator. I understand UI change should be introduced in major release not minor release. However, it is still not quite clear to me regarding the UI change process: 1) Which guideline should we

Re: [Question] UI change policy in MXNet

2018-12-20 Thread Lin Yuan
://github.com/apache/incubator-mxnet/pull/5499 . To summarize: > contrib > was created for ops for which we provide limited guarantees with respect to > backward compatibility, interface changes, testing etc. > > Anirudh > > On Thu, Dec 20, 2018 at 1:00 PM Lin Yuan wrot

Re: [Announce] Upcoming Apache MXNet (incubating) 1.4.0 release

2018-11-29 Thread Lin Yuan
Hi Steffen, Can we add the following PR to 1.4.0 release: https://github.com/apache/incubator-mxnet/pull/13452 It's just a Python API returning header path so it should not cause any regression issues. But it is required for Horovod to integrate MXNet. It's better to have this in a minor

Re: [Announce] Upcoming Apache MXNet (incubating) 1.4.0 release

2018-11-29 Thread Lin Yuan
https://github.com/apache/incubator-mxnet/pull/13452 is needed in 1.4.0 to support Horovod integration project. Thanks! Lin On Thu, Nov 29, 2018 at 1:40 PM Davydenko, Denis < dzianis.davydze...@gmail.com> wrote: > I suggest to include this issue into tracked ones for the release: >

[PROPOSAL] Large tensor support in MXNet

2018-12-02 Thread Lin Yuan
Dear Community, As some of you may have already encountered, MXNet has a limitation in supporting tensors of size greater than ~4.3 billion elements (2^32). The root cause is because in MXNet backend 32-bit integer type is used as the default integer data type for both computation and storage in

Re: CI impaired

2018-11-21 Thread Lin Yuan
Thanks for your efforts, Marco! On Wed, Nov 21, 2018 at 4:02 PM Anirudh Subramanian wrote: > Thanks for the quick response and mitigation! > > On Wed, Nov 21, 2018 at 3:55 PM Marco de Abreu > wrote: > > > Hello, > > > > today, CI had some issues and I had to cancel all jobs a few minutes ago.

Re: [DISCUSS] Build OSX builds in CI (possibly with TravisCI).

2018-09-18 Thread Lin Yuan
gt; > > > > > > Tianqi > > > > > > > > > On Wed, Sep 5, 2018 at 9:04 AM kellen sunderland < > > > > > > > > > kellen.sunderl...@gmail.com> wrote: > > > > > > > > > > >

Re: [Announcement] New Committer - Alex Zai

2019-03-31 Thread Lin Yuan
Congrats, Alex! Hope your book is going well :) Lin On Sun, Mar 31, 2019 at 6:18 PM Zhao, Patric wrote: > Congratulation, Alex. > > Thank you to your helps for MKLDNN backend including tests, coverage, CI :) > > Looking forward more cooperation together. > > > > -Original Message- > >

Re: [DISCUSS] Rebrand Gluon to MXNet imperative or something MXNet.

2019-03-22 Thread Lin Yuan
+1. Just to give some of my real experience: 1) I advertised a recent GluonNLP blog and many responses are "This seems nice. So is Gluon a new library to replace MXNet?" 2) We visited customers in a unicorn company who showed interests in MXNet but none of the engineers knew the relationship

Re: [DISCUSS] Rebrand Gluon to MXNet imperative or something MXNet.

2019-03-22 Thread Lin Yuan
> > good place to be in __ > > > > > > > > > > -- > > > > > Thanks, > > > > > Denis > > > > > > > > > > On 3/22/19, 4:48 PM, "Mu Li" wrote: > > > >

Re: [DISCUSS] Rebrand Gluon to MXNet imperative or something MXNet.

2019-03-22 Thread Lin Yuan
; (military > >> > > > connotation). If naming is the only thing we need to figure > out > >> - > >> > > that is a > >> > > > good place to be in __ > >> > > > > >> > > > -- > >>

Re: [DISCUSS] Rebrand Gluon to MXNet imperative or something MXNet.

2019-03-22 Thread Lin Yuan
@Junru Thanks for the clarification. Given that we already have courseware and books with Gluon, it makes sense to brand “Mxnet Gluon” with Gluon being the high level API of mxnet @Tianqi what’s the roadmap of GluonNLP/GluonCV? Are they positioned to be high level API of MXnet or some

[RFC] Higher order gradient support in MXNet

2019-04-04 Thread Lin Yuan
Dear Community, Higher order gradient calculation is required for many applications. However, current MXNet only support higher order gradient for a very limited number of operators. We plan to support the higher order gradient calculation in the autograd package. A design proposal is ready for

Re: [DISCUSS] Process to remove deprecated operators

2019-02-27 Thread Lin Yuan
elease. > > -sz > > On Wed, Feb 27, 2019 at 8:53 PM Lin Yuan wrote: > > > Dear Community, > > > > In MXNet there are many legacy operators such as this > > < > > > http://mxnet.incubator.apache.org/versions/master/api/python/symbol/symbol.

[DISCUSS] Process to remove deprecated operators

2019-02-27 Thread Lin Yuan
Dear Community, In MXNet there are many legacy operators such as this that has been marked DEPRECATE for several releases. However, these operators still exist in

Re: [DISCUSS] Process to remove deprecated operators

2019-02-27 Thread Lin Yuan
share some immature ideas about deprecating operators. Not > only adopting semantic versioning, but also should we provide enough > informative error message for customers to understand how to replace > deprecated operators with new ones. > > Thanks, > Junru > > On W

Re: Call for Ideas and Approaches to Community Building

2019-03-17 Thread Lin Yuan
Zach, Thanks for joining in the mxnet project and your very thoughtful discussion. We do have virtual hangout/meetups. Please refer to https://cwiki.apache.org/confluence/display/MXNET/Meetups+and+Hangouts I also strongly agree with your 4). I think we should have a clear roadmap on our wiki

Re: [Announcement] New Committer - Patric Zhao

2019-03-21 Thread Lin Yuan
Congrats, Patric! On Thu, Mar 21, 2019 at 10:32 AM Yuxi Hu wrote: > Congrats, Patric! Well deserved! > > On Wed, Mar 20, 2019 at 1:08 PM kellen sunderland < > kellen.sunderl...@gmail.com> wrote: > > > Congrats Patric! > > > > On Sun, Mar 17, 2019 at 10:34 PM Hagay Lupesko > wrote: > > > > >

Re: [Announce] Runtime feature detection

2019-02-12 Thread Lin Yuan
Thanks, Pedro for contributing this long awaiting feature. I can immediately use it for Horovod project now. Bravo! Lin On Tue, Feb 12, 2019 at 2:42 AM Pedro Larroy wrote: > An update on this topic, Sheng just merged the refinements to the > feature detection so it's now a single API call. (

Re: [RESTARTING][VOTE] Release Apache MXNet (incubating) version 1.4.0.rc2

2019-02-11 Thread Lin Yuan
+1 binding Horovod is going to release it's 0.16.0 in the coming week with MXNet integration. We need to release 1.4.0 which includes all the dependencies for Horovod integration. Best, Lin On Mon, Feb 11, 2019 at 9:30 PM Steffen Rochel wrote: > Dear community - > based on Justin's and

Re: [Announcement] New Committer - Nicolas Modrzyk

2019-02-15 Thread Lin Yuan
Welcome, Nicolas! Good to have you on board. Lin On Fri, Feb 15, 2019 at 8:03 AM Carin Meier wrote: > Please join me in welcoming Nicolas Modrzyk, (@hellonico), as a new > committer. > > He has made valuable contributions to the Clojure package, especially in > the areas of stability with

Re: Horovod-MXNet Integration

2019-01-30 Thread Lin Yuan
/mpi-operator) lately and it > would > be interesting to see an example of using Horovod + MXNet + Kubeflow using > MPI Operator. Feel free to reach out (@terrytangyuan > <https://github.com/terrytangyuan>) if you encounter any issues. > > Best, > Yuan > > > On

Re: [Announcement] New Committer -- Lin Yuan

2019-02-04 Thread Lin Yuan
gt;> > >> Dear Community: > >> > >> Please join me to welcome Lin Yuan(@apeforest) as a new committer of > >> Apache(incubating) MXNet! > >> > >> He has contributed to various improvements, including better > compatibility > >> of larg

Re: [VOTE] Release Apache MXNet (incubating) version 1.4.0.rc2

2019-02-04 Thread Lin Yuan
+1 build from source on MacOS 10.13.6 and tested mxnet-to-coreml converter. On Mon, Feb 4, 2019 at 9:03 AM Indhu wrote: > +1 > > Build from source and tested few examples from the examples folder. > > Thanks, > Indu > > > > On Fri, Feb 1, 2019 at 6:21 PM Steffen Rochel > wrote: > > > Hi Sheng

Re: [Announcement] New Committer -- Steffen Rochel

2019-02-05 Thread Lin Yuan
Welcome Steffen! Lin On Mon, Feb 4, 2019 at 7:53 PM kellen sunderland < kellen.sunderl...@gmail.com> wrote: > Great news. Congrats Steffen. > > On Mon, Feb 4, 2019, 5:29 PM Thomas DELTEIL wrote: > > > Welcome Steffen! > > > > On Mon, Feb 4, 2019, 15:55 Marco de Abreu wrote: > > > > >

Re: Fujitsu Breaks ImageNet Record using MXNet (under 75 sec)

2019-04-08 Thread Lin Yuan
Chai, Thanks for sharing. This is awesome news! Lin On Mon, Apr 8, 2019 at 8:48 AM Chaitanya Bapat wrote: > Greetings! > > Great start to a Monday morning, as I came across this news on Import AI, > an AI newsletter. > > The newsletter talked about Apache MXNet, hence thought of sharing it

Re: [QUESTION] mxnet/Tuple vs nnvm/Tuple

2019-04-16 Thread Lin Yuan
ew locations not changed in the current codebase, we should change them to > use mxnet Tuple as well for better cosmetics. The nnvm/tuple.h can be > deprecated in MXNet. > > On Mon, Apr 15, 2019 at 10:44 PM Lin Yuan wrote: > > > Dear Community, > > > > Curr

[QUESTION] mxnet/Tuple vs nnvm/Tuple

2019-04-15 Thread Lin Yuan
Dear Community, Currently in MXNet there are two Tuple template class defined in mxnet/tuple.h and nnvm/tuple.h respectively. These two templates are higly similar and most part are duplicated except for a couple of functions. However, they were used mixedly in current codebase and causing