Re: [Discussion] Remove bundled llvm OpenMP

2018-11-27 Thread Anton Chernov
Another thing to take into consideration: All python artefacts that are created (PyPi) are built with make and are not using the bundled OpenMP library. One step for the switch to CMake to happen is the approval and merging of the mentioned PR:

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Konstantin Ivlev
> Would it be possible to define cmake itself as a conan dependency for MXNet? yes, it is definitely possible for instance, to declare CMake 3.13.0 as a dependency, the following line has to be added to the conanfile.py: build_requires = "cmake_installer/3.13.0@conan/stable" other build tools

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Anton Chernov
I think I asked this already, but want to confirm in regards to the following discussion: MXNet CMake build - raise minimal required version https://lists.apache.org/thread.html/09772f9447ebff72cdfea5512ae70e295db8a21ba0ddb39359cd0a77@%3Cdev.mxnet.apache.org%3E Would it be possible to define

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Konstantin Ivlev
both questions are totally valid. > Is it easy to create a build which will build dependencies from source? 1. yep, it's very easy, just add `--build` argument to the `conan install` command line > What guarantees you get with conan with regards to ABI / C++ stdlib binary compatibility of the

Re: Redesign of the MXNet document site

2018-11-27 Thread Tianqi Chen
I like the conciseness of the new website. Thanks, Mu and Aron for bringing this Tianqi On Mon, Nov 26, 2018 at 11:56 AM Mu Li wrote: > Dear Community, > > I have been working with several Amazon folks in the past few weeks for a > major update of the document website. Now we have a minimal

Re: Include MKLDNN into default mxnet pip package

2018-11-27 Thread Anirudh Subramanian
Hi Tao, I was suggesting we can start using a release tag from mkldnn for major and minor releases of mxnet starting with 1.4.0. But this would require a versioning mechanism similar to semver for MKLDNN and MKLDNN to do patch release to backport the bug fixes/regressions. I dont know if this is

RE: Include MKLDNN into default mxnet pip package

2018-11-27 Thread Lv, Tao A
Hi Anirudh, please find the statements from MKL-DNN manager for the versioning mechanism of MKL-DNN library as below: "That's valid request and I would expect that as the software matures more and more applications will rely on stable versions. I would expect that for MXNet there is a stable

Significant performance regression in SpMV

2018-11-27 Thread Zheng, Da
Hello all, I notice there is a significant performance regression in SpMV after this PR (https://github.com/apache/incubator-mxnet/pull/12380). It seems the problem occurs when running on multiple GPUs (e.g., 8 GPUs). When running multiple GPUs for training, SpMV on CPU only uses two or three

Re: [Anouncement] New Committer: Tao Lv

2018-11-27 Thread Marco de Abreu
Thank you and welcome! Am Di., 27. Nov. 2018, 07:42 hat Steffen Rochel geschrieben: > Congratulation, Tao! Thank you for contributions and commitment to MXNet > project. > On Mon, Nov 26, 2018 at 8:04 PM Zhao, Patric > wrote: > > > Congratulation, Tao. > > > > > -Original Message- > >

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Konstantin Ivlev
Hi Pedro, yes, you're absolutely right, by default, conan will be pulling prebuilt binaries for the libraries from the bintray. however, if prebuilt binaries are not available (e.g. because you use some different compiler for which we don't have prebuilt binaries), or if you want to build

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Pedro Larroy
Hi Konstantin Thanks for this contribution. With your proposed changes, when building MXNet we will be pulling binaries for the libraries managed by conan? Pedro. On Mon, Nov 26, 2018 at 11:43 AM Konstantin Ivlev wrote: > > Hello, Ivan, > > could you possibly clarify your question (may be

MXNet Berlin Office Hours

2018-11-27 Thread Chance Bair
Hello Dev, This is a friendly reminder that Berlin office hours will be held today at 6pm-7pm (CEST) / 9am-10am (PST). More info here: https://cwiki.apache.org/confluence/display/MXNET/Apache+MXNet+%28Incubating%29+User+Groups+recurring+meetings Thanks! Chance Bair

RE: [Anouncement] New Committer: Tao Lv

2018-11-27 Thread Lv, Tao A
Thank you for the warm welcome, Kellen and Marco :) -Original Message- From: Marco de Abreu [mailto:marco.g.ab...@googlemail.com.INVALID] Sent: Tuesday, November 27, 2018 4:26 PM To: dev@mxnet.incubator.apache.org Subject: Re: [Anouncement] New Committer: Tao Lv Thank you and welcome!

RE: [Anouncement] New Committer: Tao Lv

2018-11-27 Thread Lv, Tao A
And Steffen. :) -Original Message- From: Lv, Tao A [mailto:tao.a...@intel.com] Sent: Tuesday, November 27, 2018 9:05 PM To: dev@mxnet.incubator.apache.org Subject: RE: [Anouncement] New Committer: Tao Lv Thank you for the warm welcome, Kellen and Marco :) -Original Message-

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Diego Rodriguez-Losada
Hi Pedro, Conan is distributed. So besides building from sources the dependencies, it is also possible to create binaries yourself for those dependencies (with the existing recipes, or your own recipes), and host them in your own repo (Bintray OSS repo, or Artifactory). This will provide both

RE: Include MKLDNN into default mxnet pip package

2018-11-27 Thread Lv, Tao A
Hi Anirudh, Just to confirm, you're focusing on the 1.4.0 release of MXNet and want to have a release version of MKL-DNN there, right? Or do you mean all the development in the future should base on the release version of MKL-DNN? For the former one, I think 0.17 release of MKL-DNN is a good

Re: using conan to manage Apache Incubator MXNet project dependencies

2018-11-27 Thread Pedro Larroy
Thanks both for the detailed explanations. Couple of more questions: Is it easy to create a build which will build dependencies from source? What guarantees you get with conan with regards to ABI / C++ stdlib binary compatibility of the pulled dependencies? Just to clarify: My concerns are in