[incubator-mxnet] branch master updated (bfd6b41 -> df28e61)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from bfd6b41 CI: Add test for docker cache job run on master branch commits (#18183) add df28e61 Fixed Install page history broken (#18182) No new revisions were added by this update. Summary of changes: docs/static_site/src/_sass/minima/_getting_started.scss | 5 + docs/static_site/src/assets/js/options.js | 7 +-- 2 files changed, 10 insertions(+), 2 deletions(-)
[incubator-mxnet] branch v1.x updated: Bump up additional scala 1.x branch to 1.7.0 (#17765)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a commit to branch v1.x
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git
The following commit(s) were added to refs/heads/v1.x by this push:
new 3b83cd8 Bump up additional scala 1.x branch to 1.7.0 (#17765)
3b83cd8 is described below
commit 3b83cd803612fb46d83e5157ac8dc6cebaa107a6
Author: Zach Kimberg
AuthorDate: Fri Mar 6 13:39:37 2020 -0800
Bump up additional scala 1.x branch to 1.7.0 (#17765)
---
.../src/pages/api/scala/docs/tutorials/mxnet_scala_on_intellij.md | 4 ++--
scala-package/pom.xml | 2 +-
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git
a/docs/static_site/src/pages/api/scala/docs/tutorials/mxnet_scala_on_intellij.md
b/docs/static_site/src/pages/api/scala/docs/tutorials/mxnet_scala_on_intellij.md
index b71b457..bbd12a3 100644
---
a/docs/static_site/src/pages/api/scala/docs/tutorials/mxnet_scala_on_intellij.md
+++
b/docs/static_site/src/pages/api/scala/docs/tutorials/mxnet_scala_on_intellij.md
@@ -410,14 +410,14 @@ If you chose to "Build from Source" when following the
[install instructions]({{
org.apache.mxnet
mxnet-core_${scala.version}-${platform}-sources
system
-
/PathToMXNetSource/incubator-mxnet/scala-package/assembly/osx-x86_64-cpu/target/mxnet-full_${scala.version}-osx-x86_64-cpu-1.6.0-SNAPSHOT-sources.jar
+
/PathToMXNetSource/incubator-mxnet/scala-package/assembly/osx-x86_64-cpu/target/mxnet-full_${scala.version}-osx-x86_64-cpu-1.7.0-SNAPSHOT-sources.jar
org.apache.mxnet
mxnet-full_${scala.version}-${platform}
system
-
/PathToMXNetSource/incubator-mxnet/scala-package/assembly/osx-x86_64-cpu/target/mxnet-full_${scala.version}-osx-x86_64-cpu-1.6.0-SNAPSHOT.jar
+
/PathToMXNetSource/incubator-mxnet/scala-package/assembly/osx-x86_64-cpu/target/mxnet-full_${scala.version}-osx-x86_64-cpu-1.7.0-SNAPSHOT.jar
```
diff --git a/scala-package/pom.xml b/scala-package/pom.xml
index e1887d7..186f21a 100644
--- a/scala-package/pom.xml
+++ b/scala-package/pom.xml
@@ -57,7 +57,7 @@
2.11.8
2.11
-1.6.0
+1.7.0
g++
$
[incubator-mxnet] branch master updated (8525926 -> 0f3c5da)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 8525926 Correct the grammar in 1-ndarray tutorial (#17513) add 0f3c5da Fix get_started scala gpu (#17434) No new revisions were added by this update. Summary of changes: docs/static_site/src/_includes/get_started/linux/scala/gpu.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[incubator-mxnet] branch v1.5.x updated: Fix staticbuild pipeline (#17473)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a commit to branch v1.5.x in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git The following commit(s) were added to refs/heads/v1.5.x by this push: new 87c4f23 Fix staticbuild pipeline (#17473) 87c4f23 is described below commit 87c4f237705ff2a9572635f5859d53f070596507 Author: Leonard Lausen AuthorDate: Wed Jan 29 16:34:16 2020 -0800 Fix staticbuild pipeline (#17473) --- ci/docker/install/ubuntu_publish.sh | 15 +++ 1 file changed, 7 insertions(+), 8 deletions(-) diff --git a/ci/docker/install/ubuntu_publish.sh b/ci/docker/install/ubuntu_publish.sh index 65982ee..e62efd5 100755 --- a/ci/docker/install/ubuntu_publish.sh +++ b/ci/docker/install/ubuntu_publish.sh @@ -57,14 +57,13 @@ mv apache-maven-3.3.9/ /usr/local/maven/ update-alternatives --install /usr/bin/mvn mvn /usr/local/maven/apache-maven-3.3.9/bin/mvn 1 update-ca-certificates -f -apt-get install -y python python3 +apt-get install -y python python-pip python3 python3-pip # the version of the pip shipped with ubuntu may be too lower, install a recent version here -wget -nv https://bootstrap.pypa.io/get-pip.py -python3 get-pip.py -python2 get-pip.py +# Restrict pip version to <19 due to use of Python 3.4 on Ubuntu 14.04 +python2 -m pip install --upgrade 'pip<19' +python3 -m pip install --upgrade 'pip<19' -apt-get remove -y python3-urllib3 - -pip2 install nose cpplint==1.3.0 'numpy>1.16.0,<2.0.0' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 -pip3 install nose cpplint==1.3.0 pylint==2.3.1 'numpy>1.16.0,<2.0.0' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 +# Restrict numpy version to <1.18 due to use of Python 3.4 on Ubuntu 14.04 +python2 -m pip install --upgrade --ignore-installed nose cpplint==1.3.0 'numpy>1.16.0,<1.17' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 +python3 -m pip install --upgrade --ignore-installed nose cpplint==1.3.0 pylint==2.3.1 'numpy>1.16.0,<1.18' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3
[incubator-mxnet] branch v1.5.x updated: Fix staticbuild pipeline (#17473)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a commit to branch v1.5.x in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git The following commit(s) were added to refs/heads/v1.5.x by this push: new 87c4f23 Fix staticbuild pipeline (#17473) 87c4f23 is described below commit 87c4f237705ff2a9572635f5859d53f070596507 Author: Leonard Lausen AuthorDate: Wed Jan 29 16:34:16 2020 -0800 Fix staticbuild pipeline (#17473) --- ci/docker/install/ubuntu_publish.sh | 15 +++ 1 file changed, 7 insertions(+), 8 deletions(-) diff --git a/ci/docker/install/ubuntu_publish.sh b/ci/docker/install/ubuntu_publish.sh index 65982ee..e62efd5 100755 --- a/ci/docker/install/ubuntu_publish.sh +++ b/ci/docker/install/ubuntu_publish.sh @@ -57,14 +57,13 @@ mv apache-maven-3.3.9/ /usr/local/maven/ update-alternatives --install /usr/bin/mvn mvn /usr/local/maven/apache-maven-3.3.9/bin/mvn 1 update-ca-certificates -f -apt-get install -y python python3 +apt-get install -y python python-pip python3 python3-pip # the version of the pip shipped with ubuntu may be too lower, install a recent version here -wget -nv https://bootstrap.pypa.io/get-pip.py -python3 get-pip.py -python2 get-pip.py +# Restrict pip version to <19 due to use of Python 3.4 on Ubuntu 14.04 +python2 -m pip install --upgrade 'pip<19' +python3 -m pip install --upgrade 'pip<19' -apt-get remove -y python3-urllib3 - -pip2 install nose cpplint==1.3.0 'numpy>1.16.0,<2.0.0' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 -pip3 install nose cpplint==1.3.0 pylint==2.3.1 'numpy>1.16.0,<2.0.0' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 +# Restrict numpy version to <1.18 due to use of Python 3.4 on Ubuntu 14.04 +python2 -m pip install --upgrade --ignore-installed nose cpplint==1.3.0 'numpy>1.16.0,<1.17' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3 +python3 -m pip install --upgrade --ignore-installed nose cpplint==1.3.0 pylint==2.3.1 'numpy>1.16.0,<1.18' nose-timer 'requests<2.19.0,>=2.18.4' h5py==2.8.0rc1 scipy==1.0.1 boto3
[incubator-mxnet] branch master updated (0f04b0d -> 413f748)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 0f04b0d [tvmop] support cuda multi-arch compilation (#17214) add 413f748 autograd video and image link fixes and removing symbol tutorials (#17227) No new revisions were added by this update. Summary of changes: docs/python_docs/python/api/symbol/index.rst | 10 -- .../python/tutorials/packages/autograd/index.md| 14 +++--- 2 files changed, 7 insertions(+), 17 deletions(-)
[incubator-mxnet] branch master updated (b38816d -> 77c7c3a)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from b38816d ONNX export: Gather (#15995) add 77c7c3a Enhancements for custom subgraph op (#17194) No new revisions were added by this update. Summary of changes: example/extensions/lib_custom_op/subgraph_lib.cc | 17 +--- include/mxnet/lib_api.h | 13 -- src/c_api/c_api.cc | 51 +--- 3 files changed, 48 insertions(+), 33 deletions(-)
[incubator-mxnet] branch master updated (b38816d -> 77c7c3a)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from b38816d ONNX export: Gather (#15995) add 77c7c3a Enhancements for custom subgraph op (#17194) No new revisions were added by this update. Summary of changes: example/extensions/lib_custom_op/subgraph_lib.cc | 17 +--- include/mxnet/lib_api.h | 13 -- src/c_api/c_api.cc | 51 +--- 3 files changed, 48 insertions(+), 33 deletions(-)
[incubator-mxnet] branch master updated: Link fixes5 (#16986)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git The following commit(s) were added to refs/heads/master by this push: new c573154 Link fixes5 (#16986) c573154 is described below commit c573154e9deb3881ee3a64a9fa0886248622bacf Author: Talia <31782251+techopra1...@users.noreply.github.com> AuthorDate: Mon Dec 9 10:20:03 2019 -0800 Link fixes5 (#16986) * link fixes * fixing broken links, added data tutorials back into gluon package section * Added autograd images back in to the tutorial in the python package docs * created relative link for symbol api reference * renaming data folder * incorporating new folder-name on gluon index cards * fixed gotcha link * Fixed relative link * fixing links on performance index page * took out data files, checked and modified index files for python tutorials * added license header to multi_devices.md * link fixes * fixing broken links, added data tutorials back into gluon package section * Added autograd images back in to the tutorial in the python package docs * created relative link for symbol api reference * renaming data folder * incorporating new folder-name on gluon index cards * fixed gotcha link * fixing links on performance index page * took out data files, checked and modified index files for python tutorials * added license header to multi_devices.md * adding updated submodule --- docs/python_docs/python/tutorials/index.rst| 2 +- .../autograd/_static/autograd_control_flow.png | Bin 0 -> 21635 bytes .../_static/autograd_control_flow_grad.png | Bin 0 -> 20585 bytes .../autograd/_static/autograd_forward_backward.png | Bin 0 -> 63061 bytes .../autograd/_static/autograd_grad_req.mp4 | Bin 0 -> 71224 bytes .../autograd/_static/autograd_gradient.png | Bin 0 -> 39559 bytes .../packages/autograd/_static/autograd_graph.mp4 | Bin 0 -> 113606 bytes .../autograd/_static/autograd_head_grad.mp4| Bin 0 -> 59549 bytes .../python/tutorials/packages/autograd/index.md| 14 +- .../tutorials/packages/gluon/image/index.rst | 10 - .../tutorials/packages/gluon/image/info_gan.md | 454 + .../python/tutorials/packages/gluon/index.rst | 22 +- .../python/tutorials/packages/index.rst| 6 +- .../python/tutorials/performance/backend/index.rst | 2 +- .../python/tutorials/performance/index.rst | 19 +- .../static_site/src/pages/api/faq/multi_devices.md | 217 ++ 16 files changed, 701 insertions(+), 45 deletions(-) diff --git a/docs/python_docs/python/tutorials/index.rst b/docs/python_docs/python/tutorials/index.rst index c130ce6..8e2362e 100644 --- a/docs/python_docs/python/tutorials/index.rst +++ b/docs/python_docs/python/tutorials/index.rst @@ -92,7 +92,7 @@ Performance .. card:: :title: MKL-DNN - :link: performance/backend/mkldnn/mkldnn_quantization + :link: performance/backend/mkldnn/index.html How to get the most from your CPU by using Intel's MKL-DNN. diff --git a/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow.png b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow.png new file mode 100644 index 000..804950f Binary files /dev/null and b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow.png differ diff --git a/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow_grad.png b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow_grad.png new file mode 100644 index 000..550d41f Binary files /dev/null and b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_control_flow_grad.png differ diff --git a/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_forward_backward.png b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_forward_backward.png new file mode 100644 index 000..2e13fdb Binary files /dev/null and b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_forward_backward.png differ diff --git a/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_grad_req.mp4 b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_grad_req.mp4 new file mode 100644 index 000..5f3662d Binary files /dev/null and b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_grad_req.mp4 differ diff --git a/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_gradient.png b/docs/python_docs/python/tutorials/packages/autograd/_static/autograd_gradient.png new fil
[incubator-mxnet] branch master updated (9c94fdb -> fcc42de)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 9c94fdb Fix NDArrayIter iteration bug when last_batch_handle='pad' (#16166) add fcc42de updating MXNet version to 1.6.0 in base.h for C APIs (#16905) No new revisions were added by this update. Summary of changes: include/mxnet/base.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (5fb2916 -> 78a2523)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 5fb2916 [MKLDNN] Use MKLDNNRun (#16772)
add 78a2523 [docs] Fix runtime feature detection documentation (#16746)
No new revisions were added by this update.
Summary of changes:
docs/python_docs/python/api/mxnet/index.rst| 3 ++-
.../api/{autograd => mxnet/runtime}/index.rst | 4 ++--
python/mxnet/runtime.py| 27 +-
3 files changed, 30 insertions(+), 4 deletions(-)
copy docs/python_docs/python/api/{autograd => mxnet/runtime}/index.rst (94%)
[incubator-mxnet] branch master updated (5fb2916 -> 78a2523)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 5fb2916 [MKLDNN] Use MKLDNNRun (#16772)
add 78a2523 [docs] Fix runtime feature detection documentation (#16746)
No new revisions were added by this update.
Summary of changes:
docs/python_docs/python/api/mxnet/index.rst| 3 ++-
.../api/{autograd => mxnet/runtime}/index.rst | 4 ++--
python/mxnet/runtime.py| 27 +-
3 files changed, 30 insertions(+), 4 deletions(-)
copy docs/python_docs/python/api/{autograd => mxnet/runtime}/index.rst (94%)
[incubator-mxnet] branch master updated (5fb2916 -> 78a2523)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 5fb2916 [MKLDNN] Use MKLDNNRun (#16772)
add 78a2523 [docs] Fix runtime feature detection documentation (#16746)
No new revisions were added by this update.
Summary of changes:
docs/python_docs/python/api/mxnet/index.rst| 3 ++-
.../api/{autograd => mxnet/runtime}/index.rst | 4 ++--
python/mxnet/runtime.py| 27 +-
3 files changed, 30 insertions(+), 4 deletions(-)
copy docs/python_docs/python/api/{autograd => mxnet/runtime}/index.rst (94%)
[incubator-mxnet] branch master updated (9889310 -> 55fe7c5)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 9889310 Initial checkin (#16856) add 55fe7c5 Fix IndentationError in setup.py (#16857) No new revisions were added by this update. Summary of changes: tools/pip/setup.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (8820220 -> 1256976)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 8820220 Adds pip requirements file to nightly gpu ci image (#16472) add 1256976 Fix Nightly Tests for Binaries (#16451) No new revisions were added by this update. Summary of changes: tests/utils/notebook_test/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (8820220 -> 1256976)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 8820220 Adds pip requirements file to nightly gpu ci image (#16472) add 1256976 Fix Nightly Tests for Binaries (#16451) No new revisions were added by this update. Summary of changes: tests/utils/notebook_test/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (8820220 -> 1256976)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 8820220 Adds pip requirements file to nightly gpu ci image (#16472) add 1256976 Fix Nightly Tests for Binaries (#16451) No new revisions were added by this update. Summary of changes: tests/utils/notebook_test/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (986cecd -> d61ed3f)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 986cecd Update MKL-DNN dependency (#16073) add d61ed3f Solve #14116, #15143 (#15144) No new revisions were added by this update. Summary of changes: include/mxnet/tuple.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[incubator-mxnet] branch master updated (5ed5689 -> 7fc1d84)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 5ed5689 numpy operator ravel, derive from reshape (#16016)
add 7fc1d84 Adds dynamic libmxnet to CD pipeline (#16163)
No new revisions were added by this update.
Summary of changes:
cd/Jenkinsfile_cd_pipeline | 8 +-
cd/Jenkinsfile_release_job | 4 +-
.../{static => dynamic}/Jenkins_pipeline.groovy| 16 ++--
ci/docker/runtime_functions.sh | 101 +
4 files changed, 117 insertions(+), 12 deletions(-)
copy cd/mxnet_lib/{static => dynamic}/Jenkins_pipeline.groovy (70%)
[incubator-mxnet] branch master updated (b4b7bfb -> c5383f7)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from b4b7bfb Update env_var.md (#16145) add c5383f7 CD Fixes (#16127) No new revisions were added by this update. Summary of changes: cd/Jenkinsfile_cd_pipeline| 2 +- cd/README.md | 4 ++-- ci/docker/runtime_functions.sh| 2 ++ python/mxnet/test_utils.py| 5 + tests/python/unittest/test_library_loading.py | 3 ++- 5 files changed, 12 insertions(+), 4 deletions(-)
[incubator-mxnet] branch master updated (e260f13 -> 9675a2d)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from e260f13 [Numpy] Random.choice implemented (#16089) add 9675a2d Update python dependencies (#16105) No new revisions were added by this update. Summary of changes: tools/pip/setup.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[incubator-mxnet] branch master updated (acc7865 -> c8f0b21)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from acc7865 added check for empty params file and unknown param (not arg/aux) (#15917) add c8f0b21 Remove Scala package test on build (#15915) No new revisions were added by this update. Summary of changes: ci/publish/scala/build.sh | 2 +- make/maven/maven_darwin_mkl.mk| 2 +- make/maven/maven_linux_cu90mkl.mk | 4 +++- make/maven/maven_linux_cu92mkl.mk | 4 +++- make/maven/maven_linux_mkl.mk | 2 +- make/pip/pip_linux_cu100.mk | 2 ++ make/pip/pip_linux_cu100mkl.mk| 2 ++ make/pip/pip_linux_cu101.mk | 2 ++ make/pip/pip_linux_cu101mkl.mk| 2 ++ make/pip/pip_linux_cu91.mk| 2 ++ make/pip/pip_linux_cu91mkl.mk | 2 ++ make/pip/pip_linux_cu92.mk| 2 ++ make/pip/pip_linux_cu92mkl.mk | 2 ++ tools/dependencies/openblas.sh| 2 +- tools/setup_gpu_build_tools.sh| 9 +++-- 15 files changed, 33 insertions(+), 8 deletions(-)
[incubator-mxnet] branch master updated (f586c07 -> acc7865)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from f586c07 [OpPerf] Profiler flag for Python, Cpp (#15881) add acc7865 added check for empty params file and unknown param (not arg/aux) (#15917) No new revisions were added by this update. Summary of changes: python/mxnet/model.py | 19 +-- 1 file changed, 13 insertions(+), 6 deletions(-)
[incubator-mxnet] branch master updated: Refactor LibraryInitializer so it's thread safe. Fixes random sporadical concurrency crashes. (#15762)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git
The following commit(s) were added to refs/heads/master by this push:
new bfd3bb8 Refactor LibraryInitializer so it's thread safe. Fixes random
sporadical concurrency crashes. (#15762)
bfd3bb8 is described below
commit bfd3bb8972b7e4a9cd8487c4ab6e6583202f3259
Author: Pedro Larroy
AuthorDate: Fri Aug 9 14:12:55 2019 -0700
Refactor LibraryInitializer so it's thread safe. Fixes random sporadical
concurrency crashes. (#15762)
* Refactor LibraryInitializer so it's thread safe.
Fixes #13438
Fixes #14979
* Refactor around lib loading
* Fix lint
* CR
* Add option to choose between OMP implementations
* Fix bug
* Fix from CR
---
CMakeLists.txt | 12 +-
docs/faq/env_var.md | 10 +-
src/c_api/c_api.cc | 4 +-
src/common/library.cc | 125
src/common/library.h| 57
src/common/utils.h | 12 ++
src/engine/threaded_engine_perdevice.cc | 4 +-
src/initialize.cc | 247 +---
src/initialize.h| 126
src/profiler/profiler.h | 15 +-
10 files changed, 359 insertions(+), 253 deletions(-)
diff --git a/CMakeLists.txt b/CMakeLists.txt
index 85f302f..976c736 100644
--- a/CMakeLists.txt
+++ b/CMakeLists.txt
@@ -24,6 +24,7 @@ mxnet_option(USE_OLDCMAKECUDA "Build with old cmake cuda"
OFF)
mxnet_option(USE_NCCL "Use NVidia NCCL with CUDA" OFF)
mxnet_option(USE_OPENCV "Build with OpenCV support" ON)
mxnet_option(USE_OPENMP "Build with Openmp support" ON)
+mxnet_option(USE_OPENMP_BUNDLED_LLVM "Build with bundled llvm openmp from
3rdparty" OFF)
mxnet_option(USE_CUDNN"Build with cudnn support" ON) # one could
set CUDNN_ROOT for search path
mxnet_option(USE_SSE "Build with x86 SSE instruction support" ON
IF NOT ARM)
mxnet_option(USE_F16C "Build with x86 F16C instruction support"
ON) # autodetects support if ON
@@ -433,11 +434,11 @@ if(USE_OPENMP)
find_package(OpenMP REQUIRED)
# This should build on Windows, but there's some problem and I don't have a
Windows box, so
# could a Windows user please fix?
- if(EXISTS ${CMAKE_CURRENT_SOURCE_DIR}/3rdparty/openmp/CMakeLists.txt
- AND SYSTEM_ARCHITECTURE STREQUAL "x86_64"
- AND NOT MSVC
- AND NOT CMAKE_CROSSCOMPILING)
-
+ if(USE_OPENMP_BUNDLED_LLVM AND EXISTS
${CMAKE_CURRENT_SOURCE_DIR}/3rdparty/openmp/CMakeLists.txt
+ AND SYSTEM_ARCHITECTURE STREQUAL "x86_64"
+ AND NOT MSVC
+ AND NOT CMAKE_CROSSCOMPILING)
+message("Using bundlded LLVM OpenMP")
# Intel/llvm OpenMP: https://github.com/llvm-mirror/openmp
set(OPENMP_STANDALONE_BUILD TRUE)
set(LIBOMP_ENABLE_SHARED TRUE)
@@ -451,6 +452,7 @@ if(USE_OPENMP)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} ${OpenMP_CXX_FLAGS}")
add_definitions(-DMXNET_USE_OPENMP=1)
else()
+message("Using platform provided OpenMP")
if(OPENMP_FOUND)
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} ${OpenMP_C_FLAGS}")
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} ${OpenMP_CXX_FLAGS}")
diff --git a/docs/faq/env_var.md b/docs/faq/env_var.md
index 24d62f3..b33a104 100644
--- a/docs/faq/env_var.md
+++ b/docs/faq/env_var.md
@@ -39,6 +39,9 @@ $env:MXNET_STORAGE_FALLBACK_LOG_VERBOSE=0
## Set the Number of Threads
+* MXNET_OMP_MAX_THREADS
+ - Values: Int ```(default=Number of processors / Number of processors * 2 in
X86)```
+ - Maximum number of threads to use in individual operators through OpenMP.
If not set, OMP_NUM_THREADS is considered after.
* MXNET_GPU_WORKER_NTHREADS
- Values: Int ```(default=2)```
- The maximum number of threads to use on each GPU. This parameter is used
to parallelize the computation within a single GPU card.
@@ -47,7 +50,7 @@ $env:MXNET_STORAGE_FALLBACK_LOG_VERBOSE=0
- The maximum number of concurrent threads that do the memory copy job on
each GPU.
* MXNET_CPU_WORKER_NTHREADS
- Values: Int ```(default=1)```
- - The maximum number of scheduling threads on CPU. It specifies how many
operators can be run in parallel. Note that most CPU operators are parallelized
by OpenMP. To change the number of threads used by individual operators, please
set `OMP_NUM_THREADS` instead.
+ - The maximum number of scheduling threads on CPU. It specifies how many
operators can be run in parallel. Note that most CPU operators are parallelized
by OpenMP. To change the number of threads used by individual operators, please
set
[incubator-mxnet] branch master updated (07eb482 -> a2b11ae)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 07eb482 fix tvm cmake (#15781)
add a2b11ae Fix PR #15489 (Dynamic Library Loading Support) (#15760)
No new revisions were added by this update.
Summary of changes:
CMakeLists.txt | 6 +
Makefile | 7 +-
ci/jenkins/Jenkins_steps.groovy| 10 +-
example/{rnn/large_word_lm => lib_api}/Makefile| 18 ++-
example/lib_api/libtest.cc | 78 +
.../torch_criterion.cu => example/lib_api/mylib.cc | 28 ++---
.../contrib/__init__.py => example/lib_api/test.py | 18 +--
include/mxnet/c_api.h | 7 ++
include/mxnet/lib_api.h| 50 +
python/mxnet/__init__.py | 1 +
python/mxnet/base.py | 2 +-
python/mxnet/{io/__init__.py => library.py}| 36 --
src/c_api/c_api.cc | 15 +++
src/common/library.cc | 125 +
src/common/library.h | 57 ++
src/initialize.cc | 8 ++
tests/python/gpu/test_operator_gpu.py | 1 +
tests/python/unittest/test_library_loading.py | 48
18 files changed, 471 insertions(+), 44 deletions(-)
copy example/{rnn/large_word_lm => lib_api}/Makefile (78%)
create mode 100644 example/lib_api/libtest.cc
copy plugin/torch/torch_criterion.cu => example/lib_api/mylib.cc (71%)
copy python/mxnet/gluon/contrib/__init__.py => example/lib_api/test.py (74%)
create mode 100644 include/mxnet/lib_api.h
copy python/mxnet/{io/__init__.py => library.py} (50%)
create mode 100644 src/common/library.cc
create mode 100644 src/common/library.h
create mode 100644 tests/python/unittest/test_library_loading.py
[incubator-mxnet] branch master updated (6acf7e6 -> b88705e)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 6acf7e6 Small typo fixes in batch_norm-inl.h (#15527) add b88705e fix heap-use-after-free in scala (#15503) No new revisions were added by this update. Summary of changes: .../native/src/main/native/org_apache_mxnet_native_c_api.cc| 7 --- 1 file changed, 4 insertions(+), 3 deletions(-)
[incubator-mxnet] branch master updated (379d11f -> c8ee1b3)
This is an automated email from the ASF dual-hosted git repository. zachgk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 379d11f Disables large tensor size cpu test step (#14982) add c8ee1b3 Fix test memory with ResourceScope (#14666) No new revisions were added by this update. Summary of changes: .../customop/CustomOpExampleSuite.scala| 57 -- .../IMClassificationExampleSuite.scala | 42 +--- .../ImageClassifierExampleSuite.scala | 35 +++-- .../infer/predictor/PredictorExampleSuite.scala| 38 --- .../mxnetexamples/multitask/MultiTaskSuite.scala | 18 --- .../neuralstyle/NeuralStyleSuite.scala | 24 + .../apache/mxnetexamples/rnn/ExampleRNNSuite.scala | 56 +++-- .../scala/sample/ImageClassificationExample.scala | 2 +- 8 files changed, 151 insertions(+), 121 deletions(-)
svn commit: r34064 - /dev/incubator/mxnet/KEYS
Author: zachgk Date: Wed May 15 22:24:10 2019 New Revision: 34064 Log: Add key for zac...@apache.org Modified: dev/incubator/mxnet/KEYS Modified: dev/incubator/mxnet/KEYS == --- dev/incubator/mxnet/KEYS (original) +++ dev/incubator/mxnet/KEYS Wed May 15 22:24:10 2019 @@ -807,3 +807,61 @@ QTXMfTPP627GwzHQXTdAn9CSGW5FkaSHTVTCZhal 44liPzisQFRxRFOwEubvmw== =dQvb -END PGP PUBLIC KEY BLOCK- +pub rsa4096 2019-05-15 [SC] + 228ADD932CB218723E61D09E043071126325F0EC +uid [ultimate] Zach Kimberg +sig 3043071126325F0EC 2019-05-15 Zach Kimberg +sub rsa4096 2019-05-15 [E] +sig 043071126325F0EC 2019-05-15 Zach Kimberg + +-BEGIN PGP PUBLIC KEY BLOCK- + +mQINBFzcgWsBEADpXccvPwwE1tNd/f5L1+x5+Kcaw1jLhb1y3/S9Um8iE3wZsRvR +pxNXhw8n+obqVicWFrShCI2rS6yUZFeWAP8X3XWM47sx93y/fFpg4+mDP0Ejl0op +VmZeiX4MCwloMWRMpN5XtiLzilNVUuisa0UhHJaQ67eOjQuZac/nbJojptBaBa9D +zf/1TLAd7mTTk8TBosouSd13gCX262EJb2n2hOYl2hx59Tky1CYNoHpQYdfH+u0U +bwOfMEzbrrD8HyqF1eeEu8EagWKc5piByOWn6smBjpU2uBqBh8N6MH/mY5aDsqGB +wkexiAsq/sKbPi0iFJ0CWmSls69Twe0vmW+THh7SWfGhbUxGwHsuYYIQnjcTHSMg +HZHhB0RrjqiYtyfSvqo0mSOgwtZAX0dg4uCyZtPPeRo9X5qIl8DVPVtKqybdVsX1 +06Pt8EaSSFlxPJN/giw86GflsP2hL3ttjB/p3/8oa1ffgl+Z8xjrkwlDBnKL2BI5 +sfad/l//oPd41IheNji6C2TdnZYyWRpDumes1Jr924E25bAcy3lI82QDdpyHSp4v +9+LG3NRpqLzQ/LpgBZnpjSnVMN1xBdwXpJ87omKM+fzgG0qiScBKko8jGYeRr/IR +sX1ofHUIty57zzWEUc5MN/zgtnIxY3ZSHs1erfnZm5JDou+1YblxkiMGZQARAQAB +tCBaYWNoIEtpbWJlcmcgPHphY2hna0BhcGFjaGUub3JnPokCTgQTAQgAOBYhBCKK +3ZMsshhyPmHQngQwcRJjJfDsBQJc3IFrAhsDBQsJCAcCBhUKCQgLAgQWAgMBAh4B +AheAAAoJEAQwcRJjJfDs1hgQAMMQkFmjWIOvHC63qJPeMP/BwgSeyANczohTWhBk +fkpoxFHW5nGxOJePyHqINufy0G0eQLWzBQp/VFTTFadS/tPL0gZi2JvOXSLmroLa +LBGcCkChTjXj1ah7pDq9J3KlHeOY6fzDDA9+3+8XRXMaROL2Bi3ax3jk0hhQ9iMh +jH8iROHsAZAJg7CQ9MUCnlJlyS2mCNVOWBlsKWjoOW4s3pptvH8VBXnYRQfcTZbN +VDwbwxvpq8cDgK+YJ+53MsgxCiYXQ0xtYOwYeThOdf29hRdOJBLwPpbZIlwCgYF5 +xeZinRCh10eVc8UvSFurXT4i91XulWs1pSMXv6xEV5LkXINzpfU8zzfCdpMYpq7n +j7SJc+x5EhjUt8LQsa6ohVHsmEMQpEuX18uOxaA+WE2XAn4Y5kty9Hm1g6osSFEl +40eGio9rz3zd63cHU3c9ccKAg0oxtWnsAw/kvSfExCg40kCvtrmrSoZt+iQnnw1l +isvYtrzEjQiufbF4wryIfFcP/BZEZ4KeDvC6cU6tKyH8gYlW89EYfW92E4rfvofs +o7i0Lo4vVVBmVqCoCORcsJsfRvZs5BpG4SXGD9kOsrz+LVmm3Y7vf68ycc7cTbKs +rlIGLbMzIfk43s9i+C9IRgCo7PjImi7cbEBi52FvriR37ispDhvm2WX4i9o1DNl0 +FPeiuQINBFzcgWsBEADeqh6lsnBd0dzCNANIAhR8EsbRxuy3ihg52RVZR3HcUYyl +osMlXWhGxz2HD/Tt6hKMv32oUXik14gIY9hsyXEBZpDsQAwW3fbyM2JJhTmup/ag +F7Cy76NL1GvgPQ3soClGoXNn6m+W6wDW0shR0yDCfPpWY/h56Ub+7CTcfk4STbgV +Erib+fr7sFlzGobpCOWq80k7wb70ak1J57sEBg1wJFVyme9OJGUfkUAznX8TPFy4 +o4esggkc9Wnr4hzMpk5n6/J0YVl//2YvVFlY8fvnw2pmHnyJpoMqf6ZomT2YhSJ6 +Z0Ni+tyr/CCTNpF7lKvRn9TEbP9Ll2YAWXFGK+MAz6fGmijm7V39IQN/F6duXq+5 +xrsN+tB8udxSRYgp3jG3jSdWvryC8XYyYcXKhgPhq5+PNzRCbkh2/rqqrgAjOOFS +9kIMi95r1Rtb72CUevShHfC1WOulp9fzjt/zA5IpRlI5944CbBVa5wpAS4WyEBTb +FCD9SCK2We2Nu7lJAfjdgKYQeVu3USOQaCRib/eNv2o28veqERV1ZlquefO1qtDa +rstGbiFMI+CRMN5E6Y57gAxaOGud+H3o+DhdrzSTTHGLXsge/upjnRaS6PN3eEaK +gLtUKYMuXjNBoSMSNylSkGxvlJSUQWAPEbn6fHUaZSSIugrl9Z9/TcHQTxCd5wAR +AQABiQI2BBgBCAAgFiEEIordkyyyGHI+YdCeBDBxEmMl8OwFAlzcgWsCGwwACgkQ +BDBxEmMl8Oyc1g//Z7wnTImcKyFaNNxGMHic5NPpf3e+zIqsLnDqKnUkiWxXMstE +3pY0aX8b44fXy/QrUm18jC5LdDd/qH6sXdbBb9hBPwXmp6/WT5vSCn+Bnrj7iPE5 +DWr5mM1cisosn20UGQnb9wVGNrVD3GUwylQ58mu6ehbPTQ3Jah1DtVqpx8YfN9fR +W5PPomKd8zRnYQ7i7nwkj32hWmBW0Kd+lgtCUunT2diic3w1PkQU4IL4Cr9wL4lO +iLN5YVD4D2JeUC7t4mB5EJ3UT1/IcFYIwF0ULYhD1Ke00JocQ6pEVaGkg4Ll4wLN +uO7kSOWbhvHwpH2uPtsAfTJ0h3MFsOSLypN+BdEiLNQ54c4U1zQ9BHzk6xJ3U37U +eSQr5nNq3ceqjtH//7PR5/+OpeTbYuS/75LcujyKP73SqoZLS+41MNzmLnG5nBhJ +dROfxO+mRLuY7fgZWlDBLAfe8Rmwfd7pxWusggBQ1MQjvweYRbBXwVxog04hL4uY +Z0/2Tt5t15CGyVCY7HpvnpPTmHKHcSKlRiFHOp+kNLWbxFC0ryMBntYjinAvk1xy +ihUvH40rKlgxbV3+KS/Ew88D2tJ2JGCACx2yzS3trw+oUXugoaAQiileXQfu47SI +dM5GPiAt2UECZ9v4WthkRGygnoPiL/4IyDFsS9yDX7mOBSycVmT5R+VXmOs= +=z8mO +-END PGP PUBLIC KEY BLOCK-
[incubator-mxnet] branch v1.4.x updated: [1.4.x] Adds additional build envs (#14920)
This is an automated email from the ASF dual-hosted git repository.
zachgk pushed a commit to branch v1.4.x
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git
The following commit(s) were added to refs/heads/v1.4.x by this push:
new b9ea0fa [1.4.x] Adds additional build envs (#14920)
b9ea0fa is described below
commit b9ea0fa11a0549b14854d35665f79f77bb55704d
Author: perdasilva
AuthorDate: Thu May 9 20:23:35 2019 +0200
[1.4.x] Adds additional build envs (#14920)
* Adds CUDA build environment for version 8.0, 9.0, 9.2 and 10.0
* Renames ubuntu_gpu environment to ubuntu_gpu_cu91 and updates references
* Adds static build image and updates ci/build.py
---
Jenkinsfile| 36 +--
ci/build.py| 33 ++
...buntu_gpu => Dockerfile.build.ubuntu_gpu_cu100} | 7 ++-
...ubuntu_gpu => Dockerfile.build.ubuntu_gpu_cu80} | 2 +-
...ubuntu_gpu => Dockerfile.build.ubuntu_gpu_cu90} | 7 ++-
...ubuntu_gpu => Dockerfile.build.ubuntu_gpu_cu91} | 0
...ubuntu_gpu => Dockerfile.build.ubuntu_gpu_cu92} | 7 ++-
ci/docker/Dockerfile.publish.ubuntu1404_cpu| 36 +++
ci/docker/install/ubuntu_cudnn.sh | 54 +
ci/docker/install/ubuntu_publish.sh| 70 ++
ci/jenkins/Jenkins_steps.groovy| 34 +--
dev_menu.py| 4 +-
12 files changed, 238 insertions(+), 52 deletions(-)
diff --git a/Jenkinsfile b/Jenkinsfile
index 03ad7d8..17265a6 100644
--- a/Jenkinsfile
+++ b/Jenkinsfile
@@ -360,7 +360,7 @@ core_logic: {
ws('workspace/build-cmake-mkldnn-gpu') {
timeout(time: max_time, unit: 'MINUTES') {
utils.init_git()
-utils.docker_run('ubuntu_gpu', 'build_ubuntu_gpu_cmake_mkldnn',
false)
+utils.docker_run('ubuntu_gpu_cu91',
'build_ubuntu_gpu_cmake_mkldnn', false)
utils.pack_lib('cmake_mkldnn_gpu', mx_cmake_mkldnn_lib, true)
}
}
@@ -371,7 +371,7 @@ core_logic: {
ws('workspace/build-cmake-gpu') {
timeout(time: max_time, unit: 'MINUTES') {
utils.init_git()
-utils.docker_run('ubuntu_gpu', 'build_ubuntu_gpu_cmake', false)
+utils.docker_run('ubuntu_gpu_cu91', 'build_ubuntu_gpu_cmake',
false)
utils.pack_lib('cmake_gpu', mx_cmake_lib, true)
}
}
@@ -542,7 +542,7 @@ core_logic: {
ws('workspace/ut-python2-gpu') {
try {
utils.unpack_and_init('gpu', mx_lib, true)
-python2_gpu_ut('ubuntu_gpu')
+python2_gpu_ut('ubuntu_gpu_cu91')
utils.publish_test_coverage()
} finally {
utils.collect_test_results_unix('nosetests_gpu.xml',
'nosetests_python2_gpu.xml')
@@ -555,7 +555,7 @@ core_logic: {
ws('workspace/ut-python3-gpu') {
try {
utils.unpack_and_init('gpu', mx_lib, true)
-python3_gpu_ut('ubuntu_gpu')
+python3_gpu_ut('ubuntu_gpu_cu91')
utils.publish_test_coverage()
} finally {
utils.collect_test_results_unix('nosetests_gpu.xml',
'nosetests_python3_gpu.xml')
@@ -569,7 +569,7 @@ core_logic: {
timeout(time: max_time, unit: 'MINUTES') {
try {
utils.unpack_and_init('gpu', mx_lib, true)
- utils.docker_run('ubuntu_gpu',
'unittest_ubuntu_python2_quantization_gpu', true)
+ utils.docker_run('ubuntu_gpu_cu91',
'unittest_ubuntu_python2_quantization_gpu', true)
utils.publish_test_coverage()
} finally {
utils.collect_test_results_unix('nosetests_quantization_gpu.xml',
'nosetests_python2_quantize_gpu.xml')
@@ -584,7 +584,7 @@ core_logic: {
timeout(time: max_time, unit: 'MINUTES') {
try {
utils.unpack_and_init('gpu', mx_lib, true)
- utils.docker_run('ubuntu_gpu',
'unittest_ubuntu_python3_quantization_gpu', true)
+ utils.docker_run('ubuntu_gpu_cu91',
'unittest_ubuntu_python3_quantization_gpu', true)
utils.publish_test_coverage()
} finally {
utils.collect_test_results_unix('nosetests_quantization_gpu.xml',
'nosetests_python3_quantize_gpu.xml')
@@ -613,7 +613,7 @@ core_logic: {
ws('workspace/ut-python2-mkldnn-gpu') {
try {
utils.unpack_and_init('mkldnn_gpu', mx_mkldnn_lib, true)
-python2_gpu_ut('ubuntu_gpu')
+python2_gpu_ut('ubuntu_gpu_cu91')
utils.publish_test_coverage()
} finally {
utils.collect_test_results_unix('nosetests_gpu.xml',
'nosetests_python2_mkldnn_gpu.xml')
@@ -640,7 +640,7 @@ core_logic: {
ws('workspace/ut-python3-mkldnn-gpu') {
try {
utils.
