This is an automated email from the ASF dual-hosted git repository. apeforest pushed a change to branch benchmark in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
from 618c481 [MXNET-1422] Fix wrong results of min([inf, inf]) and max([-inf,-inf]) (#16226) add be7296b removing MXNDArrayLoadFromBuffer64 and MXNDArrayLoad64 (#16203) add 11f73ed np compatible vstack (#15850) add 37c641f Faster Scala NDArray to BufferedImage function (#16219) add 93b794e Fix inconsistent interpolation method values (#16212) add 89cb4ad Numpy add numpy op roll (#15902) add da6e744 add numpy compatible trace (#16008) add 53ebe12 add numpy op hanning, hamming, blackman (#15815) add 0994ea0 julia: implement `context.num_gpus` (#16236) add 8e48cec julia: add `AbstractMXError` as parent type (#16235) add dccfc88 [Numpy]flip (#15819) add 7344c91 numpy operator around (#16126) add 8af1b57 numpy operator arctan2 (#15890) add ae2f1bb numpy operator nonzero (#15838) add bea5653 numpy operator hypot (#15901) add 72b4d9b tvm numpy operator deg2rad && rad2deg (#16015) add a77bd75 Integrate MKL-DNN leakyrelu (#16075) add cbbb96a [CD] Add COMMIT_ID param to release job (#16202) add f635595 numpy op unique add 08f8372 try to fix bug add 3ca1920 fix memory bug and disable some test add 33bd02f fix according to review add 1d4032d set fixed seed for profiler (#16155) add a5e698a FullyConnected Bias performance improvement on GPU (#16039) add 35ef45c Fix lack of dylib support in Makefile when use lapack (#15813) add 985a4ca Update KL Divergence formula (#16170) add ab2214b fix broken links (#16255) add df34e76 Add list_ctx to ParameterDict (#16185) add 1a2da12 [MKLDNN] NDArray reorder in C API and deconv (#16265) add c5007ea Numpy operators: `lcm`, `tril`, `identity` and `take` (#16264) add c69c8bf redirect to the 404 page (#16287) add f52ddfd Fix MXNDArrayGetData (#16289) add 7656a11 Removes git status update stop gap solution (#16285) add 33c7b5c add google-analytics config (#16271) add 8004a02 Fixing links for website + Fixing search (#16284) add dc5470c Factorize CUDA_KERNEL_LOOP used in CUDA kernels (#16197) add 01ca278 [Gluon] Support None argument in HybridBlock (#16280) add 943bed5 add mkl installation temp fix (#16304) add 3950a47 [MXNET-978] n-th order gradient test support. (#15611) add 512d25a Minor fix in ToTensor documentation. (#16299) No new revisions were added by this update. Summary of changes: .github/PULL_REQUEST_TEMPLATE.md | 2 +- MKLDNN_README.md | 2 +- Makefile | 8 +- NEWS.md | 14 +- R-package/R/zzz.R | 2 +- R-package/README.md | 2 +- R-package/vignettes/MultidimLstm.Rmd | 2 +- README.md | 37 +- benchmark/opperf/README.md | 20 +- benchmark/opperf/utils/benchmark_utils.py | 1 + cd/Jenkinsfile_cd_pipeline | 9 + cd/Jenkinsfile_release_job | 42 +- cd/Jenkinsfile_utils.groovy | 29 +- cd/README.md | 9 + cd/img/job_setup.png | Bin 0 -> 250237 bytes ci/Jenkinsfile_utils.groovy | 40 +- ci/docker/install/ubuntu_mkl.sh | 2 +- ci/docker/install/ubuntu_r.sh | 2 +- ci/other/ci_deploy_doc.sh | 2 +- contrib/clojure-package/README.md | 6 +- .../examples/pre-trained-models/README.md | 6 +- .../clojure-package/examples/tutorial/README.md | 2 +- .../examples/tutorial/src/tutorial/kvstore.clj | 2 +- .../examples/tutorial/src/tutorial/module.clj | 2 +- .../examples/tutorial/src/tutorial/ndarray.clj | 2 +- .../examples/tutorial/src/tutorial/symbol.clj | 2 +- contrib/tvmop/basic/ufunc.py | 137 ++- cpp-package/README.md | 6 +- docs/README.md | 6 +- docs/python_docs/python/scripts/conf.py | 4 +- .../python/tutorials/deploy/export/index.rst | 13 +- .../python/tutorials/deploy/export/onnx.md | 150 ++++ docs/python_docs/python/tutorials/deploy/index.rst | 6 +- .../python/tutorials/deploy/inference/index.rst | 38 +- .../tutorials/deploy/inference/wine_detector.md | 405 +++++++++ .../python/tutorials/deploy/run-on-aws/index.rst | 8 +- .../python/tutorials/extend/custom_layer.md | 18 +- .../python/tutorials/extend/customop.md | 2 +- docs/python_docs/python/tutorials/extend/index.rst | 12 +- .../getting-started/crash-course/5-predict.md | 2 +- .../gluon_from_experiment_to_deployment.md | 22 +- .../python/tutorials/getting-started/index.rst | 28 +- .../logistic_regression_explained.md | 257 ++++++ .../tutorials/getting-started/to-mxnet/index.rst | 2 +- .../tutorials/getting-started/to-mxnet/pytorch.md | 6 +- .../packages/autograd/{autograd.md => index.md} | 4 +- .../gluon/{ => blocks}/activations/activations.md | 0 .../gluon/{ => blocks}/activations/images/elu.png | Bin .../{ => blocks}/activations/images/leakyrelu.png | Bin .../{ => blocks}/activations/images/prelu.png | Bin .../gluon/{ => blocks}/activations/images/relu.png | Bin .../gluon/{ => blocks}/activations/images/selu.png | Bin .../{ => blocks}/activations/images/sigmoid.png | Bin .../{ => blocks}/activations/images/softrelu.png | Bin .../{ => blocks}/activations/images/softsign.png | Bin .../{ => blocks}/activations/images/swish.png | Bin .../gluon/{ => blocks}/activations/images/tanh.png | Bin .../packages/gluon/{ => blocks}/blocks.svg | 0 .../packages/gluon/{ => blocks}/custom-layer.md | 0 .../gluon/{ => blocks}/custom_layer_beginners.md | 18 +- .../packages/gluon/{ => blocks}/hybridize.md | 8 +- .../export.rst => packages/gluon/blocks/index.rst} | 11 +- .../tutorials/packages/gluon/{ => blocks}/init.md | 8 +- .../packages/gluon/{ => blocks}/naming.md | 2 +- .../tutorials/packages/gluon/{ => blocks}/nn.md | 0 .../packages/gluon/{ => blocks}/parameters.md | 20 +- .../packages/gluon/blocks/save_load_params.md | 281 ++++++ .../python/tutorials/packages/gluon/customop.md | 227 ----- .../python/tutorials/packages/gluon/data.md | 141 --- .../gluon/{ => image}/image-augmentation.md | 0 .../tutorials/packages/gluon/image/index.rst | 6 +- .../python/tutorials/packages/gluon/image/mnist.md | 16 +- .../packages/gluon/image/pretrained_models.md | 8 +- .../python/tutorials/packages/gluon/index.rst | 88 +- .../gluon/{custom-loss => loss}/custom-loss.md | 2 +- .../images/contrastive_loss.jpeg | Bin .../{custom-loss => loss}/images/inuktitut_1.png | Bin .../{custom-loss => loss}/images/inuktitut_2.png | Bin .../export.rst => packages/gluon/loss/index.rst} | 10 +- .../python/tutorials/packages/gluon/loss/loss.md | 24 +- .../python/tutorials/packages/gluon/text/index.rst | 35 +- .../tutorials/packages/gluon/text/transformer.rst | 2 +- .../gluon/{ => training}/fit_api_tutorial.md | 10 +- .../gluon/training/index.rst} | 11 +- .../gluon/training/learning_rates/index.rst} | 11 +- .../learning_rates/learning_rate_finder.md | 332 ++++++++ .../learning_rates/learning_rate_schedules.md | 347 ++++++++ .../learning_rate_schedules_advanced.md | 325 +++++++ .../{ => training}/normalization/imgs/NCHW_BN.png | Bin .../{ => training}/normalization/imgs/NCHW_IN.png | Bin .../{ => training}/normalization/imgs/NCHW_LN.png | Bin .../{ => training}/normalization/imgs/NTC_BN.png | Bin .../{ => training}/normalization/imgs/NTC_IN.png | Bin .../{ => training}/normalization/imgs/NTC_LN.png | Bin .../normalization/imgs/data_normalization.jpeg | Bin .../normalization/index.md} | 4 +- .../packages/gluon/{ => training}/trainer.md | 24 +- .../python/tutorials/packages/index.rst | 54 +- .../python/tutorials/packages/kvstore/index.rst | 4 +- .../python/tutorials/packages/kvstore/kvstore.md | 171 ++++ .../python/tutorials/packages/module/index.rst | 52 -- .../tutorials/packages/ndarray/01-ndarray-intro.md | 6 +- .../packages/ndarray/gotchas_numpy_in_mxnet.md | 187 ++++ .../python/tutorials/packages/ndarray/index.rst | 46 +- .../tutorials/packages/ndarray/sparse/csr.md | 562 ++++++++++++ .../ndarray/sparse/index.rst} | 9 +- .../packages/ndarray/sparse/row_sparse.md | 584 +++++++++++++ .../tutorials/packages/ndarray/sparse/train.md | 339 ++++++++ .../packages/ndarray/sparse/train_gluon.md | 483 +++++++++++ .../tutorials/packages/onnx/fine_tuning_gluon.md | 456 ++++++++++ .../python/tutorials/packages/onnx/index.rst | 12 +- .../packages/onnx/inference_on_onnx_model.md | 256 ++++++ .../tutorials/packages/onnx/super_resolution.md | 140 +++ .../packages/optimizer/{optimizer.md => index.md} | 4 +- .../python/tutorials/packages/viz/index.rst | 7 +- .../python/tutorials/performance/backend/amp.md | 4 +- .../python/tutorials/performance/backend/index.rst | 21 +- .../backend/{mkl-dnn.rst => mkldnn/index.rst} | 19 +- .../backend/{ => mkldnn}/mkldnn_quantization.md | 8 +- .../{MKLDNN_README.md => mkldnn/mkldnn_readme.md} | 4 +- .../tutorials/performance/backend/profiler.md | 10 +- .../backend/tensorrt}/index.rst | 22 +- .../performance/backend/tensorrt/tensorrt.md | 143 ++++ .../backend/tensorrt/wavenet_optimized.svg | 1 + .../backend/tensorrt/wavenet_unoptimized.svg | 17 + .../tutorials/performance/compression/index.rst | 23 +- .../python/tutorials/performance/index.rst | 10 +- .../themes/mx-theme/mxtheme/layout.html | 2 +- docs/static_site/src/.htaccess | 4 + docs/static_site/src/404.html | 10 +- docs/static_site/src/_config_prod.yml | 3 +- .../_includes/get_started/devices/nvidia-jetson.md | 2 +- .../_includes/get_started/devices/raspberry_pi.md | 6 +- .../src/_includes/get_started/get_started.html | 8 +- .../src/_includes/get_started/linux/cpp/cpp.md | 2 +- .../src/_includes/get_started/linux/java/cpu.md | 2 +- .../src/_includes/get_started/linux/java/gpu.md | 2 +- .../get_started/linux/julia/build-from-source.md | 2 +- .../src/_includes/get_started/linux/perl/perl.md | 2 +- .../get_started/linux/python/cpu/docker.md | 2 +- .../_includes/get_started/linux/python/cpu/pip.md | 10 +- .../get_started/linux/python/gpu/docker.md | 2 +- .../src/_includes/get_started/linux/r/cpu.md | 2 +- .../src/_includes/get_started/linux/r/gpu.md | 2 +- .../src/_includes/get_started/macos/cpp/cpp.md | 2 +- .../src/_includes/get_started/macos/java/cpu.md | 2 +- .../get_started/macos/julia/build-from-source.md | 2 +- .../src/_includes/get_started/macos/perl/perl.md | 2 +- .../macos/python/cpu/build-from-source.md | 2 +- .../get_started/macos/python/cpu/docker.md | 2 +- .../macos/python/gpu/build-from-source.md | 2 +- .../get_started/macos/python/gpu/pip_docker.md | 2 +- .../src/_includes/get_started/macos/r/cpu.md | 2 +- .../src/_includes/get_started/pip_snippet.md | 2 +- .../src/_includes/get_started/windows/cpp/cpp.md | 2 +- .../get_started/windows/julia/build-from-source.md | 2 +- .../src/_includes/get_started/windows/perl/perl.md | 2 +- .../windows/python/cpu/build-from-source.md | 2 +- .../get_started/windows/python/cpu/docker.md | 2 +- .../windows/python/gpu/build-from-source.md | 2 +- .../src/_includes/get_started/windows/r/cpu.md | 2 +- .../src/_includes/get_started/windows/r/gpu.md | 2 +- .../pages/api/architecture/exception_handling.md | 2 +- .../pages/api/architecture/note_data_loading.md | 2 +- .../src/pages/api/architecture/note_engine.md | 1 - .../src/pages/api/cpp/docs/tutorials/basics.md | 2 +- docs/static_site/src/pages/api/cpp/index.md | 4 +- .../src/pages/api/faq/add_op_in_backend.md | 30 + docs/static_site/src/pages/api/faq/float16.md | 2 +- .../src/pages/api/faq/gradient_compression.md | 2 +- docs/static_site/src/pages/api/faq/perf.md | 4 +- docs/static_site/src/pages/api/faq/recordio.md | 2 +- .../src/pages/api/perl/docs/tutorials/ndarray.md | 2 +- .../api/r/docs/tutorials/callback_function.md | 8 +- .../classify_real_image_with_pretrained_model.md | 6 +- .../pages/api/r/docs/tutorials/custom_iterator.md | 2 +- .../api/r/docs/tutorials/custom_loss_function.md | 8 +- .../docs/tutorials/five_minutes_neural_network.md | 8 +- .../api/r/docs/tutorials/mnist_competition.md | 2 +- .../pages/api/r/docs/tutorials/multi_dim_lstm.md | 2 +- .../src/pages/api/r/docs/tutorials/ndarray.md | 12 +- .../src/pages/api/r/docs/tutorials/symbol.md | 10 +- .../pages/api/scala/docs/tutorials/char_lstm.md | 2 +- .../docs/tutorials/mxnet_scala_on_intellij.md | 4 +- docs/static_site/src/pages/community/contribute.md | 2 +- .../src/pages/get_started/build_from_source.md | 4 +- docs/static_site/src/pages/get_started/index.html | 2 +- .../src/pages/get_started/java_setup.md | 2 +- .../src/pages/get_started/scala_setup.md | 2 +- .../src/pages/get_started/ubuntu_setup.md | 2 +- .../src/pages/get_started/windows_setup.md | 6 +- example/MXNetTutorialTemplate.ipynb | 6 +- example/README.md | 18 +- example/ctc/README.md | 2 +- example/distributed_training/README.md | 2 +- example/gluon/audio/README.md | 2 +- example/gluon/audio/urban_sounds/README.md | 2 +- example/image-classification/README.md | 12 +- example/image-classification/predict-cpp/README.md | 2 +- example/image-classification/train_mnist.py | 2 +- example/profiler/README.md | 4 +- example/profiler/profiler_imageiter.py | 2 +- example/quantization/README.md | 2 +- example/quantization/imagenet_gen_qsym.py | 4 +- example/quantization/imagenet_gen_qsym_mkldnn.py | 4 +- example/quantization/imagenet_inference.py | 4 +- example/rnn/bucketing/README.md | 2 +- example/rnn/old/README.md | 2 +- example/sparse/README.md | 2 +- example/sparse/linear_classification/README.md | 4 +- example/ssd/quantization.py | 4 +- include/mxnet/c_api.h | 13 - julia/NEWS.md | 3 + julia/docs/src/index.md | 2 +- julia/docs/src/tutorial/char-lstm.md | 4 +- julia/docs/src/user-guide/install.md | 2 +- julia/docs/src/user-guide/overview.md | 2 +- julia/src/MXNet.jl | 8 +- julia/src/base.jl | 7 - julia/src/context.jl | 11 + .../ci_deploy_doc.sh => julia/src/exceptions.jl | 27 +- .../test/unittest/context.jl | 30 +- .../test/unittest/exceptions.jl | 38 +- .../lib/AI/MXNet/Gluon/ModelZoo.pm | 2 +- perl-package/AI-MXNet/Changes | 2 +- perl-package/AI-MXNet/examples/mnist.pl | 2 +- perl-package/AI-MXNet/lib/AI/MXNet.pm | 4 +- perl-package/AI-MXNet/lib/AI/MXNet/Gluon.pm | 2 +- perl-package/AI-MXNet/lib/AI/MXNet/Gluon/Block.pm | 4 +- .../AI-MXNet/lib/AI/MXNet/Gluon/Trainer.pm | 2 +- perl-package/AI-MXNet/lib/AI/MXNet/IO.pm | 2 +- perl-package/AI-MXNet/lib/AI/MXNet/LinAlg.pm | 4 +- perl-package/AI-MXNet/lib/AI/MXNet/Metric.pm | 2 +- perl-package/AI-MXNetCAPI/Changes | 2 +- perl-package/AI-MXNetCAPI/README | 2 +- perl-package/AI-NNVMCAPI/Changes | 2 +- perl-package/AI-NNVMCAPI/README | 2 +- perl-package/README.md | 4 +- python/README.md | 2 +- python/mxnet/_numpy_op_doc.py | 161 ++++ python/mxnet/context.py | 4 +- python/mxnet/gluon/block.py | 194 ++++- python/mxnet/gluon/data/vision/transforms.py | 2 +- python/mxnet/gluon/loss.py | 2 +- python/mxnet/gluon/parameter.py | 10 +- python/mxnet/gluon/trainer.py | 2 +- python/mxnet/image/image.py | 12 +- python/mxnet/module/base_module.py | 8 +- python/mxnet/ndarray/numpy/_op.py | 941 ++++++++++++++++++++- python/mxnet/numpy/multiarray.py | 910 +++++++++++++++++++- python/mxnet/symbol/numpy/_symbol.py | 750 +++++++++++++++- scala-package/README.md | 16 +- .../src/main/scala/org/apache/mxnet/Image.scala | 10 +- .../javaapi/infer/objectdetector/README.md | 6 +- .../javaapi/infer/predictor/README.md | 2 +- .../org/apache/mxnetexamples/benchmark/README.md | 2 +- .../mxnetexamples/cnntextclassification/README.md | 4 +- .../mxnetexamples/infer/imageclassifier/README.md | 2 +- .../mxnetexamples/infer/objectdetector/README.md | 2 +- scala-package/packageTest/README.md | 2 +- scala-package/spark/README.md | 2 +- setup-utils/install-mxnet-osx-python.sh | 4 +- src/c_api/c_api.cc | 6 + src/common/cuda_utils.h | 76 +- src/operator/contrib/boolean_mask-inl.h | 16 + src/operator/contrib/boolean_mask.cc | 17 - src/operator/contrib/count_sketch.cu | 4 - src/operator/contrib/deformable_psroi_pooling.cu | 4 - src/operator/contrib/psroi_pooling.cu | 4 - src/operator/contrib/roi_align.cu | 11 +- src/operator/contrib/tvmop/ufunc.cc | 113 +++ src/operator/correlation.cu | 6 +- src/operator/custom/custom.cc | 2 +- src/operator/elemwise_op_common.h | 19 + src/operator/leaky_relu-inl.h | 192 +---- src/operator/leaky_relu.cc | 188 +++- src/operator/leaky_relu.cu | 14 +- src/operator/math_functions-inl.h | 2 + src/operator/mshadow_op.h | 53 ++ src/operator/mxnet_op.h | 10 + src/operator/nn/fully_connected-inl.h | 221 ++++- src/operator/nn/layer_norm-inl.h | 2 +- src/operator/nn/layer_norm.cu | 2 +- src/operator/nn/mkldnn/mkldnn_act-inl.h | 35 +- src/operator/nn/mkldnn/mkldnn_act.cc | 125 ++- src/operator/nn/mkldnn/mkldnn_base-inl.h | 3 + src/operator/nn/mkldnn/mkldnn_deconvolution.cc | 11 +- src/operator/nn/mkldnn/mkldnn_ops-inl.h | 8 +- src/operator/nn/softmax-inl.h | 2 +- src/operator/numpy/np_elemwise_broadcast_op.cc | 152 ++++ src/operator/numpy/np_elemwise_broadcast_op.cu | 31 + src/operator/numpy/np_elemwise_unary_op_basic.cc | 34 + src/operator/numpy/np_elemwise_unary_op_basic.cu | 3 + src/operator/numpy/np_init_op.cc | 10 + src/operator/numpy/np_init_op.cu | 3 + src/operator/numpy/np_init_op.h | 41 +- src/operator/numpy/np_matrix_op-inl.h | 303 +++++++ src/operator/numpy/np_matrix_op.cc | 266 ++++++ src/operator/numpy/np_matrix_op.cu | 44 + src/operator/numpy/np_nonzero_op-inl.h | 65 ++ src/operator/numpy/np_nonzero_op.cc | 129 +++ src/operator/numpy/np_nonzero_op.cu | 130 +++ src/operator/numpy/np_trace_op-inl.h | 255 ++++++ src/operator/numpy/np_trace_op.cc | 98 +++ .../{leaky_relu.cu => numpy/np_trace_op.cu} | 26 +- src/operator/numpy/np_tril_op-inl.h | 233 +++++ src/operator/numpy/np_tril_op.cc | 61 ++ .../{leaky_relu.cu => numpy/np_tril_op.cu} | 26 +- src/operator/numpy/np_unique_op.cc | 382 +++++++++ src/operator/numpy/np_unique_op.cu | 350 ++++++++ src/operator/numpy/np_unique_op.h | 88 ++ src/operator/numpy/np_window_op.cc | 79 ++ .../{leaky_relu.cu => numpy/np_window_op.cu} | 29 +- src/operator/numpy/np_window_op.h | 127 +++ src/operator/operator_tune.cc | 6 + src/operator/optimizer_op-inl.h | 2 +- src/operator/subgraph/mkldnn/mkldnn_conv-inl.h | 14 +- src/operator/subgraph/mkldnn/mkldnn_conv.cc | 6 +- .../subgraph/mkldnn/mkldnn_conv_property.h | 12 +- src/operator/tensor/broadcast_reduce_op.h | 2 +- .../tensor/elemwise_binary_scalar_op_extended.cc | 1 + src/operator/tensor/elemwise_unary_op.h | 83 ++ src/operator/tensor/indexing_op.cc | 4 + src/operator/tensor/indexing_op.cu | 4 + src/operator/tensor/indexing_op.h | 10 +- .../broken_link_checker_test/JenkinsfileForBLC | 2 +- .../broken_link_checker_test/test_broken_links.py | 4 +- tests/python/gpu/test_operator_gpu.py | 2 +- tests/python/mkl/test_subgraph.py | 17 +- tests/python/unittest/test_gluon.py | 104 ++- tests/python/unittest/test_gluon_utils.py | 2 +- tests/python/unittest/test_higher_order_grad.py | 99 ++- tests/python/unittest/test_numpy_ndarray.py | 45 + tests/python/unittest/test_numpy_op.py | 753 ++++++++++++++++- tools/caffe_translator/README.md | 4 +- tools/caffe_translator/faq.md | 4 +- tools/coreml/pip_package/README.rst | 2 +- tools/pip/doc/CPU_ADDITIONAL.md | 2 +- tools/pip/doc/CU100MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU100_ADDITIONAL.md | 2 +- tools/pip/doc/CU75MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU75_ADDITIONAL.md | 2 +- tools/pip/doc/CU80MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU80_ADDITIONAL.md | 2 +- tools/pip/doc/CU90MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU90_ADDITIONAL.md | 2 +- tools/pip/doc/CU91MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU91_ADDITIONAL.md | 2 +- tools/pip/doc/CU92MKL_ADDITIONAL.md | 2 +- tools/pip/doc/CU92_ADDITIONAL.md | 2 +- tools/pip/doc/MKL_ADDITIONAL.md | 2 +- 351 files changed, 14245 insertions(+), 1627 deletions(-) create mode 100644 cd/img/job_setup.png create mode 100644 docs/python_docs/python/tutorials/deploy/export/onnx.md create mode 100644 docs/python_docs/python/tutorials/deploy/inference/wine_detector.md rename docs/python_docs/python/tutorials/{packages/gluon => getting-started}/gluon_from_experiment_to_deployment.md (88%) create mode 100644 docs/python_docs/python/tutorials/getting-started/logistic_regression_explained.md rename docs/python_docs/python/tutorials/packages/autograd/{autograd.md => index.md} (98%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/activations.md (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/elu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/leakyrelu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/prelu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/relu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/selu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/sigmoid.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/softrelu.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/softsign.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/swish.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/activations/images/tanh.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/blocks.svg (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/custom-layer.md (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/custom_layer_beginners.md (85%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/hybridize.md (91%) copy docs/python_docs/python/tutorials/{deploy/export/export.rst => packages/gluon/blocks/index.rst} (90%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/init.md (97%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/naming.md (99%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/nn.md (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => blocks}/parameters.md (76%) create mode 100644 docs/python_docs/python/tutorials/packages/gluon/blocks/save_load_params.md delete mode 100644 docs/python_docs/python/tutorials/packages/gluon/customop.md delete mode 100644 docs/python_docs/python/tutorials/packages/gluon/data.md rename docs/python_docs/python/tutorials/packages/gluon/{ => image}/image-augmentation.md (100%) rename docs/python_docs/python/tutorials/packages/gluon/{custom-loss => loss}/custom-loss.md (93%) rename docs/python_docs/python/tutorials/packages/gluon/{custom-loss => loss}/images/contrastive_loss.jpeg (100%) rename docs/python_docs/python/tutorials/packages/gluon/{custom-loss => loss}/images/inuktitut_1.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{custom-loss => loss}/images/inuktitut_2.png (100%) copy docs/python_docs/python/tutorials/{deploy/export/export.rst => packages/gluon/loss/index.rst} (93%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/fit_api_tutorial.md (91%) copy docs/python_docs/python/tutorials/{deploy/export/export.rst => packages/gluon/training/index.rst} (91%) copy docs/python_docs/python/tutorials/{deploy/export/export.rst => packages/gluon/training/learning_rates/index.rst} (91%) create mode 100644 docs/python_docs/python/tutorials/packages/gluon/training/learning_rates/learning_rate_finder.md create mode 100644 docs/python_docs/python/tutorials/packages/gluon/training/learning_rates/learning_rate_schedules.md create mode 100644 docs/python_docs/python/tutorials/packages/gluon/training/learning_rates/learning_rate_schedules_advanced.md rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NCHW_BN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NCHW_IN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NCHW_LN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NTC_BN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NTC_IN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/NTC_LN.png (100%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/normalization/imgs/data_normalization.jpeg (100%) rename docs/python_docs/python/tutorials/packages/gluon/{normalization/normalization.md => training/normalization/index.md} (94%) rename docs/python_docs/python/tutorials/packages/gluon/{ => training}/trainer.md (69%) create mode 100644 docs/python_docs/python/tutorials/packages/kvstore/kvstore.md delete mode 100644 docs/python_docs/python/tutorials/packages/module/index.rst create mode 100644 docs/python_docs/python/tutorials/packages/ndarray/gotchas_numpy_in_mxnet.md create mode 100644 docs/python_docs/python/tutorials/packages/ndarray/sparse/csr.md rename docs/python_docs/python/tutorials/{deploy/export/export.rst => packages/ndarray/sparse/index.rst} (93%) create mode 100644 docs/python_docs/python/tutorials/packages/ndarray/sparse/row_sparse.md create mode 100644 docs/python_docs/python/tutorials/packages/ndarray/sparse/train.md create mode 100644 docs/python_docs/python/tutorials/packages/ndarray/sparse/train_gluon.md create mode 100644 docs/python_docs/python/tutorials/packages/onnx/fine_tuning_gluon.md create mode 100644 docs/python_docs/python/tutorials/packages/onnx/inference_on_onnx_model.md create mode 100644 docs/python_docs/python/tutorials/packages/onnx/super_resolution.md rename docs/python_docs/python/tutorials/packages/optimizer/{optimizer.md => index.md} (99%) rename docs/python_docs/python/tutorials/performance/backend/{mkl-dnn.rst => mkldnn/index.rst} (71%) rename docs/python_docs/python/tutorials/performance/backend/{ => mkldnn}/mkldnn_quantization.md (96%) rename docs/python_docs/python/tutorials/performance/backend/{MKLDNN_README.md => mkldnn/mkldnn_readme.md} (99%) rename docs/python_docs/python/tutorials/{packages/symbol => performance/backend/tensorrt}/index.rst (70%) create mode 100644 docs/python_docs/python/tutorials/performance/backend/tensorrt/tensorrt.md create mode 100644 docs/python_docs/python/tutorials/performance/backend/tensorrt/wavenet_optimized.svg create mode 100644 docs/python_docs/python/tutorials/performance/backend/tensorrt/wavenet_unoptimized.svg copy ci/other/ci_deploy_doc.sh => julia/src/exceptions.jl (68%) mode change 100755 => 100644 copy ci/other/ci_deploy_doc.sh => julia/test/unittest/context.jl (68%) mode change 100755 => 100644 copy ci/other/ci_deploy_doc.sh => julia/test/unittest/exceptions.jl (68%) mode change 100755 => 100644 create mode 100644 src/operator/numpy/np_nonzero_op-inl.h create mode 100644 src/operator/numpy/np_nonzero_op.cc create mode 100644 src/operator/numpy/np_nonzero_op.cu create mode 100644 src/operator/numpy/np_trace_op-inl.h create mode 100644 src/operator/numpy/np_trace_op.cc copy src/operator/{leaky_relu.cu => numpy/np_trace_op.cu} (73%) create mode 100644 src/operator/numpy/np_tril_op-inl.h create mode 100644 src/operator/numpy/np_tril_op.cc copy src/operator/{leaky_relu.cu => numpy/np_tril_op.cu} (73%) create mode 100644 src/operator/numpy/np_unique_op.cc create mode 100644 src/operator/numpy/np_unique_op.cu create mode 100644 src/operator/numpy/np_unique_op.h create mode 100644 src/operator/numpy/np_window_op.cc copy src/operator/{leaky_relu.cu => numpy/np_window_op.cu} (65%) create mode 100644 src/operator/numpy/np_window_op.h