This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a change to branch develop
in repository https://gitbox.apache.org/repos/asf/incubator-dlab.git.
from 223653d Updated test for ProjectServiceImpl
add 0c997c2 [DLAB-515]: Changed Ubuntu AMI to 18.04
add d3db17b [DLAB-515]: fixed issue with Ubuntu version change
add 7f777c6 [DLAB-515]: fixed issue with Ubuntu version change
add 909b117 [DLAB-515]: fixed issue with Ubuntu version change
add b6ea36f [DLAB-515]: fixed issue with Ubuntu version change
add 0738b69 [DLAB-515]: fixed issue with Ubuntu version change
add eefcfeb [DLAB-515]: fixed issue with Ubuntu version change
add 9395093 [DLAB-515]: [AWS] OpenResty implemented
add 8ad1aa2 [DLAB-515]: [AWS] Notebook creation fixed
add 197d78e [DLAB-515]: [AWS] Notebook creation fixed
add 46bd2f8 [DLAB-515]: [GCP] Ubuntuversion changed to 18.04
add 22f21bb [DLAB-515]: [GCP] Ubuntu version changed
add 015903d [DLAB-515]: [Azure] Ubuntu version updated
add 6c9a325 [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
add b74c4a8 [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
add 6e1b85b [DLAB-515]: EDGE as NAT configuration implemented
add 01002f2 [DLAB-515]: EDGE as NAT configuration fixed / EMR version
updated
add 746afef [DLAB-515]: EDGE as NAT configuration fixed
add 098c95e [DLAB-515] - nftables.conf fixed
add 13ec57c DLAB-1799 added parameter in tensorboard.service, changed
numpy version for python 2.7, added setuptools version to dlab.ini that is
necessary for tensorboard
add 360838b [DLAB-515]: Dataengine creation fixed
add 85d6533 [DLAB-1799]: fixed typo
add 94dad59 [DLAB-1799]: fixed error
add 9c27826 [DLAB-515]: Toree version updated
add 01594c1 [DLAB-515]: Toree version fixed/ Docker ubuntu version
updated/ Docker pip version updated
add b9cb267 [DLAB-515]- Jupyter kernels connection fixed
add f9424d8 [DLAB-515]- Jupyter remote kernels fixed
add a6bb453 [DLAB-515]- Rstudio fixed
add e55e6bc [DLAB-515]- Rstudio fixed
add 0892292 [DLAB-515]- Rstudio fixed
add 219564b [DLAB-515]- Rstudio fixed
add bbd95aa [DLAB-515]- Ubuntu 18.04 for container updated/ pip v20.1 for
containers updated/ toree v0.3.0 for all clouds updated
add 881b2dc [DLAB-1850]: added arg to jupyterlab docker build command
add 2e177e6 [DLAB-1827]: increased primary disk size to 14G as with 12
tensorflow with jupyter creation failed
add 20f5e9b [DLAB-1827]: increased primary disk size to 16G
add 2377860 [DLAB-515] - [GCP] Dataproc version updated
add 7b972e3 [DLAB-1825]: added possibility to enable warn_only for
manage_pkg
add d8561cb [DLAB-515] - [GCP] Dataproc on Jupyter and Zeppelin creation
fixed
add 012ff0f [DLAB-515] - Python version 3.5 changed for 3.6 for library
packages
add 7c1730a [DLAB-515] - Dataproc version fixed
add b3a9f2c [DLAB-515] - GPG update disabled/HTTPS proxy for apt added
add 717c402 [DLAB-515] - dataproc fixed
add 17101bb [DLAB-515] - GPG key renewal changed
add 5d9b574 [DLAB-1855]: changed pip install
add 07de2c9 [DLAB-1855]: changed pip2 installation
add fd31c7c [DLAB-1855]: added pip3 pip2 upgrade
add cae7158 [DLAB-515] - dataengine-service libs installing fixed
add 0339fb3 [DLAB-1856]: added R-devel package installation during
cluster creation
add 995b1de [DLAB-1855]: changed pip update during dataengine service
creation
add 163c8b7 [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy
implemented
add 8bed136 Update fab.py
add 4dcf89c [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy
fixed
add 02aa350 [DLAB-515] - [GCP] EDGE node as NAT implemented, [GCP]
Dataproc kernels connection via sparkmagic/livy implemented, [AWS] [GCP]
[Azure] Sprk Cluster connection via sparkmagic/livy implemented
add ef0d07a [DLAB-515] [AWS] [GCP] Dataengine/Dataengine-service kernel
removing fixed
add d5307d2 [DLAB-515]: Changed Ubuntu AMI to 18.04
add 3df3619 [DLAB-515]: fixed issue with Ubuntu version change
add 97e2b7f [DLAB-515]: fixed issue with Ubuntu version change
add c859336 [DLAB-515]: fixed issue with Ubuntu version change
add 59800e4 [DLAB-515]: fixed issue with Ubuntu version change
add b7a4e4f [DLAB-515]: fixed issue with Ubuntu version change
add 560c223 [DLAB-515]: fixed issue with Ubuntu version change
add 1c43eb9 [DLAB-515]: fixed issue with Ubuntu version change
add 01c8213 [DLAB-515]: fixed issue with Ubuntu version change
add 7415f61 [DLAB-515]: fixed issue with Ubuntu version change
add 0a267fb [DLAB-515]: [AWS] OpenResty implemented
add c722d73 [DLAB-515]: [AWS] Notebook creation fixed
add 6e6e0ad [DLAB-515]: [AWS] Notebook creation fixed
add ae07eb2e [DLAB-515]: [GCP] Ubuntuversion changed to 18.04
add 9642ba4 [DLAB-515]: [GCP] Ubuntu version changed
add 7a35c31 [DLAB-515]: [Azure] Ubuntu version updated
add b5ee9e8 [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
add da70c67 [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
add 1428f9a [DLAB-515]: EDGE as NAT configuration implemented
add ec13ff1 [DLAB-515]: EDGE as NAT configuration fixed / EMR version
updated
add 03e7935 [DLAB-515] Fixed jupyterlab image
add b2e61b8 Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add d53b2a9 [DLAB-515]: EDGE as NAT configuration fixed
add 8163a43 [DLAB-515] - nftables.conf fixed
add 9a884b5 DLAB-1799 added parameter in tensorboard.service, changed
numpy version for python 2.7, added setuptools version to dlab.ini that is
necessary for tensorboard
add 5849b09 Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add 3ede45c [DLAB-515]: Dataengine creation fixed
add 5a2b871 [DLAB-1799]: fixed typo
add 849afef Merge branch 'DLAB-515' of
https://github.com/apache/incubator-dlab into DLAB-515
add 178b0c4 [DLAB-1799]: fixed error
add d51d314 Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add 35eb846 [DLAB-515]: Toree version updated
add 50de7a6 [DLAB-515]: Toree version fixed/ Docker ubuntu version
updated/ Docker pip version updated
add e0bba64 Merge branch 'develop' into DLAB-515
add 694edd7 [DLAB-515]- Jupyter kernels connection fixed
add 2113a07 [DLAB-515]- Jupyter remote kernels fixed
add 6c0f1c7 [DLAB-515]- Rstudio fixed
add c837db6 [DLAB-515]- Rstudio fixed
add 8360a15 [DLAB-515]- Rstudio fixed
add 010f6f8 [DLAB-515]- Rstudio fixed
add 3178abb [DLAB-515]- Ubuntu 18.04 for container updated/ pip v20.1 for
containers updated/ toree v0.3.0 for all clouds updated
add 93a219f [DLAB-1850]: added arg to jupyterlab docker build command
add b86160e Merge pull request #777 from apache/DLAB-1850
add 21d56f8 [DLAB-1827]: increased primary disk size to 14G as with 12
tensorflow with jupyter creation failed
add ddf336f Merge pull request #778 from apache/DLAB-1827
add 91a492a [DLAB-1827]: increased primary disk size to 16G
add ab58e4b [DLAB-515] - [GCP] Dataproc version updated
add 5d80f34 [DLAB-1825]: added possibility to enable warn_only for
manage_pkg
add dd3cbd9 Merge pull request #783 from apache/DLAB-1825
add 560e9d2 Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add a28ff32 [DLAB-515] - [GCP] Dataproc on Jupyter and Zeppelin creation
fixed
add 3600b1a [DLAB-515] - Python version 3.5 changed for 3.6 for library
packages
add 91c734f [DLAB-515] - Dataproc version fixed
add a6ebe55 [DLAB-515] - GPG update disabled/HTTPS proxy for apt added
add 873bab8 [DLAB-515] - dataproc fixed
add a45445c [DLAB-515] - GPG key renewal changed
add 6662b81 [DLAB-1855]: changed pip install
add c881a67 [DLAB-1855]: changed pip2 installation
add 5eaa170 [DLAB-1855]: added pip3 pip2 upgrade
add 1bcf291 [DLAB-1855]: changed return in case of error during pip pkg
installation
add 7998afa Merge pull request #795 from apache/DLAB-1855
add 2f3ec2e Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add c0aae69 [DLAB-515] - dataengine-service libs installing fixed
add 7b4e6d9 [DLAB-1856]: added R-devel package installation during
cluster creation
add cf0cf20 Merge pull request #797 from apache/DLAB-1856
add a33f75d [DLAB-1855]: changed pip update during dataengine service
creation
add be4a83a [DLAB-1855]: changed pip update during dataengine service
creation
add bdd1176 Merge branch 'DLAB-1855' of
https://github.com/apache/incubator-dlab into DLAB-1855
add d487864 Merge pull request #798 from apache/DLAB-1855
add 3521c5f [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy
implemented
add 9b5f77a Update fab.py
add 8b86370 [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy
fixed
add dc8e24c [DLAB-515] - [GCP] EDGE node as NAT implemented, [GCP]
Dataproc kernels connection via sparkmagic/livy implemented, [AWS] [GCP]
[Azure] Sprk Cluster connection via sparkmagic/livy implemented
add e7eeec5 Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
add 4b85cc7 [DLAB-515] Deployment fixed
add fb6c895 [DLAB-515] [GCP] Datapoc v. 1.4 changed
add e5540a2 [DLAB-515] Dataengine kernels removing fixed
add 834cf62 [DLAB-1810]: fixed some versions
add 0f92ecb [DLAB-1810]: fixed some versions
add 638350c [DLAB-1810]: changed cmake version
add 8bb04b9 [DLAB-1810]: changed caffe2 version
add d9c40f5 [DLAB-1810]: temporarily turned of instance deletion on
failure
add 6205a03 [DLAB-1810]: changed caffe2 version and how it is installed
add 22c905d [DLAB-1810]: added fix for torch
add 825ffbf [DLAB-1810]: moved pytorch_branch as variable to dlab.ini
add 40f1909 [DLAB-1810]: uncommented superset instance removal on failure
add eb536dd [DLAB-1810]: changed torch git repository link
add a355d9c [DLAB-1810]: changed cntk version
add 9f21179 [DLAB-1810]: changed cntk version and link
add 3437ed2 [DLAB-1810]: changed mxnet version
add 7dc705a [DLAB-1810]: added cntk version for py2
add 802675a [DLAB-1810]: changed cntk-gpu link
add 4c1ee4f [DLAB-1810]: added some luarocks dependencies
add 0082910 [DLAB-1810]: increased wait time during reboot to 180, with
wait=150 script exited on gcp
add 9f56486 [DLAB-1810]: commented torch related code
add f3a405a [DLAB-1810]: disabled iTorch installation
add 8dbacee Merge pull request #835 from apache/DLAB-1810
add b45fecb [DLAB-515] JAVA_HOME for Zeppelin/Spark added
add 44f4fbf Merge branch 'develop' into DLAB-515
add c79b3a6 [DLAB-515] dataengine cluster json fixed
add d8d24bd [DLAB-515] [GCP] Dadaproc deployment fixed
new e32996b Merge pull request #841 from apache/DLAB-515
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../scripts/deploy_repository/deploy_repository.py | 10 +-
.../src/dataengine/scripts/configure_dataengine.py | 29 ++++-
.../scripts/configure_deep_learning_node.py | 28 +++--
.../src/general/conf/dlab.ini | 46 +++++---
.../src/general/files/aws/base_Dockerfile | 4 +-
.../files/aws/dataengine-service_description.json | 4 +-
.../src/general/files/aws/dataengine_Dockerfile | 2 +
.../src/general/files/aws/deeplearning_Dockerfile | 3 +-
.../src/general/files/aws/jupyter_Dockerfile | 3 +-
.../src/general/files/aws/jupyterlab_Dockerfile | 2 +-
.../src/general/files/azure/base_Dockerfile | 4 +-
.../src/general/files/azure/dataengine_Dockerfile | 2 +
.../general/files/azure/deeplearning_Dockerfile | 2 +-
.../src/general/files/azure/jupyter_Dockerfile | 2 +-
.../src/general/files/azure/jupyterlab_Dockerfile | 2 +-
.../src/general/files/gcp/base_Dockerfile | 4 +-
.../files/gcp/dataengine-service_description.json | 3 +-
.../src/general/files/gcp/dataengine_Dockerfile | 2 +
.../src/general/files/gcp/deeplearning_Dockerfile | 2 +-
.../src/general/files/gcp/jupyter_Dockerfile | 3 +-
.../src/general/files/gcp/jupyterlab_Dockerfile | 2 +-
.../src/general/files/gcp/ssn_policy.json | 4 +-
.../src/general/lib/aws/actions_lib.py | 31 +++++
.../src/general/lib/azure/actions_lib.py | 4 +
.../src/general/lib/gcp/actions_lib.py | 35 ++++++
.../src/general/lib/gcp/meta_lib.py | 19 +++
.../src/general/lib/os/debian/common_lib.py | 73 ++++++------
.../src/general/lib/os/debian/edge_lib.py | 111 ++++++++----------
.../src/general/lib/os/debian/notebook_lib.py | 127 +++++++++++++--------
.../src/general/lib/os/debian/ssn_lib.py | 4 +-
.../src/general/lib/os/fab.py | 37 ++++--
.../src/general/lib/os/redhat/notebook_lib.py | 16 +--
.../general/scripts/aws/common_create_subnet.py | 27 +++--
.../general/scripts/aws/common_prepare_notebook.py | 2 +-
.../scripts/aws/dataengine-service_configure.py | 6 +-
.../scripts/aws/dataengine-service_jars_parser.py | 2 +-
.../src/general/scripts/aws/edge_configure.py | 34 ++++++
.../edge_configure_route_table.py} | 18 ++-
.../jupyter_dataengine-service_create_configs.py | 69 ++++++++---
.../jupyter_install_dataengine-service_kernels.py | 24 ++--
.../src/general/scripts/aws/project_prepare.py | 44 +++++++
...create_bucket.py => common_create_nat_route.py} | 39 ++++---
.../general/scripts/gcp/common_prepare_notebook.py | 2 +-
.../scripts/gcp/dataengine-service_jars_parser.py | 2 +-
.../scripts/gcp/dataengine-service_prepare.py | 2 +
.../src/general/scripts/gcp/edge_configure.py | 19 +++
.../jupyter_dataengine-service_create_configs.py | 57 ++++++---
.../jupyter_install_dataengine-service_kernels.py | 24 ++--
.../src/general/scripts/gcp/project_prepare.py | 38 ++++++
.../general/scripts/os/common_clean_instance.py | 2 +-
.../scripts/os/common_configure_reverse_proxy.py | 4 +-
.../os/deeplearning_dataengine_create_configs.py | 6 +-
.../general/scripts/os/get_list_available_pkgs.py | 2 +-
.../os/jupyter_dataengine_create_configs.py | 65 ++++++++---
.../os/jupyter_install_dataengine_kernels.py | 17 +--
.../scripts/os/jupyterlab_container_start.py | 2 +-
.../scripts/os/tensor_dataengine_create_configs.py | 6 +-
.../os/zeppelin_dataengine_create_configs.py | 4 +-
.../templates/gcp/dataengine-service_cluster.json | 12 +-
.../templates/os/debian/livy.service} | 14 +--
.../templates/os/livy-env.sh} | 9 +-
.../templates/os/py3spark_local_template.json | 6 +-
.../templates/os/sparkmagic_config_template.json | 20 ++++
.../src/general/templates/os/tensorboard.service | 2 +-
.../src/jupyter/scripts/configure_jupyter_node.py | 2 +-
.../scripts/configure_jupyterlab_node.py | 2 +-
...nfigure_http_proxy.py => configure_nftables.py} | 10 +-
.../src/project/templates/nftables.conf | 22 ++++
.../src/project/templates/nginx.conf | 29 +++--
.../src/ssn/scripts/configure_docker.py | 8 +-
.../src/ssn/scripts/configure_ssn_node.py | 10 ++
.../zeppelin/scripts/configure_zeppelin_node.py | 8 ++
.../scenario_deeplearning/deeplearning_tests.py | 12 +-
73 files changed, 907 insertions(+), 396 deletions(-)
copy
infrastructure-provisioning/src/general/scripts/{gcp/common_put_to_bucket.py =>
aws/edge_configure_route_table.py} (74%)
copy
infrastructure-provisioning/src/general/scripts/gcp/{common_create_bucket.py =>
common_create_nat_route.py} (59%)
copy infrastructure-provisioning/src/{zeppelin/templates/livy-server.service
=> general/templates/os/debian/livy.service} (86%)
copy
infrastructure-provisioning/src/{superset/templates/requirements-extra.txt =>
general/templates/os/livy-env.sh} (83%)
create mode 100644
infrastructure-provisioning/src/general/templates/os/sparkmagic_config_template.json
copy infrastructure-provisioning/src/project/scripts/{configure_http_proxy.py
=> configure_nftables.py} (91%)
create mode 100644
infrastructure-provisioning/src/project/templates/nftables.conf
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
