[
https://issues.apache.org/jira/browse/DLAB-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vira Vitanska updated DLAB-1823:
--------------------------------
Description:
*Preconditions:*
1. Zeppelin is created on AWS/GCP
*Steps to reproduce:*
1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
*Actual result:*
1. Playbooks run with error
*Expected result:*
1. Playbooks run successful
------------------------------------------------------------------------------------------
(i) For GCP Playbook preparation fails only for airbnb see attachments
----
*AWS*
+Flight preparation Py2+
||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
+Flight preparation R+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
+Flight preparation scala+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
+AIRBNB+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
----
*GCP*
+AIRBNB+
||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color}
(11/06/2020)|
||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
||EMR 6.0.0 py3|*runs with error* (09/06/2020|
||Spark py2|{color:#de350b}*runs with error*{color} *{color:#de350b}-failed to
start pyspark{color}* (11/06/2020)|
||Spark py3|*runs with error* (04/06/2020)|
was:
*Preconditions:*
1. Zeppelin is created on AWS/GCP
*Steps to reproduce:*
1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
*Actual result:*
1. Playbooks run with error
*Expected result:*
1. Playbooks run successful
------------------------------------------------------------------------------------------
(i) For GCP Playbook preparation fails only for airbnb see attachments
----
*AWS*
+Flight preparation Py2+
||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
+Flight preparation R+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
+Flight preparation scala+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
+AIRBNB+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
----
*GCP*
+AIRBNB+
||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color}
(11/06/2020)|
||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
||EMR 6.0.0 py3|*runs with error* (09/06/2020|
||Spark py2|*runs with error* (04/06/2020)|
||Spark py3|*runs with error* (04/06/2020)|
> [Branch-515][AWS][GCP][Zeppelin]: Playbooks flight/airbnb preparation
> Py2/Py3/R/Scala run with error for local/remote kernels
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: DLAB-1823
> URL: https://issues.apache.org/jira/browse/DLAB-1823
> Project: Apache DLab
> Issue Type: Bug
> Components: DLab Main
> Reporter: Vira Vitanska
> Assignee: Mykola Bodnar
> Priority: Major
> Labels: AWS, Debian, DevOps
> Attachments: AIRBNB local-remote.png, GCP Preparation airbnb py2.png,
> GCP preparation airbnb py3.png, Python 2 data preparation -local logs.txt,
> Python 2 data preparation-Spark-logs.txt, Python 2 data
> preparation-local.png, Python 2 data preparation-spark.png, R data
> preparation local remote logs.txt, Scala -py2-py3- local-remote.png, Scala
> py2-py3 remote-local logs.txt, Verified-AWS-Local-Fight-R-Py3.png,
> Verified1-AWS-EMR530-AIRBNB-Prapare-Py2.png,
> Verified1-AWS-EMR530-AIRBNB-Prapare-Py3.png,
> Verified1-AWS-EMR530-Flight-preparetion-PY2.png,
> Verified1-AWS-EMR6-AIRBNB-Prapare-Py2-py3.png,
> Verified1-AWS-EMR6-Flight-Prepare-py2.png,
> Verified1-AWS-EMR6-Flight-R-Py2.png, Verified1-AWS-EMR6-Flight-R-Py3.png,
> Verified1-AWS-EMR6-Flight-Scala-Py2.png,
> Verified1-AWS-EMR6-Flight-Scala-Py3.png,
> Verified1-AWS-Scala-Flight-Prepare-Py2.png,
> Verified1-AWS-Scala-Flight-Prepare-Py3.png,
> Verified1-AWS-Spark-AIRBNB-Prepare-Py3.png,
> Verified1-AWS-Spark-Flight-Prapare-Py2.png,
> Verified1-AWS-Spark-Flight-Prepare-Py2.png,
> Verified1-AWS-Spark-Flight-Prepare-Py3.png,
> Verified1-AWS-Spark-Flight-Prepare-R-py3.png,
> Verified1-AWS-local-flight-prapare-Py2.png,
> Verified1-AWS-spark-flight-prepare-Scala-Py2.png,
> Verified1-GCP-local-AIRBNB-py2.jpg,
> Verified1-GCP-local-AirbNB-prepare-py3.jpg,
> Verifight-AWS-Spark-AIRBNB-Prepare-Py2.png,
> verified1-GCP-Spark-AIRBNB-Prapare-Py3.jpg
>
>
> *Preconditions:*
> 1. Zeppelin is created on AWS/GCP
> *Steps to reproduce:*
> 1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
> *Actual result:*
> 1. Playbooks run with error
> *Expected result:*
> 1. Playbooks run successful
> ------------------------------------------------------------------------------------------
> (i) For GCP Playbook preparation fails only for airbnb see attachments
> ----
> *AWS*
> +Flight preparation Py2+
> ||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +Flight preparation R+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
> +Flight preparation scala+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +AIRBNB+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
> ||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ----
> *GCP*
> +AIRBNB+
> ||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
> ||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color}
> (11/06/2020)|
> ||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
> ||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
> ||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
> ||EMR 6.0.0 py3|*runs with error* (09/06/2020|
> ||Spark py2|{color:#de350b}*runs with error*{color} *{color:#de350b}-failed
> to start pyspark{color}* (11/06/2020)|
> ||Spark py3|*runs with error* (04/06/2020)|
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@dlab.apache.org
For additional commands, e-mail: dev-h...@dlab.apache.org
