[jira] [Created] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2018-08-28 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-505: Summary: sparkR.session failed with "invalid jobj 1" error in Spark 2.3 Key: LIVY-505 URL: https://issues.apache.org/jira/browse/LIVY-505 Project: Livy Issue Type:

[jira] [Commented] (LIVY-231) Session recovery for batch sessions with multiple Livy servers

2018-11-14 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687299#comment-16687299 ] shanyu zhao commented on LIVY-231: -- Any update for this feature? Or should we implement an active-standby

[jira] [Commented] (LIVY-266) Livy sessions/batches are not secured. Any user can stop another user session/batch

2018-11-29 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704312#comment-16704312 ] shanyu zhao commented on LIVY-266: -- [~tc0312] are you saying that all the requests are actually using

[jira] [Updated] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-576: - Attachment: LIVY-576.patch > Unknown YARN state RUNNING for app with final status SUCCEEDED >

[jira] [Updated] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-576: - Summary: Unknown YARN state RUNNING for app with final status SUCCEEDED (was: Unknown YARN state RUNNING

[jira] [Created] (LIVY-576) Unknown YARN state RUNNING FOR app with final status SUCCEEDED

2019-03-25 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-576: Summary: Unknown YARN state RUNNING FOR app with final status SUCCEEDED Key: LIVY-576 URL: https://issues.apache.org/jira/browse/LIVY-576 Project: Livy Issue Type:

[jira] [Commented] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2019-03-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803315#comment-16803315 ] shanyu zhao commented on LIVY-505: -- Root cause: SparkR uses SparkR env variable ".sparkRjsc" as a

[jira] [Updated] (LIVY-505) sparkR.session failed with "invalid jobj 1" error in Spark 2.3

2019-03-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-505: - Attachment: LIVY-505.patch > sparkR.session failed with "invalid jobj 1" error in Spark 2.3 >

[jira] [Commented] (LIVY-547) Livy kills session after livy.server.session.timeout even if the session is active

2019-02-27 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780032#comment-16780032 ] shanyu zhao commented on LIVY-547: -- [~Jassy] are you still working on this issue? > Livy kills session

[jira] [Created] (LIVY-617) Livy session leak on Yarn when creating session duplicated names

2019-07-30 Thread shanyu zhao (JIRA)
shanyu zhao created LIVY-617: Summary: Livy session leak on Yarn when creating session duplicated names Key: LIVY-617 URL: https://issues.apache.org/jira/browse/LIVY-617 Project: Livy Issue

[jira] [Commented] (LIVY-547) Livy kills session after livy.server.session.timeout even if the session is active

2019-07-31 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897494#comment-16897494 ] shanyu zhao commented on LIVY-547: -- Created new PR and added new configuration to change the behavior of

[jira] [Commented] (LIVY-576) Unknown YARN state RUNNING for app with final status SUCCEEDED

2020-02-24 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043920#comment-17043920 ] shanyu zhao commented on LIVY-576: -- Thanks [~andrasbeni], yes LIVY-642 is basically a duplicate of this

[jira] [Created] (LIVY-750) Livy uploads local pyspark archives to Yarn distributed cache

2020-02-16 Thread shanyu zhao (Jira)
shanyu zhao created LIVY-750: Summary: Livy uploads local pyspark archives to Yarn distributed cache Key: LIVY-750 URL: https://issues.apache.org/jira/browse/LIVY-750 Project: Livy Issue Type:

[jira] [Created] (LIVY-749) Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session

2020-02-14 Thread shanyu zhao (Jira)
shanyu zhao created LIVY-749: Summary: Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session Key: LIVY-749 URL: https://issues.apache.org/jira/browse/LIVY-749 Project: Livy

[jira] [Updated] (LIVY-749) Datanucleus jars are uploaded to hdfs unnecessarily when starting a livy session

2020-02-14 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-749: - Issue Type: Bug (was: New Feature) > Datanucleus jars are uploaded to hdfs unnecessarily when starting a

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-08 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010965#comment-17010965 ] shanyu zhao commented on LIVY-718: -- LIVY-11 aims at active-standby HA, user should be able to choose

[jira] [Updated] (LIVY-750) Livy uploads local pyspark archives to Yarn distributed cache

2020-03-16 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated LIVY-750: - Description: On Livy Server, even if we set pyspark archives to use local files: {code:bash} export