[jira] [Commented] (LIVY-583) python build needs configparser

2019-07-11 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883563#comment-16883563 ] Yiheng Wang commented on LIVY-583: -- It is configured in the setup.py. [https://github.com

[jira] [Issue Comment Deleted] (LIVY-583) python build needs configparser

2019-07-12 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-583: - Comment: was deleted (was: It is configured in the setup.py. [https://github.com/apache/incubator-livy/blo

[jira] [Commented] (LIVY-582) python test_create_new_session_without_default_config test fails consistently

2019-07-12 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883767#comment-16883767 ] Yiheng Wang commented on LIVY-582: -- Just change the upper case characters in your hostname

[jira] [Commented] (LIVY-583) python build needs configparser

2019-07-12 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883769#comment-16883769 ] Yiheng Wang commented on LIVY-583: -- configparser is already in the setup.py,  [https://git

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-17 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887692#comment-16887692 ] Yiheng Wang commented on LIVY-575: -- Hi Marco I'm interested in contributing to this. Ther

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-18 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887786#comment-16887786 ] Yiheng Wang commented on LIVY-575: -- I can help create sub-tasks > Implement missing metad

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-22 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890653#comment-16890653 ] Yiheng Wang commented on LIVY-575: -- [~mgaido] Looks like PR-182 is to fix Jira-571 instead

[jira] [Commented] (LIVY-615) livy.ui.basePath does not seem to work correctly

2019-07-30 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896746#comment-16896746 ] Yiheng Wang commented on LIVY-615: -- Can you raise a PR for your patch? > livy.ui.basePath

[jira] [Created] (LIVY-622) Implement GetSchemas metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-622: Summary: Implement GetSchemas metadata operation Key: LIVY-622 URL: https://issues.apache.org/jira/browse/LIVY-622 Project: Livy Issue Type: Sub-task Compo

[jira] [Updated] (LIVY-622) Implement GetSchemas metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-622: - Description: We should support GetSchemas metadata operation in Livy thrift server. > Implement GetSchemas

[jira] [Assigned] (LIVY-575) Implement missing metadata operations

2019-08-05 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang reassigned LIVY-575: Assignee: Yiheng Wang > Implement missing metadata operations >

[jira] [Created] (LIVY-623) Implement GetTables metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-623: Summary: Implement GetTables metadata operation Key: LIVY-623 URL: https://issues.apache.org/jira/browse/LIVY-623 Project: Livy Issue Type: Sub-task Compon

[jira] [Created] (LIVY-624) Implement GetColumns metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-624: Summary: Implement GetColumns metadata operation Key: LIVY-624 URL: https://issues.apache.org/jira/browse/LIVY-624 Project: Livy Issue Type: Sub-task Compo

[jira] [Created] (LIVY-625) Implement GetFunctions metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-625: Summary: Implement GetFunctions metadata operation Key: LIVY-625 URL: https://issues.apache.org/jira/browse/LIVY-625 Project: Livy Issue Type: Sub-task Com

[jira] [Created] (LIVY-626) Implement GetPrimaryKeys metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-626: Summary: Implement GetPrimaryKeys metadata operation Key: LIVY-626 URL: https://issues.apache.org/jira/browse/LIVY-626 Project: Livy Issue Type: Sub-task C

[jira] [Created] (LIVY-628) Implement GetDelegationToken metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-628: Summary: Implement GetDelegationToken metadata operation Key: LIVY-628 URL: https://issues.apache.org/jira/browse/LIVY-628 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-627) Implement GetCrossReference metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-627: Summary: Implement GetCrossReference metadata operation Key: LIVY-627 URL: https://issues.apache.org/jira/browse/LIVY-627 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-630) Implement RenewDelegationToken metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-630: Summary: Implement RenewDelegationToken metadata operation Key: LIVY-630 URL: https://issues.apache.org/jira/browse/LIVY-630 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-629) Implement CancelDelegationToken metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-629: Summary: Implement CancelDelegationToken metadata operation Key: LIVY-629 URL: https://issues.apache.org/jira/browse/LIVY-629 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-631) Implement GetQueryId metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-631: Summary: Implement GetQueryId metadata operation Key: LIVY-631 URL: https://issues.apache.org/jira/browse/LIVY-631 Project: Livy Issue Type: Sub-task Compo

[jira] [Updated] (LIVY-631) Implement GetQueryId metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-631: - Description: We should support GetQueryId metadata operation in Livy thrift server. (was: We should suppor

[jira] [Created] (LIVY-632) Implement SetClientInfo metadata operation

2019-08-05 Thread Yiheng Wang (JIRA)
Yiheng Wang created LIVY-632: Summary: Implement SetClientInfo metadata operation Key: LIVY-632 URL: https://issues.apache.org/jira/browse/LIVY-632 Project: Livy Issue Type: Sub-task Co

[jira] [Assigned] (LIVY-630) Implement RenewDelegationToken metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang reassigned LIVY-630: Assignee: (was: Yiheng Wang) > Implement RenewDelegationToken metadata operation > -

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900963#comment-16900963 ] Yiheng Wang commented on LIVY-575: -- Got it. Sorry for the inconvenience. > Implement miss

[jira] [Assigned] (LIVY-631) Implement GetQueryId metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang reassigned LIVY-631: Assignee: (was: Yiheng Wang) > Implement GetQueryId metadata operation > ---

[jira] [Commented] (LIVY-625) Implement GetFunctions metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900969#comment-16900969 ] Yiheng Wang commented on LIVY-625: -- Working on it. > Implement GetFunctions metadata oper

[jira] [Assigned] (LIVY-632) Implement SetClientInfo metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang reassigned LIVY-632: Assignee: (was: Yiheng Wang) > Implement SetClientInfo metadata operation >

[jira] [Commented] (LIVY-624) Implement GetColumns metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900968#comment-16900968 ] Yiheng Wang commented on LIVY-624: -- Working on it. > Implement GetColumns metadata operat

[jira] [Commented] (LIVY-623) Implement GetTables metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900967#comment-16900967 ] Yiheng Wang commented on LIVY-623: -- Working on it. > Implement GetTables metadata operati

[jira] [Commented] (LIVY-622) Implement GetSchemas metadata operation

2019-08-06 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900966#comment-16900966 ] Yiheng Wang commented on LIVY-622: -- Working on it. > Implement GetSchemas metadata operat

[jira] [Commented] (LIVY-623) Implement GetTables metadata operation

2019-08-08 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902987#comment-16902987 ] Yiheng Wang commented on LIVY-623: -- [https://github.com/apache/incubator-livy/pull/194] >

[jira] [Commented] (LIVY-624) Implement GetColumns metadata operation

2019-08-08 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902988#comment-16902988 ] Yiheng Wang commented on LIVY-624: -- [https://github.com/apache/incubator-livy/pull/194] >

[jira] [Commented] (LIVY-625) Implement GetFunctions metadata operation

2019-08-08 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902989#comment-16902989 ] Yiheng Wang commented on LIVY-625: -- [https://github.com/apache/incubator-livy/pull/194] >

[jira] [Commented] (LIVY-574) Add tests for metadata operations

2019-08-12 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905849#comment-16905849 ] Yiheng Wang commented on LIVY-574: -- I found some errors relate with existing meta operatio

[jira] [Updated] (LIVY-635) Travis failed to build

2019-08-13 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-635: - Component/s: Tests > Travis failed to build > -- > > Key: LIVY-635 >

[jira] [Commented] (LIVY-637) get NullPointerException when create database using thriftserver

2019-08-14 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907012#comment-16907012 ] Yiheng Wang commented on LIVY-637: -- Spark beeline uses an older hive-jdbc-client version,

[jira] [Comment Edited] (LIVY-637) get NullPointerException when create database using thriftserver

2019-08-14 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907012#comment-16907012 ] Yiheng Wang edited comment on LIVY-637 at 8/14/19 8:25 AM: --- Spark

[jira] [Commented] (LIVY-638) get sql.AnalysisException when create table using thriftserver

2019-08-14 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907028#comment-16907028 ] Yiheng Wang commented on LIVY-638: -- It's weird that even I enable hive support in spark co

[jira] [Commented] (LIVY-573) Add tests for operation logs retrieval

2019-08-14 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907199#comment-16907199 ] Yiheng Wang commented on LIVY-573: -- Have created a patch. [~mgaido] can you please help re

[jira] [Commented] (LIVY-633) session should not be gc-ed for long running queries

2019-08-15 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907993#comment-16907993 ] Yiheng Wang commented on LIVY-633: -- Is this related to this JIRA?  [https://issues.apache.

[jira] [Commented] (LIVY-515) Livy session is idle even if spark context is unavailable

2019-08-19 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910923#comment-16910923 ] Yiheng Wang commented on LIVY-515: -- This is reported in 0.4.0. Maybe this issue has been f

[jira] [Comment Edited] (LIVY-515) Livy session is idle even if spark context is unavailable

2019-08-19 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910923#comment-16910923 ] Yiheng Wang edited comment on LIVY-515 at 8/20/19 2:14 AM: --- This

[jira] [Commented] (LIVY-178) PySpark sessions crash on invalid string

2019-08-19 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910924#comment-16910924 ] Yiheng Wang commented on LIVY-178: -- This was reported in 0.2. Maybe it has been fixed in t

[jira] [Created] (LIVY-644) Flaky test: Failed to execute goal org.jacoco:jacoco-maven-plugin:0.8.2:report-aggregate (jacoco-report) on project livy-coverage-report

2019-08-22 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-644: Summary: Flaky test: Failed to execute goal org.jacoco:jacoco-maven-plugin:0.8.2:report-aggregate (jacoco-report) on project livy-coverage-report Key: LIVY-644 URL: https://issues.apache

[jira] [Updated] (LIVY-644) Flaky test: Failed to execute goal org.jacoco:jacoco-maven-plugin:0.8.2:report-aggregate (jacoco-report) on project livy-coverage-report

2019-08-22 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-644: - Issue Type: Bug (was: Improvement) > Flaky test: Failed to execute goal > org.jacoco:jacoco-maven-plugin:

[jira] [Commented] (LIVY-633) session should not be gc-ed for long running queries

2019-09-03 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921215#comment-16921215 ] Yiheng Wang commented on LIVY-633: -- Yes, it's a different problem. It should be a bug in L

[jira] [Commented] (LIVY-660) How can we use YARN and all the nodes in our cluster when submiting a pySpark job

2019-09-05 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923112#comment-16923112 ] Yiheng Wang commented on LIVY-660: -- I think it's better to post such question in livy user

[jira] [Commented] (LIVY-664) Spark application still running when Livy session creating was rejected

2019-09-12 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928486#comment-16928486 ] Yiheng Wang commented on LIVY-664: -- In the code, it will stop the duplicated session when

[jira] [Comment Edited] (LIVY-664) Spark application still running when Livy session creating was rejected

2019-09-12 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928486#comment-16928486 ] Yiheng Wang edited comment on LIVY-664 at 9/12/19 12:18 PM: In

[jira] [Commented] (LIVY-664) Spark application still running when Livy session creating was rejected

2019-09-17 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931261#comment-16931261 ] Yiheng Wang commented on LIVY-664: -- Oh, I check the wrong branch... Sorry for the confusio

[jira] [Issue Comment Deleted] (LIVY-664) Spark application still running when Livy session creating was rejected

2019-09-17 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-664: - Comment: was deleted (was: Oh, I check the wrong branch... Sorry for the confusion.    ) > Spark applica

[jira] [Commented] (LIVY-664) Spark application still running when Livy session creating was rejected

2019-09-17 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931300#comment-16931300 ] Yiheng Wang commented on LIVY-664: -- session stop code:  [https://github.com/apache/incubat

[jira] [Commented] (LIVY-684) Livy server support zookeeper service discovery

2019-09-18 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933110#comment-16933110 ] Yiheng Wang commented on LIVY-684: -- This is duplicate with https://issues.apache.org/jira/

[jira] [Commented] (LIVY-667) Support query a lot of data.

2019-09-23 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935829#comment-16935829 ] Yiheng Wang commented on LIVY-667: -- Hi Marco. I think Spark compute on the partition data

[jira] [Created] (LIVY-690) Exclude curator in thrift server pom to avoid conflict jars

2019-09-28 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-690: Summary: Exclude curator in thrift server pom to avoid conflict jars Key: LIVY-690 URL: https://issues.apache.org/jira/browse/LIVY-690 Project: Livy Issue Type: Bug

[jira] [Commented] (LIVY-690) Exclude curator in thrift server pom to avoid conflict jars

2019-09-28 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940216#comment-16940216 ] Yiheng Wang commented on LIVY-690: -- This will be fixed by this patch: https://github.com/a

[jira] [Created] (LIVY-691) Duplicate jars in assembly jar folder

2019-09-29 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-691: Summary: Duplicate jars in assembly jar folder Key: LIVY-691 URL: https://issues.apache.org/jira/browse/LIVY-691 Project: Livy Issue Type: Bug Reporter:

[jira] [Created] (LIVY-696) Support recovery in livy thrift server

2019-10-10 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-696: Summary: Support recovery in livy thrift server Key: LIVY-696 URL: https://issues.apache.org/jira/browse/LIVY-696 Project: Livy Issue Type: Improvement Com

[jira] [Updated] (LIVY-696) Support recovery in livy thrift server

2019-10-10 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-696: - Description: This JIRA is to discuss support recovery in Livy Thrift server. Livy server support recovery.

[jira] [Updated] (LIVY-696) Support recovery in livy thrift server

2019-10-10 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-696: - Description: This JIRA is to discuss support recovery in Livy Thrift server. Livy server support recovery.

[jira] [Updated] (LIVY-696) Support recovery in livy thrift server

2019-10-10 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-696: - Description: This JIRA is to discuss support recovery in Livy Thrift server. Livy server support recovery.

[jira] [Updated] (LIVY-696) Support recovery in livy thrift server

2019-10-10 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-696: - Description: This JIRA is to discuss support recovery in Livy Thrift server. Livy server support recovery.

[jira] [Commented] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-10-30 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962882#comment-16962882 ] Yiheng Wang commented on LIVY-569: -- Hi, which version of spark/livy are you using. I canno

[jira] [Comment Edited] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-10-30 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962882#comment-16962882 ] Yiheng Wang edited comment on LIVY-569 at 10/30/19 10:05 AM: - H

[jira] [Commented] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-10-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964538#comment-16964538 ] Yiheng Wang commented on LIVY-569: -- >From the comments of the stack overflow question, it

[jira] [Created] (LIVY-708) The version of curator jars are not aligned

2019-11-07 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-708: Summary: The version of curator jars are not aligned Key: LIVY-708 URL: https://issues.apache.org/jira/browse/LIVY-708 Project: Livy Issue Type: Bug Compon

[jira] [Commented] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-11-07 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969212#comment-16969212 ] Yiheng Wang commented on LIVY-569: -- >From the latest community version of livy, I cannot r

[jira] [Commented] (LIVY-712) EMR 5.23/5.27 - Livy does not recognise that Spark job failed

2019-11-21 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979271#comment-16979271 ] Yiheng Wang commented on LIVY-712: -- This code is changed in this patch: https://github.com

[jira] [Commented] (LIVY-712) EMR 5.23/5.27 - Livy does not recognise that Spark job failed

2019-11-21 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979272#comment-16979272 ] Yiheng Wang commented on LIVY-712: -- Can you provide a way to reproduce the issue? > EMR 5

[jira] [Created] (LIVY-718) Support multi-active high availability in Livy

2019-11-28 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-718: Summary: Support multi-active high availability in Livy Key: LIVY-718 URL: https://issues.apache.org/jira/browse/LIVY-718 Project: Livy Issue Type: Epic Co

[jira] [Commented] (LIVY-719) Livy is not high available in aws EMR cluster

2019-12-01 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985791#comment-16985791 ] Yiheng Wang commented on LIVY-719: -- Hi We have proposed a JIRA for Livy HA. https://issu

[jira] [Created] (LIVY-721) Distributed Session ID generation

2019-12-01 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-721: Summary: Distributed Session ID generation Key: LIVY-721 URL: https://issues.apache.org/jira/browse/LIVY-721 Project: Livy Issue Type: Sub-task Reporter:

[jira] [Updated] (LIVY-721) Distributed Session ID Generation

2019-12-01 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-721: - Summary: Distributed Session ID Generation (was: Distributed Session ID generation) > Distributed Session

[jira] [Created] (LIVY-722) Session Allocation with Consistent Hashing

2019-12-01 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-722: Summary: Session Allocation with Consistent Hashing Key: LIVY-722 URL: https://issues.apache.org/jira/browse/LIVY-722 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-723) Server Registration

2019-12-01 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-723: Summary: Server Registration Key: LIVY-723 URL: https://issues.apache.org/jira/browse/LIVY-723 Project: Livy Issue Type: Sub-task Reporter: Yiheng Wang

[jira] [Created] (LIVY-724) Support Server Leave/Join and Session Cross Server Recovery

2019-12-01 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-724: Summary: Support Server Leave/Join and Session Cross Server Recovery Key: LIVY-724 URL: https://issues.apache.org/jira/browse/LIVY-724 Project: Livy Issue Type: Sub

[jira] [Created] (LIVY-725) Support Route Request and Server Discovery

2019-12-01 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-725: Summary: Support Route Request and Server Discovery Key: LIVY-725 URL: https://issues.apache.org/jira/browse/LIVY-725 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-731) Session Allocation with server-session Mapping

2019-12-18 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-731: Summary: Session Allocation with server-session Mapping Key: LIVY-731 URL: https://issues.apache.org/jira/browse/LIVY-731 Project: Livy Issue Type: Sub-task

[jira] [Created] (LIVY-732) A Common Zookeeper Wrapper Utility

2019-12-18 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-732: Summary: A Common Zookeeper Wrapper Utility Key: LIVY-732 URL: https://issues.apache.org/jira/browse/LIVY-732 Project: Livy Issue Type: Sub-task Reporte

[jira] [Updated] (LIVY-725) Support Route Request

2019-12-18 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-725: - Summary: Support Route Request (was: Support Route Request and Server Discovery) > Support Route Request

[jira] [Created] (LIVY-733) Support Service Discovery

2019-12-18 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-733: Summary: Support Service Discovery Key: LIVY-733 URL: https://issues.apache.org/jira/browse/LIVY-733 Project: Livy Issue Type: Sub-task Reporter: Yiheng

[jira] [Created] (LIVY-734) Support getAllSessions in Cluster

2019-12-18 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-734: Summary: Support getAllSessions in Cluster Key: LIVY-734 URL: https://issues.apache.org/jira/browse/LIVY-734 Project: Livy Issue Type: Sub-task Reporter:

[jira] [Updated] (LIVY-735) Fix RPC Channel Closed When multi clients connect to one driver

2019-12-18 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-735: - Summary: Fix RPC Channel Closed When multi clients connect to one driver (was: Fix RPC Channel closed whe

[jira] [Created] (LIVY-735) Fix RPC Channel closed when multi clients connect to one driver

2019-12-18 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-735: Summary: Fix RPC Channel closed when multi clients connect to one driver Key: LIVY-735 URL: https://issues.apache.org/jira/browse/LIVY-735 Project: Livy Issue Type

[jira] [Updated] (LIVY-735) Fix RPC Channel Closed When Multi Clients Connect to One Driver

2019-12-18 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-735: - Summary: Fix RPC Channel Closed When Multi Clients Connect to One Driver (was: Fix RPC Channel Closed Whe

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005203#comment-17005203 ] Yiheng Wang commented on LIVY-718: -- Thanks for your comments [~bikassaha] and [~meisam]. I

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006069#comment-17006069 ] Yiheng Wang commented on LIVY-718: -- bq. When a server fails, its sessions become unavailab

[jira] [Comment Edited] (LIVY-718) Support multi-active high availability in Livy

2019-12-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006069#comment-17006069 ] Yiheng Wang edited comment on LIVY-718 at 12/31/19 12:28 PM: - b

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006078#comment-17006078 ] Yiheng Wang commented on LIVY-718: -- [~bikassaha] Compared to the designated server solutio

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-09 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011909#comment-17011909 ] Yiheng Wang commented on LIVY-718: -- Hi [~bikassaha] I agree that allows multiple servers

[jira] [Assigned] (LIVY-725) Support Route Request

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang reassigned LIVY-725: Assignee: (was: mingchao zhao) > Support Route Request > - > >

[jira] [Commented] (LIVY-725) Support Route Request

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015599#comment-17015599 ] Yiheng Wang commented on LIVY-725: -- [~micahzhao]we assign the task when task is resolved.

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015606#comment-17015606 ] Yiheng Wang commented on LIVY-718: -- I updated the design doc based on the recent discussio

[jira] [Updated] (LIVY-724) Support Session Lazy Recover

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-724: - Summary: Support Session Lazy Recover (was: Support Server Leave/Join and Session Cross Server Recovery)

[jira] [Created] (LIVY-744) Livy Job API support multi-active HA

2020-01-14 Thread Yiheng Wang (Jira)
Yiheng Wang created LIVY-744: Summary: Livy Job API support multi-active HA Key: LIVY-744 URL: https://issues.apache.org/jira/browse/LIVY-744 Project: Livy Issue Type: Sub-task Report

[jira] [Commented] (LIVY-723) Server Registration

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015609#comment-17015609 ] Yiheng Wang commented on LIVY-723: -- I'm working on it. > Server Registration > --

[jira] [Updated] (LIVY-723) Server Registration

2020-01-19 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-723: - Description: In this JIRA, we want to implement a cluster manager which will monitor the cluster state cha

[jira] [Updated] (LIVY-724) Support Session Lazy Recover

2020-01-19 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiheng Wang updated LIVY-724: - Description: In this JIRA, we want to support recover a session from the state store to Livy server memory

[jira] [Commented] (LIVY-731) Session Allocation with server-session Mapping

2020-01-20 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019352#comment-17019352 ] Yiheng Wang commented on LIVY-731: -- I'm working on it. > Session Allocation with server-s