[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-14 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015606#comment-17015606 ] Yiheng Wang commented on LIVY-718: -- I updated the design doc based on the recent discussions in the JIRA.

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-13 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014846#comment-17014846 ] Saisai Shao commented on LIVY-718: -- Active-active HA doesn't only address scalability issue, but also high

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-12 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013965#comment-17013965 ] Saisai Shao commented on LIVY-718: -- [~bikassaha] The merged two sub-tasks, they're actually required by

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-11 Thread Bikas Saha (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013498#comment-17013498 ] Bikas Saha commented on LIVY-718: - Clearly, I am not aligned with the above or else I would not start and

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-09 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011909#comment-17011909 ] Yiheng Wang commented on LIVY-718: -- Hi [~bikassaha] I agree that allows multiple servers to connect to

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-08 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011485#comment-17011485 ] Saisai Shao commented on LIVY-718: -- Hi [~shanyu] what is the main reason that we should have

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-08 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010965#comment-17010965 ] shanyu zhao commented on LIVY-718: -- LIVY-11 aims at active-standby HA, user should be able to choose

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2020-01-02 Thread Bikas Saha (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006882#comment-17006882 ] Bikas Saha commented on LIVY-718: - {quote}JDBC part maintains lots of results/metadata/information on

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006078#comment-17006078 ] Yiheng Wang commented on LIVY-718: -- [~bikassaha] Compared to the designated server solution, I think

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-31 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006069#comment-17006069 ] Yiheng Wang commented on LIVY-718: -- bq. When a server fails, its sessions become unavailable until other

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005895#comment-17005895 ] Saisai Shao commented on LIVY-718: -- IIUC, current JDBC part maintains lots of results/metadata/information

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005512#comment-17005512 ] Marco Gaido commented on LIVY-718: -- > IIRC JDBC had a REST and an RPC mode. The RPC mode might not be HA

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Bikas Saha (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005439#comment-17005439 ] Bikas Saha commented on LIVY-718: - There could be in-memory state in the livy server but could that be

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Bikas Saha (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005434#comment-17005434 ] Bikas Saha commented on LIVY-718: - There could be in-memory state in the livy server but could that be

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Yiheng Wang (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005203#comment-17005203 ] Yiheng Wang commented on LIVY-718: -- Thanks for your comments [~bikassaha] and [~meisam]. I summary the

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-29 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005063#comment-17005063 ] Marco Gaido commented on LIVY-718: -- Thanks for your comments [~bikassaha]. I am not sure (actually I think

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-29 Thread Meisam (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004874#comment-17004874 ] Meisam commented on LIVY-718: - CC [~prabhu1984] [~kpraveen] > Support multi-active high availability in Livy >

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-29 Thread Meisam (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004873#comment-17004873 ] Meisam commented on LIVY-718: - I also have concerns about the second point that Bikas raised, i.e. "Service

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-29 Thread Bikas Saha (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004728#comment-17004728 ] Bikas Saha commented on LIVY-718: - Thank you for the taking this up and providing the detailed design