[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-08-19 Thread Ashish Rawat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703595#comment-14703595 ] Ashish Rawat commented on SPARK-2389: - Hi [~pwendell], We are facing exactly the prob

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-02-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327903#comment-14327903 ] Patrick Wendell commented on SPARK-2389: I've seen some variants of this question

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291818#comment-14291818 ] Robert Stupp commented on SPARK-2389: - [~srowen] yes, the problem is that drivers cann

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291804#comment-14291804 ] Sean Owen commented on SPARK-2389: -- Yes, makes sense. Maxing out one driver isn't an issu

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291798#comment-14291798 ] Robert Stupp commented on SPARK-2389: - bq. fault tolerance when he mentions scalabilit

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291797#comment-14291797 ] Robert Stupp commented on SPARK-2389: - bq. That aside, why doesn't it scale? Simply b

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291795#comment-14291795 ] Murat Eken commented on SPARK-2389: --- [~sowen], I think Robert is talking about fault tol

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291788#comment-14291788 ] Sean Owen commented on SPARK-2389: -- Yes, the SPOF problem makes sense. It doesn't seem to

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Robert Stupp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291764#comment-14291764 ] Robert Stupp commented on SPARK-2389: - [~srowen] that *one long-running* Spark app is

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291755#comment-14291755 ] Murat Eken commented on SPARK-2389: --- Yes [~sowen], it's about HA for the driver. Our app

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291737#comment-14291737 ] Sean Owen commented on SPARK-2389: -- Why can't N front-ends talk to a process built around

[jira] [Commented] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2015-01-26 Thread Murat Eken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291724#comment-14291724 ] Murat Eken commented on SPARK-2389: --- +1. We're using a Spark cluster as a real-time quer