[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127564#comment-14127564 ] Marcelo Vanzin commented on SPARK-3215: --- For those following, I moved the prototype

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123749#comment-14123749 ] Marcelo Vanzin commented on SPARK-3215: --- I updated the prototype to include a Java

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120657#comment-14120657 ] Matei Zaharia commented on SPARK-3215: -- Thanks Marcelo! Just a few notes on the API:

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120708#comment-14120708 ] Marcelo Vanzin commented on SPARK-3215: --- Thanks Matei. Looking at a Java API is next

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118960#comment-14118960 ] Marcelo Vanzin commented on SPARK-3215: --- For those who'd prefer to see some code,

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112769#comment-14112769 ] Reynold Xin commented on SPARK-3215: I looked at the document. The high level proposal

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112780#comment-14112780 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Reynold, thanks for the comments. This

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112791#comment-14112791 ] Matei Zaharia commented on SPARK-3215: -- Hey Marcelo, while this could be useful for

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112803#comment-14112803 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Matei, Both suggestions came up during

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112855#comment-14112855 ] Shivaram Venkataraman commented on SPARK-3215: -- This looks very interesting

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112931#comment-14112931 ] Evan Chan commented on SPARK-3215: -- [~vanzin] we should chat. I'm planning to move our

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112943#comment-14112943 ] Matei Zaharia commented on SPARK-3215: -- I think we should try this externally first

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112958#comment-14112958 ] Marcelo Vanzin commented on SPARK-3215: --- I think the what RPC to use discussion is

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113055#comment-14113055 ] Matei Zaharia commented on SPARK-3215: -- As I mentioned above, there's more to it than

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113062#comment-14113062 ] Marcelo Vanzin commented on SPARK-3215: --- Hi Matei, sorry if I'm missing what you're

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113121#comment-14113121 ] Matei Zaharia commented on SPARK-3215: -- The problem is just how different future or

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113206#comment-14113206 ] Marcelo Vanzin commented on SPARK-3215: --- Matei, yes, all those things exist, but

[jira] [Commented] (SPARK-3215) Add remote interface for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113294#comment-14113294 ] Matei Zaharia commented on SPARK-3215: -- Okay, so my suggestion is do it separately