RE: Support STS to run in k8s deployment with spark deployment mode as cluster

Hi, Following is the bug to track the same. https://issues.apache.org/jira/browse/SPARK-25442 Regards Surya From: Garlapati, Suryanarayana (Nokia - IN/Bangalore) Sent: Sunday, September 16, 2018 10:15 AM To: d...@spark.apache.org; Ilan Filonenko Cc: user@spark.apache.org; Imandi, Srinivas

unsubscribe

Support STS to run in k8s deployment with spark deployment mode as cluster

Hi All, I would like to propose the following changes for supporting the STS to run in k8s deployments with spark deployment mode as cluster. PR: https://github.com/apache/spark/pull/22433 Can you please review and provide the comments? Regards Surya

FlatMapGroupsFunction Without Running Out of Memory For Large Groups

This question is more about a type of processing that I haven't been able to really find a good solution for within spark than it is about the FlatMapGroupsFunction specifically. However, the FlatMapGroupsFunction serves as a good concrete example of what I'm trying to talk about. In MapReduce

Re: Should python-2 be supported in Spark 3.0?

In case this didn't make it onto this thread: There is a 3rd option, which is to deprecate Py2 for Spark-3.0, and remove it entirely on a later 3.x release. On Sat, Sep 15, 2018 at 11:09 AM, Erik Erlandson wrote: > On a separate dev@spark thread, I raised a question of whether or not to >

Should python-2 be supported in Spark 3.0?

On a separate dev@spark thread, I raised a question of whether or not to support python 2 in Apache Spark, going forward into Spark 3.0. Python-2 is going EOL at the end of 2019. The upcoming release of Spark 3.0 is an opportunity to make breaking