Re: Minimum JDK8 version

> All versions of JDK8 are not the same naturally. For example, Hadoop community also have the following document although they are not specifying the minimum versions. oh, I didn't know that. Thanks for the info and updating the doc! Bests, Takeshi On Fri, Oct 25, 2019 at 12:26 PM Dongjoon Hyun

Re: Minimum JDK8 version

Thank you. I created a PR for that. For now, the minimum requirement is 8u92 in that PR. https://github.com/apache/spark/pull/26249 Bests, Dongjoon. On Thu, Oct 24, 2019 at 7:55 PM Sean Owen wrote: > I think that's fine, personally. Anyone using JDK 8 should / probably > is on a recent

Re: Minimum JDK8 version

I think that's fine, personally. Anyone using JDK 8 should / probably is on a recent release. On Thu, Oct 24, 2019 at 8:56 PM Dongjoon Hyun wrote: > > Thank you for reply, Sean, Shane, Takeshi. > > The reason is that there is a PR to aim to add `-XX:OnOutOfMemoryError="kill > -9 %p"` as a

Re: Minimum JDK8 version

> > Probably, but what is the difference that makes it different to > support u81 vs later? > How about docker support https://blog.softwaremill.com/docker-support-in-new-java-8-finally-fd595df0ca54 On Fri, Oct 25, 2019 at 9:05 AM Takeshi Yamamuro wrote: > Hi, Dongjoon > > It might be worth

Re: Minimum JDK8 version

Thank you for reply, Sean, Shane, Takeshi. The reason is that there is a PR to aim to add `-XX:OnOutOfMemoryError="kill -9 %p"` as a default behavior at 3.0.0. (Please note that the PR will add it by *default* always. There is no way for user to remove it.) - [SPARK-27900][CORE][K8s] Add

Re: Minimum JDK8 version

Hi, Dongjoon It might be worth clearly describing which jdk versions we check in the testing infra in some documents, e.g., https://spark.apache.org/docs/latest/#downloading btw, any other project announcing the minimum support jdk version? It seems that hadoop does not. On Fri, Oct 25, 2019 at

Re: Minimum JDK8 version

Probably, but what is the difference that makes it different to support u81 vs later? On Thu, Oct 24, 2019 at 4:39 PM Dongjoon Hyun wrote: > > Hi, All. > > Apache Spark 3.x will support both JDK8 and JDK11. > > I'm wondering if we can have a minimum JDK8 version in Apache Spark 3.0. > >

Re: Minimum JDK8 version

i will happily test against the lowest agreed upon version... On Thu, Oct 24, 2019 at 2:39 PM Dongjoon Hyun wrote: > > Hi, All. > > Apache Spark 3.x will support both JDK8 and JDK11. > > I'm wondering if we can have a minimum JDK8 version in Apache Spark 3.0. > > Specifically, can we start to

Minimum JDK8 version

Hi, All. Apache Spark 3.x will support both JDK8 and JDK11. I'm wondering if we can have a minimum JDK8 version in Apache Spark 3.0. Specifically, can we start to deprecate JDK8u81 and older at 3.0. Currently, Apache Spark testing infra are testing only with jdk1.8.0_191 and above. Bests,

Re: [DISCUSS] Deprecate Python < 3.6 in Spark 3.0

Thank you for starting the thread. In addition to that, we currently are testing Python 3.6 only in Apache Spark Jenkins environment. Given that Python 3.8 is already out and Apache Spark 3.0.0 RC1 will start next January (https://spark.apache.org/versioning-policy.html), I'm +1 for the

[DISCUSS] Deprecate Python < 3.6 in Spark 3.0

Hi everyone, While deprecation of Python 2 in 3.0.0 has been announced , there is no clear statement about specific continuing support of different Python 3 version. Specifically: * Python 3.4 has been retired this year.