Re: Anyone knows how to build and spark on jdk9?

2017-10-30 Thread Steve Loughran
On 27 Oct 2017, at 19:24, Sean Owen > wrote: Certainly, Scala 2.12 support precedes Java 9 support. A lot of the work is in place already, and the last issue is dealing with how Scala closures are now implemented quite different with lambdas /

Re: Anyone knows how to build and spark on jdk9?

2017-10-27 Thread Sean Owen
Certainly, Scala 2.12 support precedes Java 9 support. A lot of the work is in place already, and the last issue is dealing with how Scala closures are now implemented quite different with lambdas / invokedynamic. This affects the ClosureCleaner. For the interested, this is as far as I know the

Re: Anyone knows how to build and spark on jdk9?

2017-10-27 Thread Jörn Franke
Scala 2.12 is not yet supported on Spark - this means also not JDK9: https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-14220 If you look at the Oracle support then jdk 9 is anyway only supported for 6 months. JDK 8 is Lts (5 years) JDK 18.3 will be only 6 months and JDK 18.9 is

Re: Anyone knows how to build and spark on jdk9?

2017-10-27 Thread Vadim Semenov
If someone else is looking how to try jdk9, you can just pass your own JAVA_HOME environment variables: spark.yarn.appMasterEnv.JAVA_HOME=/usr/lib/jvm/java-1.8.0 spark.executorEnv.JAVA_HOME=/usr/lib/jvm/java-1.8.0 On Fri, Oct 27, 2017 at 5:14 AM, Steve Loughran wrote:

Re: Anyone knows how to build and spark on jdk9?

2017-10-27 Thread Steve Loughran
On 27 Oct 2017, at 03:21, Zhang, Liyun > wrote: Hi all: 1. I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found

RE: Anyone knows how to build and spark on jdk9?

2017-10-26 Thread Zhang, Liyun
Thanks your suggestion, seems that scala 2.12.4 support jdk9 Scala 2.12.4 is now available. Our benchmarks show a further

Re: Anyone knows how to build and spark on jdk9?

2017-10-26 Thread Reynold Xin
It probably depends on the Scala version we use in Spark supporting Java 9 first. On Thu, Oct 26, 2017 at 7:22 PM Zhang, Liyun wrote: > Hi all: > > 1. I want to build spark on jdk9 and test it with Hadoop on jdk9 > env. I search for jiras related to JDK9. I only

Anyone knows how to build and spark on jdk9?

2017-10-26 Thread Zhang, Liyun
Hi all: 1. I want to build spark on jdk9 and test it with Hadoop on jdk9 env. I search for jiras related to JDK9. I only found SPARK-13278. This means now spark can build or run successfully on JDK9 ? Best Regards Kelly