[
https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261186#comment-17261186
]
Yuming Wang commented on SPARK-24417:
-------------------------------------
Hadoop 2.7 users should back port HADOOP-12760 if running Spark on YARN,
otherwise:
{noformat}
Exception in thread "DataStreamer for file
/tmp/hive-root/root/50210c06-d8a8-4437-a490-00ee7c9489d2/inuse.info"
java.lang.NoSuchMethodError: 'sun.misc.Cleaner
sun.nio.ch.DirectBuffer.cleaner()'
at
org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41)
at
org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:683)
at
org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:317)
at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:746)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:694)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:689)
Exception in thread "DataStreamer for file
/user/root/.sparkStaging/application_1605512824298_14045/__spark_libs__12000901687328320855.zip"
java.lang.NoSuchMethodError: 'sun.misc.Cleaner
sun.nio.ch.DirectBuffer.cleaner()
{noformat}
> Build and Run Spark on JDK11
> ----------------------------
>
> Key: SPARK-24417
> URL: https://issues.apache.org/jira/browse/SPARK-24417
> Project: Spark
> Issue Type: New Feature
> Components: Build
> Affects Versions: 2.3.0
> Reporter: DB Tsai
> Assignee: DB Tsai
> Priority: Major
> Fix For: 3.0.0
>
>
> This is an umbrella JIRA for Apache Spark to support JDK11
> As JDK8 is reaching EOL, and JDK9 and 10 are already end of life, per
> community discussion, we will skip JDK9 and 10 to support JDK 11 directly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
