[
https://issues.apache.org/jira/browse/SPARK-31531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091170#comment-17091170
]
Hyukjin Kwon commented on SPARK-31531:
--------------------------------------
Spark does not support Java 11 in Spark 2.x. It will be supported in Spark 3.
> sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner() method not found during
> spark-submit
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-31531
> URL: https://issues.apache.org/jira/browse/SPARK-31531
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.4.5
> Reporter: shayoni Halder
> Priority: Major
> Attachments: error.PNG
>
>
> I am trying to run the following Spark submit from a VM using Yarn cluster
> mode.
> ./spark-submit --master yarn --deploy-mode client test_spark_yarn.py
> The VM has java version 11 and spark-2.4.5 while the yarn cluster java 8 and
> spark-2.4.0. I am getting the error below:
> !error.PNG!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
