[
https://issues.apache.org/jira/browse/SPARK-22659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyunzhang updated SPARK-22659:
---
Description:
build with scala-2.12 with following steps
1. change the pom.xml with scala-2.12
{code}
./dev/change-scala-version.sh 2.12
{code}
2.build with -Pscala-2.12
{code}
./dev/make-distribution.sh --tgz -Pscala-2.12 -Phadoop-2.7 -Pyarn
-Pparquet-provided -Dhadoop.version=2.7.3
{code}
get the error
{code}
/common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172: error:
cannot find symbol
Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
{code}
This is because sun.misc.Cleaner has been moved to new location in JDK9.
HADOOP-12760 will be the long term fix
was:
the artifactId of common/tags/pom.xml and streaming/pom.xml is spark-tags_2.11
and spark_streaming_2.11 which will causes fail when building with -Pscala-2.12.
Suggest to {{scala.binary.version}} to solve
> remove sun.misc.Cleaner references
> --
>
> Key: SPARK-22659
> URL: https://issues.apache.org/jira/browse/SPARK-22659
> Project: Spark
> Issue Type: Improvement
> Components: Build
>Affects Versions: 2.2.0
>Reporter: liyunzhang
>
> build with scala-2.12 with following steps
> 1. change the pom.xml with scala-2.12
> {code}
> ./dev/change-scala-version.sh 2.12
> {code}
> 2.build with -Pscala-2.12
> {code}
> ./dev/make-distribution.sh --tgz -Pscala-2.12 -Phadoop-2.7 -Pyarn
> -Pparquet-provided -Dhadoop.version=2.7.3
> {code}
> get the error
> {code}
> /common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java:172:
> error: cannot find symbol
> Cleaner cleaner = Cleaner.create(buffer, () -> freeMemory(memory));
> {code}
> This is because sun.misc.Cleaner has been moved to new location in JDK9.
> HADOOP-12760 will be the long term fix
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
