[
https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981810#comment-16981810
]
Dongjoon Hyun commented on SPARK-30028:
---------------------------------------
Hi, [~dcolkitt]. I'm wondering why you set `2.4.4` as `Affected Version`? Since
`2.4.4` is a released version, this cannot happen there.
Also, this is not about `branch-2.4` at all. Is there any reason? If not, for
`master` branch issue, `3.0.0` is a correct version for JIRA issue.
> Spark Catalyst build fails with Maven -rf :spark-core_2.12
> ----------------------------------------------------------
>
> Key: SPARK-30028
> URL: https://issues.apache.org/jira/browse/SPARK-30028
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 2.4.4
> Environment: Building with OpenJDK-11, Scala 2.12.8 and Maven 3.6.2.
> Using Debian 10 with kernel 4.19.0-6-amd64.
> Running inside a VirtualBox hosted on a MacBook Pro.
> Reporter: Douglas Colkitt
> Priority: Major
>
> Building from latest source with the following command:
> {code:java}
> ./build/mvn -DskipTests clean package {code}
> Then manually interrupt the build at the Spark Core stage. Then resume build
> with
> {code:java}
> ./build/mvn -DskipTests clean package -rf :spark-core_2.12{code}
> Fails at Spark Project Catalyst stage with the following errors:
> {code:java}
> [INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @
> spark-catalyst_2.12 ---
> [INFO] Using incremental compilation using Mixed compile order
> [INFO] Compiler bridge file:
> /home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
> [INFO] Compiling 300 Scala sources and 91 Java sources to
> /home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105:
> Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137:
> Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138:
> Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see
> corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139:
> Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is
> deprecated: see corresponding Javadoc for more information.
> [WARNING] [Warn]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141:
> Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated:
> see corresponding Javadoc for more information.
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error]
> /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468:
> value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] 5 warnings found
>
> {code}
> This does not occur with an uninterrupted build.
> I believe it's related to the changes introduced by commit __
> _de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b_ on November 25, as the build
> doesn't break with an earlier revision.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
