[
https://issues.apache.org/jira/browse/SPARK-34176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34176.
-----------------------------------
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31259
[https://github.com/apache/spark/pull/31259]
> Java UT failed when testing sql/hive module independently in Scala 2.13
> -----------------------------------------------------------------------
>
> Key: SPARK-34176
> URL: https://issues.apache.org/jira/browse/SPARK-34176
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: Yang Jie
> Assignee: Yang Jie
> Priority: Minor
> Fix For: 3.2.0
>
>
> When execute mvn test of sql/hive module independently in Scala 2.13, there
> is Java UT failed as follow:
> #
> {code:java}
> mvn clean install -Dhadoop-3.2 -Phive-2.3 -Phadoop-cloud -Pmesos -Pyarn
> -Pkinesis-asl -Phive-thriftserver -Pspark-ganglia-lgpl -Pkubernetes -Phive
> -Pscala-2.13 -pl sql/hive -am -DskipTests{code}
> #
> {code:java}
> mvn test -Dhadoop-3.2 -Phive-2.3 -Phadoop-cloud -Pmesos -Pyarn -Pkinesis-asl
> -Phive-thriftserver -Pspark-ganglia-lgpl -Pkubernetes -Phive -Pscala-2.13 -pl
> sql/hive{code}
> #
> {code:java}
> [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 20.353 s <<< FAILURE! - in org.apache.spark.sql.hive.JavaDataFrameSuite
> [ERROR] org.apache.spark.sql.hive.JavaDataFrameSuite.testUDAF Time elapsed:
> 18.548 s <<< ERROR!
> java.lang.NoClassDefFoundError: scala/collection/parallel/TaskSupport
> at
> org.apache.spark.sql.hive.JavaDataFrameSuite.checkAnswer(JavaDataFrameSuite.java:41)
> at
> org.apache.spark.sql.hive.JavaDataFrameSuite.testUDAF(JavaDataFrameSuite.java:92)
> Caused by: java.lang.ClassNotFoundException:
> scala.collection.parallel.TaskSupport
> at
> org.apache.spark.sql.hive.JavaDataFrameSuite.checkAnswer(JavaDataFrameSuite.java:41)
> at
> org.apache.spark.sql.hive.JavaDataFrameSuite.testUDAF(JavaDataFrameSuite.java:92)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
