[
https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38394.
----------------------------------
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35725
[https://github.com/apache/spark/pull/35725]
> build of spark sql against hadoop-3.4.0-snapshot failing with bouncycastle
> classpath error
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-38394
> URL: https://issues.apache.org/jira/browse/SPARK-38394
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Fix For: 3.3.0
>
>
> builidng spark master with {{-Dhadoop.version=3.4.0-SNAPSHOT}} and a local
> hadoop build breaks in the sbt compiler plugin
> {code}
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile
> (scala-test-compile-first) on project spark-sql_2.12: Execution
> scala-test-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile failed: A required
> class was missing while executing
> net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile:
> org/bouncycastle/jce/provider/BouncyCastleProvider
> [ERROR] -----------------------------------------------------
> [ERROR] realm = plugin>net.alchim31.maven:scala-maven-plugin:4.3.0
> {code}
> * this is the classpath of the sbt compiler
> * hadoop hasn't been doing anything related to bouncy castle.
> setting scala-maven-plugin to 3.4.0 makes this go away, i.e. reapplying
> SPARK-36547
> the implication here is that the plugin version is going to have to be
> configured in different profiles.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
