Steve Loughran created SPARK-38394:
--------------------------------------
Summary: build of spark sql against hadoop-3.4.0-snapshot failing
with bouncycastle classpath error
Key: SPARK-38394
URL: https://issues.apache.org/jira/browse/SPARK-38394
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 3.3.0
Reporter: Steve Loughran
builidng spark master with {{-Dhadoop.version=3.4.0-SNAPSHOT}} and a local
hadoop build breaks in the sbt compiler plugin
{code}
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile
(scala-test-compile-first) on project spark-sql_2.12: Execution
scala-test-compile-first of goal
net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile failed: A required
class was missing while executing
net.alchim31.maven:scala-maven-plugin:4.3.0:testCompile:
org/bouncycastle/jce/provider/BouncyCastleProvider
[ERROR] -----------------------------------------------------
[ERROR] realm = plugin>net.alchim31.maven:scala-maven-plugin:4.3.0
{code}
* this is the classpath of the sbt compiler
* hadoop hasn't been doing anything related to bouncy castle.
setting scala-maven-plugin to 3.4.0 makes this go away, i.e. reapplying
SPARK-36547
the implication here is that the plugin version is going to have to be
configured in different profiles.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
