i think the scala plugin upgrade may be good, but the bouncy castle one needed. 1.70 is the most recent, afaik.
On Thu, 8 Dec 2022 at 06:59, Yang,Jie(INF) <yangji...@baidu.com> wrote: > Steve, after some investigate, I think this problem may not related to > `scala-maven-plugin`. We can add the following two test dependencies to the > `sql/core` module to make the mvn build successful: > > > > ``` > > <dependency> > > <groupId>org.bouncycastle</groupId> > > <artifactId>bcprov-jdk15on</artifactId> > > <scope>test</scope> > > </dependency> > > <dependency> > > <groupId>org.bouncycastle</groupId> > > <artifactId>bcpkix-jdk15on</artifactId> > > <scope>test</scope> > > </dependency> > > ``` > > > > Yang Jie > > > > *发件人**: *"Yang,Jie(INF)" <yangji...@baidu.com> > *日期**: *2022年12月6日 星期二 18:27 > *收件人**: *Steve Loughran <ste...@cloudera.com> > *抄送**: *Hyukjin Kwon <gurwls...@gmail.com>, Apache Spark Dev < > dev@spark.apache.org> > *主题**: *Re: maven build failing in spark sql w/BouncyCastleProvider CNFE > > > > I think we can try scala-maven-plugin 4.8.0 > > > > *发件人**: *Steve Loughran <ste...@cloudera.com> > *日期**: *2022年12月6日 星期二 18:19 > *收件人**: *"Yang,Jie(INF)" <yangji...@baidu.com> > *抄送**: *Hyukjin Kwon <gurwls...@gmail.com>, Apache Spark Dev < > dev@spark.apache.org> > *主题**: *Re: maven build failing in spark sql w/BouncyCastleProvider CNFE > > > > > > > > On Tue, 6 Dec 2022 at 04:10, Yang,Jie(INF) <yangji...@baidu.com> wrote: > > Steve, did compile failed happen when mvn build Spark master with hadoop > 3.4.0-SNAPSHOT? > > > > yes. doesn't happen with > > * branch-3.3 snapshot (3.3.9-SNAPSHOT) > > * branch-3.3.5 RC0 "pre-rc" in asf staging. > > > > maybe trying the 4.8.0 plugin would be worth trying...not something i'll > do this week as i'm really trying to get the RC0 out rather than anything > else > > > > > > *发件人**: *Hyukjin Kwon <gurwls...@gmail.com> > *日期**: *2022年12月6日 星期二 10:27 > *抄送**: *Apache Spark Dev <dev@spark.apache.org> > *主题**: *Re: maven build failing in spark sql w/BouncyCastleProvider CNFE > > > > Steve, does the lower version of scala plugin work for you? If that > solves, we could temporary downgrade for now. > > > > On Mon, 5 Dec 2022 at 22:23, Steve Loughran <ste...@cloudera.com.invalid> > wrote: > > trying to build spark master w/ hadoop trunk and the maven sbt plugin is > failing. This doesn't happen with the 3.3.5 RC0; > > > > I note that the only mention of this anywhere was me in march. > > > > clearly something in hadoop trunk has changed in a way which is > incompatible. > > > > Has anyone else tried such a build/seen this problem? any suggestions of a > fix? > > > > Created SPARK-41392 to cover this... > > > > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > net.alchim31.maven:scala-maven-plugin:4.7.2:testCompile > (scala-test-compile-first) on project spark-sql_2.12: Execution > scala-test-compile-first of goal > net.alchim31.maven:scala-maven-plugin:4.7.2:testCompile failed: A required > class was missing while executing > net.alchim31.maven:scala-maven-plugin:4.7.2:testCompile: > org/bouncycastle/jce/provider/BouncyCastleProvider > [ > >
