LuciferYang commented on PR #40931: URL: https://github.com/apache/spark/pull/40931#issuecomment-1522820195
> @amaliujia @cloud-fan > > https://github.com/apache/spark/blob/b461cdea92ea08ce39bb3c9d733f0af7c56abf8d/project/SparkBuild.scala#L404-L407 > > should add `commonUtils` to this Seq now due to 3.4.0 no `common-utils` module: > > ``` > [error] sbt.librarymanagement.ResolveException: Error downloading org.apache.spark:spark-common-utils_2.12:3.4.0 > [error] Not found > [error] Not found > [error] not found: /Users/yangjie01/.ivy2/local/org.apache.spark/spark-common-utils_2.12/3.4.0/ivys/ivy.xml > [error] not found: https://repo1.maven.org/maven2/org/apache/spark/spark-common-utils_2.12/3.4.0/spark-common-utils_2.12-3.4.0.pom > [error] at lmcoursier.CoursierDependencyResolution.unresolvedWarningOrThrow(CoursierDependencyResolution.scala:344) > [error] at lmcoursier.CoursierDependencyResolution.$anonfun$update$38(CoursierDependencyResolution.scala:313) > [error] at scala.util.Either$LeftProjection.map(Either.scala:573) > [error] at lmcoursier.CoursierDependencyResolution.update(CoursierDependencyResolution.scala:313) > [error] at sbt.librarymanagement.DependencyResolution.update(DependencyResolution.scala:60) > [error] at sbt.internal.LibraryManagement$.resolve$1(LibraryManagement.scala:59) > [error] at sbt.internal.LibraryManagement$.$anonfun$cachedUpdate$12(LibraryManagement.scala:133) > [error] at sbt.util.Tracked$.$anonfun$lastOutput$1(Tracked.scala:73) > [error] at sbt.internal.LibraryManagement$.$anonfun$cachedUpdate$20(LibraryManagement.scala:146) > [error] at scala.util.control.Exception$Catch.apply(Exception.scala:228) > [error] at sbt.internal.LibraryManagement$.$anonfun$cachedUpdate$11(LibraryManagement.scala:146) > [error] at sbt.internal.LibraryManagement$.$anonfun$cachedUpdate$11$adapted(LibraryManagement.scala:127) > [error] at sbt.util.Tracked$.$anonfun$inputChangedW$1(Tracked.scala:219) > [error] at sbt.internal.LibraryManagement$.cachedUpdate(LibraryManagement.scala:160) > [error] at sbt.Classpaths$.$anonfun$updateTask0$1(Defaults.scala:3687) > [error] at scala.Function1.$anonfun$compose$1(Function1.scala:49) > [error] at sbt.internal.util.$tilde$greater.$anonfun$$u2219$1(TypeFunctions.scala:62) > [error] at sbt.std.Transform$$anon$4.work(Transform.scala:68) > [error] at sbt.Execute.$anonfun$submit$2(Execute.scala:282) > [error] at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:23) > [error] at sbt.Execute.work(Execute.scala:291) > [error] at sbt.Execute.$anonfun$submit$1(Execute.scala:282) > [error] at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265) > [error] at sbt.CompletionService$$anon$2.call(CompletionService.scala:64) > [error] at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [error] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [error] at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [error] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > [error] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [error] at java.lang.Thread.run(Thread.java:750) > [error] (oldDeps / update) sbt.librarymanagement.ResolveException: Error downloading org.apache.spark:spark-common-utils_2.12:3.4.0 > [error] Not found > [error] Not found > [error] not found: /Users/yangjie01/.ivy2/local/org.apache.spark/spark-common-utils_2.12/3.4.0/ivys/ivy.xml > [error] not found: https://repo1.maven.org/maven2/org/apache/spark/spark-common-utils_2.12/3.4.0/spark-common-utils_2.12-3.4.0.pom > ``` with this change and rebase the code, then run the mima check: ``` [warn] multiple main classes detected: run 'show discoveredMainClasses' to see the list [info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary compatibility [error] spark-core: Failed binary compatibility check against org.apache.spark:spark-core_2.12:3.4.0! Found 4 potential problems (filtered 4035) [error] * interface org.apache.spark.QueryContext does not have a correspondent in current version [error] filter with: ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.QueryContext") [error] * class org.apache.spark.SparkException does not have a correspondent in current version [error] filter with: ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.SparkException") [error] * object org.apache.spark.SparkException does not have a correspondent in current version [error] filter with: ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.SparkException$") [error] * interface org.apache.spark.SparkThrowable does not have a correspondent in current version [error] filter with: ProblemFilters.exclude[MissingClassProblem]("org.apache.spark.SparkThrowable") [error] java.lang.RuntimeException: Failed binary compatibility check against org.apache.spark:spark-core_2.12:3.4.0! Found 4 potential problems (filtered 4035) [error] at scala.sys.package$.error(package.scala:30) [error] at com.typesafe.tools.mima.plugin.SbtMima$.reportModuleErrors(SbtMima.scala:89) [error] at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$2(MimaPlugin.scala:36) [error] at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$2$adapted(MimaPlugin.scala:26) [error] at scala.collection.Iterator.foreach(Iterator.scala:943) [error] at scala.collection.Iterator.foreach$(Iterator.scala:943) [error] at scala.collection.AbstractIterator.foreach(Iterator.scala:1431) [error] at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$1(MimaPlugin.scala:26) [error] at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$1$adapted(MimaPlugin.scala:25) [error] at scala.Function1.$anonfun$compose$1(Function1.scala:49) [error] at sbt.internal.util.$tilde$greater.$anonfun$$u2219$1(TypeFunctions.scala:62) [error] at sbt.std.Transform$$anon$4.work(Transform.scala:68) [error] at sbt.Execute.$anonfun$submit$2(Execute.scala:282) [error] at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:23) [error] at sbt.Execute.work(Execute.scala:291) [error] at sbt.Execute.$anonfun$submit$1(Execute.scala:282) [error] at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265) [error] at sbt.CompletionService$$anon$2.call(CompletionService.scala:64) [error] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [error] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [error] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [error] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [error] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [error] at java.lang.Thread.run(Thread.java:750) [error] (core / mimaReportBinaryIssues) Failed binary compatibility check against org.apache.spark:spark-core_2.12:3.4.0! Found 4 potential problems (filtered 4035) [error] Total time: 92 s (01:32), completed 2023-4-26 13:46:13 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
