[ https://issues.apache.org/jira/browse/SPARK-21631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114044#comment-16114044 ]
Liang-Chi Hsieh commented on SPARK-21631: ----------------------------------------- I can make the same error by violating scala style like: {code} [error] /root/repos/spark-1/mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala:29:0: import .ordering.wrongOrderInGroup.message [success] created output: /root/repos/spark-1/mllib/target [warn] Multiple main classes detected. Run 'show discoveredMainClasses' to see the list [info] Compiling 1 Scala source to /root/repos/spark-1/mllib/target/scala-2.11/classes... java.lang.RuntimeException: errors exist at scala.sys.package$.error(package.scala:27) at org.scalastyle.sbt.Tasks$.onHasErrors$1(Plugin.scala:132) at org.scalastyle.sbt.Tasks$.doScalastyleWithConfig$1(Plugin.scala:187) at org.scalastyle.sbt.Tasks$.doScalastyle(Plugin.scala:195) at SparkBuild$$anonfun$cachedScalaStyle$1$$anonfun$17.apply(SparkBuild.scala:165) at SparkBuild$$anonfun$cachedScalaStyle$1$$anonfun$17.apply(SparkBuild.scala:152) at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:253) at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:253) at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:267) at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:263) at sbt.Difference.apply(Tracked.scala:224) at sbt.Difference.apply(Tracked.scala:206) at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:263) at sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:262) at sbt.Difference.apply(Tracked.scala:224) at sbt.Difference.apply(Tracked.scala:200) at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:262) at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:260) at SparkBuild$$anonfun$cachedScalaStyle$1.apply(SparkBuild.scala:172) at SparkBuild$$anonfun$cachedScalaStyle$1.apply(SparkBuild.scala:147) at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47) at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40) at sbt.std.Transform$$anon$4.work(System.scala:63) at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17) at sbt.Execute.work(Execute.scala:237) at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159) at sbt.CompletionService$$anon$2.call(CompletionService.scala:28) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) [error] (mllib/*:scalaStyleOnCompile) errors exist [error] Total time: 39 s, completed Aug 4, 2017 7:20:27 AM {code} There is {{scalaStyleOnCompile}} indicating it gets error at scalaStyleOnCompile task. That's why I infer it may due to style issue. I'm not sure why mvn works because I don't use it. > Building Spark with SBT unsuccessful when source code in Mllib is modified, > But with MVN is ok > ---------------------------------------------------------------------------------------------- > > Key: SPARK-21631 > URL: https://issues.apache.org/jira/browse/SPARK-21631 > Project: Spark > Issue Type: Bug > Components: Build, MLlib > Affects Versions: 2.1.1 > Environment: ubuntu 14.04 > Spark 2.1.1 > MVN 3.3.9 > scala 2.11.8 > Reporter: Sean Wong > > I added > import org.apache.spark.internal.Logging > at the head of LinearRegression.scala file > Then, I try to build Spark using SBT. > However, here is the error: > *[info] Done packaging. > java.lang.RuntimeException: errors exist > at scala.sys.package$.error(package.scala:27) > at org.scalastyle.sbt.Tasks$.onHasErrors$1(Plugin.scala:132) > at > org.scalastyle.sbt.Tasks$.doScalastyleWithConfig$1(Plugin.scala:187) > at org.scalastyle.sbt.Tasks$.doScalastyle(Plugin.scala:195) > at > SparkBuild$$anonfun$cachedScalaStyle$1$$anonfun$17.apply(SparkBuild.scala:205) > at > SparkBuild$$anonfun$cachedScalaStyle$1$$anonfun$17.apply(SparkBuild.scala:192) > at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:235) > at sbt.FileFunction$$anonfun$cached$1.apply(Tracked.scala:235) > at > sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:249) > at > sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3$$anonfun$apply$4.apply(Tracked.scala:245) > at sbt.Difference.apply(Tracked.scala:224) > at sbt.Difference.apply(Tracked.scala:206) > at > sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:245) > at > sbt.FileFunction$$anonfun$cached$2$$anonfun$apply$3.apply(Tracked.scala:244) > at sbt.Difference.apply(Tracked.scala:224) > at sbt.Difference.apply(Tracked.scala:200) > at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:244) > at sbt.FileFunction$$anonfun$cached$2.apply(Tracked.scala:242) > at SparkBuild$$anonfun$cachedScalaStyle$1.apply(SparkBuild.scala:212) > at SparkBuild$$anonfun$cachedScalaStyle$1.apply(SparkBuild.scala:187) > at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47) > at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40) > at sbt.std.Transform$$anon$4.work(System.scala:63) > at > sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) > at > sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) > at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17) > at sbt.Execute.work(Execute.scala:237) > at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) > at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) > at > sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159) > at sbt.CompletionService$$anon$2.call(CompletionService.scala:28) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > [error] (mllib/*:scalaStyleOnCompile) errors exist* > After this, I switch to use MVN to build Spark, Everything is ok and the > building is successful. > So is this a bug for SBT building? -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org