Github user weiqingy commented on the issue:
https://github.com/apache/spark/pull/16223
Hi, @srowen The previous
[PR#16159](https://github.com/apache/spark/pull/16159#issuecomment-265000724)
broke [spark-master-compile-sbt-scala-2.10
](https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-master-compile-sbt-scala-2.10/3301/consoleFull).
As the console output shows, when running the command line â`build/sbt -mem
4096 -Phive -Phive-thriftserver -Pyarn -Phadoop-2.3 -Pkinesis-asl
-Pspark-ganglia-lgpl -Pmesos -Dscala-2.10 assembly`â, it not only compiled
the code but also ran the tests, which led to â`java.lang.OutOfMemoryError:
Java heap space`â. That command line is supposed to compile the code without
running the unit tests.
To skip the test during assembly, we set â`test in assembly := {}`â in
[object Assembly
SparkBuild.scala](https://github.com/apache/spark/blob/master/project/SparkBuild.scala#L606).
But the
[PR#16159](https://github.com/apache/spark/pull/16159#issuecomment-265000724)
upgraded sbt-assembly from 0.11.2 to 0.14.3, that made âtest in assembly :=
{}â did not work.
Need more time to dig it out. To make it safe, I did not upgrade
sbt-assembly in this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
