koertkuipers commented on pull request #29653:
URL: https://github.com/apache/spark/pull/29653#issuecomment-693128089
i suspect this pullreq causes spark master to fail for me.
i run:
`$ mvn clean test -fae`
i see these failures:
```
[ERROR] Failures:
[609/9854]
[ERROR]
SparkSubmitCommandBuilderSuite.testExamplesRunnerWithMasterNoMainClass
Expected: (an instance of java.lang.IllegalArgumentException and exception
with message a string containing "Missing example class name.")
but: an instance of java.lang.IllegalArgumentException
<java.lang.IllegalStateException: Failed to find examples' main app jar.> is a
java.lang.IllegalStateExcept$
on
Stacktrace was: java.lang.IllegalStateException: Failed to find examples'
main app jar.
at
org.apache.spark.launcher.SparkSubmitCommandBuilder.findExamplesAppJar(SparkSubmitCommandBuilder.java:412)
at
org.apache.spark.launcher.SparkSubmitCommandBuilder.<init>(SparkSubmitCommandBuilder.java:142)
at
org.apache.spark.launcher.SparkSubmitCommandBuilderSuite.newCommandBuilder(SparkSubmitCommandBuilderSuite.java:423)
at
org.apache.spark.launcher.SparkSubmitCommandBuilderSuite.buildCommand(SparkSubmitCommandBuilderSuite.java:429)
at
org.apache.spark.launcher.SparkSubmitCommandBuilderSuite.testExamplesRunnerWithMasterNoMainClass(SparkSubmitCommandBuilderSuite.java:227)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
ERROR] Errors:
[ERROR]
SparkSubmitCommandBuilderSuite.testCliKillAndStatus:87->testCLIOpts:442->buildCommand:429->newCommandBuilder:423
» IllegalState
[ERROR]
SparkSubmitCommandBuilderSuite.testExamplesRunner:240->buildCommand:429->newCommandBuilder:423
» IllegalState
[ERROR] SparkSubmitCommandBuilderSuite.testExamplesRunnerNoArg »
Unexpected exception...
[ERROR]
SparkSubmitCommandBuilderSuite.testExamplesRunnerNoMainClass:212->testCLIOpts:442->buildCommand:429->newCommandBuilder:423
» IllegalState
[ERROR]
SparkSubmitCommandBuilderSuite.testExamplesRunnerPrimaryResource:257->newCommandBuilder:423
» IllegalState
[ERROR] Tests run: 46, Failures: 1, Errors: 5, Skipped: 0
```
and
```
INFO] Reactor Summary for Spark Project Parent POM 3.1.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 5.113
s]
[INFO] Spark Project Tags ................................. SUCCESS [ 12.398
s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 35.952
s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 8.769
s]
[INFO] Spark Project Networking ........................... SUCCESS [01:01
min]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 9.461
s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 19.411
s]
[INFO] Spark Project Launcher ............................. FAILURE [ 5.735
s]
[INFO] Spark Project Core ................................. SKIPPED
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 53.520
s]
[INFO] Spark Project GraphX ............................... SKIPPED
[INFO] Spark Project Streaming ............................ SKIPPED
[INFO] Spark Project Catalyst ............................. SKIPPED
[INFO] Spark Project SQL .................................. SKIPPED
[INFO] Spark Project ML Library ........................... SKIPPED
[INFO] Spark Project Tools ................................ SUCCESS [ 11.154
s]
[INFO] Spark Project Hive ................................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
[INFO] Spark Avro ......................................... SKIPPED
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
