Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21093
@gatorsmile . Sorry for late response. I'm currently at Dataworks Summit
Berlin.
I took a look. It seems that the last two failures are due to
`JsonInferSchema` of `BucketedWriteWithoutHiveSupportSuite`.
-
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89507/testReport/
-
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89522/testReport/
```
[info] - write bucketed data *** FAILED *** (4 seconds, 698 milliseconds)
[info] org.apache.spark.SparkException: Job aborted due to stage failure:
Task 0 in stage 84.0 failed 1 times, most recent failure: Lost task 0.0 in
stage 84.0 (TID 86, localhost, executor driver):
java.lang.IllegalStateException: LiveListenerBus is stopped.
[info] at
org.apache.spark.scheduler.LiveListenerBus.addToQueue(LiveListenerBus.scala:97)
[info] at
org.apache.spark.scheduler.LiveListenerBus.addToStatusQueue(LiveListenerBus.scala:80)
[info] at
org.apache.spark.sql.internal.SharedState.<init>(SharedState.scala:93)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$sharedState$1.apply(SparkSession.scala:117)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$sharedState$1.apply(SparkSession.scala:117)
[info] at scala.Option.getOrElse(Option.scala:121)
[info] at
org.apache.spark.sql.SparkSession.sharedState$lzycompute(SparkSession.scala:117)
[info] at
org.apache.spark.sql.SparkSession.sharedState(SparkSession.scala:116)
[info] at
org.apache.spark.sql.internal.BaseSessionStateBuilder.build(BaseSessionStateBuilder.scala:286)
[info] at
org.apache.spark.sql.test.TestSparkSession.sessionState$lzycompute(TestSQLContext.scala:42)
[info] at
org.apache.spark.sql.test.TestSparkSession.sessionState(TestSQLContext.scala:41)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$1$$anonfun$apply$1.apply(SparkSession.scala:92)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$1$$anonfun$apply$1.apply(SparkSession.scala:92)
[info] at scala.Option.map(Option.scala:146)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$1.apply(SparkSession.scala:92)
[info] at
org.apache.spark.sql.SparkSession$$anonfun$1.apply(SparkSession.scala:91)
[info] at org.apache.spark.sql.internal.SQLConf$.get(SQLConf.scala:110)
[info] at
org.apache.spark.sql.types.DataType.sameType(DataType.scala:84)
[info] at
org.apache.spark.sql.catalyst.analysis.TypeCoercion$$anonfun$1.apply(TypeCoercion.scala:105)
[info] at
org.apache.spark.sql.catalyst.analysis.TypeCoercion$$anonfun$1.apply(TypeCoercion.scala:86)
[info] at
org.apache.spark.sql.execution.datasources.json.JsonInferSchema$.compatibleType(JsonInferSchema.scala:271)
[info] at
org.apache.spark.sql.execution.datasources.json.JsonInferSchema$$anonfun$org$apache$spark$sql$execution$datasources$json$JsonInferSchema$$compatibleRootType$1.apply(JsonInferSchema.scala:262)
[info] at
```
I compared with `branch-2.3` itself. Unfortunately, recent`branch-2.3`
itself is unstable. There is no success during last 18 runs for SBT builds.
-
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.3-test-sbt-hadoop-2.6/
-
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.3-test-sbt-hadoop-2.7/
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
