Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/19270
seems to be issues with the pr still. Getting errors trying to run on
larger jobs:
project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at
org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at
org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at
org.spark_project.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.NoSuchElementException: None.get
at scala.None$.get(Option.scala:347)
at scala.None$.get(Option.scala:345)
at
org.apache.spark.status.api.v1.AllStagesResource$.convertTaskData(AllStagesResource.scala:197)
at
org.apache.spark.status.api.v1.AllStagesResource$$anonfun$3.apply(AllStagesResource.scala:76)
at
org.apache.spark.status.api.v1.AllStagesResource$$anonfun$3.apply(AllStagesResource.scala:76)
Also I see the accumulators table on jobs that shouldn't have it, this was
on a running application.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
