Hey, I have quite a few jobs appearing in the web-ui with the description "run at ThreadPoolExecutor.java:1142". Are these generated by SparkSQL internally?
There are so many that they cause a RejectedExecutionException when the thread-pool runs out of space for them. RejectedExecutionException Task scala.concurrent.impl.Future$PromiseCompletingRunnable@30ec07a4 rejected from java.util.concurrent.ThreadPoolExecutor@9110d1[Running, pool size = 128, active threads = 128, queued tasks = 0, completed tasks = 392] java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution (ThreadPoolExecutor.java:2047) Any ideas where they come from? I'm pretty sure that they don't originate from my code. Cheers Jan --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
