I see the same thing.
A workaround is to put a Thread.sleep(5000) statement before sc.stop()
Let us know how it goes.
On Sep 17, 2014, at 3:43 AM, wyphao.2007 wyphao.2...@163.com wrote:
Hi, When I run spark job on yarn,and the job finished success,but I found
there are some error
This is during shutdown right? Looks ok to me since connections are being
closed. We could've handle this more gracefully, but the logs look
harmless.
On Wednesday, September 17, 2014, wyphao.2007 wyphao.2...@163.com wrote:
Hi, When I run spark job on yarn,and the job finished success,but I
