Which hadoop version are you using ? Can you show snippet of your code ?
Thanks On Tue, Aug 2, 2016 at 10:06 AM, Liangzhao Zeng <liangzhao.z...@gmail.com> wrote: > Hi, > > > I migrate my code to Spark 2.0 from 1.6. It finish last stage (and result is > correct) but get following errors then start over. > > > Any idea on what happen? > > > 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has > already stopped! Dropping event > SparkListenerExecutorMetricsUpdate(2,WrappedArray()) > 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has > already stopped! Dropping event > SparkListenerExecutorMetricsUpdate(115,WrappedArray()) > 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has > already stopped! Dropping event > SparkListenerExecutorMetricsUpdate(70,WrappedArray()) > 16/08/02 16:59:33 WARN yarn.YarnAllocator: Expected to find pending requests, > but found none. > 16/08/02 16:59:33 WARN netty.Dispatcher: Message > RemoteProcessDisconnected(17.138.53.26:55338) dropped. Could not find > MapOutputTracker. > > > > Cheers, > > > LZ > >
