Re: 答复: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-18 Thread Shixiong(Ryan) Zhu
pache.spark.rdd.RDD.iterator(RDD.scala:264) > > at > org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) > > at org.apache.spark.scheduler.Task.run(Task.scala:88) > > at > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scal

答复: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-16 Thread Triones,Deng(vip.com)
or.default-dispatcher-4]: Sent stop signal to all 42 receivers 发件人: Shixiong(Ryan) Zhu [mailto:shixi...@databricks.com] 发送时间: 2016年1月16日 6:28 收件人: 邓刚[技术中心] 抄送: Yogesh Mahajan; user 主题: Re: 答复: 答复: 答复: spark streaming context trigger invoke stop why? I see. So when your job fails, `jsc.awaitTerm

Re: 答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-15 Thread Shixiong(Ryan) Zhu
gt; > jsc.awaitTermination(); > > > > > > *发件人:* Shixiong(Ryan) Zhu [mailto:shixi...@databricks.com] > *发送时间:* 2016年1月15日 6:02 > *收件人:* 邓刚[技术中心] > *抄送:* Yogesh Mahajan; user > *主题:* Re: 答复: 答复: spark streaming context trigger invoke stop why? > > >

答复: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-14 Thread Triones,Deng(vip.com)
nes.d...@vipshop.com>> wrote: What’s more, I am running a 7*24 hours job , so I won’t call System.exit() by myself. So I believe somewhere of the driver kill itself 发件人: 邓刚[技术中心] 发送时间: 2016年1月14日 15:45 收件人: 'Yogesh Mahajan' 抄送: user 主题: 答复: 答复: spark streaming context trigger invoke s

Re: 答复: 答复: spark streaming context trigger invoke stop why?

2016-01-14 Thread Shixiong(Ryan) Zhu
stem.exit() > by myself. So I believe somewhere of the driver kill itself > > > > *发件人:* 邓刚[技术中心] > *发送时间:* 2016年1月14日 15:45 > *收件人:* 'Yogesh Mahajan' > *抄送:* user > *主题:* 答复: 答复: spark streaming context trigger invoke stop why? > > > > Thanks for your response, Appli

答复: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
What’s more, I am running a 7*24 hours job , so I won’t call System.exit() by myself. So I believe somewhere of the driver kill itself 发件人: 邓刚[技术中心] 发送时间: 2016年1月14日 15:45 收件人: 'Yogesh Mahajan' 抄送: user 主题: 答复: 答复: spark streaming context trigger invoke stop why? Thanks for your response

答复: 答复: spark streaming context trigger invoke stop why?

2016-01-13 Thread Triones,Deng(vip.com)
Thanks for your response, ApplicationMaster is only for yarn mode. I am using standalone mode. Could you kindly please let me know where trigger the shutdown hook? 发件人: Yogesh Mahajan [mailto:ymaha...@snappydata.io] 发送时间: 2016年1月14日 12:42 收件人: 邓刚[技术中心] 抄送: user 主题: Re: 答复: spark streaming