yarn commit problem

2017-05-05 Thread lining jing
Hi All! if I commit job on yarn with -d will show exception Caused by: java.lang.IllegalStateException: No operators defined in streaming topology. Cannot execute. If I delete -d will ok Can someone tell me Why? thanks!

Re: about yarn

2017-04-26 Thread lining jing
Hi, All Thanks, JinKui Shi, have told the answer, just add -d is ok 2017-04-26 14:16 GMT+08:00 lining jing <jinglini...@gmail.com>: > Hi, all > > I use /bin/flink run -m yarn-cluster > commit my flink job. But, after this, the process which name is CliFrontend > is runn

about yarn

2017-04-26 Thread lining jing
Hi, all I use /bin/flink run -m yarn-cluster commit my flink job. But, after this, the process which name is CliFrontend is running. After a duration, there are many CliFrontend run in my computer which is no need. Has any good idea soft this solution. Thanks!

question about record

2017-03-27 Thread lining jing
Hi All , data transmission is achieved through the buffer. If record serialised to multiple buffer, whether different records will share the same buffer. Can anyone tell me the answer, Thank!

Re: multiple consumer of intermediate data set

2017-03-14 Thread lining jing
Hi, if output is same, why not just only one intermediate data set is ok 2017-03-14 14:36 GMT+08:00 Zhijiang(wangzhijiang999) < wangzhijiang...@aliyun.com>: > Hi , > > I think there is no difference between JobVertex(A) and JobVertex(B). > Because the JobVertex(C) is not shown in the

Re: Set custom file as ClassPath in flink yarn command

2017-02-27 Thread lining jing
flink run -m yarn-cluster -yn 10 -yjm 1024 -ytm 2048 -c mainClass jarPath

Re: flink on yarn ha

2017-02-21 Thread lining jing
) at org.apache.flink.yarn.YarnApplicationMasterRunner.main(YarnApplicationMasterRunner.java:124) 2017-02-22 8:44 GMT+08:00 lining jing <jinglini...@gmail.com>: > Thanks, Stephan ! I will try it! > > 2017-02-21 21:42 GMT+08:00 Stephan Ewen <se...@apache.org>: > >> Hi! >>

Re: flink on yarn ha

2017-02-21 Thread lining jing
; > Thanks! > > On Tue, Feb 21, 2017 at 11:41 AM, lining jing <jinglini...@gmail.com> > wrote: > >> flink version: 1.1.3 >> >> kill jobmanager, the job fail. Ha config did not work. >> > >

flink on yarn ha

2017-02-21 Thread lining jing
flink version: 1.1.3 kill jobmanager, the job fail. Ha config did not work.

Re: Jobmanager was killed when disk less 10% in yarn

2017-02-20 Thread lining jing
f JobManager exit , and it can not get the reason from it. > You may check the container log from node manager why it was killed. > > Best, > > Zhijiang > > ------ > 发件人:lining jing <jinglini...@gmail.com> >

Jobmanager was killed when disk less 10% in yarn

2017-02-19 Thread lining jing
Hi, I use yarn manager resource. Recently when disk less 10% , JobManager was killed. I want to know whether the reason is the disk problem. log : 2017-02-19 03:20:37,087 INFO org.apache.flink.yarn.YarnApplicationMasterRunner - RECEIVED SIGNAL 15: SIGTERM. Shutting down as