答复: No data issued by flink window after a few hours

2018-10-11 Thread 潘 功森
Hi, I found the pictures maybe too big and the net here not so good, so the mail I wrote is not sent sucsessfully last night. Yes, I used event time. I found watermarks fired normally when the job started, but it stopped and no changed after running hours. And I changed as fs state backend, I

答复: No data issued by flink window after a few hours

2018-10-11 Thread 潘 功森
Please look at the mail below, the others were out of data cause the bad network. Yours, September 发件人: 潘 功森 发送时间: Friday, October 12, 2018 11:05:49 AM 收件人: vino yang 抄送: user 主题: 答复: No data issued by flink window after a few hours Hi, I found the pictures

答复: 答复: No data issued by flink window after a few hours

2018-10-11 Thread 潘 功森
The second question looks fine. [cid:image004.png@01D461B6.93D6FF70] Yours, September 发件人: Dawid Wysakowicz 发送时间: 2018年10月11日 15:13 收件人: 潘 功森; vino yang 抄送: user 主题: Re: 答复:

Re: 答复: No data issued by flink window after a few hours

2018-10-11 Thread Dawid Wysakowicz
Hi, I agree with Vino, that you should check if the watermark is progressing for all subtasks, if you are using event time semantics. If this is not the problem it would help if you could share the code of your job. By the way have you tried reproducing the problem with collection source? Best,

答复: No data issued by flink window after a few hours

2018-10-10 Thread 潘 功森
Hi, I changed as below configurations,and it looks fine when job started. But there’re no results issued when window ends after running about six hours, and no errors and exceptions. How can I position the question? Yours, September 发件人: 潘 功森 发送时间: Wednesday,

答复: No data issued by flink window after a few hours

2018-10-10 Thread 潘 功森
Hi, Cause default state size in one hour is too small,and the max window size is 24 hours, so I used 500M. MemoryStateBackend stateBackend = new MemoryStateBackend(MAX_STATE_SIZE);//500M env.setStateBackend(stateBackend); And I found Irrespective of the configured maximal state size, the

答复: No data issued by flink window after a few hours

2018-10-09 Thread 潘 功森
Hi, "ram to cache the distinct data about sliding window" means I used computer momery not the third part db to cache the data need used in window. “the data need used in window” means :such as the sliding window is 1 hour, and I need to count the distinct users, I need to cache the user id