Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-26 Thread Paul Lam
ement, which happens to be 100ms by >>>>> default. You can decrease this value to some extend, at to cost of >>>>> potential loss in throughput, but I think even values around 5-10ms are >>>>> ok-ish. See [1] for more details. If you want t

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-26 Thread Paul Lam
;>> >>> Best, >>> Stefan >>> >>>> Am 20.09.2018 um 16:03 schrieb James Yu >>> <mailto:cyu...@gmail.com>>: >>>> >>>> The previous email seems unable to display embedded images, let me put on >>&g

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread Stefan Richter
gt; <mailto:cyu...@gmail.com>>: >>> >>> The previous email seems unable to display embedded images, let me put on >>> the links. >>> Hi, >>> >>> My team and I try to measure total time spent on our flink job and found >>>

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread Hequn Cheng
gt;> My team and I try to measure total time spent on our flink job and found >> out that Flink takes 40ms ~ 100ms to proceed from one operator to another. >> I wonder how can we reduce this transition time. >> >> Following DAG represents our job: >> > http

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread Stefan Richter
;> The previous email seems unable to display embedded images, let me put on >> the links. >> Hi, >> >> My team and I try to measure total time spent on our flink job and found out >> that Flink takes 40ms ~ 100ms to proceed from one operator to another. I >

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread Stefan Richter
et me put on the > links. > Hi, > > My team and I try to measure total time spent on our flink job and found out > that Flink takes 40ms ~ 100ms to proceed from one operator to another. I > wonder how can we reduce this transition time. > > Following DAG represents ou

Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread James Yu
The previous email seems unable to display embedded images, let me put on the links. > Hi, > > My team and I try to measure total time spent on our flink job and found > out that Flink takes 40ms ~ 100ms to proceed from one operator to another. > I wonder how can we reduce this

Flink takes 40ms ~ 100ms to proceed from one operator to another?

2018-09-20 Thread James Yu
Hi, My team and I try to measure total time spent on our flink job and found out that Flink takes 40ms ~ 100ms to proceed from one operator to another. I wonder how can we reduce this transition time. Following DAG represents our job: and here is the screenshot of our log: at 19:37:04.564