Re: Parallel execution on AllWindows

2016-08-04 Thread Andrew Ge Wu
> Thanks for the explanation. > One other thing, when you say there is no coordination is that means > rebalance() will not be honored, and each window operator instance will > compete for the next available window? > > Thanks > > Andrew > From mobile > >

Re: Parallel execution on AllWindows

2016-08-03 Thread Aljoscha Krettek
indow? > > Thanks > > Andrew > From mobile > > From: Aljoscha Krettek > Sent: Wednesday, August 3, 17:11 > Subject: Re: Parallel execution on AllWindows > To: user@flink.apache.org > > Hi, > > if you manually force a parallelism different from 1 after a *windowAl

Re: Parallel execution on AllWindows

2016-08-03 Thread andrew . ge-wu
ent: Wednesday, August 3, 17:11 Subject: Re: Parallel execution on AllWindows To: user@flink.apache.org Hi, if you manually force a parallelism different from 1 after a *windowAll() then you will get parallel execution of your window. For example, if you do this: input.countWindowAll(

Re: Parallel execution on AllWindows

2016-08-03 Thread Aljoscha Krettek
Hi, if you manually force a parallelism different from 1 after a *windowAll() then you will get parallel execution of your window. For example, if you do this: input.countWindowAll(100).setParallelism(5) then you will get five parallel instances of the window operator that each wait for 100 eleme

Parallel execution on AllWindows

2016-08-03 Thread Andrew Ge Wu
Hi, I have such task that I want to count window on a stream and execute them batch by batch. Execute a count window may take some time, so I want it to be executed in parallel. I read this part in the documentation when I found it automatically reduced parallelization to 1 * Note: This operat