Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-11-01 Thread Aljoscha Krettek
t; > can't just take the timestamp of the last element as > > maximum > > > > > > >> timestamp, > > > > > > >> > > but > > > > > > >> > > > check each and every element in the window. > > >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-31 Thread Vishnu Viswanath
> > > > >> > > > > .evictor(new ProcessingTimeEvictor()) > > > > > >> > > > > .apply(...) > > > > > >> > > > > > > > > > >> > > > > where ProcessingTimeEvictor looks like this: >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-18 Thread Aljoscha Krettek
ave elements 1,2,3,4,5 in the window buffer > to > > be > > > > able to evict 2 and 4? > > > > We discussed about this some email exchanges ago but as I said I am > not > > > > sure if this functionality is captured in this interface. Basically, > > will > > > > the

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-17 Thread Vishnu Viswanath
method from Iterators be available? > > > > > > Best regards, > > > > > > > > > -Original Message- > > > From: Vishnu Viswanath [mailto:vishnu.viswanat...@gmail.com] > > > Sent: Friday, October 07, 2016 8:29 AM > >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-17 Thread Aljoscha Krettek
remove() method from Iterators be available? > > > > Best regards, > > > > > > -Original Message- > > From: Vishnu Viswanath [mailto:vishnu.viswanat...@gmail.com] > > Sent: Friday, October 07, 2016 8:29 AM > > To: Dev > > Subjec

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-07 Thread Vishnu Viswanath
ctingWindowOperator > >> any > >> > > > more. > >> > > > > > It could be a very thin subclass of WindowOperator. > >> > > > > > > >> > > > > > Cheers, > >> > > > > > Aljoscha > >>

RE: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-07 Thread Radu Tudoran
[mailto:vishnu.viswanat...@gmail.com] Sent: Friday, October 07, 2016 8:29 AM To: Dev Subject: Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink Hi Aljoscha, To pass the time information to Evictor at the same to not expose the StreamRecord, I suppose we can change the signature of evictBefore and

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-06 Thread Vishnu Viswanath
wrote: >> > > > > >> > >> > > > > >> > > Hi Aljoscha, >> > > > > >> > > >> > > > > >> > > Can you point us to the way it is handled now. Is there >> > anything >> >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-05 Thread Vishnu Viswanath
> Thanks, > > > > > >> Vishnu > > > > > >> > > > > > >> On Mon, Jul 25, 2016 at 7:48 AM, Aljoscha Krettek < > > > > aljos...@apache.org> > > > > > >> wrote: > > > > > >> > >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-09-20 Thread Aljoscha Krettek
gt; Cheers, > > > > >> > Aljoscha > > > > >> > > > > > >> > On Mon, 25 Jul 2016 at 13:00 Radu Tudoran < > > radu.tudo...@huawei.com> > > > > >> wrote: > > > > >> > > > > > &

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-09-18 Thread Vishnu Viswanath
gt; > > remove from window buffers? > > > >> > > > > > >> > > Dr. Radu Tudoran > > > >> > > Research Engineer - Big Data Expert > > > >> > > IT R&D Division > > > >> > >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-31 Thread Aljoscha Krettek
: radu.tudo...@huawei.com > > >> > > Mobile: +49 15209084330 > > >> > > Telephone: +49 891588344173 > > >> > > > > >> > > HUAWEI TECHNOLOGIES Duesseldorf GmbH > > >> > > Hansaallee 205, 40549 Düsseldorf, Germ

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-30 Thread Vishnu Viswanath
wei.com > >> > > Registered Office: Düsseldorf, Register Court Düsseldorf, HRB 56063, > >> > > Managing Director: Bo PENG, Wanzhou MENG, Lifang CHEN > >> > > Sitz der Gesellschaft: Düsseldorf, Amtsgericht Düsseldorf, HRB > 56063, > >> >

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-29 Thread Aljoscha Krettek
nd its attachments contain confidential information from >> > > HUAWEI, which is intended only for the person or entity whose address >> is >> > > listed above. Any use of the information contained herein in any way >> > > (including, but not limited to, total

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-28 Thread Aljoscha Krettek
the information contained herein in any way > > > (including, but not limited to, total or partial disclosure, > > reproduction, > > > or dissemination) by persons other than the intended recipient(s) is > > > prohibited. If you receive this e-mail in error, please notify the

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-26 Thread Vishnu Viswanath
> > This is very costly but the only way I see of doing this right now with > > every state backend. > > > > Cheers, > > Aljoscha > > > > On Mon, 25 Jul 2016 at 09:46 Radu Tudoran > wrote: > > > > > Hi, > > > > > > Tha

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-25 Thread Aljoscha Krettek
Can someone point to where the events are > > removed from buffers - I am trying to understand the new logic of > handling > > the eviction in this new API. Thanks > > > > > > > > -Original Message- > > From: Vishnu Viswanath [mailto:vishnu.vis

RE: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-25 Thread Radu Tudoran
e- > From: Vishnu Viswanath [mailto:vishnu.viswanat...@gmail.com] > Sent: Saturday, July 23, 2016 3:04 AM > To: Dev > Subject: Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink > > Hi Radu, > > - Yes we can remove elements from the iterator. > - Right now the EvictingWindowO

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-25 Thread Aljoscha Krettek
..@gmail.com] > Sent: Saturday, July 23, 2016 3:04 AM > To: Dev > Subject: Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink > > Hi Radu, > > - Yes we can remove elements from the iterator. > - Right now the EvictingWindowOperator just skips the elements from the > Iterable

RE: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-25 Thread Radu Tudoran
, July 23, 2016 3:04 AM To: Dev Subject: Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink Hi Radu, - Yes we can remove elements from the iterator. - Right now the EvictingWindowOperator just skips the elements from the Iterable before passing to the window function(Yes this has to be changed

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-22 Thread Vishnu Viswanath
dissemination) by persons other than the intended recipient(s) is > prohibited. If you receive this e-mail in error, please notify the sender > by phone or email immediately and delete it! > > > -Original Message----- > From: Vishnu Viswanath [mailto:vishnu.viswanat..

RE: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-22 Thread Radu Tudoran
ath [mailto:vishnu.viswanat...@gmail.com] Sent: Friday, July 22, 2016 12:43 PM To: Dev Subject: Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink Hi, I have created a FLIP page for this enhancement https://cwiki.apache.org/confluence/display/FLINK/FLIP-4+%3A+Enhance+Window+Evictor Thanks, Vishnu O

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-07-22 Thread Vishnu Viswanath
Hi, I have created a FLIP page for this enhancement https://cwiki.apache.org/confluence/display/FLINK/FLIP-4+%3A+Enhance+Window+Evictor Thanks, Vishnu On Thu, Jul 21, 2016 at 6:53 AM, Vishnu Viswanath < vishnu.viswanat...@gmail.com> wrote: > Thanks Aljoscha. > > On Thu, Jul 21, 2016 at 4:46 AM,