Re: separation of JVMs for different applications

small correction, FLIP-6 is not almost finished yet. But we're > working on it and are happy for every helping hand :-) > > Cheers, > Till > > On Fri, Dec 9, 2016 at 2:27 AM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > If there are not any existing jira for standalone v2.

Re: separation of JVMs for different applications

If there are not any existing jira for standalone v2.0, may I open a new one ? Thanks, Manu On Wed, Dec 7, 2016 at 12:39 PM Manu Zhang <owenzhang1...@gmail.com> wrote: > Good to know that. > > Is it the "standalone setup v2.0" section ? The wiki page has no > Goog

Re: separation of JVMs for different applications

ile, and it will start > multiple TaskManagers on a machine. > > Best, > Stephan > > > > On Tue, Dec 6, 2016 at 3:51 AM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > Thanks Stephan, > > They don't use YARN now but I think they will consider it.

Re: separation of JVMs for different applications

> example by interactive shells) and it pre-allocates and manages a lot of > memory for batch jobs. > > > > On Mon, Dec 5, 2016 at 3:48 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > > The pro for the multi-tenant cluster mode is that you can share data > between

Re: separation of JVMs for different applications

gt; isolated from any other jobs (given that you don't submit other jobs to > this cluster). > > Cheers, > Till > > On Sat, Dec 3, 2016 at 2:50 PM, Manu Zhang <owenzhang1...@gmail.com> > wrote: > >> Thanks Fabian and Till. >> >> We have customers who are i

Re: separation of JVMs for different applications

ent. > FLIP-6 is focusing on deployments via resource providers (YARN, Mesos, > etc.) which allow to start Flink processes per job. > > Till (in CC) is more familiar with the FLIP-6 effort and might be able to > add more detail. > > Best, > Fabian > > 2016-12-01 4:16 G

separation of JVMs for different applications

didn't found any mention of changing it in the future. Any thoughts or have I missed anything ? Thanks, Manu Zhang

Re: emit partial state in window (streaming)

Hi Luis, You may try ContinuousEventTimeTrigger that continuously fire on given time interval instead of writing your own. Note that

Re: watermark trigger doesn't check whether element's timestamp is passed

aside (or help out how I can) if you or anyone is > interested to take charge of it. > > That said, I'm also not sure if discussions are ongoing. I had hoped to > prototype the proposal as is, to have something more concrete to discuss. > > Cheers, > aj > On Nov 1, 2016 3:24 PM

Re: watermark trigger doesn't check whether element's timestamp is passed

ent watermark. With this recent PR > https://github.com/apache/flink/pull/2736 you would be able to evict > elements from the window state after the window function was called. > > Cheers, > Aljoscha > > On Tue, 1 Nov 2016 at 02:27 Manu Zhang <owenzhang1...@gmail.com> wrote:

Re: watermark trigger doesn't check whether element's timestamp is passed

t 31, 2016 at 10:29 PM Aljoscha Krettek <aljos...@apache.org> wrote: > Hmm, I don't completely understand what's going on. Could you maybe post > an example, with the trigger code that shows this behaviour? > > Cheers, > Aljoscha > > On Thu, 27 Oct 2016 at 17:12 Manu Zhang &l

Re: watermark trigger doesn't check whether element's timestamp is passed

t to emit. > > Cheers, > Aljoscha > > On Wed, 26 Oct 2016 at 04:04 Manu Zhang <owenzhang1...@gmail.com> wrote: > > Hi Aljoscha, > > Thanks for your response. My use case is to track user trajectory based > on page view event when they visit a website.

watermark trigger doesn't check whether element's timestamp is passed

will be emitted on watermark(1:04). This is incorrect since there could be elements with timestamp between 1:04 and 1:06 that have not arrived yet. I guess this is because watermark trigger doesn't check whether element's timestamp has been passed. Please correct me if any of the above is not right. Thanks, Manu Zhang