RE: Distribution of sinks among the nodes

Thanks, One more thing to expect from the next version ! -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: lundi 8 février 2016 13:18 To: user@flink.apache.org Subject: Re: Distribution of sinks among the nodes Hi, I just merged the new feature, so once

Re: Distribution of sinks among the nodes

>> same parallelism for sinks as mapping : that way each map will have it’s own >> sink and there will be no exchanges between flink instances. >> >> From: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] On Behalf Of >> Stephan Ewen >> Sent: jeudi 4 févri

Re: Distribution of sinks among the nodes

to be deployed. That way you keep the >> standard behavior, don’t have to make a complicated generic-optimized >> algorithm, and let the user make it’s choices. *Should I create a JIRA ?* >> >> >> >> For the time being we could start the application 4 time : one time

RE: Distribution of sinks among the nodes

be at 24 if there was no chaining … From: Gwenhael Pasquiers [mailto:gwenhael.pasqui...@ericsson.com] Sent: jeudi 4 février 2016 09:55 To: user@flink.apache.org Subject: RE: Distribution of sinks among the nodes Don’t we need to set the number of slots to 24 (4 sources + 16 mappers + 4 sinks

Re: Distribution of sinks among the nodes

we could start the application 4 time : one time per > node, put that’s not pretty at all J > > > > B.R. > > > > *From:* Till Rohrmann [mailto:trohrm...@apache.org] > *Sent:* mercredi 3 février 2016 17:58 > > *To:* user@flink.apache.org > *Subject:* Re: Dis

RE: Distribution of sinks among the nodes

. From: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] On Behalf Of Stephan Ewen Sent: jeudi 4 février 2016 15:13 To: user@flink.apache.org Subject: Re: Distribution of sinks among the nodes To your other question, there are two things in Flink: (1) Chaining. Tasks are folded together

Re: Distribution of sinks among the nodes

here will be no exchanges between flink instances. > > From: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] On Behalf Of > Stephan Ewen > Sent: jeudi 4 février 2016 15:13 > To: user@flink.apache.org > Subject: Re: Distribution of sinks among the nodes > > To you

RE: Distribution of sinks among the nodes

the application 4 time : one time per node, put that’s not pretty at all ☺ B.R. From: Till Rohrmann [mailto:trohrm...@apache.org] Sent: mercredi 3 février 2016 17:58 To: user@flink.apache.org Subject: Re: Distribution of sinks among the nodes Hi Gwenhäel, if you set the number of slots for each TaskManager

RE: Distribution of sinks among the nodes

have only 4 kafka partitions. That's why we need more mappers than sources / sinks -Original Message- From: Aljoscha Krettek [mailto:aljos...@apache.org] Sent: mercredi 3 février 2016 16:26 To: user@flink.apache.org Subject: Re: Distribution of sinks among the nodes Hi Gwenhäel, when

Re: Distribution of sinks among the nodes

Hi Gwenhäel, when you say 16 maps, are we talking about one mapper with parallelism 16 or 16 unique map operators? Regards, Aljoscha > On 03 Feb 2016, at 15:48, Gwenhael Pasquiers > wrote: > > Hi, > > We try to deploy an application with the following

Re: Distribution of sinks among the nodes

> -Original Message- > From: Aljoscha Krettek [mailto:aljos...@apache.org] > Sent: mercredi 3 février 2016 16:26 > To: user@flink.apache.org > Subject: Re: Distribution of sinks among the nodes > > Hi Gwenhäel, > when you say 16 maps, are we talking about one mapper with