Re: Flink Batch job: All slots for groupReduce task scheduled on same machine

Hmm, that seems weird. Could you please also post the code of the complete program? Only the parts that build the program graph should be enough. And maybe a screenshot of the complete graph from the dashboard. -- Aljoscha > On 20. Feb 2018, at 11:36, Aneesha Kaushal

Re: Flink Batch job: All slots for groupReduce task scheduled on same machine

2018-02-20, 14:31:582018-02-20, 14:52:2820m 30s Map (Map at com.rfk.dataplatform.batch.jobs.topk.TopkOperations$$anonfun$4.apply(TopkOperations.scala:128)) 10.8 GB 130,639,359 10.8 GB 130,639,359 16 00016000 FINISHED Start Time End TimeDuration

Re: Flink Batch job: All slots for groupReduce task scheduled on same machine

Could you please send a screenshot? > On 20. Feb 2018, at 11:09, Aneesha Kaushal > wrote: > > Hello Aljoscha > > I looked into the Subtasks session on Flink Dashboard, for the about two > tasks. > > Thanks > Aneesha > >> On 20-Feb-2018, at 3:32 PM, Aljoscha

Re: Flink Batch job: All slots for groupReduce task scheduled on same machine

Hello Aljoscha I looked into the Subtasks session on Flink Dashboard, for the about two tasks. Thanks Aneesha > On 20-Feb-2018, at 3:32 PM, Aljoscha Krettek wrote: > > Hi, > > Could you please also post where/how you see which tasks are mapped to which >

Re: Flink Batch job: All slots for groupReduce task scheduled on same machine

Hi, Could you please also post where/how you see which tasks are mapped to which slots/TaskManagers? Best, Aljoscha > On 20. Feb 2018, at 10:50, Aneesha Kaushal > wrote: > > Hello, > > I have a fink batch job, where I am grouping dataset on some keys, and

Flink Batch job: All slots for groupReduce task scheduled on same machine

Hello, I have a fink batch job, where I am grouping dataset on some keys, and then using group reduce. Parallelism is set to 16. The slots for the Map task is distributed across all the machines, but for GroupReduce all the slots are being assigned to the same machine. Can you help me