RE: Flink kafka consumer that read from two partitions in local mode

2017-09-26 Thread Tzu-Li (Gordon) Tai
and regards, Tovi   From: Sofer, Tovi [ICG-IT] Sent: יום ב 25 ספטמבר 2017 17:18 To: 'Tzu-Li (Gordon) Tai'; Fabian Hueske Cc: user Subject: RE: Flink kafka consumer that read from two partitions in local mode   Hi Gordon,   Thanks for your assistance.   · We are running flink

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-26 Thread Sofer, Tovi
: user Subject: RE: Flink kafka consumer that read from two partitions in local mode Hi Gordon, Thanks for your assistance. · We are running flink currently in local mode(MiniCluster), using flink 1.3.2 and flink-connector-kafka-0.10_2.10. · In Consumer log I see 1 partition

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-25 Thread Sofer, Tovi
e into default topic fix Thanks, Tovi From: Tzu-Li (Gordon) Tai [mailto:tzuli...@apache.org] Sent: יום ב 25 ספטמבר 2017 15:06 To: Sofer, Tovi [ICG-IT]; Fabian Hueske Cc: user Subject: RE: Flink kafka consumer that read from two partitions in local mode Hi Tovi, Your code seems to be correct,

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-25 Thread Tzu-Li (Gordon) Tai
t: Re: Flink kafka consumer that read from two partitions in local mode   Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer instance reads can read

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-24 Thread Sofer, Tovi
(Gordon) Tai Subject: Re: Flink kafka consumer that read from two partitions in local mode Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer instance

Re: Flink kafka consumer that read from two partitions in local mode

2017-09-19 Thread Fabian Hueske
Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer instance reads can read from multiple partitions. Best, Fabian 2017-09-19 17:02 GMT+02:00 Sofer,

Flink kafka consumer that read from two partitions in local mode

2017-09-19 Thread Sofer, Tovi
Hi, I am trying to setup FlinkKafkaConsumer which reads from two partitions in local mode, using setParallelism=2. The producer writes to two partition (as it is shown in metrics report). But the consumer seems to read always from one partition only. Am I missing something in partition