Re: Weird Kafka Connector issue

2018-04-25 Thread TechnoMage
019/flink-kafka-consumer-groupid-not-working > > <https://stackoverflow.com/questions/38639019/flink-kafka-consumer-groupid-not-working> > > From: TechnoMage [mailto:mla...@technomage.com] > Sent: Wednesday, April 25, 2018 8:52 AM > To: Tzu-Li (Gordon) Tai > Cc: user

RE: Weird Kafka Connector issue

2018-04-25 Thread Nortman, Bill
-working From: TechnoMage [mailto:mla...@technomage.com] Sent: Wednesday, April 25, 2018 8:52 AM To: Tzu-Li (Gordon) Tai Cc: user Subject: Re: Weird Kafka Connector issue I have another java program reading the topic to monitor the test. It receives 60,000 records on the “travel” topic, while the

Re: Weird Kafka Connector issue

2018-04-25 Thread TechnoMage
Just in case it is a metrics bug, I will add a step to do my own counting in the Flink job. Michael > On Apr 25, 2018, at 9:52 AM, TechnoMage wrote: > > I have another java program reading the topic to monitor the test. It > receives 60,000 records on the “travel” topic, while the kafka cons

Re: Weird Kafka Connector issue

2018-04-25 Thread TechnoMage
I have another java program reading the topic to monitor the test. It receives 60,000 records on the “travel” topic, while the kafka consumer only reports 4,138. That and the incongruity of the source to the maps are what seems very weird. I have several other topics where the source is built

Weird Kafka Connector issue

2018-04-23 Thread TechnoMage
I have been using the kafka connector sucessfully for a while now. But, am getting weird results in one case. I have a test that submits 3 streams to kafka topics, and monitors them on a separate process. The flink job has a source for each topic, and one such is fed to 3 separate map functio