Hi Lim, Thanks for your response and sorry for being so vague regarding my first question. Actually I am unable to pinpoint the problem. We have several storm topology integration tests that we run in parallel and had been working very well before the upgrade. The tests started failing after the upgrade, looks like messages are getting dropped somehow. Just wanted to see if anybody is seeing any issues with 1.0.1 LocalCluster.
Thanks Kamal From: Jungtaek Lim <[email protected]> Reply-To: "[email protected]" <[email protected]> Date: Tuesday, December 6, 2016 at 9:25 PM To: "[email protected]" <[email protected]> Subject: [EXTERNAL] Re: Integration testing using LocalCluster in Storm 1.0.1 Hi Kang, I didn't see that issue and don't know about first question. I'll answer the second question. storm-kafka-client 1.1.0 SNAPSHOT is compatible with Kafka 0.10, whereas storm-kafka-client 1.0.x is compatible with Kafka 0.9. Btw, HDP 1.0.1.2.5.0.0-1245 is based on snapshot of Storm 1.1.0 SNAPSHOT so you can pull it with adding Hortonworks remote repository to Maven. Hope this helps. Thanks, Jungtaek Lim (HeartSaVioR) 2016년 12월 7일 (수) 오전 1:32, Kang, Kamaljeet <[email protected]<mailto:[email protected]>>님이 작성: Hi all, We recently upgrade our cluster from Strom 0.11 to 1.0.1.2.5.0.0-1245 (HortonWorks), Kafka from 0.8.2 to 0.10.0.1. We had integration tests using Storm LocalCluster, KafkaEmbedded and EmbeddedZookeeper that started failing sometimes (under load) after the upgrade. Just wanted to see if anybody had similar experience. Another question, we were thinking of upgrading KafkaSpouts to new Consumer API but looks like Kafka Client in Maven central is not compatible with Kafka 0.10.0.1. If we build Kafka Client jar from Git, is it production ready? Thanks Kamal
