Github user lukess commented on the issue:
https://github.com/apache/storm/pull/1935
@srdo the issue is if I clone a storm repo from github, and follow
[doc](https://github.com/apache/storm/blob/master/docs/storm-kafka-client.md#using-storm-kafka-client-with-different-versions-of-kafka)
would fail if
mvn clean package -Dstorm.kafka.client.version=0.10.1.0
mvn clean package -Dstorm.kafka.client.version=0.10.1.1
`
Running org.apache.storm.kafka.bolt.KafkaBoltTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec -
in org.apache.storm.kafka.bolt.KafkaBoltTest
Running org.apache.storm.kafka.spout.KafkaSpoutRebalanceTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 sec -
in org.apache.storm.kafka.spout.KafkaSpoutRebalanceTest
Running org.apache.storm.kafka.spout.KafkaSpoutConfigTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in
org.apache.storm.kafka.spout.KafkaSpoutConfigTest
Running org.apache.storm.kafka.spout.ByTopicRecordTranslatorTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec -
in org.apache.storm.kafka.spout.ByTopicRecordTranslatorTest
Running org.apache.storm.kafka.spout.DefaultRecordTranslatorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec -
in org.apache.storm.kafka.spout.DefaultRecordTranslatorTest
Running org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest
Tests run: 4, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 7.591 sec
<<< FAILURE! - in org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest
shouldReplayInOrderFailedMessages(org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest)
Time elapsed: 1.826 sec <<< ERROR!
kafka.common.FailedToSendMessageException: Failed to send messages after 3
tries.
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:96)
at kafka.producer.Producer.send(Producer.scala:78)
at kafka.javaapi.producer.Producer.send(Producer.scala:35)
at info.batey.kafka.unit.KafkaUnit.sendMessages(KafkaUnit.java:263)
at
org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest.lambda$populateTopicData$0(SingleTopicKafkaSpoutTest.java:102)
shouldContinueWithSlowDoubleAcks(org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest)
Time elapsed: 1.651 sec <<< ERROR!
kafka.common.FailedToSendMessageException: Failed to send messages after 3
tries.
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:96)
at kafka.producer.Producer.send(Producer.scala:78)
at kafka.javaapi.producer.Producer.send(Producer.scala:35)
at info.batey.kafka.unit.KafkaUnit.sendMessages(KafkaUnit.java:263)
at
org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest.lambda$populateTopicData$0(SingleTopicKafkaSpoutTest.java:102)
shouldEmitAllMessages(org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest)
Time elapsed: 2.465 sec <<< ERROR!
kafka.common.FailedToSendMessageException: Failed to send messages after 3
tries.
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:96)
at kafka.producer.Producer.send(Producer.scala:78)
at kafka.javaapi.producer.Producer.send(Producer.scala:35)
at info.batey.kafka.unit.KafkaUnit.sendMessages(KafkaUnit.java:263)
at
org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest.lambda$populateTopicData$0(SingleTopicKafkaSpoutTest.java:102)
shouldReplayFirstTupleFailedOutOfOrder(org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest)
Time elapsed: 1.648 sec <<< ERROR!
kafka.common.FailedToSendMessageException: Failed to send messages after 3
tries.
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:96)
at kafka.producer.Producer.send(Producer.scala:78)
at kafka.javaapi.producer.Producer.send(Producer.scala:35)
at info.batey.kafka.unit.KafkaUnit.sendMessages(KafkaUnit.java:263)
at
org.apache.storm.kafka.spout.SingleTopicKafkaSpoutTest.lambda$populateTopicData$0(SingleTopicKafkaSpoutTest.java:102)
Results :
Tests in error:
SingleTopicKafkaSpoutTest.shouldContinueWithSlowDoubleAcks:129->initializeSpout:107->populateTopicData:97->lambda$populateTopicData$0:102
» FailedToSendMessage
SingleTopicKafkaSpoutTest.shouldEmitAllMessages:168->initializeSpout:107->populateTopicData:97->lambda$populateTopicData$0:102
» FailedToSendMessage
SingleTopicKafkaSpoutTest.shouldReplayFirstTupleFailedOutOfOrder:237->initializeSpout:107->populateTopicData:97->lambda$populateTopicData$0:102
» FailedToSendMessage
SingleTopicKafkaSpoutTest.shouldReplayInOrderFailedMessages:196->initializeSpout:107->populateTopicData:97->lambda$populateTopicData$0:102
» FailedToSendMessage
Tests run: 12, Failures: 0, Errors: 4, Skipped:
`
It only works if
mvn clean package -Dstorm.kafka.client.version=0.10.0.0
mvn clean package -Dstorm.kafka.client.version=0.10.0.1
I know the doc does say storm-kafka-client module only supports 0.10 or
newer kafka client API not storm-kafka-client module only supports 0.10 or
newer kafka client library. Just not that clear to me. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
