[jira] [Commented] (KAFKA-3150) kafka.tools.UpdateOffsetsInZK not work (sasl enabled)
[ https://issues.apache.org/jira/browse/KAFKA-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117261#comment-15117261 ] Ismael Juma commented on KAFKA-3150: UpdateOffsetsInZK requires a PLAINTEXT port to be open by the brokers.There are no plans to improve this tool as offsets are no longer stored in ZK by the new consumer. > kafka.tools.UpdateOffsetsInZK not work (sasl enabled) > - > > Key: KAFKA-3150 > URL: https://issues.apache.org/jira/browse/KAFKA-3150 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.9.0.1 > Environment: redhat as6.5 >Reporter: linbao111 > > ./bin/kafka-run-class.sh kafka.tools.UpdateOffsetsInZK earliest > config/consumer.properties alalei_2 > [2016-01-26 17:20:49,920] WARN Property sasl.kerberos.service.name is not > valid (kafka.utils.VerifiableProperties) > [2016-01-26 17:20:49,920] WARN Property security.protocol is not valid > (kafka.utils.VerifiableProperties) > Exception in thread "main" kafka.common.BrokerEndPointNotAvailableException: > End point PLAINTEXT not found for broker 1 > at kafka.cluster.Broker.getBrokerEndPoint(Broker.scala:136) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply$mcVI$sp(UpdateOffsetsInZK.scala:70) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply(UpdateOffsetsInZK.scala:59) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply(UpdateOffsetsInZK.scala:59) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at > kafka.tools.UpdateOffsetsInZK$.getAndSetOffsets(UpdateOffsetsInZK.scala:59) > at kafka.tools.UpdateOffsetsInZK$.main(UpdateOffsetsInZK.scala:43) > at kafka.tools.UpdateOffsetsInZK.main(UpdateOffsetsInZK.scala) > same error for: > ./bin/kafka-consumer-offset-checker.sh --broker-info --group > test-consumer-group --topic alalei_2 --zookeeper slave1:2181 > [2016-01-26 17:23:45,218] WARN WARNING: ConsumerOffsetChecker is deprecated > and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand > instead. (kafka.tools.ConsumerOffsetChecker$) > Exiting due to: End point PLAINTEXT not found for broker 0. > ./bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper > slave1:2181 --group test-consumer-group > [2016-01-26 17:26:15,075] WARN WARNING: ConsumerOffsetChecker is deprecated > and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand > instead. (kafka.tools.ConsumerOffsetChecker$) > Exiting due to: End point PLAINTEXT not found for broker 0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-3150) kafka.tools.UpdateOffsetsInZK not work (sasl enabled)
[ https://issues.apache.org/jira/browse/KAFKA-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118477#comment-15118477 ] linbao111 commented on KAFKA-3150: -- so how can i manage topic offset on sasl-enabled cluster? i also find kafka-console-consumer.sh not work with --from-beginning,or even with property auto.offset.reset=earlist,which means that new kafka-console-consumer.sh process can not get earlier topics message > kafka.tools.UpdateOffsetsInZK not work (sasl enabled) > - > > Key: KAFKA-3150 > URL: https://issues.apache.org/jira/browse/KAFKA-3150 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.9.0.1 > Environment: redhat as6.5 >Reporter: linbao111 > > ./bin/kafka-run-class.sh kafka.tools.UpdateOffsetsInZK earliest > config/consumer.properties alalei_2 > [2016-01-26 17:20:49,920] WARN Property sasl.kerberos.service.name is not > valid (kafka.utils.VerifiableProperties) > [2016-01-26 17:20:49,920] WARN Property security.protocol is not valid > (kafka.utils.VerifiableProperties) > Exception in thread "main" kafka.common.BrokerEndPointNotAvailableException: > End point PLAINTEXT not found for broker 1 > at kafka.cluster.Broker.getBrokerEndPoint(Broker.scala:136) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply$mcVI$sp(UpdateOffsetsInZK.scala:70) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply(UpdateOffsetsInZK.scala:59) > at > kafka.tools.UpdateOffsetsInZK$$anonfun$getAndSetOffsets$2.apply(UpdateOffsetsInZK.scala:59) > at > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) > at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) > at > kafka.tools.UpdateOffsetsInZK$.getAndSetOffsets(UpdateOffsetsInZK.scala:59) > at kafka.tools.UpdateOffsetsInZK$.main(UpdateOffsetsInZK.scala:43) > at kafka.tools.UpdateOffsetsInZK.main(UpdateOffsetsInZK.scala) > same error for: > ./bin/kafka-consumer-offset-checker.sh --broker-info --group > test-consumer-group --topic alalei_2 --zookeeper slave1:2181 > [2016-01-26 17:23:45,218] WARN WARNING: ConsumerOffsetChecker is deprecated > and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand > instead. (kafka.tools.ConsumerOffsetChecker$) > Exiting due to: End point PLAINTEXT not found for broker 0. > ./bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper > slave1:2181 --group test-consumer-group > [2016-01-26 17:26:15,075] WARN WARNING: ConsumerOffsetChecker is deprecated > and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand > instead. (kafka.tools.ConsumerOffsetChecker$) > Exiting due to: End point PLAINTEXT not found for broker 0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
