Way to check existence of topic

2014-12-11 Thread SasakiKai
Hi, all. I have a simple question. Is there anyway to check existence of some topic from consumer? I want to implement a consumer which checks before consuming messages efficiently. Has this type of API already been implemented? Or if you have any plan, please let me know. Thank you Sent

Re: Way to check existence of topic

2014-12-11 Thread Joe Stein
Take a look at the entry point https://github.com/apache/kafka/blob/0.8.1/core/src/main/scala/kafka/admin/TopicCommand.scala#L32 behind kafka-topics.sh --describe --topic for how to-do that now . We are working on a new CLI and Shell for that https://issues.apache.org/jira/browse/KAFKA-1694

[jira] [Commented] (KAFKA-313) Add JSON/CSV output and looping options to ConsumerOffsetChecker

2014-12-11 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243021#comment-14243021 ] Ashish Kumar Singh commented on KAFKA-313: -- [~jjkoshy], just a reminder :), still

[jira] [Commented] (KAFKA-1664) Kafka does not properly parse multiple ZK nodes with non-root chroot

2014-12-11 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243024#comment-14243024 ] Ashish Kumar Singh commented on KAFKA-1664: --- [~nehanarkhede] Addressed your

[jira] [Commented] (KAFKA-1351) String.format is very expensive in Scala

2014-12-11 Thread Fabian Lange (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243223#comment-14243223 ] Fabian Lange commented on KAFKA-1351: - Hi, I was about to create a new issue, but

[jira] [Commented] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-11 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243242#comment-14243242 ] Jay Kreps commented on KAFKA-742: - No, I said that but then never did any work. Definitely

[jira] [Updated] (KAFKA-1812) Allow IpV6 in configuration with parseCsvMap

2014-12-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1812: - Reviewer: Gwen Shapira Allow IpV6 in configuration with parseCsvMap

[jira] [Updated] (KAFKA-1811) ensuring registered broker host:port is unique

2014-12-11 Thread Dave Parfitt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Parfitt updated KAFKA-1811: Attachment: KAFKA_1811.patch ensuring registered broker host:port is unique

[jira] [Commented] (KAFKA-1811) ensuring registered broker host:port is unique

2014-12-11 Thread Dave Parfitt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243286#comment-14243286 ] Dave Parfitt commented on KAFKA-1811: - Patch attached. ensuring registered broker

Build failed in Jenkins: Kafka-trunk #352

2014-12-11 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/352/ -- [...truncated 970 lines...] kafka.admin.TopicCommandTest testConfigPreservationAcrossPartitionAlteration PASSED kafka.admin.AdminTest testReplicaAssignment PASSED kafka.admin.AdminTest

[jira] [Commented] (KAFKA-1512) Limit the maximum number of connections per ip address

2014-12-11 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243430#comment-14243430 ] Jeff Holoman commented on KAFKA-1512: - [~jkreps], I noticed that the overrides are not

[jira] [Commented] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-11 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243517#comment-14243517 ] Ashish Kumar Singh commented on KAFKA-742: -- [~jkreps] ok, I am on it then :)

[jira] [Updated] (KAFKA-742) Existing directories under the Kafka data directory without any data cause process to not start

2014-12-11 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-742: Fix Version/s: 0.8.3 Existing directories under the Kafka data directory without any data cause process

Re: Review Request 28793: Patch for KAFKA-1784

2014-12-11 Thread Mayuresh Gharat
On Dec. 10, 2014, 12:37 a.m., Neha Narkhede wrote: core/src/main/scala/kafka/tools/OffsetClient.scala, line 142 https://reviews.apache.org/r/28793/diff/1/?file=785102#file785102line142 This and a lot of the rest of the code exists in ClientUtils. Until the refactoring is

[jira] [Commented] (KAFKA-1650) Mirror Maker could lose data on unclean shutdown.

2014-12-11 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243646#comment-14243646 ] Jiangjie Qin commented on KAFKA-1650: - [~joestein] It was my bad. In the

Re: Review Request 28793: Patch for KAFKA-1784

2014-12-11 Thread Neha Narkhede
On Dec. 10, 2014, 12:37 a.m., Neha Narkhede wrote: core/src/main/scala/kafka/tools/OffsetClient.scala, line 142 https://reviews.apache.org/r/28793/diff/1/?file=785102#file785102line142 This and a lot of the rest of the code exists in ClientUtils. Until the refactoring is

[jira] [Commented] (KAFKA-1811) ensuring registered broker host:port is unique

2014-12-11 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243741#comment-14243741 ] Gwen Shapira commented on KAFKA-1811: - Few notes that may help: 1. We like reviewing

[jira] [Commented] (KAFKA-1812) Allow IpV6 in configuration with parseCsvMap

2014-12-11 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243745#comment-14243745 ] Gwen Shapira commented on KAFKA-1812: - [~joestein] - this patch tests look good to