New and updated producers and consumers

2015-11-05 Thread Prabhjot Bharaj
Hi, I'm using the latest update: 0.8.2.2 I would like to use the latest producer and consumer apis over the past few weeks, I have tried to do some performance benchmarking using the producer and consumer scripts provided in the bin directory. It was a fun activity and I have learnt a lot about

[GitHub] kafka pull request: MINOR: Remove unnecessary println

2015-11-05 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/429 MINOR: Remove unnecessary println Looks like this println might have been left in there by mistake. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-2749) Failure of end to end latency test during nightly run

2015-11-05 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991447#comment-14991447 ] Rajini Sivaram commented on KAFKA-2749: --- [~geoffra] Yes, will look into it this morning. > Failure

Re: New and updated producers and consumers

2015-11-05 Thread Prabhjot Bharaj
Adding users as well On Thu, Nov 5, 2015 at 3:37 PM, Prabhjot Bharaj wrote: > Hi, > > I'm using the latest update: 0.8.2.2 > I would like to use the latest producer and consumer apis > over the past few weeks, I have tried to do some performance benchmarking > using the

Build failed in Jenkins: kafka-trunk-jdk7 #761

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2742: Fix SourceTaskOffsetCommitter to handle removal of commit -- [...truncated 123 lines...] :kafka-trunk-jdk7:clients:determineCommitId UP-TO-DATE

[jira] [Resolved] (KAFKA-2738) Can't set SSL as inter-broker-protocol by rolling restart of brokers

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2738. -- Resolution: Fixed Issue resolved by pull request 428 [https://github.com/apache/kafka/pull/428]

[GitHub] kafka pull request: KAFKA-2738: Replica FetcherThread should conne...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #100

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2742: Fix SourceTaskOffsetCommitter to handle removal of commit [wangguoz] KAFKA-2741: Make SourceTaskContext and SinkTaskContext interfaces and [wangguoz] KAFKA-2743: Make forwarded task reconfiguration

Re: New and updated producers and consumers

2015-11-05 Thread Jeff Holoman
Prabhjot, The answer changes slightly for the Producer and Consumer and depends on your timeline and comfort with using new APIs Today and in the future, for the Producer, you should be using the "new" producer, which isn't all that new anymore: org.apache.kafka.clients.producer.KafkaProducer;

[jira] [Created] (KAFKA-2752) Add clean bounce system test for distributed Copycat

2015-11-05 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2752: Summary: Add clean bounce system test for distributed Copycat Key: KAFKA-2752 URL: https://issues.apache.org/jira/browse/KAFKA-2752 Project: Kafka

[jira] [Created] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread Craig W (JIRA)
Craig W created KAFKA-2751: -- Summary: Documentation for retention.ms is confusing Key: KAFKA-2751 URL: https://issues.apache.org/jira/browse/KAFKA-2751 Project: Kafka Issue Type: Bug Affects

[jira] [Created] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

2015-11-05 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2753: -- Summary: Improve SyncGroup error handling in AbstractCoordinator Key: KAFKA-2753 URL: https://issues.apache.org/jira/browse/KAFKA-2753 Project: Kafka

[jira] [Commented] (KAFKA-2742) SourceTaskOffsetCommitter does not properly remove commit tasks when they are already in progress

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991938#comment-14991938 ] ASF GitHub Bot commented on KAFKA-2742: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2742) SourceTaskOffsetCommitter does not properly remove commit tasks when they are already in progress

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2742. -- Resolution: Fixed Issue resolved by pull request 421 [https://github.com/apache/kafka/pull/421]

[jira] [Resolved] (KAFKA-2741) Source/SinkTaskContext should be interfaces and implementations kept in runtime jar

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2741. -- Resolution: Fixed Issue resolved by pull request 420 [https://github.com/apache/kafka/pull/420]

[jira] [Commented] (KAFKA-2738) Can't set SSL as inter-broker-protocol by rolling restart of brokers

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992000#comment-14992000 ] ASF GitHub Bot commented on KAFKA-2738: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2572: Add VerifiableSource/Sink connecto...

2015-11-05 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/432 KAFKA-2572: Add VerifiableSource/Sink connectors and rolling bounce Copycat system tests. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request: KAFKA-2742: Fix SourceTaskOffsetCommitter to h...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-2743) Forwarding task reconfigurations in Copycat can deadlock with rebalances and has no backoff

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2743. -- Resolution: Fixed Issue resolved by pull request 422 [https://github.com/apache/kafka/pull/422]

Build failed in Jenkins: kafka-trunk-jdk7 #762

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2741: Make SourceTaskContext and SinkTaskContext interfaces and [wangguoz] KAFKA-2743: Make forwarded task reconfiguration requests asynchronous on [wangguoz] KAFKA-2738: Replica FetcherThread should

Re: New and updated producers and consumers

2015-11-05 Thread Jeff Holoman
The best thing that I know is the latest javadoc that's committed to trunk: https://github.com/apache/kafka/blob/ef5d168cc8f10ad4f0efe9df4cbe849a4b35496e/clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java Thanks Jeff On Thu, Nov 5, 2015 at 12:51 PM, Cliff Rhyne

[jira] [Commented] (KAFKA-2741) Source/SinkTaskContext should be interfaces and implementations kept in runtime jar

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991943#comment-14991943 ] ASF GitHub Bot commented on KAFKA-2741: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2743: Make forwarded task reconfiguratio...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/422 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2743) Forwarding task reconfigurations in Copycat can deadlock with rebalances and has no backoff

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991949#comment-14991949 ] ASF GitHub Bot commented on KAFKA-2743: --- Github user asfgit closed the pull request at:

Re: New and updated producers and consumers

2015-11-05 Thread Prabhjot Bharaj
Hello Folks, Requesting your expertise on this. I see that under core/src/main/scala/kafka/producer/, there are many implementations - Producer.scala and SyncProducer.scala Also, going via the producerPerformance.scala, there are 2 implementations - NewShinyProducer (which points to

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992063#comment-14992063 ] ASF GitHub Bot commented on KAFKA-2702: --- Github user granthenke closed the pull request at:

[GitHub] kafka pull request: KAFKA-2702: ConfigDef toHtmlTable() sorts in a...

2015-11-05 Thread granthenke
GitHub user granthenke reopened a pull request: https://github.com/apache/kafka/pull/379 KAFKA-2702: ConfigDef toHtmlTable() sorts in a way that is a bit conf… …using You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request: KAFKA-2741: Make SourceTaskContext and SinkTas...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/420 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request: KAFKA-2748: Ensure sink tasks commit offsets u...

2015-11-05 Thread ewencp
GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/431 KAFKA-2748: Ensure sink tasks commit offsets upon rebalance and rewind if the SinkTask flush fails. Also fix the incorrect consumer group ID setting which was giving each task its own group

[GitHub] kafka pull request: KAFKA-2702: ConfigDef toHtmlTable() sorts in a...

2015-11-05 Thread granthenke
Github user granthenke closed the pull request at: https://github.com/apache/kafka/pull/379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992064#comment-14992064 ] ASF GitHub Bot commented on KAFKA-2702: --- GitHub user granthenke reopened a pull request:

[jira] [Commented] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992060#comment-14992060 ] ASF GitHub Bot commented on KAFKA-2748: --- GitHub user ewencp opened a pull request:

[jira] [Commented] (KAFKA-2572) zk connection instability

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992082#comment-14992082 ] ASF GitHub Bot commented on KAFKA-2572: --- GitHub user ewencp opened a pull request:

Re: New and updated producers and consumers

2015-11-05 Thread Cliff Rhyne
Hi Jeff, Is there a writeup of how to use the new consumer API (either in general or for Java)? I've seen various proposals but I don't see a recent one on the actual implementation. My team wants to start the development work to migrate to 0.9. Thanks, Cliff On Thu, Nov 5, 2015 at 11:18 AM,

Build failed in Jenkins: kafka-trunk-jdk8 #102

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2753: improve SyncGroup error handling in client -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-5 (docker

Jenkins build is back to normal : kafka-trunk-jdk7 #763

2015-11-05 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-1605) Producer should not require metadata.broker.list

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1605. Resolution: Won't Fix > Producer should not require metadata.broker.list >

[GitHub] kafka pull request: MINOR: follow-up KAFKA-2730 to use two tags fo...

2015-11-05 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/434 MINOR: follow-up KAFKA-2730 to use two tags for broker id and fetcher id combination You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

2015-11-05 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992208#comment-14992208 ] Jiangjie Qin commented on KAFKA-2350: - [~hachikuji] [~guozhang] I noticed that currently if we pause a

[jira] [Resolved] (KAFKA-1575) Topic Hierarchy

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1575. Resolution: Duplicate > Topic Hierarchy > --- > > Key: KAFKA-1575 >

[jira] [Resolved] (KAFKA-1520) Tools for contributors

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-1520. Resolution: Fixed This is resolved by the new Github pull request process and maintaining docs in

[jira] [Updated] (KAFKA-2754) Support defining ACLs at topic creation time

2015-11-05 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated KAFKA-2754: - Description: With a secured kafka cluster we want to be able have certain users create topics

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992391#comment-14992391 ] Grant Henke commented on KAFKA-2424: It was on the basis that both are static code/style analysis and

[jira] [Commented] (KAFKA-2730) partition-reassignment tool stops working due to error in registerMetric

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992392#comment-14992392 ] ASF GitHub Bot commented on KAFKA-2730: --- GitHub user guozhangwang opened a pull request:

Build failed in Jenkins: kafka-trunk-jdk8 #101

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2748: Ensure sink tasks commit offsets upon rebalance and rewind -- [...truncated 389 lines...] [ant:scaladoc] ^ [ant:scaladoc]

Re: New and updated producers and consumers

2015-11-05 Thread Prabhjot Bharaj
Hi Jeff, Thanks for your response. On scala side, is there a Producer implementation that I could use? is the java based KafkaProducer (org.apache.kafka.clients.producer.KafkaProducer;) same as Producer in Producer.scala ? Thanks, Prabhjot On Thu, Nov 5, 2015 at 11:28 PM, Jeff Holoman

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992357#comment-14992357 ] Guozhang Wang commented on KAFKA-2350: -- Could this be resolved by calling {code}

[jira] [Resolved] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2748. -- Resolution: Fixed Issue resolved by pull request 431 [https://github.com/apache/kafka/pull/431]

[jira] [Commented] (KAFKA-2748) SinkTasks do not handle rebalances and offset commit properly

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992140#comment-14992140 ] ASF GitHub Bot commented on KAFKA-2748: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2748: Ensure sink tasks commit offsets u...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/431 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992160#comment-14992160 ] ASF GitHub Bot commented on KAFKA-2753: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2753. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 433

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-11-05 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992363#comment-14992363 ] Ashish K Singh commented on KAFKA-2077: --- Hey guys, this seems to be interesting. Is anyone,

[jira] [Commented] (KAFKA-2423) Introduce Scalastyle

2015-11-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992390#comment-14992390 ] Ismael Juma commented on KAFKA-2423: My understanding is that this is something we want to do, but the

[jira] [Commented] (KAFKA-2753) Improve SyncGroup error handling in AbstractCoordinator

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992136#comment-14992136 ] ASF GitHub Bot commented on KAFKA-2753: --- GitHub user hachikuji opened a pull request:

[GitHub] kafka pull request: KAFKA-2753: improve SyncGroup error handling i...

2015-11-05 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/433 KAFKA-2753: improve SyncGroup error handling in client You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-2753

[GitHub] kafka pull request: KAFKA-2753: improve SyncGroup error handling i...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/433 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Debug kafka code in intellij

2015-11-05 Thread Prabhjot Bharaj
Hello Folks, Requesting your expertise on this Thanks, Prabhjot On Thu, Nov 5, 2015 at 4:46 PM, Prabhjot Bharaj wrote: > Hi, > > I'm using kafka 0.8.2.1 version with IntelliJ. > Sometimes, I change the code and build it using this command: > > ./gradlew

[jira] [Created] (KAFKA-2754) Support defining ACLs at topic creation time

2015-11-05 Thread Thomas Graves (JIRA)
Thomas Graves created KAFKA-2754: Summary: Support defining ACLs at topic creation time Key: KAFKA-2754 URL: https://issues.apache.org/jira/browse/KAFKA-2754 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-2754) Support defining ACLs at topic creation time

2015-11-05 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Brahmbhatt reassigned KAFKA-2754: --- Assignee: Parth Brahmbhatt > Support defining ACLs at topic creation time >

[jira] [Commented] (KAFKA-2423) Introduce Scalastyle

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992334#comment-14992334 ] Grant Henke commented on KAFKA-2423: Are we sill thinking of applying something like this after the

[jira] [Resolved] (KAFKA-2424) Consider introducing lint-like tool for Scala

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2424. Resolution: Duplicate > Consider introducing lint-like tool for Scala >

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

2015-11-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992386#comment-14992386 ] Ismael Juma commented on KAFKA-2424: I'm not sure this is a duplicate. Can you please explain the

[jira] [Commented] (KAFKA-2702) ConfigDef toHtmlTable() sorts in a way that is a bit confusing

2015-11-05 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992387#comment-14992387 ] Grant Henke commented on KAFKA-2702: I have updated the pull request based on all discussion above.

[jira] [Commented] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992681#comment-14992681 ] Guozhang Wang commented on KAFKA-2756: -- Thanks for the patch [~mbr...@blackberry.com] LGTM. Just

[GitHub] kafka pull request: KAFKA-2756: Use request version Id instead of ...

2015-11-05 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/438 KAFKA-2756: Use request version Id instead of latest version Id to parse the corresponding response. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-2730) partition-reassignment tool stops working due to error in registerMetric

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992719#comment-14992719 ] ASF GitHub Bot commented on KAFKA-2730: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992686#comment-14992686 ] Gwen Shapira commented on KAFKA-2751: - [~lindong], in 0.9 the configuration docs will be

[GitHub] kafka pull request: MINOR: follow-up KAFKA-2730 to use two tags fo...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/434 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request: MINOR: KAFKA-2751 Improve documentation for lo...

2015-11-05 Thread lindong28
Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/437 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992771#comment-14992771 ] ASF GitHub Bot commented on KAFKA-2751: --- Github user lindong28 closed the pull request at:

[GitHub] kafka pull request: KAFKA-2745: Update JavaDoc for new / updated c...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-2745) Update JavaDoc for the new / updated APIs

2015-11-05 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-2745. - Resolution: Fixed Issue resolved by pull request 425 [https://github.com/apache/kafka/pull/425]

[jira] [Commented] (KAFKA-2745) Update JavaDoc for the new / updated APIs

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992804#comment-14992804 ] ASF GitHub Bot commented on KAFKA-2745: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2756: - Assignee: Matthew Bruce (was: Guozhang Wang) > Replication Broken between Kafka 0.8.2.1 and 0.9

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2756: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992727#comment-14992727 ] ASF GitHub Bot commented on KAFKA-2756: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2756: Use request version Id instead of ...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/438 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2350) Add KafkaConsumer pause capability

2015-11-05 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992452#comment-14992452 ] Jiangjie Qin commented on KAFKA-2350: - Ah, right. That would work. It still a bit weird we commit the

[jira] [Updated] (KAFKA-2750) Sender.java: handleProduceResponse does not check protocol version

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2750: - Affects Version/s: 0.10.0.0 > Sender.java: handleProduceResponse does not check protocol version

[GitHub] kafka pull request: KAFKA-2755: NPE thrown while handling Describe...

2015-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2755. -- Resolution: Fixed Fix Version/s: 0.9.0.0 Issue resolved by pull request 435

[jira] [Commented] (KAFKA-2721) Avoid handling duplicate LeaderAndISR requests

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992520#comment-14992520 ] ASF GitHub Bot commented on KAFKA-2721: --- GitHub user lindong28 opened a pull request:

Build failed in Jenkins: kafka-trunk-jdk8 #103

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2755: Suspicious reference forwarding cause NPE on [wangguoz] KAFKA-2735: BrokerEndPoint should support uppercase hostnames. -- Started by an SCM change

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Matthew Bruce (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Bruce updated KAFKA-2756: - Affects Version/s: 0.9.0.0 Status: Patch Available (was: Open) diff --git

[jira] [Assigned] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-2751: --- Assignee: Dong Lin > Documentation for retention.ms is confusing >

[jira] [Commented] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992651#comment-14992651 ] ASF GitHub Bot commented on KAFKA-2751: --- GitHub user lindong28 opened a pull request:

[GitHub] kafka pull request: MINOR: KAFKA-2751 Improve documentation for lo...

2015-11-05 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/437 MINOR: KAFKA-2751 Improve documentation for log.retention.ms You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-2751

Kafka retention anomaly when restoring a broker

2015-11-05 Thread Justin Venus
TL;DR broker replication should preserve file create time. My colleagues and I stumbled on an interesting issue in production. We use a time based retention policy instead of a size based policy and this normally works great (60 hours retention). A few days ago we rebuilt a broker (os

[jira] [Updated] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2756: Priority: Blocker (was: Major) > Replication Broken between Kafka 0.8.2.1 and 0.9 -

[jira] [Resolved] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-2751. - Resolution: Won't Fix > Documentation for retention.ms is confusing >

[jira] [Commented] (KAFKA-2751) Documentation for retention.ms is confusing

2015-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992772#comment-14992772 ] Dong Lin commented on KAFKA-2751: - [~gwenshap] Ah I forgot that patch. Thanks for letting me know. >

Build failed in Jenkins: kafka-trunk-jdk7 #765

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: follow-up KAFKA-2730 to use two tags for broker id and fetcher id [wangguoz] KAFKA-2756: Use request version Id instead of latest version Id to parse -- Started

Build failed in Jenkins: kafka-trunk-jdk7 #764

2015-11-05 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2755: Suspicious reference forwarding cause NPE on [wangguoz] KAFKA-2735: BrokerEndPoint should support uppercase hostnames. -- Started by an SCM change

[jira] [Commented] (KAFKA-2424) Consider introducing lint-like tool for Scala

2015-11-05 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992398#comment-14992398 ] Ismael Juma commented on KAFKA-2424: I think there's some overlap, but they tend to capture different

[GitHub] kafka pull request: KAFKA-2755: NPE thrown while handling Describe...

2015-11-05 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/435 KAFKA-2755: NPE thrown while handling DescribeGroup request for non-e… …xistent consumer group You can merge this pull request into a Git repository by running: $ git pull

RE: Replication Broken between Kafka 0.8.2.1 and 0.9 (trunk)

2015-11-05 Thread Matthew Bruce
Hi Grant, Creating a patch for this issue actually wasn't a whole lot of work. I've uploaded one to the JIRA ticket. Thanks, Matt -Original Message- From: Matthew Bruce Sent: Thursday, November 5, 2015 3:52 PM To: 'dev@kafka.apache.org' Subject: RE: Replication

[jira] [Commented] (KAFKA-2755) NPE thrown while handling DescribeGroup request for non-existent consumer group

2015-11-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992408#comment-14992408 ] ASF GitHub Bot commented on KAFKA-2755: --- GitHub user SinghAsDev opened a pull request:

[jira] [Created] (KAFKA-2757) Consoliate BrokerEndPoint and EndPoint

2015-11-05 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2757: Summary: Consoliate BrokerEndPoint and EndPoint Key: KAFKA-2757 URL: https://issues.apache.org/jira/browse/KAFKA-2757 Project: Kafka Issue Type: Bug

[jira] [Assigned] (KAFKA-2756) Replication Broken between Kafka 0.8.2.1 and 0.9 - NetworkClient.java uses wrong protocol version

2015-11-05 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-2756: Assignee: Guozhang Wang > Replication Broken between Kafka 0.8.2.1 and 0.9 -

  1   2   >