[jira] [Updated] (KAFKA-1861) Publishing kafka-client:test in order to utilize the helper utils in TestUtils

2015-01-21 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1861: --- Attachment: KAFKA-1861.patch Publishing kafka-client:test in order to utilize the helper

Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-21 Thread Jason Rosenberg
For the maven artifacts listed above, there doesn't seem to be any distinction between rc1 or rc2, so is it assumed that this is release2 here?: https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka_2.11/0.8.2.0/ Thanks! Jason On Wed, Jan 21, 2015 at 8:28 AM, Jun Rao

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Attachment: refactor-scripts-v1.patch Refactor shell wrapper scripts

Re: Kafka ecosystem licensing question

2015-01-21 Thread Jonathan Natkins
Hi Eliot, I can't speak for the Kafka PMC, but as a general rule, if the code is going to be contributed to the Kafka project itself, it must be Apache-licensed. What you can do, and what many organizations do is release code separately via a public Github account, which would allow you to choose

[jira] [Commented] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-01-21 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285979#comment-14285979 ] Andrii Biletskyi commented on KAFKA-1845: - In uploaded patch (KAFKA-1845.patch)

[jira] [Comment Edited] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286097#comment-14286097 ] Francois Saint-Jacques edited comment on KAFKA-1889 at 1/21/15 7:18 PM:

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2015-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286029#comment-14286029 ] Guozhang Wang commented on KAFKA-1782: -- Jeff, Sorry for getting late on this. I

[jira] [Created] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created KAFKA-1889: - Summary: Refactor shell wrapper scripts Key: KAFKA-1889 URL: https://issues.apache.org/jira/browse/KAFKA-1889 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-1804) Kafka network thread lacks top exception handler

2015-01-21 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Ozeritskiy updated KAFKA-1804: - Priority: Critical (was: Major) Kafka network thread lacks top exception handler

[jira] [Commented] (KAFKA-1861) Publishing kafka-client:test in order to utilize the helper utils in TestUtils

2015-01-21 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285995#comment-14285995 ] Manikumar Reddy commented on KAFKA-1861: Can we include this simple patch to

[jira] [Commented] (KAFKA-1861) Publishing kafka-client:test in order to utilize the helper utils in TestUtils

2015-01-21 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285990#comment-14285990 ] Manikumar Reddy commented on KAFKA-1861: Created reviewboard

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-21 Thread Jiangjie Qin
Hi Gwen, Please see inline answers. I¹ll update them in the KIP as well. Thanks. Jiangjie (Becket) Qin On 1/20/15, 6:39 PM, Gwen Shapira gshap...@cloudera.com wrote: Thanks for the detailed document, Jiangjie. Super helpful. Few questions: 1. You mention that A ConsumerRebalanceListener

[jira] [Commented] (KAFKA-1804) Kafka network thread lacks top exception handler

2015-01-21 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286162#comment-14286162 ] Sriharsha Chintalapani commented on KAFKA-1804: --- [~jjkoshy] [~aozeritsky]

[jira] [Commented] (KAFKA-1728) update 082 docs

2015-01-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286158#comment-14286158 ] Jun Rao commented on KAFKA-1728: Thanks for the patch for missing configs . +1 and

Review Request 30128: Patch for KAFKA-1861

2015-01-21 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30128/ --- Review request for kafka. Bugs: KAFKA-1861

Review Request 30126: Patch for KAFKA-1845

2015-01-21 Thread Andrii Biletskyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30126/ --- Review request for kafka. Bugs: KAFKA-1845

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286006#comment-14286006 ] Francois Saint-Jacques commented on KAFKA-1889: --- I have multiple other

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Assignee: Francois Saint-Jacques Status: Patch Available (was: Open)

[jira] [Updated] (KAFKA-1845) KafkaConfig should use ConfigDef

2015-01-21 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-1845: Status: Patch Available (was: Open) KafkaConfig should use ConfigDef

[jira] [Updated] (KAFKA-1861) Publishing kafka-client:test in order to utilize the helper utils in TestUtils

2015-01-21 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1861: --- Assignee: Manikumar Reddy Status: Patch Available (was: Open) Publishing

[jira] [Commented] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286097#comment-14286097 ] Francois Saint-Jacques commented on KAFKA-1889: --- The second patch should

Re: [VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-21 Thread Jun Rao
That's right. What's in maven staging is always for the latest RC being voted. The stuff in maven staging will be promoted to maven central once the vote passes. Thanks, Jun On Wed, Jan 21, 2015 at 10:35 AM, Jason Rosenberg j...@squareup.com wrote: For the maven artifacts listed above, there

[jira] [Updated] (KAFKA-1889) Refactor shell wrapper scripts

2015-01-21 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated KAFKA-1889: -- Attachment: refactor-scripts-v2.patch Refactor shell wrapper scripts

[jira] [Updated] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2015-01-21 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1367: - Fix Version/s: 0.8.3 Broker topic metadata not kept in sync with ZooKeeper

[VOTE] 0.8.2.0 Candidate 2 (with the correct links)

2015-01-21 Thread Jun Rao
This is the second candidate for release of Apache Kafka 0.8.2.0. There has been some changes since the 0.8.2 beta release, especially in the new java producer api and jmx mbean names. It would be great if people can test this out thoroughly. Release Notes for the 0.8.2.0 release

Re: [kafka-clients] [VOTE] 0.8.2.0 Candidate 2

2015-01-21 Thread Manikumar Reddy
Ok, got it. Link is different from Release Candidate 1. On Wed, Jan 21, 2015 at 10:01 PM, Jun Rao j...@confluent.io wrote: Is it? You just need to navigate into org, then apache, then kafka, etc. Thanks, Jun On Wed, Jan 21, 2015 at 8:28 AM, Manikumar Reddy ku...@nmsworks.co.in wrote:

Re: Review Request 27799: New consumer

2015-01-21 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/ --- (Updated Jan. 21, 2015, 4:42 p.m.) Review request for kafka. Summary

Re: [kafka-clients] [VOTE] 0.8.2.0 Candidate 2

2015-01-21 Thread Jun Rao
Is it? You just need to navigate into org, then apache, then kafka, etc. Thanks, Jun On Wed, Jan 21, 2015 at 8:28 AM, Manikumar Reddy ku...@nmsworks.co.in wrote: Also Maven artifacts link is not correct On Wed, Jan 21, 2015 at 9:50 PM, Jun Rao j...@confluent.io wrote: Yes, will send out a

Re: Review Request 27799: Patch for KAFKA-1760

2015-01-21 Thread Jay Kreps
On Jan. 13, 2015, 10:32 p.m., Onur Karaman wrote: clients/src/main/java/org/apache/kafka/clients/ClientRequest.java, lines 34-37 https://reviews.apache.org/r/27799/diff/2/?file=816201#file816201line34 It looks like you'd want to replace the attachment docs with new callback

Re: Review Request 27799: New consumer

2015-01-21 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/ --- (Updated Jan. 21, 2015, 4:47 p.m.) Review request for kafka. Bugs:

Kafka ecosystem licensing question

2015-01-21 Thread Weitz, Eliot
Hello, I lead a group of developers at our company, ViaSat, who are building a set of stream processing services on top of Kafka. We would very much like to open source our work and become part of the Kafka “ecosystem” contributing back to the community. Our company is fairly new to

Re: [kafka-clients] [VOTE] 0.8.2.0 Candidate 2

2015-01-21 Thread Manikumar Reddy
Also Maven artifacts link is not correct On Wed, Jan 21, 2015 at 9:50 PM, Jun Rao j...@confluent.io wrote: Yes, will send out a new email with the correct links. Thanks, Jun On Wed, Jan 21, 2015 at 3:12 AM, Manikumar Reddy ku...@nmsworks.co.in wrote: All links are pointing to

[jira] [Issue Comment Deleted] (KAFKA-1664) Kafka does not properly parse multiple ZK nodes with non-root chroot

2015-01-21 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated KAFKA-1664: -- Comment: was deleted (was: Testing file

Re: [kafka-clients] [VOTE] 0.8.2.0 Candidate 2

2015-01-21 Thread Jun Rao
Yes, will send out a new email with the correct links. Thanks, Jun On Wed, Jan 21, 2015 at 3:12 AM, Manikumar Reddy ku...@nmsworks.co.in wrote: All links are pointing to https://people.apache.org/~junrao/kafka-0.8.2.0-candidate1/. They should be

[jira] [Updated] (KAFKA-1760) Implement new consumer client

2015-01-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1760: - Attachment: KAFKA-1760_2015-01-21_08:42:20.patch Implement new consumer client

[jira] [Commented] (KAFKA-1760) Implement new consumer client

2015-01-21 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285851#comment-14285851 ] Jay Kreps commented on KAFKA-1760: -- Updated reviewboard

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-21 Thread Gwen Shapira
Thanks for the answers. Much clearer now :) Unrelated question: How do you test MirrorMaker (especially around data loss)? I didn't see any unit-tests or integration tests in trunk. Gwen On Wed, Jan 21, 2015 at 9:55 AM, Jiangjie Qin j...@linkedin.com.invalid wrote: Hi Gwen, Please see inline

[jira] [Commented] (KAFKA-1886) SimpleConsumer swallowing ClosedByInterruptException

2015-01-21 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286326#comment-14286326 ] Chris Riccomini commented on KAFKA-1886: IMO, the SimpleConsumer should at least

Re: [DISCUSS] KIPs

2015-01-21 Thread Jay Kreps
Hey Gwen, Could we get the actual changes in that KIP? I.e. changes to metadata request, changes to UpdateMetadataRequest, new configs and what will their valid values be, etc. This kind of says that those things will change but doesn't say what they will change to... -Jay On Mon, Jan 19, 2015

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-21 Thread Jiangjie Qin
Currently it is a manual process. For functional test, I just setup two Kafka clusters locally, mirror between them and keep producing data to one of the cluster. Then try a hard kill / bounce mirror maker to see if messages are lost in target cluster. Jiangjie (Becket) Qin On 1/21/15, 12:24 PM,

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-21 Thread Jay Kreps
Hey guys, A couple questions/comments: 1. The callback and user-controlled commit offset functionality is already in the new consumer which we are working on in parallel. If we accelerated that work it might help concentrate efforts. I admit this might take slightly longer in calendar time but

[jira] [Commented] (KAFKA-1886) SimpleConsumer swallowing ClosedByInterruptException

2015-01-21 Thread Aditya A Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286287#comment-14286287 ] Aditya A Auradkar commented on KAFKA-1886: -- [~junrao] any thoughts?

NIO and Threading implementation

2015-01-21 Thread Chittaranjan Hota
Hello, Congratulations to the folks behind kafka. Its has been a smooth ride dealing with multi TB data when the same set up in JMS fell apart often. Although I have been using kafka for more than a few days now, started looking into the code base since yesterday and already have doubts at the

Re: [kafka-clients] Re: Heads up: KAFKA-1697 - remove code related to ack1 on the broker

2015-01-21 Thread Gwen Shapira
We have the new warning in 0.8.2. I updated KIP-1 with the new plan: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1+-+Remove+support+of+request.required.acks I'm waiting a day for additional discussion and if there are no replies, I'll send the [VOTE] email. Gwen On Mon, Jan 19, 2015

Re: Review Request 29728: Patch for KAFKA-1848

2015-01-21 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29728/#review69107 --- Ship it! Ship It! - Guozhang Wang On Jan. 8, 2015, 10:49 p.m.,

[jira] [Commented] (KAFKA-1697) remove code related to ack1 on the broker

2015-01-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286676#comment-14286676 ] Jun Rao commented on KAFKA-1697: From the discussion in the mailing list, we decided not

Re: Review Request 27391: Fix KAFKA-1634

2015-01-21 Thread Guozhang Wang
On Jan. 20, 2015, 4:35 p.m., Joel Koshy wrote: core/src/main/scala/kafka/server/KafkaApis.scala, line 147 https://reviews.apache.org/r/27391/diff/8/?file=822017#file822017line147 I just realized that if we have a v0 or v1 request then we use the offset manager default retention

[jira] [Commented] (KAFKA-1697) remove code related to ack1 on the broker

2015-01-21 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286696#comment-14286696 ] Gwen Shapira commented on KAFKA-1697: - Updated! remove code related to ack1 on the

Re: Review Request 30126: Patch for KAFKA-1845

2015-01-21 Thread Eric Olander
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30126/#review69063 --- core/src/main/scala/kafka/server/KafkaConfig.scala

[jira] [Commented] (KAFKA-1782) Junit3 Misusage

2015-01-21 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286491#comment-14286491 ] Jeff Holoman commented on KAFKA-1782: - Thank you for the feedback [~guozhang]. I will

[jira] [Commented] (KAFKA-1729) add doc for Kafka-based offset management in 0.8.2

2015-01-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286651#comment-14286651 ] Jun Rao commented on KAFKA-1729: [~jjkoshy], are you on track to complete the doc for the

Re: Review Request 27391: Fix KAFKA-1634

2015-01-21 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27391/ --- (Updated Jan. 22, 2015, 12:43 a.m.) Review request for kafka. Bugs:

[jira] [Commented] (KAFKA-1634) Improve semantics of timestamp in OffsetCommitRequests and update documentation

2015-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286662#comment-14286662 ] Guozhang Wang commented on KAFKA-1634: -- Updated reviewboard

[jira] [Updated] (KAFKA-1634) Improve semantics of timestamp in OffsetCommitRequests and update documentation

2015-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1634: - Attachment: KAFKA-1634_2015-01-21_16:43:01.patch Improve semantics of timestamp in

[DISCUSS] KIP-6 - New reassignment partition logic for re-balancing

2015-01-21 Thread Joe Stein
Posted a KIP for --re-balance for partition assignment in reassignment tool. https://cwiki.apache.org/confluence/display/KAFKA/KIP-6+-+New+reassignment+partition+logic+for+re-balancing JIRA https://issues.apache.org/jira/browse/KAFKA-1792 While going through the KIP I thought of one thing from

[DISCUSS] KIP-8 - Decommission a broker

2015-01-21 Thread Joe Stein
Hi, created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Decommission+a+broker JIRA related https://issues.apache.org/jira/browse/KAFKA-1753 I took out the compatibility, migration section since this is new behavior. If anyone can think of any we should add it back in.

[jira] [Commented] (KAFKA-1848) Checking shutdown during each iteration of ZookeeperConsumerConnector

2015-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286734#comment-14286734 ] Guozhang Wang commented on KAFKA-1848: -- Pushed to trunk, thanks. Checking shutdown

[jira] [Resolved] (KAFKA-1848) Checking shutdown during each iteration of ZookeeperConsumerConnector

2015-01-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1848. -- Resolution: Fixed Checking shutdown during each iteration of ZookeeperConsumerConnector

Jenkins build is back to normal : Kafka-trunk #376

2015-01-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/376/changes

Re: Review Request 27799: New consumer

2015-01-21 Thread Jaikiran Pai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/#review69121 --- clients/src/main/java/org/apache/kafka/clients/NetworkClient.java

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-01-21 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286967#comment-14286967 ] Ewen Cheslack-Postava commented on KAFKA-1835: -- [~ppearcy] these are easier

[DISCUSS] KIP-5 - Broker Configuration Management

2015-01-21 Thread Joe Stein
Created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-5+-+Broker+Configuration+Management JIRA https://issues.apache.org/jira/browse/KAFKA-1786 /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC

[DISCUSS] KIP-4 - Command line and centralized administrative operations

2015-01-21 Thread Joe Stein
Hi, created a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-4+-+Command+line+and+centralized+administrative+operations JIRA https://issues.apache.org/jira/browse/KAFKA-1694 /*** Joe Stein Founder, Principal Consultant Big Data Open Source

Re: NIO and Threading implementation

2015-01-21 Thread Chittaranjan Hota
Thanks for your comments Jay. Quote Technically startup is not called from multiple threads but the classes correctness should not depended on the current usage so it should work correctly if it were. -- If this were a requirement then one can see that many methods are NOT thread safe while the

Re: [KIP-DISCUSSION] Mirror Maker Enhancement

2015-01-21 Thread Jiangjie Qin
Hi Jay, Thanks for comments. Please see inline responses. Jiangjie (Becket) Qin On 1/21/15, 1:33 PM, Jay Kreps jay.kr...@gmail.com wrote: Hey guys, A couple questions/comments: 1. The callback and user-controlled commit offset functionality is already in the new consumer which we are working

[KIP-DISCUSSION] KIP-7 Security - IP Filtering

2015-01-21 Thread Jeff Holoman
Posted a KIP for IP Filtering: https://cwiki.apache.org/confluence/display/KAFKA/KIP-7+-+Security+-+IP+Filtering Relevant JIRA: https://issues.apache.org/jira/browse/KAFKA-1810 Appreciate any feedback. Thanks Jeff

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-01-21 Thread Paul Pearcy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286816#comment-14286816 ] Paul Pearcy commented on KAFKA-1835: Do I need to do anything else to get this in the

[jira] [Commented] (KAFKA-1810) Add IP Filtering / Whitelists-Blacklists

2015-01-21 Thread Jeff Holoman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286741#comment-14286741 ] Jeff Holoman commented on KAFKA-1810: - The current plan is to rework the configuration

[jira] [Commented] (KAFKA-1634) Improve semantics of timestamp in OffsetCommitRequests and update documentation

2015-01-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286763#comment-14286763 ] Jun Rao commented on KAFKA-1634: I guess you mean rebasing KAFAK-1841, instead of

Re: Review Request 27391: Fix KAFKA-1634

2015-01-21 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27391/#review69106 --- Thanks for the patch. A few more comments.

Re: Review Request 27799: New consumer

2015-01-21 Thread Jaikiran Pai
On Jan. 22, 2015, 3:14 a.m., Jaikiran Pai wrote: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java, line 253 https://reviews.apache.org/r/27799/diff/4/?file=828376#file828376line253 Hi Jay, I think doing this unmuteAll in a finally block might be a good

Re: [DISCUSS] KIPs

2015-01-21 Thread Gwen Shapira
Good point :) I added the specifics of the new UpdateMetadataRequest, which is the only protocol bump in this change. Highlighted the broker and producer/consumer configuration changes, added some example values and added the new zookeeper json. Hope this makes things clearer. On Wed, Jan 21,

Re: Review Request 27799: New consumer

2015-01-21 Thread Onur Karaman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27799/#review69117 ---

[jira] [Updated] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-01-21 Thread Paul Pearcy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Pearcy updated KAFKA-1835: --- Attachment: KAFKA-1835.patch Kafka new producer needs options to make blocking behavior explicit

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-01-21 Thread Paul Pearcy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287035#comment-14287035 ] Paul Pearcy commented on KAFKA-1835: Created reviewboard

[jira] [Commented] (KAFKA-1835) Kafka new producer needs options to make blocking behavior explicit

2015-01-21 Thread Paul Pearcy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287042#comment-14287042 ] Paul Pearcy commented on KAFKA-1835: Thanks Ewan. I created a review, added your

Review Request 30158: Patch for KAFKA-1835

2015-01-21 Thread Paul Pearcy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30158/ --- Review request for kafka. Bugs: KAFKA-1835

[jira] [Updated] (KAFKA-1728) update 082 docs

2015-01-21 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1728: --- Attachment: missing-config-props-0.8.2.patch Uploaded a patch to add missing config