Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/ --- (Updated Sept. 22, 2014, 5:59 a.m.) Review request for kafka. Repository:

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Attachment: KAFKA-1555.1.patch Sorry, first patch was missing a file. provide strong consistency

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Status: Patch Available (was: Open) provide strong consistency with reasonable availability

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142967#comment-14142967 ] Sriram Subramanian commented on KAFKA-1555: --- Sorry to be late here but I think

[jira] [Commented] (KAFKA-977) Implement generation/term per leader to reconcile messages correctly

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142990#comment-14142990 ] Sriram Subramanian commented on KAFKA-977: -- I would like to bring this issue to

[jira] [Commented] (KAFKA-1034) Improve partition reassignment to optimize writes to zookeeper

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142999#comment-14142999 ] Sriram Subramanian commented on KAFKA-1034: --- At the high level, we were making

[jira] [Assigned] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-09-22 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov reassigned KAFKA-1644: -- Assignee: Anton Karamanov Inherit FetchResponse from RequestOrResponse

[jira] [Updated] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-09-22 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1644: --- Attachment: 0001-KAFKA-1644-Inherit-FetchResponse-from-RequestOrRespo.patch Inherit

[jira] [Commented] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-09-22 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143112#comment-14143112 ] Anton Karamanov commented on KAFKA-1644: Here's a

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2014-09-22 Thread Magnus Edenhill (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143218#comment-14143218 ] Magnus Edenhill commented on KAFKA-1367: Apart from supplying the ISR count and

[jira] [Resolved] (KAFKA-1034) Improve partition reassignment to optimize writes to zookeeper

2014-09-22 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-1034. -- Resolution: Won't Fix Improve partition reassignment to optimize writes to zookeeper

[jira] [Commented] (KAFKA-1034) Improve partition reassignment to optimize writes to zookeeper

2014-09-22 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143326#comment-14143326 ] Neha Narkhede commented on KAFKA-1034: -- We need to move to batch ZK writes which is

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143352#comment-14143352 ] Gwen Shapira commented on KAFKA-1555: - Hi Sriram, Thank you for raising these

[jira] [Commented] (KAFKA-1590) Binarize trace level request logging along with debug level text logging

2014-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143360#comment-14143360 ] Guozhang Wang commented on KAFKA-1590: -- [~jkreps] agreed, binary log files should

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143383#comment-14143383 ] Guozhang Wang commented on KAFKA-1305: -- Thanks [~becket_qin] for the great findings.

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2014-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143413#comment-14143413 ] Guozhang Wang commented on KAFKA-1367: -- Hello [~edenhill], I think your use case may

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143486#comment-14143486 ] Joe Stein commented on KAFKA-1555: -- [~gwenshap] thanks for the patch! few initial

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-09-22 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143500#comment-14143500 ] Otis Gospodnetic commented on KAFKA-1481: - This is [~junrao]'s new suggestion for

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143501#comment-14143501 ] Gwen Shapira commented on KAFKA-1555: - There is a review board

[jira] [Comment Edited] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143521#comment-14143521 ] Joe Stein edited comment on KAFKA-1555 at 9/22/14 5:51 PM: --- ah,

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143521#comment-14143521 ] Joe Stein commented on KAFKA-1555: -- ah, my bad. Any suggestions regarding the problem

[jira] [Updated] (KAFKA-847) kafka appender layout does not work for kafka 0.7.1

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-847: Fix Version/s: 0.8.2 kafka appender layout does not work for kafka 0.7.1

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143578#comment-14143578 ] Sriram Subramanian commented on KAFKA-1555: --- [~gwenshap] A key thing I would

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143622#comment-14143622 ] Joe Stein commented on KAFKA-1555: -- I agree with [~gwenshap] A business case for this

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143628#comment-14143628 ] Sriram Subramanian commented on KAFKA-1555: --- Surviving the leader crash makes

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143701#comment-14143701 ] Joe Stein commented on KAFKA-1555: -- I am more interested in being able to specify why 2

[jira] [Comment Edited] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143701#comment-14143701 ] Joe Stein edited comment on KAFKA-1555 at 9/22/14 8:03 PM: --- I

Re: Review Request 22131: Patch for KAFKA-1477

2014-09-22 Thread Rajasekar Elango
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/22131/#review54191 --- config/server.properties

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

2014-09-22 Thread Rajasekar Elango (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143826#comment-14143826 ] Rajasekar Elango commented on KAFKA-1477: - [~lagivan] Thanks for picking this up.

Handling errors in the new (0.8.2) Java Client's Producer

2014-09-22 Thread Andrew Stein
Using the new (0.8.2) KafkaProducer interface, if the Kafka server goes down, how can one stop future attempts to write messages that have been sent to the producer? This is the TLDR of the post. The rest is detail... Background == We have a process in a large application that writes a

Offset manager movement (due to change in KAFKA-1469)

2014-09-22 Thread Joel Koshy
I just wanted to send this out as an FYI but it does not affect any released versions. This only affects those who release off trunk and use Kafka-based consumer offset management. KAFKA-1469 fixes an issue in our Utils.abs code. Since we use this method in determining the offset manager for a

[jira] [Updated] (KAFKA-1469) Util.abs function does not return correct absolute values for negative values

2014-09-22 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1469: -- Description: Reported by Russell Melick. [edit1: I don't think this affects correctness of the places

Apache Kafka Meetup = Strata Hadoop World = NYC

2014-09-22 Thread Joe Stein
Hey folks, we are going to be kicking off our first ever Apache Kafka NYC meetup during Hadoop world (10/15/2014) http://www.meetup.com/Apache-Kafka-NYC/events/206001372/ starting @ 6pm. We already have 3 (maybe 4) speakers ready to go (I will be updating the site over the next day or so). I was

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/ --- (Updated Sept. 23, 2014, 12:05 a.m.) Review request for kafka. Changes

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Attachment: KAFKA-1555.2.patch provide strong consistency with reasonable availability

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144101#comment-14144101 ] Gwen Shapira commented on KAFKA-1555: - Uploaded an updated patch addressing

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2014-09-22 Thread Dan Hoffman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144108#comment-14144108 ] Dan Hoffman commented on KAFKA-1367: I'd also add that having the broker being able to

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/ --- (Updated Sept. 23, 2014, 12:28 a.m.) Review request for kafka. Repository:

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Attachment: KAFKA-1555.3.patch Removed the warning from appendToLocalLog since the exception won't

Re: Kafka Security

2014-09-22 Thread Joe Stein
At the request of the folks that were at the first meeting and can't attend tomorrow I am moving tomorrow's meeting to next Tuesday (same bat time, same bat channel). /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC

[jira] [Updated] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1618: -- Status: Patch Available (was: In Progress) Exception thrown when running console producer

[jira] [Updated] (KAFKA-1618) Exception thrown when running console producer with no port number for the broker

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1618: -- Attachment: KAFKA-1618-REVIEW-COMMENTS-SPACE-CORRECTION.patch [~nehanarkhede] Corrected space

[jira] [Assigned] (KAFKA-1476) Get a list of consumer groups

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri reassigned KAFKA-1476: - Assignee: BalajiSeshadri (was: Balaji Seshadri) Get a list of consumer groups

[jira] [Assigned] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri reassigned KAFKA-328: Assignee: BalajiSeshadri (was: Balaji Seshadri) Write unit test for kafka server startup

[jira] [Resolved] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri resolved KAFKA-328. -- Resolution: Fixed Write unit test for kafka server startup and shutdown API

[jira] [Updated] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-09-22 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-328: - Attachment: KAFKA-328.patch [~nehanarkhede] please find patch attached. Write unit test for

[jira] [Commented] (KAFKA-1490) remove gradlew initial setup output from source distribution

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144311#comment-14144311 ] Joe Stein commented on KAFKA-1490: -- [~edgefox] can you rebase please, unless something

[jira] [Created] (KAFKA-1645) some more jars in our src release

2014-09-22 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1645: Summary: some more jars in our src release Key: KAFKA-1645 URL: https://issues.apache.org/jira/browse/KAFKA-1645 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-1646) Improve consumer read performance for Windows

2014-09-22 Thread xueqiang wang (JIRA)
xueqiang wang created KAFKA-1646: Summary: Improve consumer read performance for Windows Key: KAFKA-1646 URL: https://issues.apache.org/jira/browse/KAFKA-1646 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144378#comment-14144378 ] Joe Stein commented on KAFKA-1555: -- [~gwenshap] patch applied, tests passed however; I