Re: [DISCUSS] Client-side Assignment for New Consumer

2015-08-17 Thread Jiangjie Qin
Ewen, Honestly I am not sure whether we can keep all the topic in the same cluster or not. By default, we will mirror the topic. Because when application teams run their test, they would expect the environment to be as similar to production as possible. Also, we are developing a comprehensive cont

[jira] [Commented] (KAFKA-2203) Get gradle build to work with Java 8

2015-08-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700728#comment-14700728 ] Allen Wittenauer commented on KAFKA-2203: - FYI, the precommit code that we're putt

[jira] [Resolved] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-08-17 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-1788. Resolution: Duplicate > producer record can stay in RecordAccumulator forever if leader is n

[jira] [Reopened] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-08-17 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy reopened KAFKA-1788: > producer record can stay in RecordAccumulator forever if leader is no > available > -

[jira] [Updated] (KAFKA-2436) log.retention.hours should be honored by LogManager

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2436: Priority: Critical (was: Major) > log.retention.hours should be honored by LogManager > ---

[jira] [Updated] (KAFKA-2436) log.retention.hours should be honored by LogManager

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2436: Status: Patch Available (was: In Progress) > log.retention.hours should be honored by LogManager >

[GitHub] kafka pull request: KAFKA-2203: Getting Java8 to relax about javad...

2015-08-17 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/147 KAFKA-2203: Getting Java8 to relax about javadoc and let our build pass This patch is different than the one attached to the JIRA - I'm applying the new javadoc rules to all subprojects while the on

[jira] [Commented] (KAFKA-2203) Get gradle build to work with Java 8

2015-08-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700554#comment-14700554 ] ASF GitHub Bot commented on KAFKA-2203: --- GitHub user gwenshap opened a pull request:

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Jun Rao
Hi, Grant, I took a look at that list. None of those is really critical as you said. So, I'd suggest that we not include those to minimize the scope of the release. Thanks, Jun On Mon, Aug 17, 2015 at 5:16 PM, Grant Henke wrote: > Thanks Gwen. > > I updated a few small things on the wiki page

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Jun Rao
Gwen, Thanks for putting the list together. I'd recommend that we exclude the following: KAFKA-1702: This is for the old producer and is only a problem if there are some unexpected exceptions (e.g. UnknownClass). KAFKA-2336: Most people don't change offsets.topic.num.partitions. KAFKA-1724: The p

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Grant Henke
Thanks Gwen. I updated a few small things on the wiki page. Below is a list of jiras I think could also be marked as included. All of these, though not super critical, seem like fairly small and low risk changes that help avoid potentially confusing issues or errors for users. KAFKA-2012 KAFKA-9

Re: [Copycat] How will copycat serialize its metadata

2015-08-17 Thread Ewen Cheslack-Postava
@Neha, not sure what you mean by using base64 encoded strings. base64 encoding takes bytes and gives you ASCII text. We need to go from arbitrarily structured offsets data to bytes (e.g. user has given us a record (with schema they have defined) containing db name + table name for the key, and anot

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700499#comment-14700499 ] Dong Lin commented on KAFKA-1690: - [~ijuma] Yes. I observed this as well. > Add SSL suppo

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700495#comment-14700495 ] Ismael Juma commented on KAFKA-1690: If you apply the patch in Review Board via `git a

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700491#comment-14700491 ] Dong Lin commented on KAFKA-1690: - [~sriharsha] The patch KAFKA-1690_2015-08-17_12-20-53.p

[jira] [Comment Edited] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700488#comment-14700488 ] Sriharsha Chintalapani edited comment on KAFKA-1690 at 8/18/15 12:08 AM: ---

Re: [DISCUSS] Client-side Assignment for New Consumer

2015-08-17 Thread Ewen Cheslack-Postava
Becket, Just to clarify, when topics are being created/resized for automated tests, are those excluded by mirrormaker? I assume you don't want to bother with copying them since they are just for tests. If they are excluded, then they don't need to affect the metadata used by the consumer and so wo

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700488#comment-14700488 ] Sriharsha Chintalapani commented on KAFKA-1690: --- [~lindong] strange I was ab

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

2015-08-17 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700483#comment-14700483 ] Guozhang Wang commented on KAFKA-1387: -- [~fpj] That makes sense. So it seems the righ

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700469#comment-14700469 ] Dong Lin commented on KAFKA-1690: - [~sriharsha] I am not able to apply it again 63b89658b

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700431#comment-14700431 ] Sriharsha Chintalapani commented on KAFKA-1690: --- [~lindong] you should be ab

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700417#comment-14700417 ] Dong Lin commented on KAFKA-1690: - [~harsha_ch] Can you tell me the hash that I can use th

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Gwen Shapira
Thanks for creating a list, Grant! I placed it on the wiki with a quick evaluation of the content and whether it should be in 0.8.2.2: https://cwiki.apache.org/confluence/display/KAFKA/Proposed+patches+for+0.8.2.2 I'm attempting to only cherrypick fixes that are both important for large number of

Kafka KIP meeting Aug. 18

2015-08-17 Thread Jun Rao
Hi, Everyone, We will have a Kafka KIP meeting tomorrow at 11am PST. If you plan to attend but haven't received an invite, please let me know. The following is the agenda. Agenda 1. Discuss the proposal on client-side assignment strategy ( https://cwiki.apache.org/confluence/display/KAFKA/Kafka+C

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

2015-08-17 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700187#comment-14700187 ] Flavio Junqueira commented on KAFKA-1387: - bq. I thought that when the previous se

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

2015-08-17 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700113#comment-14700113 ] Guozhang Wang commented on KAFKA-1387: -- I thought that when the previous session has

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700077#comment-14700077 ] Sriharsha Chintalapani commented on KAFKA-1690: --- Updated reviewboard https:/

[jira] [Updated] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1690: -- Attachment: KAFKA-1690_2015-08-17_12:20:53.patch > Add SSL support to Kafka Brok

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/ --- (Updated Aug. 17, 2015, 7:21 p.m.) Review request for kafka. Bugs: KAFKA-1690

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Rajini Sivaram
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/#review95619 --- clients/src/main/java/org/apache/kafka/common/network/SSLTransportL

[jira] [Commented] (KAFKA-2436) log.retention.hours should be honored by LogManager

2015-08-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699985#comment-14699985 ] ASF GitHub Bot commented on KAFKA-2436: --- Github user lindong28 closed the pull reque

[GitHub] kafka pull request: KAFKA-2436; log.retention.hours should be hono...

2015-08-17 Thread lindong28
Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/142 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] kafka pull request: KAFKA-2436; log.retention.hours should be hono...

2015-08-17 Thread lindong28
GitHub user lindong28 reopened a pull request: https://github.com/apache/kafka/pull/142 KAFKA-2436; log.retention.hours should be honored by LogManager You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka KAFKA-2436 A

[jira] [Commented] (KAFKA-2436) log.retention.hours should be honored by LogManager

2015-08-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699986#comment-14699986 ] ASF GitHub Bot commented on KAFKA-2436: --- GitHub user lindong28 reopened a pull reque

Re: [DISCUSS] Client-side Assignment for New Consumer

2015-08-17 Thread Jason Gustafson
Hey Becket, Thanks for raising these concerns. I think the rolling upgrade problem is handled quite a bit better with the new consumer if Onur's LeaveGroup patch (or a variant) is accepted. Without it, the coordinator has to wait for the full session timeout to detect that a node has left the grou

[jira] [Commented] (KAFKA-1792) change behavior of --generate to produce assignment config with fair replica distribution and minimal number of reassignments

2015-08-17 Thread chenshangan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699875#comment-14699875 ] chenshangan commented on KAFKA-1792: you guys can take a look at https://issues.apache

[jira] [Created] (KAFKA-2441) SSL/TLS in official docs

2015-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-2441: -- Summary: SSL/TLS in official docs Key: KAFKA-2441 URL: https://issues.apache.org/jira/browse/KAFKA-2441 Project: Kafka Issue Type: Sub-task Reporter:

Re: [copycat] How to upgrade connectors

2015-08-17 Thread Jay Kreps
Totally agree with the priorities, and I'm actually not even advocating the alternative I through out. I think, ultimately, the connector developer is the one who has to support compatibility, though, irrespective of the mechanism. So I guess it is really just a question of whether it is easier for

[jira] [Updated] (KAFKA-2411) remove usage of BlockingChannel in the broker

2015-08-17 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2411: --- Description: In KAFKA-1690, we are adding the SSL support at Selector. However, there are still a few

[jira] [Updated] (KAFKA-2106) Partition balance tool between borkers

2015-08-17 Thread chenshangan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenshangan updated KAFKA-2106: --- Attachment: KAFKA-2106.3 implement a global balance among the cluster, which will destroy the original

[jira] [Work started] (KAFKA-2440) Use `NetworkClient` instead of `SimpleConsumer` to fetch data from replica

2015-08-17 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2440 started by Ismael Juma. -- > Use `NetworkClient` instead of `SimpleConsumer` to fetch data from replica > --

[jira] [Assigned] (KAFKA-2440) Use `NetworkClient` instead of `SimpleConsumer` to fetch data from replica

2015-08-17 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-2440: -- Assignee: Ismael Juma > Use `NetworkClient` instead of `SimpleConsumer` to fetch data from repl

[jira] [Created] (KAFKA-2440) Use `NetworkClient` instead of `SimpleConsumer` to fetch data from replica

2015-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-2440: -- Summary: Use `NetworkClient` instead of `SimpleConsumer` to fetch data from replica Key: KAFKA-2440 URL: https://issues.apache.org/jira/browse/KAFKA-2440 Project: Kafka

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Ashish Singh
+1 for 0.8.2.2 release with fixes for KAFKA-2189, 2114 and 2308. On Mon, Aug 17, 2015 at 9:16 AM, Flavio Junqueira wrote: > It is pretty typical that Apache projects have a release manager for each > release: > > http://www.apache.org/dev/release-publishing.html < > http://www.apache.org/dev/rel

[jira] [Commented] (KAFKA-2092) New partitioning for better load balancing

2015-08-17 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699794#comment-14699794 ] Gwen Shapira commented on KAFKA-2092: - I'm -1 on putting this into Apache Kafka. We c

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699783#comment-14699783 ] Sriharsha Chintalapani commented on KAFKA-1690: --- Updated reviewboard https:/

[jira] [Updated] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1690: -- Attachment: KAFKA-1690_2015-08-17_09:28:52.patch > Add SSL support to Kafka Brok

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/ --- (Updated Aug. 17, 2015, 4:28 p.m.) Review request for kafka. Bugs: KAFKA-1690

[jira] [Commented] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699773#comment-14699773 ] Sriharsha Chintalapani commented on KAFKA-1690: --- Instructions on enabling ss

Re: [copycat] How to upgrade connectors

2015-08-17 Thread Gwen Shapira
I see our "make life easy" priorities as follows: users > connector developers > core copycat developers. In this case I think that best user experience will be consistent behavior for all copycat connectors, so they'll know what to expect during upgrades. I'm not sure how much we can enforce from

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Flavio Junqueira
It is pretty typical that Apache projects have a release manager for each release: http://www.apache.org/dev/release-publishing.html It doesn't have to be the same person every time, though, not even for the same branch. -Flavio > On 17 Au

[jira] [Commented] (KAFKA-2092) New partitioning for better load balancing

2015-08-17 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699763#comment-14699763 ] Jason Gustafson commented on KAFKA-2092: [~gwenshap] [~guozhang] Can either of you

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Gwen Shapira
but +1 for 0.8.2 patch that marks the new consumer API as unstable (or unimplemented ;) On Mon, Aug 17, 2015 at 9:12 AM, Gwen Shapira wrote: > The network refactoring portion was not tested well enough yet for me to > feel comfortable pushing it into a bugfix release. The new purgatory and > Mi

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Gwen Shapira
The network refactoring portion was not tested well enough yet for me to feel comfortable pushing it into a bugfix release. The new purgatory and MirrorMaker changes are also pretty big. The whole goal of bugfix releases is to make sure it is more stable than the previous releases. On Mon, Aug 17

Re: [copycat] How to upgrade connectors

2015-08-17 Thread Jay Kreps
Yeah I meant this purely as an approach for the connectors themselves to implement not that we would automatically suppress configs in the framework. -Jay On Fri, Aug 14, 2015 at 7:48 PM, Gwen Shapira wrote: > The "ignore new configs" plan is good, IMO. I just don't know if its > feasible in cu

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Stevo Slavić
Instead of cherrypicking, why not just make 0.8.2.2 of off current trunk, with new consumer API appropriately annotated/documented as unstable? On Mon, Aug 17, 2015, 17:17 Grant Henke wrote: > +dev > > Adding dev list back in. Somehow it got dropped. > > > On Mon, Aug 17, 2015 at 10:16 AM, Grant

[jira] [Assigned] (KAFKA-2431) Test SSL/TLS impact on performance

2015-08-17 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-2431: --- Assignee: Ben Stopford > Test SSL/TLS impact on performance > ---

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Ismael Juma
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/#review95589 --- Ship it! Thanks for the various fixes. There is still a small issue

[jira] [Commented] (KAFKA-2435) More optimally balanced partition assignment strategy

2015-08-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699669#comment-14699669 ] ASF GitHub Bot commented on KAFKA-2435: --- GitHub user noslowerdna opened a pull reque

[jira] [Commented] (KAFKA-2434) remove roundrobin identical topic constraint in consumer coordinator (old API)

2015-08-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699668#comment-14699668 ] ASF GitHub Bot commented on KAFKA-2434: --- GitHub user noslowerdna opened a pull reque

[GitHub] kafka pull request: KAFKA-2434: Remove identical topic subscriptio...

2015-08-17 Thread noslowerdna
GitHub user noslowerdna opened a pull request: https://github.com/apache/kafka/pull/145 KAFKA-2434: Remove identical topic subscription constraint for roundrobin strategy in old consumer API You can merge this pull request into a Git repository by running: $ git pull https://

[GitHub] kafka pull request: KAFKA-2435: Fair consumer partition assignment...

2015-08-17 Thread noslowerdna
GitHub user noslowerdna opened a pull request: https://github.com/apache/kafka/pull/146 KAFKA-2435: Fair consumer partition assignment strategy You can merge this pull request into a Git repository by running: $ git pull https://github.com/noslowerdna/kafka KAFKA-2435 Alterna

[jira] [Updated] (KAFKA-1690) Add SSL support to Kafka Broker, Producer and Consumer

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1690: -- Summary: Add SSL support to Kafka Broker, Producer and Consumer (was: new java

Re: [DISCUSSION] Kafka 0.8.2.2 release?

2015-08-17 Thread Grant Henke
+dev Adding dev list back in. Somehow it got dropped. On Mon, Aug 17, 2015 at 10:16 AM, Grant Henke wrote: > Below is a list of candidate bug fix jiras marked fixed for 0.8.3. I don't > suspect all of these will (or should) make it into the release but this > should be a relatively complete li

[jira] [Updated] (KAFKA-1690) new java producer needs ssl support as a client

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1690: -- Attachment: KAFKA-1690_2015-08-17_08:12:50.patch > new java producer needs ssl s

[jira] [Commented] (KAFKA-1690) new java producer needs ssl support as a client

2015-08-17 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699660#comment-14699660 ] Sriharsha Chintalapani commented on KAFKA-1690: --- Updated reviewboard https:/

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/ --- (Updated Aug. 17, 2015, 3:13 p.m.) Review request for kafka. Bugs: KAFKA-1690

Re: question in regard to KIP-30

2015-08-17 Thread Sergiy Yevtushenko
Well, from my point of view it at least makes sense to abstract out the implementation. Now any attempt to replace ZK with something else will lead to significant efforts. So, even providing of pluggable interface for the consensus and metadata would be extremely helpful and would enable other peop

[jira] [Commented] (KAFKA-2435) More optimally balanced partition assignment strategy

2015-08-17 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699565#comment-14699565 ] Andrew Olson commented on KAFKA-2435: - [~becket_qin] Thanks for the info, I'll send a

[jira] [Updated] (KAFKA-2092) New partitioning for better load balancing

2015-08-17 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated KAFKA-2092: -- Attachment: KAFKA-2092-v3.patch Updated formatting to pass check

Re: question in regard to KIP-30

2015-08-17 Thread Joe Stein
I don't think it makes sense to change the core default implementation with KIP-30. Too much risk both in stability and in increasing the time to getting it done and available for folks that want to try Kafka without Zookeeper. It would be interesting to see how that implementation would work alon

question in regard to KIP-30

2015-08-17 Thread Sergiy Yevtushenko
Hi, Are there any plans to work on this improvement? As a possible core for default implementation it might worth to consider https://github.com/belaban/jgroups-raft . It already contains RAFT consensus algorithm implementation. Adding something like distributed hash map for shared metadata should

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

2015-08-17 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699514#comment-14699514 ] Flavio Junqueira commented on KAFKA-1387: - There are two problems at a high level

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Ismael Juma
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33620/#review95582 --- clients/src/main/java/org/apache/kafka/common/network/SSLTransportL

Re: Review Request 33620: Patch for KAFKA-1690

2015-08-17 Thread Ismael Juma
> On July 27, 2015, 1:32 p.m., Ismael Juma wrote: > > clients/src/main/java/org/apache/kafka/common/config/SSLConfigs.java, line > > 29 > > > > > > SSL is deprecated > > (https://ma.ttias.be/rfc-7568-ssl-3-0-is-now

[jira] [Commented] (KAFKA-2072) Add StopReplica request/response to o.a.k.common.requests and replace the usage in core module

2015-08-17 Thread David Jacot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699279#comment-14699279 ] David Jacot commented on KAFKA-2072: As discussed with [~ijuma], it would be better to

[jira] [Commented] (KAFKA-2388) subscribe(topic)/unsubscribe(topic) should either take a callback to allow user to handle exceptions or it should be synchronous.

2015-08-17 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699166#comment-14699166 ] Onur Karaman commented on KAFKA-2388: - Hey [~hachikuji]. I'll try to take a look at it

[GitHub] kafka pull request: Kafka 2015 - Enable ConsoleConsumer to use new...

2015-08-17 Thread benstopford
GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/144 Kafka 2015 - Enable ConsoleConsumer to use new consumer This extends the original patch done by GZ to provide Console access to both the new and old consumer API's. The code follows a pattern sim