Re: [DISCUSS] Control Messages - [Was: KIP-82 - Add Record Headers]

I agree with all. Just want to elaborate a few things: 3. There are two different use cases: (a) the one you describe -- I want to shutdown NOW and don't want to wait -- I agree with your observations etc (b) we intentionally want to "drain" the stream processing topology before shutting

[GitHub] kafka pull request #2284: MINOR: KStream JavaDoc fix

GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/2284 MINOR: KStream JavaDoc fix You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka javaDoc Alternatively you can review and apply these

Re: [VOTE] KIP-84: Support SASL SCRAM mechanisms

Jun, The KIP currently proposes to add 4 SASL mechanisms SCRAM-SHA-224, SCRAM-SHA-256, SCRAM-SHA-384 and SCRAM-SHA-512. Ismael suggested supporting just SCRAM-SHA-256 and SCRAM-SHA-512 to make it easier for non-Java client support. What do you think? Thank you, Rajini On Fri, Dec 2, 2016 at

[jira] [Commented] (KAFKA-2196) remove roundrobin identical topic constraint in consumer coordinator

[ https://issues.apache.org/jira/browse/KAFKA-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766440#comment-15766440 ] Jeff Widman commented on KAFKA-2196: What version did this land in? > remove roundrobin identical

[jira] [Commented] (KAFKA-2019) RoundRobinAssignor clusters by consumer

[ https://issues.apache.org/jira/browse/KAFKA-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766498#comment-15766498 ] Jeff Widman commented on KAFKA-2019: As noted in KIP-54

Re: [VOTE] KIP-90 Remove zkClient dependency from Streams

+1 On 12/21/16 12:45 AM, Edoardo Comar wrote: > +1 (non-binding) > thanks! > -- > Edoardo Comar > IBM MessageHub > eco...@uk.ibm.com > IBM UK Ltd, Hursley Park, SO21 2JN > > IBM United Kingdom Limited Registered in England and Wales with number

[jira] [Commented] (KAFKA-2172) Round-robin partition assignment strategy too restrictive

[ https://issues.apache.org/jira/browse/KAFKA-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766445#comment-15766445 ] Jeff Widman commented on KAFKA-2172: Should this be marked as resolved? KAFKA-2196 added this to the

[jira] [Commented] (KAFKA-3297) More optimally balanced partition assignment strategy (new consumer)

[ https://issues.apache.org/jira/browse/KAFKA-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766465#comment-15766465 ] Jeff Widman commented on KAFKA-3297: Was this KIP ever voted on? I see there's only a handful of

[jira] [Comment Edited] (KAFKA-3297) More optimally balanced partition assignment strategy (new consumer)

[ https://issues.apache.org/jira/browse/KAFKA-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766465#comment-15766465 ] Jeff Widman edited comment on KAFKA-3297 at 12/21/16 8:38 AM: -- Is this being

[jira] [Commented] (KAFKA-2331) Kafka does not spread partitions in a topic among all consumers evenly

[ https://issues.apache.org/jira/browse/KAFKA-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766509#comment-15766509 ] Jeff Widman commented on KAFKA-2331: Isn't this what round robin partitioning strategy was trying to

[GitHub] kafka pull request #2223: Update `createFile` function of Uitls.scala

Github user Allianzcortex closed the pull request at: https://github.com/apache/kafka/pull/2223 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (KAFKA-4426) Add consumer.close(timeout, unit) for graceful close with timeout

[ https://issues.apache.org/jira/browse/KAFKA-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766945#comment-15766945 ] ASF GitHub Bot commented on KAFKA-4426: --- GitHub user rajinisivaram opened a pull request:

Re: [DISCUSS] KIP-101: Alter Replication Protocol to use Leader Generation rather than High Watermark for Truncation

Thanks Apurva - yes that's one of those funny english phrases which are often read one way, but are really quite ambiguous. I have reworded. Thanks for pointing this one out. Appreciated. B On Tue, 20 Dec 2016 at 23:49, Apurva Mehta wrote: Hi Ben, Thanks for the KIP.

[jira] [Updated] (KAFKA-4426) Add consumer.close(timeout, unit) for graceful close with timeout

[ https://issues.apache.org/jira/browse/KAFKA-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4426: --- Fix Version/s: 0.10.2.0 > Add consumer.close(timeout, unit) for graceful close with timeout >

[GitHub] kafka pull request #2285: KAFKA-4426: Add close with timeout for KafkaConsum...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/2285 KAFKA-4426: Add close with timeout for KafkaConsumer Code corresponding to KIP-102. You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS] KIP-102 - Add close with timeout for consumers

I have added some more detail to the "Proposed Changes" section. Also created a preliminary PR for the JIRA ( https://github.com/apache/kafka/pull/2285). I am using *request.timeout.ms * to bound individual requests during close (the KIP does not address timeouts in any

[jira] [Commented] (KAFKA-2442) QuotasTest should not fail when cpu is busy

[ https://issues.apache.org/jira/browse/KAFKA-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767765#comment-15767765 ] Dong Lin commented on KAFKA-2442: - [~guozhang] I lost track of this issue and I am not sure if it is still

[jira] [Resolved] (KAFKA-2442) QuotasTest should not fail when cpu is busy

[ https://issues.apache.org/jira/browse/KAFKA-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-2442. - Resolution: Won't Fix > QuotasTest should not fail when cpu is busy >

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

> > > @Joel, > > I read over your wiki, and apart from the introduction of the notion of > journal partitions --whose pros and cons are already being discussed-- you > also introduce the notion of a 'producer group' which enables multiple > producers to participate in a single transaction. This is

[jira] [Updated] (KAFKA-2620) Introduce Scalariform

[ https://issues.apache.org/jira/browse/KAFKA-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2620: - Reviewer: Gwen Shapira > Introduce Scalariform > - > > Key:

[jira] [Updated] (KAFKA-4186) Transient failure in KStreamAggregationIntegrationTest.shouldGroupByKey

[ https://issues.apache.org/jira/browse/KAFKA-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4186: --- Fix Version/s: (was: 0.10.1.1) > Transient failure in

Re: [VOTE] 0.10.1.1 RC1

Hi Guozhang, Thanks for driving this release as it includes a few important fixes. I belatedly tested Scala 2.12 binaries using the quickstart, +1 (non-binding) from me. Ismael On Thu, Dec 15, 2016 at 1:29 PM, Guozhang Wang wrote: > Hello Kafka users, developers and

[jira] [Commented] (KAFKA-2442) QuotasTest should not fail when cpu is busy

[ https://issues.apache.org/jira/browse/KAFKA-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767720#comment-15767720 ] Guozhang Wang commented on KAFKA-2442: -- [~lindong] Is this still a valid issue? > QuotasTest should

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

+1, thanks. On Wed, Dec 21, 2016 at 10:26 AM, radai wrote: > +1 > > On Wed, Dec 21, 2016 at 9:51 AM, Dong Lin wrote: > > > +1 (non-binding) > > > > On Thu, Dec 15, 2016 at 5:32 PM, Becket Qin > wrote: > > > > > Hi, > > > >

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hi Joel, The alternatives are embedded in the 'discussion' sections which are spread throughout the google doc. Admittedly, we have not covered high level alternatives like those which have been brought up in this thread. In particular, having a separate log for transactional mesages and also

[GitHub] kafka pull request #2269: fixup typo

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2269 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

+1 On Wed, Dec 21, 2016 at 9:51 AM, Dong Lin wrote: > +1 (non-binding) > > On Thu, Dec 15, 2016 at 5:32 PM, Becket Qin wrote: > > > Hi, > > > > I want to start a voting thread on KIP-92 which proposes to add per > > partition lag metrics to

Re: [DISCUSS] KIP-92 - Add per partition lag metrics to KafkaConsumer

LGTM. However, can you comment on the effect of releasing ownership of partitions after a rebalance? For e.g., should it reset itself to (say) -1? or removed? This really applies to any per-partition metrics that we intend to maintain in the consumer. On Mon, Nov 14, 2016 at 9:35 AM, Becket Qin

[jira] [Updated] (KAFKA-4533) subscribe() then poll() on new topic is very slow when subscribed to many topics

[ https://issues.apache.org/jira/browse/KAFKA-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Alaev updated KAFKA-4533: Attachment: sgs.log.tar.gz org.apache.kafka.* TRACE logs > subscribe() then poll() on new topic is

[GitHub] kafka pull request #2284: MINOR: KStream JavaDoc fix

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2284 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2341) Need Standard Deviation Metrics in MetricsBench

[ https://issues.apache.org/jira/browse/KAFKA-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767672#comment-15767672 ] Guozhang Wang commented on KAFKA-2341: -- [~sebadiaz] Added you to the contributor list. > Need

[jira] [Updated] (KAFKA-2341) Need Standard Deviation Metrics in MetricsBench

[ https://issues.apache.org/jira/browse/KAFKA-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2341: - Assignee: sebastien diaz > Need Standard Deviation Metrics in MetricsBench >

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767709#comment-15767709 ] Guozhang Wang commented on KAFKA-1194: -- Is this PR trying to tackle this issue at all?

[jira] [Commented] (KAFKA-2170) 10 LogTest cases failed for file.renameTo failed under windows

[ https://issues.apache.org/jira/browse/KAFKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767712#comment-15767712 ] Guozhang Wang commented on KAFKA-2170: -- Is this PR still valid in tackling this issue?

[jira] [Updated] (KAFKA-1573) Transient test failures on LogTest.testCorruptLog

[ https://issues.apache.org/jira/browse/KAFKA-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-1573: --- Fix Version/s: (was: 0.10.1.1) > Transient test failures on LogTest.testCorruptLog >

[jira] [Updated] (KAFKA-2358) Cluster collection returning methods should never return null

[ https://issues.apache.org/jira/browse/KAFKA-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2358: - Assignee: Stevo Slavic > Cluster collection returning methods should never return null >

Re: [DISCUSS] KIP-92 - Add per partition lag metrics to KafkaConsumer

Good point. I think it makes sense to remove the corresponding metric if the consumer does not own a partition anymore. I have updated the KIP. On Wed, Dec 21, 2016 at 10:24 AM, Joel Koshy wrote: > LGTM. However, can you comment on the effect of releasing ownership of >

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

+1 On Wed, Dec 21, 2016 at 10:26 AM, radai wrote: > +1 > > On Wed, Dec 21, 2016 at 9:51 AM, Dong Lin wrote: > > > +1 (non-binding) > > > > On Thu, Dec 15, 2016 at 5:32 PM, Becket Qin > wrote: > > > > > Hi, > > > > > > I

[jira] [Updated] (KAFKA-3587) LogCleaner fails due to incorrect offset map computation on a replica

[ https://issues.apache.org/jira/browse/KAFKA-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3587: - Fix Version/s: 0.9.0.2 > LogCleaner fails due to incorrect offset map computation on a replica >

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

+1 (non-binding) On Thu, Dec 15, 2016 at 5:32 PM, Becket Qin wrote: > Hi, > > I want to start a voting thread on KIP-92 which proposes to add per > partition lag metrics to KafkaConsumer. The KIP wiki page is below: > >

Re: [VOTE] 0.10.1.1 RC1

Thanks for everyone who voted. Having community vote of confidence in bugfix releases is hugely important, especially as we are trying to support more in-flight versions :) On Wed, Dec 21, 2016 at 8:49 AM, Ismael Juma wrote: > Hi Guozhang, > > Thanks for driving this release

[jira] [Updated] (KAFKA-3564) Count metric always increments by 1.0

[ https://issues.apache.org/jira/browse/KAFKA-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3564: - Resolution: Not A Bug Status: Resolved (was: Patch Available) Closing as not a bug for

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

That seems reasonable. It would be good to update the KIP to make this clear. Ismael On Wed, Dec 21, 2016 at 1:49 PM, Becket Qin wrote: > Hi Ismael, > > Thanks for the comments. Good observation. I guess for max lag of all the > partitions the average value is less

[GitHub] kafka pull request #660: KAFKA-2980 Fix deadlock when ZookeeperConsumerConne...

Github user becketqin closed the pull request at: https://github.com/apache/kafka/pull/660 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

KIP-103: Separation of Internal and External traffic

Hi all, We've posted "KIP-103: Separation of Internal and External traffic" for discussion: *https://cwiki.apache.org/confluence/display/KAFKA/KIP-103%3A+Separation+of+Internal+and+External+traffic

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

Thanks for the KIP, it's a useful improvement. Just one question, the KIP states that it's about adding per partition metrics for metrics that already exist. However, when I look at the code, it seems that `records-lag-avg` doesn't exist? this.recordsFetchLag = metrics.sensor("records-lag");

[GitHub] kafka pull request #1958: MINOR: trivial doc cleanup

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2077: MINOR: Fix document header/footer links

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4565) Separation of Internal and External traffic

[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4565: --- Summary: Separation of Internal and External traffic (was: Separate Internal and External traffic)

[jira] [Updated] (KAFKA-4565) Separation of Internal and External traffic

[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4565: --- Description: During the 0.9.0.0 release cycle, support for multiple listeners per broker was

[jira] [Commented] (KAFKA-2980) ZookeeperConsumerConnector may enter deadlock if a rebalance occurs during a stream creation.

[ https://issues.apache.org/jira/browse/KAFKA-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768278#comment-15768278 ] ASF GitHub Bot commented on KAFKA-2980: --- Github user becketqin closed the pull request at:

[jira] [Updated] (KAFKA-3284) Consider removing beta label in security documentation

[ https://issues.apache.org/jira/browse/KAFKA-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3284: --- Status: Patch Available (was: Open) > Consider removing beta label in security documentation >

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768183#comment-15768183 ] Ismael Juma commented on KAFKA-2260: The following KIP may be of interest:

[jira] [Commented] (KAFKA-3284) Consider removing beta label in security documentation

[ https://issues.apache.org/jira/browse/KAFKA-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768357#comment-15768357 ] ASF GitHub Bot commented on KAFKA-3284: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2286: KAFKA-3284: Remove beta label from security docume...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2286 KAFKA-3284: Remove beta label from security documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

Jenkins build is back to normal : kafka-trunk-jdk8 #1126

See

[jira] [Created] (KAFKA-4566) Can't Symlink to Kafka bins

Stephane Maarek created KAFKA-4566: -- Summary: Can't Symlink to Kafka bins Key: KAFKA-4566 URL: https://issues.apache.org/jira/browse/KAFKA-4566 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-4560) Min / Max Partitions Fetch Records params

[ https://issues.apache.org/jira/browse/KAFKA-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15769203#comment-15769203 ] huxi commented on KAFKA-4560: - Could you illustrate a real scenario when 'max.partitions.fetch.records' might

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768086#comment-15768086 ] Bill Warshaw commented on KAFKA-2260: - I'd like to revive the discussion on this KIP. I've worked on

Jenkins build is back to normal : kafka-trunk-jdk8 #1123

See

[jira] [Commented] (KAFKA-2260) Allow specifying expected offset on produce

[ https://issues.apache.org/jira/browse/KAFKA-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768180#comment-15768180 ] Enrico Olivelli commented on KAFKA-2260: I am interested in this new feature as it will enable

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

Hi Ismael, Thanks for the comments. Good observation. I guess for max lag of all the partitions the average value is less meaningful because the lag can be from different partitions, so an average of lags from different partitions at different times seems hard to reason about. On the other hand,

[jira] [Updated] (KAFKA-2980) ZookeeperConsumerConnector may enter deadlock if a rebalance occurs during a stream creation.

[ https://issues.apache.org/jira/browse/KAFKA-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2980: Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) >

[ANNOUCE] Apache Kafka 0.10.1.1 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 0.10.1.1. This is a bug fix release that fixes 30 issues in 0.10.1.0. All of the changes in this release can be found in the release notes: *https://archive.apache.org/dist/kafka/0.10.1.1/RELEASE_NOTES.html

[GitHub] kafka pull request #2288: MINOR: Create Hyperlinks in protocol api docs

GitHub user imandhan opened a pull request: https://github.com/apache/kafka/pull/2288 MINOR: Create Hyperlinks in protocol api docs Minor changes to generate hyperlinks in the protocol api documentation to ease lookup. You can merge this pull request into a Git repository by

Build failed in Jenkins: kafka-trunk-jdk8 #1124

See Changes: [wangguoz] MINOR: fixup typo in ops.html -- [...truncated 34375 lines...] org.apache.kafka.connect.runtime.WorkerTest > testConverterOverrides PASSED

Re: [VOTE] KIP-92 - Add per partition lag metrics to KafkaConsumer

Just updated the wiki to clarify that. Thanks everyone for the votes. KIP-92 has passed with +3 (binding) and +2 (non-binding). On Wed, Dec 21, 2016 at 1:53 PM, Ismael Juma wrote: > That seems reasonable. It would be good to update the KIP to make this > clear. > > Ismael >

[jira] [Commented] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768722#comment-15768722 ] Vahid Hashemian commented on KAFKA-2273: The thread is

[jira] [Commented] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768710#comment-15768710 ] Jeff Widman commented on KAFKA-2273: What was the outcome of the vote? > Add rebalance with a minimal

[jira] [Commented] (KAFKA-4277) creating ephemeral node already exist

[ https://issues.apache.org/jira/browse/KAFKA-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768759#comment-15768759 ] Jun Rao commented on KAFKA-4277: [~fpj], in KAFKA-1387, you had the following comment: "If a client has

[jira] [Commented] (KAFKA-2170) 10 LogTest cases failed for file.renameTo failed under windows

[ https://issues.apache.org/jira/browse/KAFKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768403#comment-15768403 ] Vahid Hashemian commented on KAFKA-2170: Looks like the PR needs a rebase. > 10 LogTest cases

Re: KIP-103: Separation of Internal and External traffic

Hi Ismael, Thank you for the KIP. This is a very useful change. Once you allow multiple interfaces with the same security protocol, you will soon also need to be able to configure protocol-specific properties for each of the interfaces. To use SSL on internal and external networks, you would

Re: KIP-103: Separation of Internal and External traffic

Thanks Rajini. I agree that it's worth thinking about what a fully configurable label would look like. I'll update the KIP. Ismael On 21 Dec 2016 10:53 pm, "Rajini Sivaram" wrote: Hi Ismael, Thank you for the KIP. This is a very useful change. Once you allow

[GitHub] kafka pull request #2287: MINOR: Make SenderMetrics class private with priva...

GitHub user rajatvig opened a pull request: https://github.com/apache/kafka/pull/2287 MINOR: Make SenderMetrics class private with private members to reduce accessibility of the inner class. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #219: MINOR: Make SenderMetrics class private with privat...

Github user rajatvig closed the pull request at: https://github.com/apache/kafka/pull/219 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1868: MINOR: Improve output format of `kafka_reassign_pa...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1868 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #1125

See Changes: [wangguoz] MINOR: trivial logCleanerEnable doc cleanup [wangguoz] MINOR: Fix document header/footer links -- [...truncated 30479 lines...]

[GitHub] kafka pull request #214: MINOR: Make private class FetchManagerMetrics as a ...

Github user rajatvig closed the pull request at: https://github.com/apache/kafka/pull/214 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Different key with the same digest in log compaction

Hi, all: I am just learning the Kafka codebase, as what I saw in https://github.com/apache/kafka/blob/6ed3e6b1cb8a73b1f5f78926ccb247a8953a554c/core/src/main/scala/kafka/log/OffsetMap.scala#L43-L43 if different log keys have the same digest value, they will be treated as the same key in log

Different key with the same digest in log compaction

Hi,all: I am just learning the kafka codebase, as what I saw in https://github.com/apache/kafka/blob/6ed3e6b1cb8a73b1f5f78926ccb247a8953a554c/core/src/main/scala/kafka/log/OffsetMap.scala#L43-L43 if different log keys have the same digest value, they will be treated as the same key in log

[jira] [Updated] (KAFKA-4547) Consumer.position returns incorrect results for Kafka 0.10.1.0 client

[ https://issues.apache.org/jira/browse/KAFKA-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4547: --- Fix Version/s: 0.10.2.0 > Consumer.position returns incorrect results for Kafka 0.10.1.0 client >

Re: Reg: ACLS

Yes, that's correct. Ismael On Sat, Dec 10, 2016 at 11:02 AM, BigData dev wrote: > Hi Ashish, Ismael > Thanks for Info. > So on Kafka Cluster (With out any security enabled) I can add ACLS with IP > address. > Is that correct? > > > Thanks, > Bharat > > > On Fri, Dec

[jira] [Commented] (KAFKA-4547) Consumer.position returns incorrect results for Kafka 0.10.1.0 client

[ https://issues.apache.org/jira/browse/KAFKA-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767226#comment-15767226 ] Ismael Juma commented on KAFKA-4547: It would be good to fix this for 0.10.2.0, assuming it's not

[jira] [Commented] (KAFKA-4533) subscribe() then poll() on new topic is very slow when subscribed to many topics

[ https://issues.apache.org/jira/browse/KAFKA-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15767243#comment-15767243 ] Ismael Juma commented on KAFKA-4533: Thanks for the report. The requests are done in batches. We'd

[jira] [Updated] (KAFKA-4229) Controller can't start after several zk expired event

[ https://issues.apache.org/jira/browse/KAFKA-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4229: --- Fix Version/s: 0.10.2.0 > Controller can't start after several zk expired event >

[jira] [Created] (KAFKA-4565) Separate Internal and External traffic

Ismael Juma created KAFKA-4565: -- Summary: Separate Internal and External traffic Key: KAFKA-4565 URL: https://issues.apache.org/jira/browse/KAFKA-4565 Project: Kafka Issue Type: Bug