[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-06 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469613#comment-15469613 ] Manikumar Reddy commented on KAFKA-4074: [~junrao] Yes, Both issues are same. I can merge my

[jira] [Commented] (KAFKA-4111) broker compress data of certain size instead on a produce request

2016-09-06 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469580#comment-15469580 ] Manikumar Reddy commented on KAFKA-4111: Ok got it. Broker handles each producer request

Build failed in Jenkins: kafka-trunk-jdk8 #864

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Reduce the log level when the peer isn't authenticated but is -- [...truncated 12235 lines...] org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest >

[jira] [Created] (KAFKA-4137) Refactor multi-threaded consumer for safer network layer access

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4137: -- Summary: Refactor multi-threaded consumer for safer network layer access Key: KAFKA-4137 URL: https://issues.apache.org/jira/browse/KAFKA-4137 Project: Kafka

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Ashish Singh
Congrats, Jason! On Tuesday, September 6, 2016, Jason Gustafson wrote: > Thanks all! > > On Tue, Sep 6, 2016 at 5:13 PM, Becket Qin > wrote: > > > Congrats, Jason! > > > > On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman >

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-06 Thread Sriram Subramanian
Sounds good to me. > On Sep 6, 2016, at 8:22 PM, Jason Gustafson wrote: > > Hey All, > > It sounds like the general consensus is in favor of time-based releases. We > can continue the discussion about LTS, but I wanted to go ahead and get > things moving forward by

[jira] [Commented] (KAFKA-4111) broker compress data of certain size instead on a produce request

2016-09-06 Thread julien1987 (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469377#comment-15469377 ] julien1987 commented on KAFKA-4111: --- Sorry, my expression was not clear. I mean all messages from

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-06 Thread Jason Gustafson
Hey All, It sounds like the general consensus is in favor of time-based releases. We can continue the discussion about LTS, but I wanted to go ahead and get things moving forward by volunteering to manage the next release, which is currently slated for October. If that sounds OK, I'll draft a

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-06 Thread Sriram Subramanian
+1 binding > On Sep 6, 2016, at 7:46 PM, Ismael Juma wrote: > > Hi all, > > I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion

Build failed in Jenkins: kafka-trunk-jdk8 #863

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Include TopicPartition in warning when log cleaner resets dirty [ismael] KAFKA-4129; Processor throw exception when getting channel remote [cshapi] MINOR: More graceful handling of buffers that are too

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Jason Gustafson
Thanks all! On Tue, Sep 6, 2016 at 5:13 PM, Becket Qin wrote: > Congrats, Jason! > > On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman > > wrote: > > > congrats jason! > > > > On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian

[VOTE] KIP-78 Cluster Id (second attempt)

2016-09-06 Thread Ismael Juma
Hi all, I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id As explained in the KIP and discussion thread, we see this as a good first step that can serve as a foundation for future improvements.

[GitHub] kafka pull request #1825: MINOR: Reduce the log level when the peer isn't au...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #862

2016-09-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: changes embedded broker time to MockTime -- [...truncated 12223 lines...] org.apache.kafka.streams.processor.internals.assignment.AssignmentInfoTest >

Build failed in Jenkins: kafka-trunk-jdk7 #1519

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Include TopicPartition in warning when log cleaner resets dirty [ismael] KAFKA-4129; Processor throw exception when getting channel remote [cshapi] MINOR: More graceful handling of buffers that are too

[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469233#comment-15469233 ] Jun Rao commented on KAFKA-4074: [~jjkoshy], is this the same issue as

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi Jun, This is a new [VOTE] thread, you can see it in the archives: http://mail-archives.apache.org/mod_mbox/kafka-dev/201609.mbox/%3CCAD5tkZbLv7fvH4q%2BKe%2B%3DJMgGq%2BZT2t34e0WRUsCT1ErhtKOg1w%40mail.gmail.com%3E I suspect Gmail is incorrectly placing it in the wrong thread (it did for me

[jira] [Comment Edited] (KAFKA-4024) First metadata update always take retry.backoff.ms milliseconds to complete

2016-09-06 Thread Yuto Kawamura (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458639#comment-15458639 ] Yuto Kawamura edited comment on KAFKA-4024 at 9/7/16 1:46 AM: -- I reconsidered

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Jun Rao
Ismael, Could you move this to a new [VOTE] thread to make the voting clear? Thanks, Jun On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > >

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469156#comment-15469156 ] ASF GitHub Bot commented on KAFKA-4033: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469155#comment-15469155 ] ASF GitHub Bot commented on KAFKA-4033: --- Github user vahidhashemian closed the pull request at:

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1726 KAFKA-4033: KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change This PR changes topic subscription semantics so a change in subscription does not

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #1672: MINOR: More graceful handling of buffers that are ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469078#comment-15469078 ] Ismael Juma commented on KAFKA-3937: [~williamyu], we occasionally commit to the `0.9.0` branch, but

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread William Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469051#comment-15469051 ] William Yu commented on KAFKA-3937: --- [~ijuma] So, we don't plan on upgrading to kafka 0.10.x anytime in

[GitHub] kafka pull request #1826: KAFKA-4129: Processor throw exception when getting...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4129: --- Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469049#comment-15469049 ] ASF GitHub Bot commented on KAFKA-4129: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1801: MINOR: Include TopicPartition in warning when log ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1801 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Becket Qin
Congrats, Jason! On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman wrote: > congrats jason! > > On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian > wrote: > > > Congratulations Jason! > > > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > >

Build failed in Jenkins: kafka-trunk-jdk7 #1518

2016-09-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: changes embedded broker time to MockTime -- [...truncated 1484 lines...] kafka.api.SslEndToEndAuthorizationTest > testNoProduceAcl STARTED

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Onur Karaman
congrats jason! On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian wrote: > Congratulations Jason! > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > vahidhashem...@us.ibm.com > > wrote: > > > Congratulations Jason on this very well deserved recognition. > > > >

[jira] [Resolved] (KAFKA-4048) Connect does not support RetriableException consistently for sinks

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4048. Resolution: Not A Problem Turns out all exceptions from {{task.flush()}} are treated as

[jira] [Created] (KAFKA-4136) KafkaBasedLog should include offsets it is trying to/successfully read to in log messages

2016-09-06 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4136: Summary: KafkaBasedLog should include offsets it is trying to/successfully read to in log messages Key: KAFKA-4136 URL:

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-06 Thread Guozhang Wang
Hi Matthias, I agree with your concerns of coupling with record forwarding with record storing in the state store, and my understanding is that this can (and should) be resolved with the current interface. Here are my thoughts: 1. The global cache, MemoryLRUCacheBytes, although is currently

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Gwen Shapira
+1 (binding) Thank you for the KIP and discussion. Looking forward to the PR and future improvements. On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > >

Agenda item for next KIP meeting

2016-09-06 Thread Vahid S Hashemian
Hi, I'd like to add KIP-54 to the agenda for next KIP meeting. This KIP has been in discussion phase for a long time, and it would be nice to have an online discussion about it, collect additional feedback, and move forward, if possible. Thanks. Regards, --Vahid

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Sriram Subramanian
+1 (binding) On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion thread, we

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Sriram Subramanian
Congratulations Jason! On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian wrote: > Congratulations Jason on this very well deserved recognition. > > --Vahid > > > > From: Neha Narkhede > To: "dev@kafka.apache.org" , >

[VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi all, I would like to initiate the voting process for KIP-78: Cluster Id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id As explained in the KIP and discussion thread, we see this as a good first step that can serve as a foundation for future improvements. Thanks,

Re: [DISCUSS] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
On Mon, Sep 5, 2016 at 10:41 PM, Ismael Juma wrote: > I will update the KIP to make this point clearer. > Done. Ismael

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Vahid S Hashemian
Congratulations Jason on this very well deserved recognition. --Vahid From: Neha Narkhede To: "dev@kafka.apache.org" , "us...@kafka.apache.org" Cc: "priv...@kafka.apache.org" Date:

[jira] [Commented] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468842#comment-15468842 ] Gwen Shapira commented on KAFKA-4132: - Assigning to [~iwrigley], as he volunteered off-list. I hope no

[jira] [Updated] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-4132: Assignee: Ian Wrigley > Make our upgrade docs more factual and less scary >

[GitHub] kafka pull request #1808: MINOR: changes embedded broker time to MockTime

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Ismael Juma
Congratulations Jason! Well-deserved. :) Ismael On Tue, Sep 6, 2016 at 11:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous

[jira] [Commented] (KAFKA-3478) Finer Stream Flow Control

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468825#comment-15468825 ] Guozhang Wang commented on KAFKA-3478: -- [~mjsax] Since separate JIRAs have been created for these two

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Gwen Shapira
Well deserved, Jason. Looking forward to your future contributions :) On Tue, Sep 6, 2016 at 3:29 PM, Guozhang Wang wrote: > Welcome, and really happy to have you onboard Jason! > > > Guozhang > > On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > >>

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Jun Rao
Congratulations, Jason! Thanks, Jun On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Guozhang Wang
Welcome, and really happy to have you onboard Jason! Guozhang On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468817#comment-15468817 ] Guozhang Wang commented on KAFKA-4113: -- More thoughts regarding this issue after discussing with

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Matthias J. Sax
Congrats Jason!!! -Matthias On 09/07/2016 12:25 AM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a committer > and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range of areas, notably > within

[ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Neha Narkhede
The PMC for Apache Kafka has invited Jason Gustafson to join as a committer and we are pleased to announce that he has accepted! Jason has contributed numerous patches to a wide range of areas, notably within the new consumer and the Kafka Connect layers. He has displayed great taste and

[jira] [Created] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4135: -- Summary: Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription Key: KAFKA-4135 URL: https://issues.apache.org/jira/browse/KAFKA-4135

[jira] [Reopened] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reopened KAFKA-3779: - > Add the LRU cache for KTable.to() operator > -- > >

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468615#comment-15468615 ] Eno Thereska commented on KAFKA-3779: - Sure. Thanks. > Add the LRU cache for KTable.to() operator >

Jenkins build is back to normal : kafka-trunk-jdk8 #861

2016-09-06 Thread Apache Jenkins Server
See

[jira] [Comment Edited] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468453#comment-15468453 ] Guozhang Wang edited comment on KAFKA-3779 at 9/6/16 8:29 PM: -- Thanks for the

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468453#comment-15468453 ] Guozhang Wang commented on KAFKA-3779: -- Thanks for the explanation, LGTM. Just for keeping track in

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Greg Fodor (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468374#comment-15468374 ] Greg Fodor commented on KAFKA-3769: --- It's just the sensor calls inside of Selector, not Kafka Streams

[jira] [Commented] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468352#comment-15468352 ] Shikhar Bhushan commented on KAFKA-3962: This is also realizable today by using

[jira] [Comment Edited] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468352#comment-15468352 ] Shikhar Bhushan edited comment on KAFKA-3962 at 9/6/16 7:49 PM: This is

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468313#comment-15468313 ] Eno Thereska commented on KAFKA-3779: - I suggest we wait on adding dedup for (4) until we have

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468302#comment-15468302 ] Guozhang Wang commented on KAFKA-3779: -- Are all KTable changelog stream contains deduped data even

[jira] [Commented] (KAFKA-4043) User-defined handler for topology restart

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468278#comment-15468278 ] Guozhang Wang commented on KAFKA-4043: -- Hi [~gfodor], when there is a rebalance happening and some

[jira] [Commented] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468274#comment-15468274 ] ASF GitHub Bot commented on KAFKA-4134: --- GitHub user cotedm opened a pull request:

[GitHub] kafka pull request #1829: KAFKA-4134: log ConnectException at WARN

2016-09-06 Thread cotedm
GitHub user cotedm opened a pull request: https://github.com/apache/kafka/pull/1829 KAFKA-4134: log ConnectException at WARN Simply log the connection refused instance. If we're worried about spamming users, I can add a flag to make sure we only log this exception once, but the

[jira] [Created] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread Dustin Cote (JIRA)
Dustin Cote created KAFKA-4134: -- Summary: Transparently notify users of "Connection Refused" for client to broker connections Key: KAFKA-4134 URL: https://issues.apache.org/jira/browse/KAFKA-4134

[jira] [Commented] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468167#comment-15468167 ] ASF GitHub Bot commented on KAFKA-4023: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1803: KAFKA-4023: add thread/task id for logging prefix

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1803 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4023: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468157#comment-15468157 ] Guozhang Wang commented on KAFKA-3769: -- Yes please :) Also is it a general issue in {{Selector}}

[jira] [Created] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4133: -- Summary: Provide a configuration to control consumer max in-flight fetches Key: KAFKA-4133 URL: https://issues.apache.org/jira/browse/KAFKA-4133 Project: Kafka

[jira] [Updated] (KAFKA-4001) Improve Kafka Streams Join Semantics (KIP-77)

2016-09-06 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4001: --- Status: Patch Available (was: In Progress) > Improve Kafka Streams Join Semantics (KIP-77) >

[jira] [Commented] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468012#comment-15468012 ] Shikhar Bhushan commented on KAFKA-4127: Dupe of KAFKA-3968 > Possible data loss >

[jira] [Resolved] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4127. Resolution: Duplicate > Possible data loss > -- > > Key:

[jira] [Closed] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan closed KAFKA-4127. -- > Possible data loss > -- > > Key: KAFKA-4127 >

[GitHub] kafka pull request #1828: MINOR: allow creation of statestore without loggin...

2016-09-06 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/1828 MINOR: allow creation of statestore without loggingenabled or explicit sourcetopic @guozhangwang You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4081) Consumer API consumer new interface commitSyn does not verify the validity of offset

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467915#comment-15467915 ] ASF GitHub Bot commented on KAFKA-4081: --- GitHub user mimaison opened a pull request:

[GitHub] kafka pull request #1827: KAFKA-4081: Consumer API consumer new interface co...

2016-09-06 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/1827 KAFKA-4081: Consumer API consumer new interface commitSync does not v… …erify the validity of offset Commit throws InvalidOffsetException if the offset is negative You can merge this

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-06 Thread Becket Qin
Hi Magnus, Thanks for the comments. I agree that querying messages within a time range is a valid use case (actually this is an example use case in my previous email). The current proposal can achieve this by having two ListOffsetRequest, right? I think the current API already supports the use

[jira] [Created] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-4132: --- Summary: Make our upgrade docs more factual and less scary Key: KAFKA-4132 URL: https://issues.apache.org/jira/browse/KAFKA-4132 Project: Kafka Issue Type:

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:38 PM: -- Hi, We had

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:37 PM: -- Hi, We had

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:32 PM: -- Hi, We had

[jira] [Commented] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467695#comment-15467695 ] Bill Bejeck commented on KAFKA-4131: If it's ok, I'll pick this one up > Multiple Regex

[jira] [Assigned] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reassigned KAFKA-4131: -- Assignee: Bill Bejeck (was: Guozhang Wang) > Multiple Regex KStream-Consumers cause Null

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467691#comment-15467691 ] Charly Molter commented on KAFKA-2729: -- Hi, We had this issue on a test cluster so I took time to

[jira] [Updated] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-09-06 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated KAFKA-4130: Description: Paragraph in Kafka documentation {quote} This style of pagecache-centric design is

[jira] [Created] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread David J. Garcia (JIRA)
David J. Garcia created KAFKA-4131: -- Summary: Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class Key: KAFKA-4131 URL:

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-06 Thread Eno Thereska
A small update to the KIP: the deduping of records using the cache does not affect the .to operator since we'd have already deduped the KTable before the operator. Adjusting KIP. Thanks Eno > On 5 Sep 2016, at 12:43, Eno Thereska wrote: > > Hi Matthias, > > The

[jira] [Created] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-09-06 Thread Stevo Slavic (JIRA)
Stevo Slavic created KAFKA-4130: --- Summary: [docs] Link to Varnish architect notes is broken Key: KAFKA-4130 URL: https://issues.apache.org/jira/browse/KAFKA-4130 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread TAO XIAO (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TAO XIAO updated KAFKA-4129: Status: Patch Available (was: Open) > Processor throw exception when getting channel remote address after

[jira] [Commented] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467403#comment-15467403 ] ASF GitHub Bot commented on KAFKA-4129: --- GitHub user xiaotao183 opened a pull request:

[GitHub] kafka pull request #1826: KAFKA-4129: Processor throw exception when getting...

2016-09-06 Thread xiaotao183
GitHub user xiaotao183 opened a pull request: https://github.com/apache/kafka/pull/1826 KAFKA-4129: Processor throw exception when getting channel remote address after closing the channel Get channel remote address before calling ```channel.close``` You can merge this pull request

[jira] [Created] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread TAO XIAO (JIRA)
TAO XIAO created KAFKA-4129: --- Summary: Processor throw exception when getting channel remote address after closing the channel Key: KAFKA-4129 URL: https://issues.apache.org/jira/browse/KAFKA-4129 Project:

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Todd Palino
Yeah, that's why I mentioned it with a caveat :) Someone (I can't recall who, but it was someone I consider reasonably knowledgable as I actually gave it some weight) mentioned it, but I haven't looked into it further than that. I agree that I don't see how this is going to help us at the app

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Description: Pumping 30k msgs/second after some 6-8 hrs of run below logs are printed and the

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Priority: Critical (was: Major) > Kafka broker losses messages when zookeeper session times out

  1   2   >