[jira] [Created] (KAFKA-7307) Upgrade EasyMock for Java 11 support

2018-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-7307: -- Summary: Upgrade EasyMock for Java 11 support Key: KAFKA-7307 URL: https://issues.apache.org/jira/browse/KAFKA-7307 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-7310) Fix SSL tests when running with Java 11

2018-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-7310: -- Summary: Fix SSL tests when running with Java 11 Key: KAFKA-7310 URL: https://issues.apache.org/jira/browse/KAFKA-7310 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-7308) Fix rat and checkstyle plugins configuration for Java 11 support

2018-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-7308: -- Summary: Fix rat and checkstyle plugins configuration for Java 11 support Key: KAFKA-7308 URL: https://issues.apache.org/jira/browse/KAFKA-7308 Project: Kafka

[jira] [Created] (KAFKA-7309) Upgrade Jacoco for Java 11 support

2018-08-17 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-7309: -- Summary: Upgrade Jacoco for Java 11 support Key: KAFKA-7309 URL: https://issues.apache.org/jira/browse/KAFKA-7309 Project: Kafka Issue Type: Sub-task

Jenkins build is back to normal : kafka-trunk-jdk10 #414

2018-08-17 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7306) Ability for produce to push to topic on remote server

2018-08-17 Thread t oo (JIRA)
t oo created KAFKA-7306: --- Summary: Ability for produce to push to topic on remote server Key: KAFKA-7306 URL: https://issues.apache.org/jira/browse/KAFKA-7306 Project: Kafka Issue Type: New Feature

Build failed in Jenkins: kafka-trunk-jdk8 #2906

2018-08-17 Thread Apache Jenkins Server
See Changes: [mjsax] MINOR: Change order of Property Check To Avoid NPE (#5528) [wangguoz] Minor: add valueChangingOperation and mergeNode to -- [...truncated 425.78

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-08-17 Thread Ismael Juma
Hi Dongjin and Jason, I would agree. My summary: 1. Support zstd with message format 2 only. 2. Bump produce and fetch request versions. 3. Provide broker errors whenever possible based on the request version and rely on clients for the cases where the broker can't validate efficiently (example

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-08-17 Thread Jason Gustafson
Hi Dongjin, Yes, that's a good summary. For clients which support v2, the client can parse the message format and hopefully raise a useful error message indicating the unsupported compression type. For older clients, our options are probably (1) to down-convert to the old format using no

Build failed in Jenkins: kafka-trunk-jdk10 #413

2018-08-17 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Update test to wait for final value to reduce flakiness updated -- [...truncated 1.95 MB...] at

Build failed in Jenkins: kafka-trunk-jdk8 #2905

2018-08-17 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6998: Disable Caching when max.cache.bytes are zero. (#5488) [wangguoz] MINOR: Update test to wait for final value to reduce flakiness updated

Build failed in Jenkins: kafka-trunk-jdk10 #412

2018-08-17 Thread Apache Jenkins Server
See Changes: [github] KAFKA-6998: Disable Caching when max.cache.bytes are zero. (#5488) -- [...truncated 1.99 MB...]

Re: [DISCUSS] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-17 Thread John Roesler
Hi Nikolay, Thanks for this very nice KIP! To answer your questions: 1. Correct, we should not delete existing methods that have been released, but ... 2. Yes, we should deprecate the 'long' variants so that we can drop them later on. Personally, I like to mention which version deprecated the

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-08-17 Thread Jan Filipiak
Cool stuff. I made some random remarks. Did not touch the core of the algorithm yet. Will do Monday 100% I don't see Interactive Queries :) like that! On 17.08.2018 20:28, Adam Bellemare wrote: I have submitted a PR with my code against trunk: https://github.com/apache/kafka/pull/5527 Do

Re: 答复: [VOTE] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-17 Thread Yishun Guan
Thanks for the clarification. I will address this in my KIP. On Fri, Aug 17, 2018, 12:06 PM Guozhang Wang wrote: > Today we do have logic for auto down-conversion, but it is assuming a > one-to-one mapping. The actual logic is here: > > >

Re: [DISCUSS] KIP-357: Add support to list ACLs per principal

2018-08-17 Thread Priyank Shah
+1(non-binding) Thanks. Priyank On 8/16/18, 6:01 AM, "Manikumar" wrote: Hi all, I have created a minor KIP to add support to list ACLs per principal using AclCommand (kafka-acls.sh)

Re: 答复: [VOTE] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-17 Thread Guozhang Wang
Today we do have logic for auto down-conversion, but it is assuming a one-to-one mapping. The actual logic is here: https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/NetworkClient.java#L775 As you can see, NetworkClient maintains a "apiVersions" map that

Re: 答复: [VOTE] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-17 Thread Yishun Guan
@Guozhang Wang One thing that I remain confused about (and forgive me if you have explained this to me before), is that if we don't have any transformation helpers (between versions) implemented before, how do we deal with other incompatibility issues when we try to update requests and bump up

Re: [VOTE] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-17 Thread Priyank Shah
+1 (non-binding) Thanks Priyank On 8/17/18, 1:34 AM, "Mickael Maison" wrote: +1 (non-binding) Thanks Vahid! On Fri, Aug 17, 2018 at 7:34 AM Manikumar wrote: > > +1 (non-binding) > > Thanks for the KIP. > > On Fri, Aug 17, 2018 at 9:41 AM Satish Duggana

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-08-17 Thread Adam Bellemare
I have submitted a PR with my code against trunk: https://github.com/apache/kafka/pull/5527 Do I continue on this thread or do we begin a new one for discussion? On Thu, Aug 16, 2018 at 1:40 AM, Jan Filipiak wrote: > even before message headers, the option for me always existed to just wrap >

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-08-17 Thread Jason Gustafson
> > The issue with the __consumer_offsets topic is problematic, that is true. > Nevertheless, I have some concerns with having a certain threshold of > `uncleanable.bytes`. There is now a chance that a single error in a big > partition (other than __consumer_offsets) marks the directory as offline

Build failed in Jenkins: kafka-trunk-jdk8 #2904

2018-08-17 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H26 (ubuntu xenial) in workspace

Re: 答复: [VOTE] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-17 Thread Guozhang Wang
Yishun, some more comments: 1. "All the coordinator ids " + "for this request": it should be "all the requested group ids looking for their coordinators" right? 2. I just thought about this a bit more, regarding "*Compatibility issues between old and new versions need to be considered, we should

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

2018-08-17 Thread Guozhang Wang
+1 from myself as well. I'm closing this voting thread with three binding votes (Matthias, Damian, myself) and two non-binding votes (Bill, Eno). Thanks, Guozhang On Wed, Aug 15, 2018 at 1:18 AM, Damian Guy wrote: > +1 > > On Tue, 14 Aug 2018 at 22:58 Matthias J. Sax > wrote: > > > +1

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-08-17 Thread Dongjin Lee
Thanks Jason, I reviewed the down-converting logic following your explanation.[^1] You mean the following routines, right? - https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/server/KafkaApis.scala#L534 -

[jira] [Created] (KAFKA-7305) Offsets should not expire at the record-entry level

2018-08-17 Thread Evgeniy Efimov (JIRA)
Evgeniy Efimov created KAFKA-7305: - Summary: Offsets should not expire at the record-entry level Key: KAFKA-7305 URL: https://issues.apache.org/jira/browse/KAFKA-7305 Project: Kafka Issue

[jira] [Resolved] (KAFKA-5444) Producer.send() will hang 8+ hours

2018-08-17 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5444. -- Resolution: Fixed Closing as per above comment. Please reopen if the issue still exists. >

Re: [VOTE] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-17 Thread Mickael Maison
+1 (non-binding) Thanks Vahid! On Fri, Aug 17, 2018 at 7:34 AM Manikumar wrote: > > +1 (non-binding) > > Thanks for the KIP. > > On Fri, Aug 17, 2018 at 9:41 AM Satish Duggana > wrote: > > > +1 > > > > Thanks, > > Satish. > > > > On Fri, Aug 17, 2018 at 1:45 AM, Bill Bejeck wrote: > > > > > +1

[jira] [Created] (KAFKA-7304) memory leakage in org.apache.kafka.common.network.Selector

2018-08-17 Thread Yu Yang (JIRA)
Yu Yang created KAFKA-7304: -- Summary: memory leakage in org.apache.kafka.common.network.Selector Key: KAFKA-7304 URL: https://issues.apache.org/jira/browse/KAFKA-7304 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-17 Thread Manikumar
+1 (non-binding) Thanks for the KIP. On Fri, Aug 17, 2018 at 9:41 AM Satish Duggana wrote: > +1 > > Thanks, > Satish. > > On Fri, Aug 17, 2018 at 1:45 AM, Bill Bejeck wrote: > > > +1 > > > > Thanks, > > Bill > > > > On Thu, Aug 16, 2018 at 3:13 PM Ted Yu wrote: > > > > > +1 > > > > > > On