[jira] [Resolved] (KAFKA-7369) Retry when possible in AdminClient.listConsumerGroups

2018-08-31 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7369. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Retry when

Re: [jira] [Created] (KAFKA-7370) Enhance FileConfigProvider to read a directory

2018-08-31 Thread M. Manna
Do you want to raise a KIP and explain the motivation behind it ? Please ignore if you’re doing that already. Thanks , On Sat, 1 Sep 2018 at 00:15, Robert Yokota (JIRA) wrote: > Robert Yokota created KAFKA-7370: > > > Summary: Enhance

[jira] [Created] (KAFKA-7370) Enhance FileConfigProvider to read a directory

2018-08-31 Thread Robert Yokota (JIRA)
Robert Yokota created KAFKA-7370: Summary: Enhance FileConfigProvider to read a directory Key: KAFKA-7370 URL: https://issues.apache.org/jira/browse/KAFKA-7370 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7369) Retry when possible in AdminClient.listConsumerGroups

2018-08-31 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7369: -- Summary: Retry when possible in AdminClient.listConsumerGroups Key: KAFKA-7369 URL: https://issues.apache.org/jira/browse/KAFKA-7369 Project: Kafka

[jira] [Resolved] (KAFKA-7287) Set open ACL permissions for old consumer znode path

2018-08-31 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7287. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.1.2 Also

[jira] [Created] (KAFKA-7368) Support joining Windowed KTables

2018-08-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7368: --- Summary: Support joining Windowed KTables Key: KAFKA-7368 URL: https://issues.apache.org/jira/browse/KAFKA-7368 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7367) Verify that Streams never creates RocksDB stores unless they are needed

2018-08-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7367: --- Summary: Verify that Streams never creates RocksDB stores unless they are needed Key: KAFKA-7367 URL: https://issues.apache.org/jira/browse/KAFKA-7367 Project: Kafka

[jira] [Resolved] (KAFKA-4988) JVM crash when running on Alpine Linux

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-4988. - Resolution: Won't Fix I think this issue is out of our hands. If you think there is something

[jira] [Resolved] (KAFKA-6033) Kafka Streams does not work with musl-libc (alpine linux)

2018-08-31 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-6033. - Resolution: Won't Fix This is unfortunately out of our hands. If you think I'm wrong about

Re: [DISCUSS] KIP-347: Enable batching in FindCoordinatorRequest

2018-08-31 Thread Yishun Guan
@Guozhang Wang Could you review this again when you have time? Thanks! -Yishun On Wed, Aug 29, 2018 at 11:57 AM Yishun Guan wrote: > > Hi, because I have made some significant changes on this design, so I > want to reopen the discussion on this KIP: > https://cwiki.apache.org/confluence/x/CgZPBQ

Re: [VOTE] KIP-363: Make FunctionConversions private

2018-08-31 Thread John Roesler
Yeah, let's go ahead and do that to minimize confusion and to stick to the formal process. Sorry for the run-around. Thanks, -John On Fri, Aug 31, 2018 at 11:27 AM Joan Goyeau wrote: > Ah ok I didn't know we need multiple binding vote. > Should I send again a new email with the updated

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread John Roesler
Hi Nikolay, You can start a PR any time, but we cannot per it (and probably won't do serious reviews) until after the KIP is voted and approved. Sometimes people start a PR during discussion just to help provide more context, but it's not required (and can also be distracting because the KIP

[jira] [Created] (KAFKA-7366) topic level segment.bytes and segment.ms not taking effect immediately

2018-08-31 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-7366: -- Summary: topic level segment.bytes and segment.ms not taking effect immediately Key: KAFKA-7366 URL: https://issues.apache.org/jira/browse/KAFKA-7366 Project: Kafka

Re: [VOTE] KIP-363: Make FunctionConversions private

2018-08-31 Thread Joan Goyeau
Ah ok I didn't know we need multiple binding vote. Should I send again a new email with the updated KIP-366 title? Thanks On Wed, 29 Aug 2018 at 21:14 John Roesler wrote: > Hey Joan, > > It looks like you've updated the KIP to "Accepted", but I only count one > binding vote (Guozhang). Ted,

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread Bill Bejeck
Hi Nickolay, Thanks for the clarification. -Bill On Fri, Aug 31, 2018 at 11:59 AM Nikolay Izhikov wrote: > Hello, John. > > This is my first KIP, so, please, help me with kafka development process. > > Should I start to work on PR now? Or should I wait for a "+1" from > commiters? > > В Пт,

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread Nikolay Izhikov
Hello, John. This is my first KIP, so, please, help me with kafka development process. Should I start to work on PR now? Or should I wait for a "+1" from commiters? В Пт, 31/08/2018 в 10:33 -0500, John Roesler пишет: > I see. I guess that once we are in the PR-reviewing phase, we'll be in a >

Re: [jira] [Created] (KAFKA-7363) How num.stream.threads in streaming application influence memory consumption?

2018-08-31 Thread John Roesler
Hi Seweryn, It's a little hard to say. For one thing, extra threads have some overhead of their own, but I agree with you that the bulk of the extra memory would come from the extra throughput you're able to drive through the application. I haven't done any analysis of this before, so just

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread John Roesler
I see. I guess that once we are in the PR-reviewing phase, we'll be in a better position to see what else can/should be done, and we can talk about follow-on work at that time. Thanks for the clarification, -John On Fri, Aug 31, 2018 at 1:19 AM Nikolay Izhikov wrote: > Hello, Bill > > > In the

kafka.tools.DumpLogSegments

2018-08-31 Thread Meeiling . Bradley
Is using /opt/confluent-4.1.1/bin/kafka-run-class kafka.tools.DumpLogSegments kafka.tools.DumpLogSegments –files --print-data-log, correct way to verify that the kafka logs are compressed, if using compression.type=snappy? I have set my compression.type: snappy in my property file for kafka

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-08-31 Thread Dongjin Lee
I just updated the draft implementation[^1], rebasing against the latest trunk and implementing error routine (i.e., Error code 74 for UnsupportedCompressionTypeException.) Since we decided to disallow all fetch request below version 2.1.0 for the topics specifying ZStandard, I added an error

Re: [DISCUSS] KIP-363: Allow performance tools to print final results to output file

2018-08-31 Thread Attila Sasvári
Hi all, I have updated the KIP based on the suggestions received so far, please take a look at the new version: https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file Best, - Attila On Fri, Aug 24, 2018 at 3:52 PM Attila

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-31 Thread M. Manna
Yes I’m more than happy to change it to a more appropriate name. The issue with RoundRobinPatitoner is that the DefaultPartitioner already has a Round-Robin associated to it. But if community doesn’t mind the name, I don’t either. Thanks for reading the KIP btw. Regards, On Fri, 31 Aug 2018 at

[jira] [Created] (KAFKA-7365) max.poll.records setting in Kafka Consumer is not working

2018-08-31 Thread Kashyap Ivaturi (JIRA)
Kashyap Ivaturi created KAFKA-7365: -- Summary: max.poll.records setting in Kafka Consumer is not working Key: KAFKA-7365 URL: https://issues.apache.org/jira/browse/KAFKA-7365 Project: Kafka

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread Nikolay Izhikov
Hello, Bill > In the "Proposed Changes" section, there is "Try to reduce the visibility of > methods in next tickets" does that mean eventual deprecation and removal? 1. Some methods will become deprecated. I think they will be removed in the future. You can find list of deprecated methods in

[jira] [Created] (KAFKA-7364) kafka periodically run into high cpu usage with ssl writing

2018-08-31 Thread Yu Yang (JIRA)
Yu Yang created KAFKA-7364: -- Summary: kafka periodically run into high cpu usage with ssl writing Key: KAFKA-7364 URL: https://issues.apache.org/jira/browse/KAFKA-7364 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7363) How num.stream.threads in streaming application influence memory consumption?

2018-08-31 Thread Seweryn Habdank-Wojewodzki (JIRA)
Seweryn Habdank-Wojewodzki created KAFKA-7363: - Summary: How num.stream.threads in streaming application influence memory consumption? Key: KAFKA-7363 URL: