Re: Request for contribution

2019-04-10 Thread Matthias J. Sax
Check out the link in section "Developers": https://cwiki.apache.org/confluence/display/KAFKA/Index -Matthias On 4/10/19 1:16 AM, Manish G wrote: > Hi, > > I am Manish, a Java programmer by profession. > > I want to learn and contribute to Kafka. > > Can you please guide me to appropriate link

[jira] [Resolved] (KAFKA-8161) Comma conflict when run script bin/kafka-configs.sh with config 'follower.replication.throttled.replicas'

2019-04-10 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxihx resolved KAFKA-8161. --- Resolution: Not A Problem > Comma conflict when run script bin/kafka-configs.sh with config > 'follower.rep

[jira] [Created] (KAFKA-8215) Limit memory usage of RocksDB

2019-04-10 Thread Sophie Blee-Goldman (JIRA)
Sophie Blee-Goldman created KAFKA-8215: -- Summary: Limit memory usage of RocksDB Key: KAFKA-8215 URL: https://issues.apache.org/jira/browse/KAFKA-8215 Project: Kafka Issue Type: Improveme

Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

2019-04-10 Thread Jason Gustafson
Hi Guozhang and Boyang, Thanks for the KIP. A few comments/questions below: 1. More of a nitpick, but `onPartitionsEmigrated` is not a very clear name. How about `onPartitionsEvicted`? Or even perhaps `onMembershipLost`? 2. For `onPartitionsEmigrated`, how will we maintain compatibility with the

Re: [DISCUSS] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-10 Thread Bruno Cadonna
Hi Marteen and John, I would opt for option 1 with an additional log message on INFO or WARN level, since the log file is the place where you would look first to understand what went wrong. I would also not adjust it when persistence stores are available for suppress. I would not go for option 2

[jira] [Created] (KAFKA-8214) Handling RecordTooLargeException in the main thread

2019-04-10 Thread Mohan Parthasarathy (JIRA)
Mohan Parthasarathy created KAFKA-8214: -- Summary: Handling RecordTooLargeException in the main thread Key: KAFKA-8214 URL: https://issues.apache.org/jira/browse/KAFKA-8214 Project: Kafka

[jira] [Created] (KAFKA-8213) KStreams interactive query documentation typo

2019-04-10 Thread Michael Drogalis (JIRA)
Michael Drogalis created KAFKA-8213: --- Summary: KStreams interactive query documentation typo Key: KAFKA-8213 URL: https://issues.apache.org/jira/browse/KAFKA-8213 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-8212) KStreams documentation Maven artifact table is cut off

2019-04-10 Thread Michael Drogalis (JIRA)
Michael Drogalis created KAFKA-8212: --- Summary: KStreams documentation Maven artifact table is cut off Key: KAFKA-8212 URL: https://issues.apache.org/jira/browse/KAFKA-8212 Project: Kafka Is

Build failed in Jenkins: kafka-trunk-jdk8 #3531

2019-04-10 Thread Apache Jenkins Server
See Changes: [bbejeck] [MINOR] Guard against crashing on invalid key range queries (#6521) -- [...truncated 1.59 MB...] org.apache.kafka.streams.integration.TableTableJoin

[jira] [Created] (KAFKA-8211) Flaky Test: ResetConsumerGroupOffsetTest.testResetOffsetsExportImportPlan

2019-04-10 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-8211: -- Summary: Flaky Test: ResetConsumerGroupOffsetTest.testResetOffsetsExportImportPlan Key: KAFKA-8211 URL: https://issues.apache.org/jira/browse/KAFKA-8211 Project: Kafka

Re: [VOTE] KIP-445: In-memory session store

2019-04-10 Thread Guozhang Wang
+1 (binding). On Tue, Apr 9, 2019 at 5:46 PM Bill Bejeck wrote: > Thanks for the KIP Sophie. > > +1(binding) > > -Bill > > On Tue, Apr 9, 2019 at 12:14 AM Matthias J. Sax > wrote: > > > Thanks for the KIP Sophie! > > > > +1 (binding) > > > > > > -Matthias > > > > On 4/8/19 5:26 PM, Sophie Blee-

[jira] [Created] (KAFKA-8210) Missing link for KStreams in Streams DSL docs

2019-04-10 Thread Michael Drogalis (JIRA)
Michael Drogalis created KAFKA-8210: --- Summary: Missing link for KStreams in Streams DSL docs Key: KAFKA-8210 URL: https://issues.apache.org/jira/browse/KAFKA-8210 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-8209) Wrong link for KStreams DSL in Core Concepts doc

2019-04-10 Thread Michael Drogalis (JIRA)
Michael Drogalis created KAFKA-8209: --- Summary: Wrong link for KStreams DSL in Core Concepts doc Key: KAFKA-8209 URL: https://issues.apache.org/jira/browse/KAFKA-8209 Project: Kafka Issue Ty

[jira] [Created] (KAFKA-8208) Broken link for out-of-order data in KStreams Core Concepts doc

2019-04-10 Thread Michael Drogalis (JIRA)
Michael Drogalis created KAFKA-8208: --- Summary: Broken link for out-of-order data in KStreams Core Concepts doc Key: KAFKA-8208 URL: https://issues.apache.org/jira/browse/KAFKA-8208 Project: Kafka

Re: [VOTE] KIP-339: Create a new IncrementalAlterConfigs API

2019-04-10 Thread Colin McCabe
Hi Rajini, That is a good point. We want to keep the "transactionality" of updating several configs for the same ConfigResource at once. SSL configs are a good example of this-- it often wouldn't make sense to change just one at once. How about an input like Map> and a result like: Map? be

Build failed in Jenkins: kafka-trunk-jdk8 #3530

2019-04-10 Thread Apache Jenkins Server
See -- [...truncated 545 B...] > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10 Fetching upstream changes from https://github.com/apache/kafka.git > git -

Re: [DISCUSS] KIP-446: Add changelog topic configuration to KTable suppress

2019-04-10 Thread John Roesler
Thanks for the update and comments, Maarten. It would be interesting to hear what others think as well. -John On Thu, Apr 4, 2019 at 2:43 PM Maarten Duijn wrote: > Thank you for the explanation regarding the internals, I have edited the > KIP accordingly and updated the Javadoc. About the possib

Re: Request for contribution

2019-04-10 Thread Bruno Cadonna
Hi Manish, Good to hear that you want to learn and contribute to Kafka. The documentation and the project info site are great starting points https://kafka.apache.org/project https://kafka.apache.org/documentation/ To start contributing take a look at https://kafka.apache.org/contributing and

[jira] [Reopened] (KAFKA-7895) Ktable supress operator emitting more than one record for the same key per window

2019-04-10 Thread John Roesler (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reopened KAFKA-7895: - > Ktable supress operator emitting more than one record for the same key per > window >

Request for contribution

2019-04-10 Thread Manish G
Hi, I am Manish, a Java programmer by profession. I want to learn and contribute to Kafka. Can you please guide me to appropriate links for it? With regards Manish

[jira] [Created] (KAFKA-8207) StickyPartitionAssignor for KStream

2019-04-10 Thread neeraj (JIRA)
neeraj created KAFKA-8207: - Summary: StickyPartitionAssignor for KStream Key: KAFKA-8207 URL: https://issues.apache.org/jira/browse/KAFKA-8207 Project: Kafka Issue Type: Improvement Compone

Jenkins build is back to normal : kafka-trunk-jdk8 #3529

2019-04-10 Thread Apache Jenkins Server
See

Partition Strategy in Kafka Stream

2019-04-10 Thread Neeraj Bhatt
Hi Which partition strategy Kafka stream uses? Can we change the partition strategy in Kafka Stream as we can change in normal Kafka Consumer streamsConfiguration.put(ConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIG,Collections.singletonList(ColombiaStrictStickyAssignor.class)); do not change t

Jenkins build is back to normal : kafka-trunk-jdk11 #430

2019-04-10 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask is stopped

2019-04-10 Thread Mickael Maison
+1 (non-binding) Thanks for the KIP! On Mon, Apr 8, 2019 at 8:07 PM Andrew Schofield wrote: > > Hi, > I’d like to begin the voting thread for KIP-419. This is a minor KIP to add a > new stopped() method to the SourceTask interface in Kafka Connect. Its > purpose is to give the task a safe oppor

Re: [DISCUSS] KIP-201: Rationalising Policy interfaces

2019-04-10 Thread Rajini Sivaram
Thanks Tom. Once you have updated the KIP to support broker config updates, it may be good to start a new vote thread since the other one is quite old and perhaps the KIP has changed since then. On Wed, Apr 10, 2019 at 3:58 AM Tom Bentley wrote: > Hi Rajini, > > I'd be happy to do that. I'll t

Re: [VOTE] KIP-360: Improve handling of unknown producer when using EOS

2019-04-10 Thread Magnus Edenhill
+1 (non-binding) Den ons 10 apr. 2019 kl 02:38 skrev Guozhang Wang : > +1 (binding). Thanks for the written KIP! The approach lgtm. > > One minor thing: the name of "last epoch" maybe a bit misleading (although > it is for internal usage only and will not be exposed to users) for future > develo

Build failed in Jenkins: kafka-trunk-jdk8 #3528

2019-04-10 Thread Apache Jenkins Server
See -- [...truncated 545 B...] > git config remote.origin.url https://github.com/apache/kafka.git # timeout=10 Fetching upstream changes from https://github.com/apache/kafka.git > git -