Re: wiki permission please!

2018-09-30 Thread Matthias J. Sax
Done On 9/27/18 11:51 AM, Ryanne Dolan wrote: > I would like to create some KIPs. > > JIRA user: ryannedolan > wiki user: ryannedolan > Ryanne Dolan > ryannedo...@gmail.com > > Thanks! > Ryanne > signature.asc Description: OpenPGP digital signature

Re: Apache Kafka project charter

2018-09-30 Thread Matthias J. Sax
I am not aware of anything like this. And I also think, it's difficult to generalize. So far, each feature is discussed on a per-case basis. Because it's hard to draw the boarder line we might be too restrictive or too loose in a "project charter", thus, scaring people from starting KIPs, what

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-09-30 Thread Matthias J. Sax
+1 (binding) @Abhimanyu: can you please update the table in https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals and add a link to the KIP. Thanks. -Matthias On 9/4/18 9:56 PM, Abhimanyu Nagrath wrote: > +1 > > On Wed, Sep 5, 2018 at 2:39 AM Magesh Nandakumar > wrote:

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-09-30 Thread nick
> On Sep 30, 2018, at 5:16 AM, Dongjin Lee wrote: > > 1. Your KIP document > > > > lacks hyperlink to the

Re: [DISCUSS]: KIP-230: Name Windowing Joins

2018-09-30 Thread Matthias J. Sax
With KIP-372 accepted, we can retire this KIP, because it's subsumed. https://cwiki.apache.org/confluence/display/KAFKA/KIP-372%3A+Naming+Repartition+Topics+for+Joins+and+Grouping I'll update the wiki pages accordingly. Thanks for initiating this KIP Florian! -Matthias On 6/10/18 5:24 PM,

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

2018-09-30 Thread Matthias J. Sax
It seems that KIP-320 was accepted. Thus, I am wondering what the status of this KIP is? -Matthias On 7/11/18 10:59 AM, Dong Lin wrote: > Hey Jun, > > Certainly. We can discuss later after KIP-320 settles. > > Thanks! > Dong > > > On Wed, Jul 11, 2018 at 8:54 AM, Jun Rao wrote: > >> Hi,

[DISCUSS] KIP-378: Enable Dependency Injection for Kafka Streams handlers

2018-09-30 Thread Wladimir Schmidt
Dear colleagues, I am happy to inform you that I have just finished my first KIP (KIP-378: Enable Dependency Injection for Kafka Streams handlers ). Your feedback on this

[jira] [Resolved] (KAFKA-6273) Allow names for windowing joins

2018-09-30 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6273. Resolution: Duplicate > Allow names for windowing joins > ---

Build failed in Jenkins: kafka-trunk-jdk10 #538

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [DISCUSS] KIP-280: Enhanced log compaction

2018-09-30 Thread Matthias J. Sax
Luis, What is the status of this KIP? I tend to agree, that introducing the feature only globally, might be less useful (I would assume that people want to turn it on, on a per-topic basis). As I am not familiar with the corresponding code, I cannot judge the complexity to add topic level

Re: [DISCUSS] KIP-333 Consider a faster form of rebalancing

2018-09-30 Thread Matthias J. Sax
What is the status of this KIP? I was just catching up and I agree with Becket that it seems a very special use case, that might not be generic enough to be part of Kafka itself. Also, for regular rebalance, as Becket pointed out, catching up should not take very long. Only for longer offline

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-09-30 Thread Matthias J. Sax
+1 (binding) As Dongjin pointed out, the community is working on upcoming 2.1 release, and thus it might take some time until people find time to follow up on this an vote. -Matthias On 9/30/18 11:11 AM, n...@afshartous.com wrote: > >> On Sep 30, 2018, at 5:16 AM, Dongjin Lee wrote: >> >> 1.

Build failed in Jenkins: kafka-trunk-jdk10 #539

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

2018-09-30 Thread Matthias J. Sax
It seems Jeyhun (cc'ed) is not working on the KIP any longer. If there is no response within a week from Jeyhun, feel free to take over the KIP. One more side comment: we recently accepted KIP-372, that overlaps with this KIP. Thus, if you resume KIP-221, please consider the changes of KIP-372.

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

2018-09-30 Thread Dong Lin
Hey Matthias, Thanks for checking back on the status. The KIP has been marked as replaced by KIP-320 in the KIP list wiki page and the status has been updated in the discussion and voting email thread. Thanks, Dong On Sun, 30 Sep 2018 at 11:51 AM Matthias J. Sax wrote: > It seems that

Build failed in Jenkins: kafka-trunk-jdk8 #3028

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

2018-09-30 Thread Matthias J. Sax
Ah thanks. I did not check the wiki but just browsed through all open KIP discussions following the email threads. -Matthias On 9/30/18 12:06 PM, Dong Lin wrote: > Hey Matthias, > > Thanks for checking back on the status. The KIP has been marked as > replaced by KIP-320 in the KIP list wiki

Build failed in Jenkins: kafka-trunk-jdk8 #3029

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: Accessing Topology Builder

2018-09-30 Thread Matthias J. Sax
For most operators yes. For sure, for all stateless operators like `mapValues()` -- for stateful operators, it depends if data repartitioning is required. If yes, the topology would be split into two sub-topologies and thus, both `peek()` operations could run on different threads. If you want to

Build failed in Jenkins: kafka-trunk-jdk8 #3027

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [DISCUSS] KIP-378: Enable Dependency Injection for Kafka Streams handlers

2018-09-30 Thread Guozhang Wang
Hello Wladimir, Thanks for proposing the KIP. I think the injection can currently be done by passing in the key/value pair directly into the properties which can then be accessed from the `ProcessorContext#appConfigs` or `#appConfigsWithPrefix`. For example, when constructing the properties you

Re: [DISCUSSION] KIP-376: Implement AutoClosable on appropriate classes that has close()

2018-09-30 Thread Matthias J. Sax
Closeable is part of `java.io` while AutoClosable is part of `java.lang`. Thus, the second one is more generic. Also, JavaDoc points out that `Closable#close()` must be idempotent while `AutoClosable#close()` can have side effects. Thus, I am not sure atm which one suits better. However, it's a

Build failed in Jenkins: kafka-trunk-jdk8 #3030

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

[jira] [Resolved] (KAFKA-7460) Connect Values converter uses incorrect date format string

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-7460. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1

Re: Apache Kafka project charter

2018-09-30 Thread Ewen Cheslack-Postava
Hey all, Sorry I haven't been closely following the threads on this, but I think I can provide a bit more color. Jakub, re: general policy, I'll take the blame that the relevant "rejected alternatives" section in the KIP

Build failed in Jenkins: kafka-trunk-jdk10 #546

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #3034

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-1.1-jdk7 #209

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H29 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #542

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

[DISCUSS] Replacing EasyMock with Mockito in Kafka

2018-09-30 Thread Ismael Juma
Hi all, As described in KAFKA-7438 , EasyMock's development has stagnated. This presents a number of issues: 1. Blocks us from running tests with newer Java versions, which is a frequent occurrence give the new Java release cadence. It is the

[jira] [Created] (KAFKA-7461) Connect Values converter should have coverage of logical types

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-7461: Summary: Connect Values converter should have coverage of logical types Key: KAFKA-7461 URL: https://issues.apache.org/jira/browse/KAFKA-7461

Re: [DISCUSS] KIP-374: Add '--help' option to all available Kafka CLI commands

2018-09-30 Thread Srinivas Reddy
Hi Dongjin, I have identified most of the code changes for this task. I can raise a GitHub PR if community think this is a good to have feature in Kafka. Should I start working on it? - Srinivas - Typed on tiny keys. pls ignore typos.{mobile app} On Thu 27 Sep, 2018, 14:40 Dongjin Lee,

Re: Anyone interested in helping out a little brother Apache project with their Kafka integration?

2018-09-30 Thread Ewen Cheslack-Postava
Chris, Can you point at the starting point for your Connector? Happy to do a quick review of code. I'll admit, I'm a bit confused by the PLC4X positioning -- it seems to claim to be universal IoT protocol, but then I see, e.g., nothing about MQTT on the front page, a protocol that Kafka Connect

Build failed in Jenkins: kafka-trunk-jdk10 #541

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

[jira] [Created] (KAFKA-7460) Connect Values converter uses incorrect date format string

2018-09-30 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-7460: Summary: Connect Values converter uses incorrect date format string Key: KAFKA-7460 URL: https://issues.apache.org/jira/browse/KAFKA-7460 Project:

Build failed in Jenkins: kafka-trunk-jdk8 #3032

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #544

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #543

2018-09-30 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7223: internally provide full consumer record during restore [mjsax] MINOR: don't log config during unit tests (#5671) -- [...truncated

[jira] [Resolved] (KAFKA-7459) Concurrency bug in updating RequestsPerSec metric

2018-09-30 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7459. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Concurrency bug in

Build failed in Jenkins: kafka-1.1-jdk7 #208

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H29 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #545

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #3035

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Jenkins build is back to normal : kafka-trunk-jdk10 #540

2018-09-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #3031

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-1.1-jdk7 #207

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H29 (ubuntu xenial) in workspace

Jenkins build is back to normal : kafka-trunk-jdk8 #3033

2018-09-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk10 #534

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #3023

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #3022

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #3021

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #535

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #536

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu xenial) in workspace

[DISCUSS] KIP-378: Enable Dependency Injection for Kafka Streams handlers

2018-09-30 Thread Wladimir Schmidt
Dear colleagues, I am happy to inform you that I have just finished my first KIP (KIP-378: Enable Dependency Injection for Kafka Streams handlers ). Your feedback on this

Re: [DISCUSS] KIP-378: Enable Dependency Injection for Kafka Streams handlers

2018-09-30 Thread Dongjin Lee
Hi Wladimir, Thanks for your great KIP. Let me have a look. And let's discuss this KIP in depth after the release of 2.1.0. (The committers are very busy for it.) Best, Dongjin On Sun, Sep 30, 2018 at 10:49 PM Wladimir Schmidt wrote: > Dear colleagues, > > I am happy to inform you that I have

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

2018-09-30 Thread Adam Bellemare
Hi Jan With the Stores.windowStoreBuilder and Stores.persistentWindowStore, you actually only need to specify the amount of segments you want and how large they are. To the best of my understanding, what happens is that the segments are automatically rolled over as new data with new timestamps

Build failed in Jenkins: kafka-trunk-jdk8 #3026

2018-09-30 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7434: Fix NPE in DeadLetterQueueReporter [lindong28] MINOR: Update Scala to 2.12.7, lz4-java to 1.5 and others -- [...truncated 2.69 MB...]

Jenkins build is back to normal : kafka-trunk-jdk10 #537

2018-09-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #3024

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [VOTE] KIP-349 Priorities for Source Topics

2018-09-30 Thread Dongjin Lee
Hi Nick, Thanks for your proposal. However, I have two things I would like to point out: 1. Your KIP document lacks hyperlink to the discussion thread. And I couldn`t find the discussion thread from the

Build failed in Jenkins: kafka-trunk-jdk8 #3025

2018-09-30 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace