Re: [VOTE] Allowing write access to GitHub repositories (aka GitBox)

2017-12-12 Thread Damian Guy
+1 On Tue, 12 Dec 2017 at 15:47 Ismael Juma wrote: > Hi all, > > The Apache Infra team has started a new project earlier this year called > GitBox that supports two-way synchronization between GitHub and > git-wip-us.apache.org and, most importantly, provides GitHub write

[jira] [Created] (KAFKA-6349) ConcurrentModificationException during streams state restoration

2017-12-12 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-6349: - Summary: ConcurrentModificationException during streams state restoration Key: KAFKA-6349 URL: https://issues.apache.org/jira/browse/KAFKA-6349 Project: Kafka

Re: [DISCUSS] Allowing write access to GitHub repositories

2017-12-12 Thread Damian Guy
+1 On Tue, 12 Dec 2017 at 10:20 Rajini Sivaram wrote: > Hi Ismael, > > Thank you for looking into this. Sounds like a good improvement. > > Regards, > > Rajini > > On Mon, Dec 11, 2017 at 6:35 AM, Guozhang Wang wrote: > > > Sounds good to me. > > >

[jira] [Created] (KAFKA-6259) Make KafkaStreams.cleanup() clean global state directory

2017-11-22 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-6259: - Summary: Make KafkaStreams.cleanup() clean global state directory Key: KAFKA-6259 URL: https://issues.apache.org/jira/browse/KAFKA-6259 Project: Kafka Issue Type

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-11-22 Thread Damian Guy
gt; >>> page before chatting more. > >>> > >>> > >>> Guozhang > >>> > >> > >> > >> On 11/6/17 1:41 PM, Jeyhun Karimov wrote: > >> > >>> Hi Matthias, > >>> > >>> Thanks a lot for correcting. It is

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

2017-11-20 Thread Damian Guy
+1 On Mon, 20 Nov 2017 at 17:52 Gwen Shapira wrote: > +1 > > Make sense. We have a supplier for every other client type :) > > On Fri, Nov 17, 2017 at 1:33 PM Matthias J. Sax > wrote: > > > +1 > > > > On 11/17/17 9:35 AM, Ted Yu wrote: > > > +1 > > > >

Re: SessionKeySchema#segmentsToSearch()

2017-11-20 Thread Damian Guy
w.r.t `SessionKeySchema` MAX_VALUE is correct. This is because we use the end time (rather than the start time) of the session to define which segment the session is in. So it could be in any segment starting from `from` time. On Sun, 19 Nov 2017 at 20:27 Ted Yu wrote: >

Re: [VOTE] KIP-224: Add configuration parameters `retries` to Streams API

2017-11-14 Thread Damian Guy
+1 On Tue, 14 Nov 2017 at 02:40 Bill Bejeck wrote: > Thanks for the KIP, +1 > > -Bill > > On Mon, Nov 13, 2017 at 7:25 PM, Ted Yu wrote: > > > +1 > > > > On Mon, Nov 13, 2017 at 4:20 PM, Matthias J. Sax > > wrote: > > > > > Hi

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-11-10 Thread Damian Guy
+1 (binding) - thanks On Tue, 7 Nov 2017 at 15:14 Paolo Patierno wrote: > Because Guozhang and Colin are doing a great job on reviewing the related > PR and we are really close to have it in a decent/final shape, what do the > other committers think about this KIP ? > > We

Re: [DISCUSS] KIP-224: Add configuration parameters `retries` and `retry.backoff.ms` to Streams API

2017-11-09 Thread Damian Guy
> > > > > -Bill > > > > On Thu, Nov 9, 2017 at 8:40 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > lgtm > > > > > > bq. pass both parameter > > > > > > parameter should be in plural. > > > S

Re: [DISCUSS] KIP-224: Add configuration parameters `retries` and `retry.backoff.ms` to Streams API

2017-11-09 Thread Damian Guy
Thanks Matthias, LGTM On Thu, 9 Nov 2017 at 11:13 Matthias J. Sax wrote: > Hi, > > I want to propose a new KIP to make Streams API more resilient to broker > disconnections. > > >

Re: [VOTE] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-11-08 Thread Damian Guy
+1 (binding) On Sat, 4 Nov 2017 at 16:50 Matthias J. Sax wrote: > Yes. A KIP needs 3 binding "+1" to be accepted. > > You can still work on the PR and get it ready to get merged -- I am > quite confident that this KIP will be accepted :) > > > -Matthias > > On 11/4/17

[jira] [Resolved] (KAFKA-6186) RocksDB based WindowStore fail to create db file on Windows OS

2017-11-08 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6186. --- Resolution: Duplicate > RocksDB based WindowStore fail to create db file on Windows

Re: [ANNOUNCE] Apache Kafka 1.0.0 Released

2017-11-02 Thread Damian Guy
de, including > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > A big thank you for the following 108 contributors to this release! > > Abhishek Mendhekar, Xi Hu, Andras Beni, Andrey Dyachk

Re: wiki access for KIP

2017-11-01 Thread Damian Guy
Hi Steven, You should have permission now. Thanks, Damian On Wed, 1 Nov 2017 at 06:43 Steven Aerts wrote: > I hereby would like to request write access to the wiki to create a > KIP for KAFKA-6018. > > My wiki id is steven.aerts. > > Thanks, > > >Steven >

Re: Re: [DISCUSS] KIP-213 Support non-key joining in KTable

2017-11-01 Thread Damian Guy
Hi Jan, Thanks for the KIP! In both alternatives the API will need to use the `Joined` class rather than than passing in `Serde`s. Also, as with all other joins etc, there probably should be an overload that doesn't require any `Serdes`. It isn't clear to me what `joinPrefixFaker` is doing? In

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-11-01 Thread Damian Guy
;>>>>>>>>>> > > >>>>>>>>>>> 2. Some of the listed functions are not necessary since their > > >>>>> pairing > > >>>>>>>>>> APIs > > >>>>>>>>>>> are being deprecated in 1.0

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-10-31 Thread Damian Guy
Thanks for the KIP - +1 (binding) On Mon, 23 Oct 2017 at 18:39 Guozhang Wang wrote: > Thanks Jorge for driving this KIP! +1 (binding). > > > Guozhang > > On Mon, Oct 16, 2017 at 2:11 PM, Bill Bejeck wrote: > > > +1 > > > > Thanks, > > Bill > > > > On Fri,

Re: [VOTE] KIP-205: Add all() and range() API to ReadOnlyWindowStore

2017-10-25 Thread Damian Guy
+1 On Tue, 24 Oct 2017 at 16:46 Guozhang Wang wrote: > +1. Thanks. > > On Mon, Oct 23, 2017 at 8:11 PM, Richard Yu > wrote: > > > Hi all, > > > > I want to propose KIP-205 for the addition of new API. It is about adding > > methods similar to

Re: Authorize to create a KIP page

2017-10-25 Thread Damian Guy
Hi Jan, You should have permissions now. Thanks, Damian On Wed, 25 Oct 2017 at 09:41 Jan Filipiak wrote: > Hello, > > to get KAFKA-3705 moving a little bit more I am thinking of starting a > KIP to discuss the finaly API design. > > My confluence id is: "jfilipiak"

[jira] [Resolved] (KAFKA-6069) Streams metrics tagged incorrectly

2017-10-19 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6069. --- Resolution: Fixed Fix Version/s: 1.0.1 1.1.0 Issue resolved by pull request

Re: KIP Access

2017-10-18 Thread Damian Guy
Hi Matt, You should have permission now. Thanks, Damian On Wed, 18 Oct 2017 at 15:54 Matt Farmer wrote: > Hey everyone, > > I'm a software engineer at MailChimp working on our Data Systems team. I'm > looking to file a KIP to improve the error handling hooks that Kafka > Streams

[jira] [Resolved] (KAFKA-6023) ThreadCache#sizeBytes() should check overflow

2017-10-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6023. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4041 [https://github.com

[jira] [Resolved] (KAFKA-4890) State directory being deleted when another thread holds the lock

2017-10-04 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4890. --- Resolution: Duplicate > State directory being deleted when another thread holds the l

[jira] [Resolved] (KAFKA-5985) Mention the need to close store iterators

2017-10-02 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5985. --- Resolution: Fixed Issue resolved by pull request 3994 [https://github.com/apache/kafka/pull/3994

[jira] [Created] (KAFKA-6001) Remove <Bytes, byte[]> from usages of Materialized in Streams

2017-10-02 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-6001: - Summary: Remove <Bytes, byte[]> from usages of Materialized in Streams Key: KAFKA-6001 URL: https://issues.apache.org/jira/browse/KAFKA-6001 Project: Kafka

[jira] [Created] (KAFKA-5986) Streams State Restoration never completes when logging is disabled

2017-09-28 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5986: - Summary: Streams State Restoration never completes when logging is disabled Key: KAFKA-5986 URL: https://issues.apache.org/jira/browse/KAFKA-5986 Project: Kafka

[jira] [Resolved] (KAFKA-5765) Move merge() from StreamsBuilder to KStream

2017-09-26 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5765. --- Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.0.0 Issue resolved

[jira] [Resolved] (KAFKA-5489) Failing test: InternalTopicIntegrationTest.shouldCompactTopicsForStateChangelogs

2017-09-25 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5489. --- Resolution: Cannot Reproduce Closing this as i haven't seen it fail in a while and i'm unable

[jira] [Resolved] (KAFKA-5956) StreamBuilder#table and StreamsBuilder#globalTable should use serdes from Materialized

2017-09-22 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5956. --- Resolution: Fixed Issue resolved by pull request 3936 [https://github.com/apache/kafka/pull/3936

[jira] [Created] (KAFKA-5956) StreamBuilder#table and StreamsBuilder#globalTable should use serdes from Materialized

2017-09-21 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5956: - Summary: StreamBuilder#table and StreamsBuilder#globalTable should use serdes from Materialized Key: KAFKA-5956 URL: https://issues.apache.org/jira/browse/KAFKA-5956

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-09-21 Thread Damian Guy
gt; (because we want both KIP-149 and KIP-159 to be as an "atomic" merge). So > I decided to wait until KIP-182 gets stable (there are some minor updates > AFAIK) and update the KIP accordingly. Please correct me if I am wrong or I > misunderstood. > > Cheers, > Je

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-09-21 Thread Damian Guy
Hi All, There has been one further update to the KIP. WindowedKStream has been renamed to TimeWindowedKStream. Thanks, Damian On Tue, 19 Sep 2017 at 12:21 Damian Guy <damian@gmail.com> wrote: > All, a small addition to the KIP. During implementation we realized it > would be

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-09-21 Thread Damian Guy
> > .. > > > > } > > > > > > > > > > > > So, we check the type of object, whether it is RichXXX or XXXWithKey > > > inside > > > > the called method and continue accordingly. > > > > > >

[jira] [Resolved] (KAFKA-5931) Deprecate KTable#to and KTable#through

2017-09-20 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5931. --- Resolution: Fixed Issue resolved by pull request 3903 [https://github.com/apache/kafka/pull/3903

[jira] [Created] (KAFKA-5939) Add a dryrun option to release.py

2017-09-20 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5939: - Summary: Add a dryrun option to release.py Key: KAFKA-5939 URL: https://issues.apache.org/jira/browse/KAFKA-5939 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-202

2017-09-19 Thread Damian Guy
+1 On Tue, 19 Sep 2017 at 14:15 Bill Bejeck wrote: > +1 > > -Bill > > On Tue, Sep 19, 2017 at 4:41 AM, Guozhang Wang wrote: > > > Thanks for the KIP, +1. > > > > If we can make it in 1.0.0, I think we can just remove the merge() in > > StreamsBuilder as

[jira] [Created] (KAFKA-5931) Deprecate KTable#to and KTable#through

2017-09-19 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5931: - Summary: Deprecate KTable#to and KTable#through Key: KAFKA-5931 URL: https://issues.apache.org/jira/browse/KAFKA-5931 Project: Kafka Issue Type: Sub-task

Re: [Discuss] KIP-202 Move merge() from StreamsBuilder to KStream

2017-09-19 Thread Damian Guy
Hi Richard, Thanks for the KIP. Looks good, just one thing: we don't need to deprecate StreamBuilder#merge as it has been added during this release cycle. It can just be removed. Thanks, Damian On Mon, 18 Sep 2017 at 23:22 Richard Yu wrote: > The discussion should

[jira] [Resolved] (KAFKA-5873) Add Materialized overloads to StreamBuilder

2017-09-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5873. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3837 [https://github.com

[jira] [Created] (KAFKA-5922) Add SessionWindowedKStream

2017-09-18 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5922: - Summary: Add SessionWindowedKStream Key: KAFKA-5922 URL: https://issues.apache.org/jira/browse/KAFKA-5922 Project: Kafka Issue Type: Sub-task Components

[jira] [Created] (KAFKA-5921) Add Materialized overloads to WindowedKStream

2017-09-18 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5921: - Summary: Add Materialized overloads to WindowedKStream Key: KAFKA-5921 URL: https://issues.apache.org/jira/browse/KAFKA-5921 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-5754) Refactor Streams to use LogContext

2017-09-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5754. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3727 [https://github.com

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-09-15 Thread Damian Guy
s a syntax sugar. I think the extra step "toStream" > is actually better to remind the caller that it is sending its changelog > stream to topic, plus it is not that much characters. > > > Guozhang > > On Wed, Sep 13, 2017 at 12:40 AM, Damian Guy <damian@gma

[jira] [Resolved] (KAFKA-5908) CompositeReadOnlyWindowStore range fetch doesn't return all values when fetching with different start and end times

2017-09-15 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5908. --- Resolution: Fixed Issue resolved by pull request 3868 [https://github.com/apache/kafka/pull/3868

[jira] [Created] (KAFKA-5908) CompositeReadOnlyWindowStore range fetch doesn't return all values when fetching with different start and end times

2017-09-15 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5908: - Summary: CompositeReadOnlyWindowStore range fetch doesn't return all values when fetching with different start and end times Key: KAFKA-5908 URL: https://issues.apache.org/jira/browse

Re: [ANNOUCE] Apache Kafka 0.11.0.1 Released

2017-09-13 Thread Damian Guy
afka/kafka-clients > > Do you know when artifacts would be visible for downstream projects ? > > Thanks > > On Wed, Sep 13, 2017 at 4:36 AM, Damian Guy <damian...@apache.org> wrote: > > > The Apache Kafka community is pleased to announce the release for Apache >

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-09-13 Thread Damian Guy
KIP with regard to DSL refactoring. IMHO, we can > >> just finish this one and the DSL refactoring will help later on to > >> reduce the number of overloads. > >> > >> -Matthias > >> > >> On 7/7/17 5:28 AM, Jeyhun Karimov wrote: > >> >

[ANNOUCE] Apache Kafka 0.11.0.1 Released

2017-09-13 Thread Damian Guy
/www.apache.org/dyn/closer.cgi?path=/kafka/0.11.0.1/ kafka_2.12-0.11.0.1.tgz <https://www.apache.org/dyn/closer.cgi?path=/kafka/0.11.0.0/kafka_2.12-0.11.0.0.tgz> >* A big thank you for the following 33 contributors to this release! Apurva Mehta, Bill Bejeck, Colin P. Mccabe, Damian Guy, Derrick Or,

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-09-13 Thread Damian Guy
> KTable.toStream if people agree that it is confusing to users? > > > Guozhang > > > On Tue, Sep 12, 2017 at 1:18 AM, Damian Guy <damian@gmail.com> wrote: > > > Hi All, > > > > A minor update to the KIP, i needed to add KTable.to(Produced) for >

[jira] [Resolved] (KAFKA-5655) Add new API methods to KGroupedTable

2017-09-12 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5655. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3829 [https://github.com

[RESULTS] [VOTE] Release Kafka version 0.11.0.1

2017-09-12 Thread Damian Guy
This vote passes with 6 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jun Rao * Gouzhang Wang * Ismael Juma Community: * Manikumar Reddy * Thomas Crawford * Magnus Edenhill 0 votes * No votes -1 votes * No votes Vote threads (two as some votes were on user list

Re: [VOTE] 0.11.0.1 RC0

2017-09-12 Thread Damian Guy
> testing, and everything looks good. +1 (non-binding) from us. > > On Tue, Sep 5, 2017 at 9:34 PM, Damian Guy <damian@gmail.com> wrote: > > > Hello Kafka users, developers and client-developers, > > > > This is the first candidate for release of Apache Kafka 0.11.0.1. >

[jira] [Created] (KAFKA-5873) Add Materialized overloads to StreamBuilder

2017-09-12 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5873: - Summary: Add Materialized overloads to StreamBuilder Key: KAFKA-5873 URL: https://issues.apache.org/jira/browse/KAFKA-5873 Project: Kafka Issue Type: Sub-task

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-09-12 Thread Damian Guy
Hi All, A minor update to the KIP, i needed to add KTable.to(Produced) for consistency. KTable.through will be deprecated in favour of using KTable.toStream().through() Thanks, Damian On Thu, 7 Sep 2017 at 08:52 Damian Guy <damian@gmail.com> wrote: > Thanks all. The vote is n

Re: [VOTE] KIP-198: Remove ZK dependency from Streams Reset Tool

2017-09-09 Thread Damian Guy
+1 On Sat, 9 Sep 2017 at 03:46, Sriram Subramanian wrote: > +1 > > On Fri, Sep 8, 2017 at 3:04 PM, Guozhang Wang wrote: > > > +1, thanks. > > > > On Fri, Sep 8, 2017 at 1:54 PM, Bill Bejeck wrote: > > > > > +1 > > > > > > Thanks, > > >

[jira] [Resolved] (KAFKA-5853) Add WindowedKStream interface and implemenation

2017-09-08 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5853. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3809 [https://github.com

[jira] [Resolved] (KAFKA-5832) Add Consumed class and overloads to StreamBuilder

2017-09-08 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5832. --- Resolution: Fixed Issue resolved by pull request 3784 [https://github.com/apache/kafka/pull/3784

[jira] [Created] (KAFKA-5853) Add WindowedKStream interface and implemenation

2017-09-07 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5853: - Summary: Add WindowedKStream interface and implemenation Key: KAFKA-5853 URL: https://issues.apache.org/jira/browse/KAFKA-5853 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-5852) Add filter, filterNot, mapValues and Materialized to KTable

2017-09-07 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5852: - Summary: Add filter, filterNot, mapValues and Materialized to KTable Key: KAFKA-5852 URL: https://issues.apache.org/jira/browse/KAFKA-5852 Project: Kafka Issue

[jira] [Resolved] (KAFKA-5844) Add groupBy(KeyValueMapper, Serialized) to KTable

2017-09-07 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5844. --- Resolution: Fixed Issue resolved by pull request 3802 [https://github.com/apache/kafka/pull/3802

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-09-07 Thread Damian Guy
, Guozhang Wang <wangg...@gmail.com> wrote: > > > +1 > > > > On Fri, Sep 1, 2017 at 3:45 PM, Matthias J. Sax <matth...@confluent.io> > > wrote: > > > > > +1 > > > > > > On 9/1/17 2:53 PM, Bill Bejeck wrote: > > > >

[jira] [Created] (KAFKA-5844) Add groupBy(KeyValueMapper, Serialized) to KTable

2017-09-06 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5844: - Summary: Add groupBy(KeyValueMapper, Serialized) to KTable Key: KAFKA-5844 URL: https://issues.apache.org/jira/browse/KAFKA-5844 Project: Kafka Issue Type: Sub

Re: [VOTE] 0.11.0.1 RC0

2017-09-06 Thread Damian Guy
Resending as i wasn't part of the kafka-clients mailing list On Tue, 5 Sep 2017 at 21:34 Damian Guy <damian@gmail.com> wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 0.11.0.1. > > This

[VOTE] 0.11.0.1 RC0

2017-09-05 Thread Damian Guy
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 0.11.0.1. This is a bug fix release and it includes fixes and improvements from 49 JIRAs (including a few critical bugs). Release notes for the 0.11.0.1 release:

[jira] [Created] (KAFKA-5832) Add Consumed class and overloads to StreamBuilder

2017-09-04 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5832: - Summary: Add Consumed class and overloads to StreamBuilder Key: KAFKA-5832 URL: https://issues.apache.org/jira/browse/KAFKA-5832 Project: Kafka Issue Type: Sub

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-09-01 Thread Damian Guy
Hi all, There is one last outstanding issue in 0.11.0.1. This will hopefully be resolved today. Assuming it is i will cut the first RC tomorrow. Thanks for your patience. Regards, Damian On Tue, 29 Aug 2017 at 10:53 Damian Guy <damian@gmail.com> wrote: > We still have 2 outstandi

[jira] [Created] (KAFKA-5819) Add Joined class and relevant KStream join overloads

2017-09-01 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5819: - Summary: Add Joined class and relevant KStream join overloads Key: KAFKA-5819 URL: https://issues.apache.org/jira/browse/KAFKA-5819 Project: Kafka Issue Type: Sub

[jira] [Created] (KAFKA-5817) Add Serialized class and KStream groupBy and groupByKey overloads

2017-08-31 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5817: - Summary: Add Serialized class and KStream groupBy and groupByKey overloads Key: KAFKA-5817 URL: https://issues.apache.org/jira/browse/KAFKA-5817 Project: Kafka

[jira] [Created] (KAFKA-5816) Add Produced class and new to and through overloads to KStream

2017-08-31 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5816: - Summary: Add Produced class and new to and through overloads to KStream Key: KAFKA-5816 URL: https://issues.apache.org/jira/browse/KAFKA-5816 Project: Kafka

[jira] [Created] (KAFKA-5815) Add Printed class and KStream#print(Printed)

2017-08-31 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5815: - Summary: Add Printed class and KStream#print(Printed) Key: KAFKA-5815 URL: https://issues.apache.org/jira/browse/KAFKA-5815 Project: Kafka Issue Type: Sub-task

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-31 Thread Damian Guy
o the arguments to Store#persistentWindowStore and Store#persistentSessionStore Please take a look and recast the votes. Thanks for your time, Damian On Fri, 25 Aug 2017 at 17:05 Matthias J. Sax <matth...@confluent.io> wrote: > Thanks Damian. Great KIP! > > +1 > > > -Matthias &

Re: [VOTE] KIP-138: Change punctuate semantics

2017-08-30 Thread Damian Guy
+1 On Wed, 30 Aug 2017 at 17:49 Guozhang Wang wrote: > Hello Michal and community: > > While working on updating the web docs and java docs for this KIP, I felt > that the term SYSTEM_TIME a bit confusing sometimes from a reader's > perspective as we are actually talking

[jira] [Resolved] (KAFKA-5769) Transient test failure org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache

2017-08-30 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5769. --- Resolution: Duplicate > Transient test fail

[jira] [Resolved] (KAFKA-4835) Allow users control over repartitioning

2017-08-30 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4835. --- Resolution: Duplicate > Allow users control over repartition

[jira] [Reopened] (KAFKA-4835) Allow users control over repartitioning

2017-08-30 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy reopened KAFKA-4835: --- > Allow users control over repartition

[jira] [Resolved] (KAFKA-5804) ChangeLoggingWindowBytesStore needs to retain duplicates when writing to the log

2017-08-30 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5804. --- Resolution: Fixed Issue resolved by pull request 3754 [https://github.com/apache/kafka/pull/3754

[jira] [Created] (KAFKA-5804) ChangeLoggingWindowBytesStore needs to retain duplicates when writing to the log

2017-08-29 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5804: - Summary: ChangeLoggingWindowBytesStore needs to retain duplicates when writing to the log Key: KAFKA-5804 URL: https://issues.apache.org/jira/browse/KAFKA-5804 Project

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-29 Thread Damian Guy
We still have 2 outstanding issues to close. They both have patches available and will hopefully be completed shortly. Thanks, Damian On Thu, 24 Aug 2017 at 10:05 Damian Guy <damian@gmail.com> wrote: > A quick update. There are 2 remaining issues, that both have patches &g

Re: [VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-25 Thread Damian Guy
wrote: > > > +1. Thanks Damian! > > > > On Thu, Aug 24, 2017 at 9:47 AM, Bill Bejeck <bbej...@gmail.com> wrote: > > > > > Thanks for the KIP! > > > > > > +1 > > > > > > Thanks, > > > Bill > > > > > >

[jira] [Resolved] (KAFKA-5771) org.apache.kafka.streams.state.internals.Segments#segments method returns incorrect results when segments were added out of order

2017-08-25 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5771. --- Resolution: Fixed Fix Version/s: 0.11.0.1 1.0.0 Issue resolved by pull

[jira] [Created] (KAFKA-5787) StoreChangeLogReader needs to restore partitions that were added post initialization

2017-08-25 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5787: - Summary: StoreChangeLogReader needs to restore partitions that were added post initialization Key: KAFKA-5787 URL: https://issues.apache.org/jira/browse/KAFKA-5787 Project

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-25 Thread Damian Guy
the ability to use our wrapper stores, i.e, ChangeLogging, Caching, Metered. Presently they can't do this without jumping through various hoops. To provide this ability we presently need to use <Bytes, byte[]> as the CachingStores are <Bytes, byte[]>. They need to remain that way for the

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-25 Thread Damian Guy
> >> topic, final Consumed<K, V> options) > >> > >> This would prevent so write code like > >> > >> builder.stream("topic", Consumers.with(...)); > >> > >> I think, we need methods > >> > >> StreamsBuilder#stream

Re: 答复: [ANNOUNCE] New Kafka PMC member: Jiangjie (Becket) Qin

2017-08-24 Thread Damian Guy
Congratulations. On Thu, 24 Aug 2017 at 17:44 Matthias J. Sax wrote: > Congrats! > > On 8/23/17 10:40 PM, Hu Xi wrote: > > Congrats Becket! > > > > > > > > 发件人: Guozhang Wang > > 发送时间: 2017年8月24日 13:32 > > 收件人:

[VOTE] KIP-182 - Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
Hi, I'd like to kick off the voting thread for KIP-182: https://cwiki.apache.org/confluence/display/KAFKA/KIP-182%3A+Reduce+Streams+DSL+overloads+and+allow+easier+use+of+custom+storage+engines Thanks, Damian

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-24 Thread Damian Guy
A quick update. There are 2 remaining issues, that both have patches available. Hopefully they will be merged soon and we can begin: https://issues.apache.org/jira/projects/KAFKA/versions/12340632 Thanks, Damian On Tue, 22 Aug 2017 at 10:29 Damian Guy <damian@gmail.com> wrote: >

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
I've updated the kip to reflect Bill's comment and also to make StreamBuilder methods have topic as the first param, i.e., StreamBuilder#stream no longer accepts varargs. On Thu, 24 Aug 2017 at 09:12 Damian Guy <damian@gmail.com> wrote: > On Thu, 24 Aug 2017 at 02:49 Guozhang Wa

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-24 Thread Damian Guy
feel we should just correct it > with a new class and deprecate / remove the old one before 1.0.0, but that > could be in its own KIP. > > The problem with this is that we'd need to add new `groupBy` and `groupByKey` methods that return `GroupedKStream`, we can't change the existing ones as that

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-23 Thread Damian Guy
esn't. Should we add one for consistency? > > > > Thanks, > > Bill > > > > On Wed, Aug 23, 2017 at 4:15 AM, Damian Guy <damian....@gmail.com> > wrote: > > > >> KIP has been updated. thanks > >> > >> On Wed, 23 Aug 2017 at 09:10 Damian G

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-23 Thread Damian Guy
t; > Yep, i'll update it > Thanks, > Bill > > On Wed, Aug 23, 2017 at 4:15 AM, Damian Guy <damian@gmail.com> wrote: > > > KIP has been updated. thanks > > > > On Wed, 23 Aug 2017 at 09:10 Damian Guy <damian@gmail.com> wrote: > > > > >

[jira] [Created] (KAFKA-5769) Transient test failure org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache

2017-08-23 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5769: - Summary: Transient test failure org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache Key: KAFKA-5769 URL: https

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-23 Thread Damian Guy
KIP has been updated. thanks On Wed, 23 Aug 2017 at 09:10 Damian Guy <damian@gmail.com> wrote: > Hi Matthias, > > >> KStream: >> leftJoin and outerJoin for KStream/KTable join should not have >> `JoinWindows` parameter >> >> Thanks! > &g

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-23 Thread Damian Guy
dTable and should mention which > one? There is just one sentence "Deprecate the existing overloads.", but > we don't deprecate all existing once. I personally don't care to much if > we spell deprecated method out explicitly, but right now it's not > consistent as we only li

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-08-22 Thread Damian Guy
I've just updated the KIP with some additional changes targeted at StreamsBuilder Thanks, Damian On Thu, 10 Aug 2017 at 12:59 Damian Guy <damian@gmail.com> wrote: > >> Got it, thanks. >> >> Does it still make sense to have one static constructors for each sp

[jira] [Resolved] (KAFKA-5689) Refactor WindowStore hierarchy so that Metered Store is the outermost store

2017-08-22 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5689. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3692 [https://github.com

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-22 Thread Damian Guy
can get this cleaned up in the next day or two and then i can go about building an RC. Thanks, Damian On Thu, 17 Aug 2017 at 17:45 Damian Guy <damian@gmail.com> wrote: > Just a quick update. > > The list has reduced to 6 remaining issues: > https://issues.apache.org/j

[jira] [Resolved] (KAFKA-5725) Additional failure testing for streams with bouncing brokers

2017-08-18 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5725. --- Resolution: Fixed > Additional failure testing for streams with bouncing brok

[jira] [Created] (KAFKA-5749) Refactor SessionStore hierarchy

2017-08-18 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5749: - Summary: Refactor SessionStore hierarchy Key: KAFKA-5749 URL: https://issues.apache.org/jira/browse/KAFKA-5749 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] 0.11.0.1 bug fix release

2017-08-17 Thread Damian Guy
Just a quick update. The list has reduced to 6 remaining issues: https://issues.apache.org/jira/projects/KAFKA/versions/12340632 Thanks to everyone for completing and/or moving tickets to future releases. Damian On Thu, 17 Aug 2017 at 09:50 Damian Guy <damian@gmail.com> wrote:

<    1   2   3   4   5   6   7   8   >