Re: [VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

t; >> Leah > >> > >> On Thu, Jul 16, 2020 at 6:39 PM Sophie Blee-Goldman < > sop...@confluent.io> > >> wrote: > >> > >>> Hey Jorge, > >>> > >>> Thanks for the reminder -- +1 (non-binding) > >>> > &g

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

4/20 7:02 AM, John Roesler wrote: > > Thanks Jorge, > > > > This KIP looks good to me! > > > > -John > > > > On Fri, Jul 3, 2020, at 03:19, Jorge Esteban Quilcate Otoya wrote: > >> Hi John, > >> > >> Thanks for the feedback. > >> &g

Re: [VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Bumping this vote thread to check if there's any feedback. Cheers, Jorge. On Sat, Jul 4, 2020 at 6:20 PM John Roesler wrote: > Thanks Jorge, > > I’m +1 (binding) > > -John > > On Fri, Jul 3, 2020, at 10:26, Jorge Esteban Quilcate Otoya wrote: > > Hola everyone, >

Re: [DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

Hi everyone, Bumping this thread to check if there's any feedback. Cheers, Jorge. On Tue, Jun 30, 2020 at 12:46 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, > > I would like to start the discussion for > KIP-634:https://cwiki.apache.org/

[VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Hola everyone, I'd like to start a new thread to vote for KIP-617 as there have been significant changes since the previous vote started. KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-617%3A+Allow+Kafka+Streams+State+Stores+to+be+iterated+backwards Many thanks! Jorge.

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

ce > 3. Fully fix the problem by moving the existing methods as well as your > new ones. Since SessionStore extends ReadOnlySessionStore, it’s ok just to > move the definitions. > > I’m ok with whatever you prefer. > > Thanks, > John > > On Thu, Jul 2, 2020,

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

(sorry for the spam) Actually `findSessions` are only deprecated on `InMemorySessionStore`, which seems strange as RocksDB and interfaces haven't marked these methods as deprecated. Any hint on how to handle this? Cheers, On Thu, Jul 2, 2020 at 4:57 PM Jorge Esteban Quilcate Otoya

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

@John: I can see there are some deprecations in there as well. Will update the KIP. Thanks, Jorge On Thu, Jul 2, 2020 at 3:29 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks John. > > > it looks like there’s a revision error in which two me

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

gt; Thanks, > John > > On Wed, Jul 1, 2020, at 17:01, Jorge Esteban Quilcate Otoya wrote: > > Quick update: KIP is updated with latest changes now. > > Will leave it open this week while working on the PR. > > > > Hope to open a new vote thread over the next few days

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Quick update: KIP is updated with latest changes now. Will leave it open this week while working on the PR. Hope to open a new vote thread over the next few days if no additional feedback is provided. Cheers, Jorge. On Mon, Jun 29, 2020 at 11:30 AM Jorge Esteban Quilcate Otoya < quilcate

[DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

Hi everyone, I would like to start the discussion for KIP-634:https://cwiki.apache.org/confluence/display/KAFKA/KIP-634%3A+Complementary+support+for+headers+in+Kafka+Streams+DSL Looking forward to your feedback. Thanks! Jorge.

Re: [VOTE] KIP-418: A method-chaining way to branch KStream

This will be a great addition. Thanks Ivan! +1 (non-binding) On Fri, Jun 26, 2020 at 7:07 PM John Roesler wrote: > Thanks, Ivan! > > I’m +1 (binding) > > -John > > On Thu, May 28, 2020, at 17:24, Ivan Ponomarev wrote: > > Hello all! > > > > I'd like to start the vote for KIP-418 which proposes

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

We might be able to revamp the API in the > future to support mixins, but it's a much larger scope of work than this > KIP. > A more minor comment is that we don't need to add Deprecated variants > of new methods. > > Thanks again, and once again, I'm sorry I tuned out and didn't of

Re: New Website Layout

Looks great!! A small comment about menus: `Get Started` and `Docs` pages have different UX. While Get Started pages use the whole page, Docs have a menu on the left side. I'd like Docs pages to also use most of the page. For instance, config and metrics tables could look more readable using more

Re: [VOTE] KIP-629: Use racially neutral terms in our codebase

+1 (non-binding) Thank you Xavier! On Fri, Jun 26, 2020 at 8:38 AM Bruno Cadonna wrote: > +1 (non-binding) > > On Fri, Jun 26, 2020 at 3:41 AM Jay Kreps wrote: > > > > +1 > > > > On Thu, Jun 25, 2020 at 6:39 PM Bill Bejeck wrote: > > > > > Thanks for this KIP Xavier. > > > > > > +1(binding) >

Re: [DISCUSS] KIP-629: Use racially neutral terms in our codebase

Hi Xavier, Thank you for this proposal! It's awesome to see the community taking action on this. `include` and `exclude` make sense to me. Probably obvious but is documentation and website considered as well as part of the KIP? This would be interesting because it could be also important to

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

know if you have any questions. Thanks, Jorge. On Tue, Jun 16, 2020 at 12:47 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, sorry for the late reply. > > Thanks Matthias for your feedback. I think it makes sense to reconsider > the current de

Re: [VOTE] KIP-626: Rename StreamsConfig config variable name

+1 Thanks Matthias. On Tue, Jun 16, 2020 at 4:02 AM Matthias J. Sax wrote: > Hi, > > I found a small inconsistency in our public API and propose a small KIP > to fix it. As the change is trivial, I skip the discussion and call > directly for a VOTE. > > > >

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

; > > This might be more code to write, but I believe it provides the better > user experience. Thoughts? > > > > -Matthias > > > > > On 5/26/20 8:47 PM, John Roesler wrote: > > Sorry for my silence, Jorge, > > > > I've just taken another look, a

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

If no additional comments, I will proceed to start the a vote thread. Thanks a lot for your feedback! On Fri, May 22, 2020 at 9:25 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks Sophie. I like the `reverseAll()` idea. > > I updated the KIP wit

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

d the `all()` problem by just giving `all()` a reverse form to > complement it? > Ie we would have `all()` and `reverseAll()`, or something to that effect. > > On Thu, May 21, 2020 at 3:41 PM Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > >

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Thanks John. Agree. I like the first approach as well, with StreamsConfig flag passing by via ProcessorContext. Another positive effect with "reverse parameters" is that in the case of `fetch(keyFrom, keyTo, timeFrom, timeTo)` users can decide _which_ pair to flip, whether with `ReadDirection`

[jira] [Created] (KAFKA-9929) Support reverse iterator on WindowStore

Jorge Esteban Quilcate Otoya created KAFKA-9929: --- Summary: Support reverse iterator on WindowStore Key: KAFKA-9929 URL: https://issues.apache.org/jira/browse/KAFKA-9929 Project: Kafka

Re: Kafka JMX monitoring

Hi, You could start by looking at Jolokia or Prometheus JMX Exporter depending on your needs. Jorge. On Thu, Mar 19, 2020 at 7:54 AM 张祥 wrote: > Hi, > > I want to know what the best practice to collect Kafka JMX metrics is. I

Re: [DISCUSS] KIP-515: Enable ZK client to use the new TLS supported authentication

Hi Pere, Have you add your KIP to the list here https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals? I found the KIP number assigned to another. On Mon, Sep 2, 2019 at 2:23 PM Pere Urbón Bayes wrote: > Thanks for your time Harsha, >anyone else with comments?

Re: [ANNOUNCE] New Committer: Bill Bejeck

Congratulations Bill! On Thu, 14 Feb 2019, 09:29 Mickael Maison, wrote: > Congratulations Bill! > > On Thu, Feb 14, 2019 at 7:52 AM Gurudatt Kulkarni > wrote: > > > Congratulations Bill! > > > > On Thursday, February 14, 2019, Konstantine Karantasis < > > konstant...@confluent.io> wrote: > > >

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin!! El mié., 26 sept. 2018 a las 5:54, Dongjin Lee () escribió: > Congratulations!! > > Best, > Dongjin > > On Wed, Sep 26, 2018 at 11:56 AM Satish Duggana > wrote: > > > Congratulations Colin! > > > > > > > > On Wed, Sep 26, 2018 at 5:52 AM, Vahid Hashemian > > wrote: > >

Re: Accessing Topology Builder

implementation I can think of. > > -Matthias > > On 9/22/18 4:51 AM, Jorge Esteban Quilcate Otoya wrote: > > Thanks, everyone! > > > > @Bill, the main issue with using `KStraem#peek()` is that AFAIK each > `peek` > > processor runs on a potentially dif

Re: Accessing Topology Builder

Would that work for you? > > > > > > Guozhang > > > > > > On Tue, Sep 18, 2018 at 8:02 AM, Jorge Esteban Quilcate Otoya < > > quilcate.jo...@gmail.com> wrote: > > > > > final StreamsBuilder builder = kafkaStreamsTracing.builder();Thank

Re: Accessing Topology Builder

alStreamsTopology: more specifically, you can provide an > > `abstract WrapperProcessorSupplier > > implements ProcessorSupplier` and then let users to instantiate this > class > > instead of the "bare-metal" interface. WDYT? > > > > >

Re: Accessing Topology Builder

reamsBuilder(final Topology topology) { > > > I think I am lacking some context what you try to achieve. Maybe you can > elaborate in the problem you try to solve? > > > -Matthias > > On 9/15/18 10:31 AM, Jorge Esteban Quilcate Otoya wrote: > > Hi ev

Accessing Topology Builder

Hi everyone, I'm experimenting on how to add tracing to Kafka Streams. One option is to override and access `InternalTopologyBuilder#addProcessor`. Currently this method it is final, and builder is not exposed as part of `StreamsBuilder`: ``` public class StreamsBuilder { /** The actual

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulations!! El sáb., 15 sept. 2018 a las 15:18, Dongjin Lee () escribió: > Congratulations! > > Best, > Dongjin > > On Sat, Sep 15, 2018 at 3:00 PM Colin McCabe wrote: > > > Congratulations, Dong Lin! > > > > best, > > Colin > > > > On Wed, Aug 22, 2018, at 05:26, Satish Duggana wrote: >

Checking Connection with Kafka Broker from Client-side

Hi everyone, I'm evaluating how to validate connection to Kafka Brokers in an application that uses Consumer API by making health check using AdminClient. Is there any consideration around Authorization that I should take into consideration/any best practice? (I'm considering calling

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

Hi, I'd like to point out that: org.apache.kafka.streams.test.ConsumerRecordFactory Has also been included as part of this KIP to support changes on test cases, just in case there is additional feedback here. Cheers, Jorge. El lun., 21 may. 2018 a las 16:46, Jorge Esteban Quilcate Otoya

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

P! > > +1 > > -Bill > > On Tue, May 15, 2018 at 1:47 PM, Damian Guy <damian@gmail.com> wrote: > > > Thanks. +1 (binding) > > > > On Tue, 15 May 2018 at 01:04 Jorge Esteban Quilcate Otoya < > > quilcate.jo...@gmail.com> wrote: > > >

Re: [DISCUSS] Apache Kafka 2.0.0 Release Plan

Ok, thanks! On Mon, 21 May 2018, 15:17 Rajini Sivaram, <rajinisiva...@gmail.com> wrote: > Jorge, > > KIP-244 has binding votes from Guozhang, Matthias and Damian. So you can > close the vote and move the KIP to Accepted state. > > > On Mon, May 21, 2018 at 2:13 PM, J

Re: [DISCUSS] Apache Kafka 2.0.0 Release Plan

I think there is one missing vote in KIP-244 too. Pull request is almost ready to be merged also. On Mon, 21 May 2018, 11:48 Rajini Sivaram, wrote: > Hi all, > > This is a reminder that KIP freeze for 2.0.0 release is tomorrow. KIPs that > are not yet in voting stage

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

> `setRecordMetadata` API. Since this class is part of the public > test-utils > > package we should claim it in the wiki as well. > > > > > > Guozhang > > > > On Mon, May 14, 2018 at 8:43 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >&

Re: KIP-244: Add Record Header support to Kafka Streams

on. > > > Guozhang > > > On Mon, May 14, 2018 at 8:31 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks for your feedback everyone! > > > > If there is no more comments on this KIP, I think we can open the VOTE > > thr

[VOTE] KIP-244: Add Record Header support to Kafka Streams

Hi everyone, I would like to start a vote on KIP-244: Add Record Header support to Kafka Streams KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams+Processor+API The discussion thread is here:

Re: KIP-244: Add Record Header support to Kafka Streams

AM, Guozhang Wang wrote: > > > That's a good question. I think we can manage this in KIP-159. I will > go > > > ahead and try to augment that KIP together with the original author > > Jeyhun. > > > > > > > > > Guozhang > > > > >

Re: KIP-244: Add Record Header support to Kafka Streams

en > >> to > >>>>>> the output topics increasing the size of the messages. Overall, I am > >> not > >>>>>> sure which default strategy might be the better one for headers. Is > >>>>>> there a convincing argument for either one o

Re: KIP 244 WIP

Hi Florian, I have updated this KIP and restarted the discussion to reduce scope to Processor API first, to then prepare another KIP to define behaviour on DSL functions. Feel free to validate the current WIP and give feedback to check that KIP is supporting your use-case. Cheers, Jorge. El

Re: KIP-244: Add Record Header support to Kafka Streams

here's of course some middle ground, but instinctively, I think I'd > prefer > > to have a clear definition that headers are currently *not* forwarded, > > rather than having a complex list of operators that do or don't forward > > them. Plus, I think it might be tricky to define this b

Re: KIP-244: Add Record Header support to Kafka Streams

atm. We can scope them accordingly: > one for PAPI only, and second as a dependent JIRA for DSL. > > > -Matthias > > On 12/30/17 3:11 PM, Jorge Esteban Quilcate Otoya wrote: > > Thanks for your feedback! > > > > 1. I was adding headers to KeyValue to support groupB

Re: [VOTE] Kafka 2.0.0 in June 2018

+1 (non binding), thanks Ismael! El jue., 19 abr. 2018 a las 13:01, Manikumar () escribió: > +1 (non-binding). > > Thanks. > > On Thu, Apr 19, 2018 at 3:07 PM, Stephane Maarek < > steph...@simplemachines.com.au> wrote: > > > +1 (non binding). Thanks Ismael! > > > > On

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

her > > > than > > > > do a > > > > > > dry run. The latter in particular seems dangerous since users who > > > were > > > > > > previously using the default behavior to view offsets will now > > > suddenly > > > &

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

the discussion on the PR. Cheers, Jorge. El dom., 7 ene. 2018 a las 21:00, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Great! > > I have added `listGroupOffsets` to the KIP. > > If there are no additional feedback, VOTE thread is already open. > &g

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

rrently says this KIP is "under discussion": > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-222+-+Add+Consumer+Group+operations+to+Admin+API > > > > Also, should the JIRA ticket be tagged with 1.1.0 (provided this is > merged > > by then)? >

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

from the internal one. This > makes extending the type in the future easier. > > Thanks, > > Jun > > On Sun, Jan 21, 2018 at 3:19 PM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Hi all, > > > > Thanks all for your votes an

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

d, Jan 17, 2018 at 11:29 AM, Gwen Shapira <g...@confluent.io > > > > >> > wrote: > > >> > > > > >> > > > Hey, since there were no additional comments in the discussion, > > I'd > > >> > like > > >> > > to > >

Re: [ANNOUNCE] New committer: Matthias J. Sax

Congratulations Matthias!! El lun., 15 ene. 2018 a las 9:08, Boyang Chen () escribió: > Great news Matthias! > > > > From: Kaufman Ng > Sent: Monday, January 15, 2018 11:32 AM > To: us...@kafka.apache.org > Cc:

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

gt; existing ConsumerGroups CLI to depend on client libraries only. > > Thanks for adding them :) > > On Sun, Dec 31, 2017 at 1:39 PM Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks all for your feedback, and sorry for late respo

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

t; > > > > using a new wrapper class. However, I think we could include the > > > > > > protocol_type returned from the ListGroupsResponse along with the > > > > > groupId. > > > > > > This is a very useful information to tell which consumer gr

Re: KIP-244: Add Record Header support to Kafka Streams

necessary, but I'm wondering if there > > is something else we can do to cut down on the overloads introduced. I > > don't have any sound suggestions ATM, so I'll have to think about it some > > more, but I wanted to put the thought out there. > > > > Thanks

KIP-244: Add Record Header support to Kafka Streams

Hi all, I have created a KIP to add Record Headers support to Kafka Streams API: https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams The main goal is to be able to use headers to filter, map and process records as streams. Stateful processing

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Added. El mar., 14 nov. 2017 a las 19:00, Ted Yu (<yuzhih...@gmail.com>) escribió: > Please fill in JIRA number in Status section. > > On Tue, Nov 14, 2017 at 9:57 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > JIRA issue title updat

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

JIRA > title. > > On Tue, Nov 14, 2017 at 9:04 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Hi all, > > > > As I didn't see any further discussion around this KIP, I'd like to start > > voting. > > > > KIP docu

[VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Hi all, As I didn't see any further discussion around this KIP, I'd like to start voting. KIP documentation: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=74686265 Cheers, Jorge.

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

> > > > > On Fri, Oct 13, 2017 at 6:36 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > > > > > +1 > > > > > > > > > > On Fri, Oct 13, 2017 at 3:32 PM, Matthias J. Sax < > > > matth...@confluent.io> > &

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

ostly get in the way when using the API. I would > be interested in what others thought about this. > > Cheers, > > Tom > > On 6 November 2017 at 22:16, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks for the feedback! > > >

Re: [ANNOUNCE] New committer: Onur Karaman

Congratulations Onur!! On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai wrote: > Congratulations Onur! > > -Jaikiran > > > On 06/11/17 10:54 PM, Jun Rao wrote: > > Hi, everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > > Karaman. > >

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

cribeConsumerGroupResult, just so > > >>> everyone knows exactly what being proposed. > > >>> 3. Can you describe the ConsumerGroupDescription class? > > >>> 4. Probably worth mentioning that this will use > > >>> DescribeGroupsRequest/Response

[DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

Hi everyone, I would like to start a discussion on KIP-222 [1] based on issue [2]. Looking forward to feedback. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=74686265 [2] https://issues.apache.org/jira/browse/KAFKA-6058 Cheers, Jorge.

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

part. Than we can move > `StreamsResetter` to `streams` package. > > Cf. https://issues.apache.org/jira/browse/KAFKA-6058 > https://issues.apache.org/jira/browse/KAFKA-5965 > > Feel free to pick up KAFKA-6058 and KAFKA-5965. > > > -Matthias > > > > On 10/9/

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

ybe we can resolve those dependencies somehow > and thus, be able to more StreamsResetter out of core package. Could you > summarize those dependencies in the KIP or just as a reply? > > Thanks! > > > -Matthias > > On 9/11/17 3:02 PM, Jorge Esteban Quilcate Otoya wrote:

[VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

Hi All, It seems that there is no further concern with the KIP-171. At this point we would like to start the voting process. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-171+-+Extend+Consumer+Group+Reset+Offset+for+Stream+Application Thanks!

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

e, Aug 22, 2017 at 1:45 PM, Matthias J. Sax <matth...@confluent.io> > wrote: > > > Thanks for the update Jorge. > > > > I don't have any further comments. > > > > > > -Matthias > > > > On 8/12/17 6:43 PM, Jorge Esteban Quilcate Otoya wrote:

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

rd compatibility issue for this case. > Actually, I don't expect people to call `StreamsResetter` from Java > code, but you can never know. So if we break this, we need to make sure > to cover it in the KIP and later on in the release notes. > > > -Matthias > > On 7/14/17 7:1

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

reset to a particular > > offset? If we clear the state then we've lost any previously aggregated > > values (which may or may not be what is expected). If we don't clear > them, > > then we will end up with incorrect aggregates. > > > > @matthias, could we

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

y to plain > consumers -- note, a Streams applications is more than just a client. > > WDYT? > > Would be good to get some feedback from others, too. > > > -Matthias > > > On 6/27/17 9:05 AM, Jorge Esteban Quilcate Otoya wrote: > > Thanks for the feedba

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

replace the stream > reset tool: how would the reset tool know if it is resetting a streams > applications or a regular consumer group? > > > > -Matthias > > > On 6/26/17 1:28 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi all, > > > > I'd like to start the discu

[DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

Hi all, I'd like to start the discussion to add reset offset tooling for Stream applications. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-171+-+Extend+Consumer+Group+Reset+Offset+for+Stream+Application Thanks, Jorge.

Re: KIP-162: Enable topic deletion by default

+1 El vie., 26 may. 2017 a las 16:14, Matthias J. Sax () escribió: > +1 > > On 5/26/17 7:03 AM, Gwen Shapira wrote: > > Hi Kafka developers, users and friends, > > > > I've added a KIP to improve our out-of-the-box usability a bit: > > KIP-162: Enable topic deletion by

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

Thanks to everyone who voted and/or provided feedback! The vote passed with 4 binding +1s (Gwen, Grant, Jason, Becket) and 5 non-binding +1s (Matthias, Vahid, Bill, Dong, Mickael). El mié., 5 abr. 2017 a las 11:58, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: &g

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

Thanks Ismael! Response inline. El mar., 4 abr. 2017 a las 17:43, Ismael Juma (<ism...@juma.me.uk>) escribió: Sorry for the delay Jorge. Responses inline. On Thu, Mar 23, 2017 at 5:56 PM, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > @Ismael, thanks for you

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

ferent option for that? 5. It's a bit odd that `by-duration` subtracts while `shift-by` moves forward. It would be nice if the name made it clear that `by-duration` is subtracting, but I have no good suggestions, so maybe that's the best we can do. Ismael On Fri, Feb 24, 2017 at 12:46 AM, Jorge E

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

11:50 AM, Grant Henke <ghe...@cloudera.com > > > > > > wrote: > > > > > > > > > > > +1. Agreed. This is a great tool to have. > > > > > > > > > > > > On Tue, Mar 14, 2017 at 12:33 AM, Gwen Shapira < > g...@co

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

hem...@us.ibm.com>) escribió: Thanks Jorge for addressing my suggestions. Looks good to me. --Vahid From: Jorge Esteban Quilcate Otoya <quilcate.jo...@gmail.com> To: dev@kafka.apache.org Date: 02/27/2017 01:57 AM Subject:Re: KIP-122: Add a tool to Reset Consumer Group Offse

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

nder "Description" column, you put 0 for lag. So I assume that is the > > current lag being reported, and not the new lag. Might be helpful to > > explicitly specify that (i.e. CURRENT-LAG) in the column header. > > The other option is to report both current and new lags, bu

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

ed to affect only one Consumer Group. > > Also, I was wondering if you can provide at least one full command example > for each of the "plan", "execute", and "export" options. They would > definitely help in understanding some of the details. > > Added

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

Great! KIP updated. El vie., 24 feb. 2017 a las 18:22, Matthias J. Sax (<matth...@confluent.io>) escribió: > I like this! > > --by-duration and --shift-by > > > -Matthias > > On 2/24/17 12:57 AM, Jorge Esteban Quilcate Otoya wrote: > > Renaming to --by-

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

-by to --shift-by-offset > > Not sure what the best option is, but naming would be more consistent IMHO. > > > > -Matthias > > On 2/23/17 4:42 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi All, > > > > If there are no more concerns, I'd like to start vote for

[VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

Hi All, It seems that there is no further concern with the KIP-122. At this point we would like to start the voting process. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling Thanks! Jorge.

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

Hi All, If there are no more concerns, I'd like to start vote for this KIP. Thanks! Jorge. El jue., 23 feb. 2017 a las 22:50, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Oh ok :) > > So, we can keep `--topic t1:1,2,3` > > I think with

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

topic arguments, it does also not matter if we use > t1:1,2 or t2=1,2 > > I just suggested '=' because I wanted use ':' to chain multiple topics. > > > -Matthias > > On 2/23/17 10:49 AM, Jorge Esteban Quilcate Otoya wrote: > > Yeap, `--topic t1=1,2`LGTM > > > &

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

ther characters seem to be worse to use to me. > But maybe you have a better idea. > > > > -Matthias > > > On 2/23/17 3:15 AM, Jorge Esteban Quilcate Otoya wrote: > > @Matthias about the point 9: > > > > What about keeping only the --topic option, and

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

partition 2. Jorge. El mar., 21 feb. 2017 a las 11:11, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Thanks for the feedback Matthias. > > * 1. You're right. I'll reorder the scenarios. > > * 2. Agree. I'll update the KIP. > > * 3. I like it, updating

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

we > can have two options that are easier to distinguish. > > > * I still think that JSON is not the best format (it's too verbose/hard > to write for humans from scratch). A simple CSV format with implicit > schema (topic,partition,offset) would be sufficient. > > > * W

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling Looking forward to your feedback! Jorge. El mié., 8 feb. 2017 a las 23:23, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Great. I think I got the idea. What about thi

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

; > validate the JSON etc. > > > > 2. Thinking if there are other common use-cases that we can make easy > > rather than just one generic but not very usable method. > > > > Gwen > > > > On Wed, Feb 8, 2017 at 3:25 AM, Jorge Esteban Quilcate Otoya > >

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

>> such cases. I spent some time learning existing tools and learning yet > >> another one is a deterrent. > >> > >> Gwen > >> > >> > >> > >> On Tue, Feb 7, 2017 at 6:43 PM, Jorge Esteban Quilcate Otoya > >> <quilcat

KIP-122: Add a tool to Reset Consumer Group Offsets

Hi all, I would like to propose a KIP to Add a tool to Reset Consumer Group Offsets. https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+a+tool+to+Reset+Consumer+Group+Offsets Please, take a look at the proposal and share your feedback. Thanks, Jorge.

Re: Rewind Kafka Stream consumer offset by timestamp

gt;>> > >>> This is currently not possible, but it is likely to be considered for > >> discussion. One challenge is that, if you have multiple topics, it is > >> difficult to rewind them all back to a consistent point in time. KIP-95, > >> currently under d

Re: Rewind Kafka Stream consumer offset by timestamp

pping the consuming at a point in time: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-95%3A+Incremental+Batch+Processing+for+Kafka+Streams > < > https://cwiki.apache.org/confluence/display/KAFKA/KIP-95:+Incremental+Batch+Processing+for+Kafka+Streams > >. > >

Rewind Kafka Stream consumer offset by timestamp

Hi everyone, I was wondering if its possible to rewind consumers offset in Kafka Stream using timestamp as with `offsetsForTimes(Map timestampsToSearch)` in KafkaConsumer. I know its possible to go back to `earliest` offset in topic or `latest`, but would be useful to go

<    1   2   3