Re: Rewind Kafka Stream consumer offset by timestamp

2017-01-31 Thread Jorge Esteban Quilcate Otoya
gt;>> > >>> This is currently not possible, but it is likely to be considered for > >> discussion. One challenge is that, if you have multiple topics, it is > >> difficult to rewind them all back to a consistent point in time. KIP-95, > >> currently under d

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-08 Thread Jorge Esteban Quilcate Otoya
; > validate the JSON etc. > > > > 2. Thinking if there are other common use-cases that we can make easy > > rather than just one generic but not very usable method. > > > > Gwen > > > > On Wed, Feb 8, 2017 at 3:25 AM, Jorge Esteban Quilcate Otoya > >

KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-07 Thread Jorge Esteban Quilcate Otoya
Hi all, I would like to propose a KIP to Add a tool to Reset Consumer Group Offsets. https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+a+tool+to+Reset+Consumer+Group+Offsets Please, take a look at the proposal and share your feedback. Thanks, Jorge.

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-08 Thread Jorge Esteban Quilcate Otoya
>> such cases. I spent some time learning existing tools and learning yet > >> another one is a deterrent. > >> > >> Gwen > >> > >> > >> > >> On Tue, Feb 7, 2017 at 6:43 PM, Jorge Esteban Quilcate Otoya > >> <quilcat

Re: Rewind Kafka Stream consumer offset by timestamp

2017-01-30 Thread Jorge Esteban Quilcate Otoya
pping the consuming at a point in time: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-95%3A+Incremental+Batch+Processing+for+Kafka+Streams > < > https://cwiki.apache.org/confluence/display/KAFKA/KIP-95:+Incremental+Batch+Processing+for+Kafka+Streams > >. > >

Rewind Kafka Stream consumer offset by timestamp

2017-01-29 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I was wondering if its possible to rewind consumers offset in Kafka Stream using timestamp as with `offsetsForTimes(Map timestampsToSearch)` in KafkaConsumer. I know its possible to go back to `earliest` offset in topic or `latest`, but would be useful to go

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-21 Thread Jorge Esteban Quilcate Otoya
we > can have two options that are easier to distinguish. > > > * I still think that JSON is not the best format (it's too verbose/hard > to write for humans from scratch). A simple CSV format with implicit > schema (topic,partition,offset) would be sufficient. > > > * W

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-17 Thread Jorge Esteban Quilcate Otoya
://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling Looking forward to your feedback! Jorge. El mié., 8 feb. 2017 a las 23:23, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Great. I think I got the idea. What about thi

[VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-02-23 Thread Jorge Esteban Quilcate Otoya
Hi All, It seems that there is no further concern with the KIP-122. At this point we would like to start the voting process. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-122%3A+Add+Reset+Consumer+Group+Offsets+tooling Thanks! Jorge.

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-23 Thread Jorge Esteban Quilcate Otoya
topic arguments, it does also not matter if we use > t1:1,2 or t2=1,2 > > I just suggested '=' because I wanted use ':' to chain multiple topics. > > > -Matthias > > On 2/23/17 10:49 AM, Jorge Esteban Quilcate Otoya wrote: > > Yeap, `--topic t1=1,2`LGTM > > > &

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-23 Thread Jorge Esteban Quilcate Otoya
Hi All, If there are no more concerns, I'd like to start vote for this KIP. Thanks! Jorge. El jue., 23 feb. 2017 a las 22:50, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Oh ok :) > > So, we can keep `--topic t1:1,2,3` > > I think with

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-24 Thread Jorge Esteban Quilcate Otoya
-by to --shift-by-offset > > Not sure what the best option is, but naming would be more consistent IMHO. > > > > -Matthias > > On 2/23/17 4:42 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi All, > > > > If there are no more concerns, I'd like to start vote for

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-24 Thread Jorge Esteban Quilcate Otoya
Great! KIP updated. El vie., 24 feb. 2017 a las 18:22, Matthias J. Sax (<matth...@confluent.io>) escribió: > I like this! > > --by-duration and --shift-by > > > -Matthias > > On 2/24/17 12:57 AM, Jorge Esteban Quilcate Otoya wrote: > > Renaming to --by-

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-24 Thread Jorge Esteban Quilcate Otoya
ed to affect only one Consumer Group. > > Also, I was wondering if you can provide at least one full command example > for each of the "plan", "execute", and "export" options. They would > definitely help in understanding some of the details. > > Added

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-23 Thread Jorge Esteban Quilcate Otoya
partition 2. Jorge. El mar., 21 feb. 2017 a las 11:11, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Thanks for the feedback Matthias. > > * 1. You're right. I'll reorder the scenarios. > > * 2. Agree. I'll update the KIP. > > * 3. I like it, updating

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-23 Thread Jorge Esteban Quilcate Otoya
ther characters seem to be worse to use to me. > But maybe you have a better idea. > > > > -Matthias > > > On 2/23/17 3:15 AM, Jorge Esteban Quilcate Otoya wrote: > > @Matthias about the point 9: > > > > What about keeping only the --topic option, and

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-02-27 Thread Jorge Esteban Quilcate Otoya
nder "Description" column, you put 0 for lag. So I assume that is the > > current lag being reported, and not the new lag. Might be helpful to > > explicitly specify that (i.e. CURRENT-LAG) in the column header. > > The other option is to report both current and new lags, bu

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-03-23 Thread Jorge Esteban Quilcate Otoya
ferent option for that? 5. It's a bit odd that `by-duration` subtracts while `shift-by` moves forward. It would be nice if the name made it clear that `by-duration` is subtracting, but I have no good suggestions, so maybe that's the best we can do. Ismael On Fri, Feb 24, 2017 at 12:46 AM, Jorge E

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-03-22 Thread Jorge Esteban Quilcate Otoya
11:50 AM, Grant Henke <ghe...@cloudera.com > > > > > > wrote: > > > > > > > > > > > +1. Agreed. This is a great tool to have. > > > > > > > > > > > > On Tue, Mar 14, 2017 at 12:33 AM, Gwen Shapira < > g...@co

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-04-05 Thread Jorge Esteban Quilcate Otoya
Thanks Ismael! Response inline. El mar., 4 abr. 2017 a las 17:43, Ismael Juma (<ism...@juma.me.uk>) escribió: Sorry for the delay Jorge. Responses inline. On Thu, Mar 23, 2017 at 5:56 PM, Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > @Ismael, thanks for you

Re: [VOTE] KIP-122: Add Reset Consumer Group Offsets tooling

2017-04-05 Thread Jorge Esteban Quilcate Otoya
Thanks to everyone who voted and/or provided feedback! The vote passed with 4 binding +1s (Gwen, Grant, Jason, Becket) and 5 non-binding +1s (Matthias, Vahid, Bill, Dong, Mickael). El mié., 5 abr. 2017 a las 11:58, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: &g

Re: KIP-122: Add a tool to Reset Consumer Group Offsets

2017-03-02 Thread Jorge Esteban Quilcate Otoya
hem...@us.ibm.com>) escribió: Thanks Jorge for addressing my suggestions. Looks good to me. --Vahid From: Jorge Esteban Quilcate Otoya <quilcate.jo...@gmail.com> To: dev@kafka.apache.org Date: 02/27/2017 01:57 AM Subject:Re: KIP-122: Add a tool to Reset Consumer Group Offse

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-08-12 Thread Jorge Esteban Quilcate Otoya
rd compatibility issue for this case. > Actually, I don't expect people to call `StreamsResetter` from Java > code, but you can never know. So if we break this, we need to make sure > to cover it in the KIP and later on in the release notes. > > > -Matthias > > On 7/14/17 7:1

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-07-14 Thread Jorge Esteban Quilcate Otoya
reset to a particular > > offset? If we clear the state then we've lost any previously aggregated > > values (which may or may not be what is expected). If we don't clear > them, > > then we will end up with incorrect aggregates. > > > > @matthias, could we

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-06-29 Thread Jorge Esteban Quilcate Otoya
y to plain > consumers -- note, a Streams applications is more than just a client. > > WDYT? > > Would be good to get some feedback from others, too. > > > -Matthias > > > On 6/27/17 9:05 AM, Jorge Esteban Quilcate Otoya wrote: > > Thanks for the feedba

[DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-06-26 Thread Jorge Esteban Quilcate Otoya
Hi all, I'd like to start the discussion to add reset offset tooling for Stream applications. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-171+-+Extend+Consumer+Group+Reset+Offset+for+Stream+Application Thanks, Jorge.

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-06-27 Thread Jorge Esteban Quilcate Otoya
replace the stream > reset tool: how would the reset tool know if it is resetting a streams > applications or a regular consumer group? > > > > -Matthias > > > On 6/26/17 1:28 PM, Jorge Esteban Quilcate Otoya wrote: > > Hi all, > > > > I'd like to start the discu

Re: KIP-162: Enable topic deletion by default

2017-05-26 Thread Jorge Esteban Quilcate Otoya
+1 El vie., 26 may. 2017 a las 16:14, Matthias J. Sax () escribió: > +1 > > On 5/26/17 7:03 AM, Gwen Shapira wrote: > > Hi Kafka developers, users and friends, > > > > I've added a KIP to improve our out-of-the-box usability a bit: > > KIP-162: Enable topic deletion by

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-10-13 Thread Jorge Esteban Quilcate Otoya
part. Than we can move > `StreamsResetter` to `streams` package. > > Cf. https://issues.apache.org/jira/browse/KAFKA-6058 > https://issues.apache.org/jira/browse/KAFKA-5965 > > Feel free to pick up KAFKA-6058 and KAFKA-5965. > > > -Matthias > > > > On 10/9/

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-09-11 Thread Jorge Esteban Quilcate Otoya
e, Aug 22, 2017 at 1:45 PM, Matthias J. Sax <matth...@confluent.io> > wrote: > > > Thanks for the update Jorge. > > > > I don't have any further comments. > > > > > > -Matthias > > > > On 8/12/17 6:43 PM, Jorge Esteban Quilcate Otoya wrote:

[VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-09-11 Thread Jorge Esteban Quilcate Otoya
Hi All, It seems that there is no further concern with the KIP-171. At this point we would like to start the voting process. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-171+-+Extend+Consumer+Group+Reset+Offset+for+Stream+Application Thanks!

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-10-09 Thread Jorge Esteban Quilcate Otoya
ybe we can resolve those dependencies somehow > and thus, be able to more StreamsResetter out of core package. Could you > summarize those dependencies in the KIP or just as a reply? > > Thanks! > > > -Matthias > > On 9/11/17 3:02 PM, Jorge Esteban Quilcate Otoya wrote:

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-11-14 Thread Jorge Esteban Quilcate Otoya
> > > > > On Fri, Oct 13, 2017 at 6:36 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > > > > > +1 > > > > > > > > > > On Fri, Oct 13, 2017 at 3:32 PM, Matthias J. Sax < > > > matth...@confluent.io> > &

[VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-14 Thread Jorge Esteban Quilcate Otoya
Hi all, As I didn't see any further discussion around this KIP, I'd like to start voting. KIP documentation: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=74686265 Cheers, Jorge.

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-14 Thread Jorge Esteban Quilcate Otoya
JIRA > title. > > On Tue, Nov 14, 2017 at 9:04 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Hi all, > > > > As I didn't see any further discussion around this KIP, I'd like to start > > voting. > > > > KIP docu

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-14 Thread Jorge Esteban Quilcate Otoya
Added. El mar., 14 nov. 2017 a las 19:00, Ted Yu (<yuzhih...@gmail.com>) escribió: > Please fill in JIRA number in Status section. > > On Tue, Nov 14, 2017 at 9:57 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > JIRA issue title updat

[DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-06 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I would like to start a discussion on KIP-222 [1] based on issue [2]. Looking forward to feedback. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=74686265 [2] https://issues.apache.org/jira/browse/KAFKA-6058 Cheers, Jorge.

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-06 Thread Jorge Esteban Quilcate Otoya
cribeConsumerGroupResult, just so > > >>> everyone knows exactly what being proposed. > > >>> 3. Can you describe the ConsumerGroupDescription class? > > >>> 4. Probably worth mentioning that this will use > > >>> DescribeGroupsRequest/Response

Re: [ANNOUNCE] New committer: Onur Karaman

2017-11-06 Thread Jorge Esteban Quilcate Otoya
Congratulations Onur!! On Tue, 7 Nov 2017 at 06:30, Jaikiran Pai wrote: > Congratulations Onur! > > -Jaikiran > > > On 06/11/17 10:54 PM, Jun Rao wrote: > > Hi, everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur > > Karaman. > >

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-11-07 Thread Jorge Esteban Quilcate Otoya
ostly get in the way when using the API. I would > be interested in what others thought about this. > > Cheers, > > Tom > > On 6 November 2017 at 22:16, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks for the feedback! > > >

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-14 Thread Jorge Esteban Quilcate Otoya
on. > > > Guozhang > > > On Mon, May 14, 2018 at 8:31 AM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks for your feedback everyone! > > > > If there is no more comments on this KIP, I think we can open the VOTE > > thr

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-14 Thread Jorge Esteban Quilcate Otoya
AM, Guozhang Wang wrote: > > > That's a good question. I think we can manage this in KIP-159. I will > go > > > ahead and try to augment that KIP together with the original author > > Jeyhun. > > > > > > > > > Guozhang > > > > >

[VOTE] KIP-244: Add Record Header support to Kafka Streams

2018-05-14 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I would like to start a vote on KIP-244: Add Record Header support to Kafka Streams KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams+Processor+API The discussion thread is here:

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

2018-05-15 Thread Jorge Esteban Quilcate Otoya
> `setRecordMetadata` API. Since this class is part of the public > test-utils > > package we should claim it in the wiki as well. > > > > > > Guozhang > > > > On Mon, May 14, 2018 at 8:43 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > >&

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-11 Thread Jorge Esteban Quilcate Otoya
en > >> to > >>>>>> the output topics increasing the size of the messages. Overall, I am > >> not > >>>>>> sure which default strategy might be the better one for headers. Is > >>>>>> there a convincing argument for either one o

Re: KIP 244 WIP

2018-05-04 Thread Jorge Esteban Quilcate Otoya
Hi Florian, I have updated this KIP and restarted the discussion to reduce scope to Processor API first, to then prepare another KIP to define behaviour on DSL functions. Feel free to validate the current WIP and give feedback to check that KIP is supporting your use-case. Cheers, Jorge. El

Re: [DISCUSS] Apache Kafka 2.0.0 Release Plan

2018-05-21 Thread Jorge Esteban Quilcate Otoya
Ok, thanks! On Mon, 21 May 2018, 15:17 Rajini Sivaram, <rajinisiva...@gmail.com> wrote: > Jorge, > > KIP-244 has binding votes from Guozhang, Matthias and Damian. So you can > close the vote and move the KIP to Accepted state. > > > On Mon, May 21, 2018 at 2:13 PM, J

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

2018-05-21 Thread Jorge Esteban Quilcate Otoya
P! > > +1 > > -Bill > > On Tue, May 15, 2018 at 1:47 PM, Damian Guy <damian@gmail.com> wrote: > > > Thanks. +1 (binding) > > > > On Tue, 15 May 2018 at 01:04 Jorge Esteban Quilcate Otoya < > > quilcate.jo...@gmail.com> wrote: > > >

Re: [DISCUSS] Apache Kafka 2.0.0 Release Plan

2018-05-21 Thread Jorge Esteban Quilcate Otoya
I think there is one missing vote in KIP-244 too. Pull request is almost ready to be merged also. On Mon, 21 May 2018, 11:48 Rajini Sivaram, wrote: > Hi all, > > This is a reminder that KIP freeze for 2.0.0 release is tomorrow. KIPs that > are not yet in voting stage

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

2018-05-21 Thread Jorge Esteban Quilcate Otoya
Hi, I'd like to point out that: org.apache.kafka.streams.test.ConsumerRecordFactory Has also been included as part of this KIP to support changes on test cases, just in case there is additional feedback here. Cheers, Jorge. El lun., 21 may. 2018 a las 16:46, Jorge Esteban Quilcate Otoya

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-02 Thread Jorge Esteban Quilcate Otoya
atm. We can scope them accordingly: > one for PAPI only, and second as a dependent JIRA for DSL. > > > -Matthias > > On 12/30/17 3:11 PM, Jorge Esteban Quilcate Otoya wrote: > > Thanks for your feedback! > > > > 1. I was adding headers to KeyValue to support groupB

Re: KIP-244: Add Record Header support to Kafka Streams

2018-05-03 Thread Jorge Esteban Quilcate Otoya
here's of course some middle ground, but instinctively, I think I'd > prefer > > to have a clear definition that headers are currently *not* forwarded, > > rather than having a complex list of operators that do or don't forward > > them. Plus, I think it might be tricky to define this b

Re: KIP-244: Add Record Header support to Kafka Streams

2017-12-30 Thread Jorge Esteban Quilcate Otoya
necessary, but I'm wondering if there > > is something else we can do to cut down on the overloads introduced. I > > don't have any sound suggestions ATM, so I'll have to think about it some > > more, but I wanted to put the thought out there. > > > > Thanks

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2017-12-31 Thread Jorge Esteban Quilcate Otoya
t; > > > > using a new wrapper class. However, I think we could include the > > > > > > protocol_type returned from the ListGroupsResponse along with the > > > > > groupId. > > > > > > This is a very useful information to tell which consumer gr

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2018-01-07 Thread Jorge Esteban Quilcate Otoya
gt; existing ConsumerGroups CLI to depend on client libraries only. > > Thanks for adding them :) > > On Sun, Dec 31, 2017 at 1:39 PM Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Thanks all for your feedback, and sorry for late respo

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2018-01-21 Thread Jorge Esteban Quilcate Otoya
d, Jan 17, 2018 at 11:29 AM, Gwen Shapira <g...@confluent.io > > > > >> > wrote: > > >> > > > > >> > > > Hey, since there were no additional comments in the discussion, > > I'd > > >> > like > > >> > > to > >

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2018-01-22 Thread Jorge Esteban Quilcate Otoya
from the internal one. This > makes extending the type in the future easier. > > Thanks, > > Jun > > On Sun, Jan 21, 2018 at 3:19 PM, Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > Hi all, > > > > Thanks all for your votes an

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-15 Thread Jorge Esteban Quilcate Otoya
Congratulations Matthias!! El lun., 15 ene. 2018 a las 9:08, Boyang Chen () escribió: > Great news Matthias! > > > > From: Kaufman Ng > Sent: Monday, January 15, 2018 11:32 AM > To: us...@kafka.apache.org > Cc:

Re: [VOTE] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2018-02-06 Thread Jorge Esteban Quilcate Otoya
rrently says this KIP is "under discussion": > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-222+-+Add+Consumer+Group+operations+to+Admin+API > > > > Also, should the JIRA ticket be tagged with 1.1.0 (provided this is > merged > > by then)? >

Re: [DISCUSS] KIP-222 - Add "describe consumer group" to KafkaAdminClient

2018-02-06 Thread Jorge Esteban Quilcate Otoya
the discussion on the PR. Cheers, Jorge. El dom., 7 ene. 2018 a las 21:00, Jorge Esteban Quilcate Otoya (< quilcate.jo...@gmail.com>) escribió: > Great! > > I have added `listGroupOffsets` to the KIP. > > If there are no additional feedback, VOTE thread is already open. > &g

KIP-244: Add Record Header support to Kafka Streams

2017-12-21 Thread Jorge Esteban Quilcate Otoya
Hi all, I have created a KIP to add Record Headers support to Kafka Streams API: https://cwiki.apache.org/confluence/display/KAFKA/KIP-244%3A+Add+Record+Header+support+to+Kafka+Streams The main goal is to be able to use headers to filter, map and process records as streams. Stateful processing

Checking Connection with Kafka Broker from Client-side

2018-08-15 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I'm evaluating how to validate connection to Kafka Brokers in an application that uses Consumer API by making health check using AdminClient. Is there any consideration around Authorization that I should take into consideration/any best practice? (I'm considering calling

Re: [VOTE] Kafka 2.0.0 in June 2018

2018-04-19 Thread Jorge Esteban Quilcate Otoya
+1 (non binding), thanks Ismael! El jue., 19 abr. 2018 a las 13:01, Manikumar () escribió: > +1 (non-binding). > > Thanks. > > On Thu, Apr 19, 2018 at 3:07 PM, Stephane Maarek < > steph...@simplemachines.com.au> wrote: > > > +1 (non binding). Thanks Ismael! > > > > On

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2018-02-26 Thread Jorge Esteban Quilcate Otoya
her > > > than > > > > do a > > > > > > dry run. The latter in particular seems dangerous since users who > > > were > > > > > > previously using the default behavior to view offsets will now > > > suddenly > > > &

Re: Accessing Topology Builder

2018-09-22 Thread Jorge Esteban Quilcate Otoya
Would that work for you? > > > > > > Guozhang > > > > > > On Tue, Sep 18, 2018 at 8:02 AM, Jorge Esteban Quilcate Otoya < > > quilcate.jo...@gmail.com> wrote: > > > > > final StreamsBuilder builder = kafkaStreamsTracing.builder();Thank

Re: Accessing Topology Builder

2018-09-26 Thread Jorge Esteban Quilcate Otoya
implementation I can think of. > > -Matthias > > On 9/22/18 4:51 AM, Jorge Esteban Quilcate Otoya wrote: > > Thanks, everyone! > > > > @Bill, the main issue with using `KStraem#peek()` is that AFAIK each > `peek` > > processor runs on a potentially dif

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-26 Thread Jorge Esteban Quilcate Otoya
Congratulations Colin!! El mié., 26 sept. 2018 a las 5:54, Dongjin Lee () escribió: > Congratulations!! > > Best, > Dongjin > > On Wed, Sep 26, 2018 at 11:56 AM Satish Duggana > wrote: > > > Congratulations Colin! > > > > > > > > On Wed, Sep 26, 2018 at 5:52 AM, Vahid Hashemian > > wrote: > >

Accessing Topology Builder

2018-09-15 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I'm experimenting on how to add tracing to Kafka Streams. One option is to override and access `InternalTopologyBuilder#addProcessor`. Currently this method it is final, and builder is not exposed as part of `StreamsBuilder`: ``` public class StreamsBuilder { /** The actual

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-09-15 Thread Jorge Esteban Quilcate Otoya
Congratulations!! El sáb., 15 sept. 2018 a las 15:18, Dongjin Lee () escribió: > Congratulations! > > Best, > Dongjin > > On Sat, Sep 15, 2018 at 3:00 PM Colin McCabe wrote: > > > Congratulations, Dong Lin! > > > > best, > > Colin > > > > On Wed, Aug 22, 2018, at 05:26, Satish Duggana wrote: >

Re: Accessing Topology Builder

2018-09-16 Thread Jorge Esteban Quilcate Otoya
reamsBuilder(final Topology topology) { > > > I think I am lacking some context what you try to achieve. Maybe you can > elaborate in the problem you try to solve? > > > -Matthias > > On 9/15/18 10:31 AM, Jorge Esteban Quilcate Otoya wrote: > > Hi ev

Re: Accessing Topology Builder

2018-09-18 Thread Jorge Esteban Quilcate Otoya
alStreamsTopology: more specifically, you can provide an > > `abstract WrapperProcessorSupplier > > implements ProcessorSupplier` and then let users to instantiate this > class > > instead of the "bare-metal" interface. WDYT? > > > > >

Re: [ANNOUNCE] New Committer: Bill Bejeck

2019-02-14 Thread Jorge Esteban Quilcate Otoya
Congratulations Bill! On Thu, 14 Feb 2019, 09:29 Mickael Maison, wrote: > Congratulations Bill! > > On Thu, Feb 14, 2019 at 7:52 AM Gurudatt Kulkarni > wrote: > > > Congratulations Bill! > > > > On Thursday, February 14, 2019, Konstantine Karantasis < > > konstant...@confluent.io> wrote: > > >

Re: [DISCUSS] KIP-515: Enable ZK client to use the new TLS supported authentication

2019-09-03 Thread Jorge Esteban Quilcate Otoya
Hi Pere, Have you add your KIP to the list here https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals? I found the KIP number assigned to another. On Mon, Sep 2, 2019 at 2:23 PM Pere Urbón Bayes wrote: > Thanks for your time Harsha, >anyone else with comments?

Re: Kafka JMX monitoring

2020-03-19 Thread Jorge Esteban Quilcate Otoya
Hi, You could start by looking at Jolokia or Prometheus JMX Exporter depending on your needs. Jorge. On Thu, Mar 19, 2020 at 7:54 AM 张祥 wrote: > Hi, > > I want to know what the best practice to collect Kafka JMX metrics is. I

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-21 Thread Jorge Esteban Quilcate Otoya
Thanks John. Agree. I like the first approach as well, with StreamsConfig flag passing by via ProcessorContext. Another positive effect with "reverse parameters" is that in the case of `fetch(keyFrom, keyTo, timeFrom, timeTo)` users can decide _which_ pair to flip, whether with `ReadDirection`

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-22 Thread Jorge Esteban Quilcate Otoya
d the `all()` problem by just giving `all()` a reverse form to > complement it? > Ie we would have `all()` and `reverseAll()`, or something to that effect. > > On Thu, May 21, 2020 at 3:41 PM Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > >

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-26 Thread Jorge Esteban Quilcate Otoya
If no additional comments, I will proceed to start the a vote thread. Thanks a lot for your feedback! On Fri, May 22, 2020 at 9:25 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks Sophie. I like the `reverseAll()` idea. > > I updated the KIP wit

Re: [DISCUSS] KIP-629: Use racially neutral terms in our codebase

2020-06-24 Thread Jorge Esteban Quilcate Otoya
Hi Xavier, Thank you for this proposal! It's awesome to see the community taking action on this. `include` and `exclude` make sense to me. Probably obvious but is documentation and website considered as well as part of the KIP? This would be interesting because it could be also important to

Re: [VOTE] KIP-629: Use racially neutral terms in our codebase

2020-06-26 Thread Jorge Esteban Quilcate Otoya
+1 (non-binding) Thank you Xavier! On Fri, Jun 26, 2020 at 8:38 AM Bruno Cadonna wrote: > +1 (non-binding) > > On Fri, Jun 26, 2020 at 3:41 AM Jay Kreps wrote: > > > > +1 > > > > On Thu, Jun 25, 2020 at 6:39 PM Bill Bejeck wrote: > > > > > Thanks for this KIP Xavier. > > > > > > +1(binding) >

Re: New Website Layout

2020-06-26 Thread Jorge Esteban Quilcate Otoya
Looks great!! A small comment about menus: `Get Started` and `Docs` pages have different UX. While Get Started pages use the whole page, Docs have a menu on the left side. I'd like Docs pages to also use most of the page. For instance, config and metrics tables could look more readable using more

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-06-29 Thread Jorge Esteban Quilcate Otoya
We might be able to revamp the API in the > future to support mixins, but it's a much larger scope of work than this > KIP. > A more minor comment is that we don't need to add Deprecated variants > of new methods. > > Thanks again, and once again, I'm sorry I tuned out and didn't of

Re: [VOTE] KIP-418: A method-chaining way to branch KStream

2020-06-29 Thread Jorge Esteban Quilcate Otoya
This will be a great addition. Thanks Ivan! +1 (non-binding) On Fri, Jun 26, 2020 at 7:07 PM John Roesler wrote: > Thanks, Ivan! > > I’m +1 (binding) > > -John > > On Thu, May 28, 2020, at 17:24, Ivan Ponomarev wrote: > > Hello all! > > > > I'd like to start the vote for KIP-418 which proposes

Re: [VOTE] KIP-626: Rename StreamsConfig config variable name

2020-06-16 Thread Jorge Esteban Quilcate Otoya
+1 Thanks Matthias. On Tue, Jun 16, 2020 at 4:02 AM Matthias J. Sax wrote: > Hi, > > I found a small inconsistency in our public API and propose a small KIP > to fix it. As the change is trivial, I skip the discussion and call > directly for a VOTE. > > > >

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-06-15 Thread Jorge Esteban Quilcate Otoya
; > > This might be more code to write, but I believe it provides the better > user experience. Thoughts? > > > > -Matthias > > > > > On 5/26/20 8:47 PM, John Roesler wrote: > > Sorry for my silence, Jorge, > > > > I've just taken another look, a

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-06-22 Thread Jorge Esteban Quilcate Otoya
know if you have any questions. Thanks, Jorge. On Tue, Jun 16, 2020 at 12:47 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, sorry for the late reply. > > Thanks Matthias for your feedback. I think it makes sense to reconsider > the current de

[DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

2020-06-29 Thread Jorge Esteban Quilcate Otoya
Hi everyone, I would like to start the discussion for KIP-634:https://cwiki.apache.org/confluence/display/KAFKA/KIP-634%3A+Complementary+support+for+headers+in+Kafka+Streams+DSL Looking forward to your feedback. Thanks! Jorge.

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-02 Thread Jorge Esteban Quilcate Otoya
gt; Thanks, > John > > On Wed, Jul 1, 2020, at 17:01, Jorge Esteban Quilcate Otoya wrote: > > Quick update: KIP is updated with latest changes now. > > Will leave it open this week while working on the PR. > > > > Hope to open a new vote thread over the next few days

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-02 Thread Jorge Esteban Quilcate Otoya
(sorry for the spam) Actually `findSessions` are only deprecated on `InMemorySessionStore`, which seems strange as RocksDB and interfaces haven't marked these methods as deprecated. Any hint on how to handle this? Cheers, On Thu, Jul 2, 2020 at 4:57 PM Jorge Esteban Quilcate Otoya

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-02 Thread Jorge Esteban Quilcate Otoya
@John: I can see there are some deprecations in there as well. Will update the KIP. Thanks, Jorge On Thu, Jul 2, 2020 at 3:29 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks John. > > > it looks like there’s a revision error in which two me

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-03 Thread Jorge Esteban Quilcate Otoya
ce > 3. Fully fix the problem by moving the existing methods as well as your > new ones. Since SessionStore extends ReadOnlySessionStore, it’s ok just to > move the definitions. > > I’m ok with whatever you prefer. > > Thanks, > John > > On Thu, Jul 2, 2020,

[VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-03 Thread Jorge Esteban Quilcate Otoya
Hola everyone, I'd like to start a new thread to vote for KIP-617 as there have been significant changes since the previous vote started. KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-617%3A+Allow+Kafka+Streams+State+Stores+to+be+iterated+backwards Many thanks! Jorge.

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-01 Thread Jorge Esteban Quilcate Otoya
Quick update: KIP is updated with latest changes now. Will leave it open this week while working on the PR. Hope to open a new vote thread over the next few days if no additional feedback is provided. Cheers, Jorge. On Mon, Jun 29, 2020 at 11:30 AM Jorge Esteban Quilcate Otoya < quilcate

Re: [VOTE] KIP-450: Sliding Window Aggregations in the DSL

2020-07-29 Thread Jorge Esteban Quilcate Otoya
Thanks Leah! This will be a great addition. +1 (non-binding) Very happy that KIP-617 is being used already :D Cheers, Jorge. On Wed, Jul 29, 2020 at 2:28 PM John Roesler wrote: > Thanks for the awesome KIP, Leah, > > I’m +1 (binding) > > Thanks, > John > > On Tue, Jul 28, 2020, at 19:10,

Re: [VOTE] KIP-648: Renaming getter method for Interactive Queries

2020-07-29 Thread Jorge Esteban Quilcate Otoya
+1 (non-binding). Thanks John! On Wed, Jul 29, 2020 at 3:00 PM Navinder Brar wrote: > +1 (non-binding). Thanks John, looks good to me. > > ~NavinderOn Wednesday, 29 July, 2020, 04:32:25 am IST, John Thomas < > johnthote...@live.com> wrote: > > Hello everyone, > > I'd like to kick-off a

Re: [VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-29 Thread Jorge Esteban Quilcate Otoya
t; >> Leah > >> > >> On Thu, Jul 16, 2020 at 6:39 PM Sophie Blee-Goldman < > sop...@confluent.io> > >> wrote: > >> > >>> Hey Jorge, > >>> > >>> Thanks for the reminder -- +1 (non-binding) > >>> > &g

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-23 Thread Jorge Esteban Quilcate Otoya
4/20 7:02 AM, John Roesler wrote: > > Thanks Jorge, > > > > This KIP looks good to me! > > > > -John > > > > On Fri, Jul 3, 2020, at 03:19, Jorge Esteban Quilcate Otoya wrote: > >> Hi John, > >> > >> Thanks for the feedback. > >> &g

Re: [VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-07-16 Thread Jorge Esteban Quilcate Otoya
Bumping this vote thread to check if there's any feedback. Cheers, Jorge. On Sat, Jul 4, 2020 at 6:20 PM John Roesler wrote: > Thanks Jorge, > > I’m +1 (binding) > > -John > > On Fri, Jul 3, 2020, at 10:26, Jorge Esteban Quilcate Otoya wrote: > > Hola everyone, >

Re: [DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

2020-07-16 Thread Jorge Esteban Quilcate Otoya
Hi everyone, Bumping this thread to check if there's any feedback. Cheers, Jorge. On Tue, Jun 30, 2020 at 12:46 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, > > I would like to start the discussion for > KIP-634:https://cwiki.apache.org/

[jira] [Created] (KAFKA-9929) Support reverse iterator on WindowStore

2020-04-28 Thread Jorge Esteban Quilcate Otoya (Jira)
Jorge Esteban Quilcate Otoya created KAFKA-9929: --- Summary: Support reverse iterator on WindowStore Key: KAFKA-9929 URL: https://issues.apache.org/jira/browse/KAFKA-9929 Project: Kafka