Contributor Access to JIRA

Hi, Can you please provide me Contributor access to Kafka JIRA, as I am interested in contributing. Thanks, Kalpitha

Discussion on KIP-670 : Add ConsumerGroupCommand to delete static members

Hi All, I am new to the Kafka contribution community. I have picked up a jira ticket https://issues.apache.org/jira/browse/KAFKA-9440 which requires KIP. I have submitted KIP for it https://cwiki.apache.org/confluence/display/KAFKA/KIP-670%3A+Add+ConsumerGroupCommand+to+delete+static+members I

Re: Need contributor access to Kafka Improvement Proposals

Hi Matthias, Can you please grant me contributor access to create KIP ? UserId : sndp2693 EmailId : sndp2...@gmail.com Regards, Sandeep On Thu, Sep 3, 2020 at 1:26 PM Sandeep Kumar wrote: > HI, > > Can you please grant me access to create KIP? > > Thanks, > Sandeep >

Re: Contributor Access to JIRA

Please create an account (self-service) and share you account info here, so we can add you. On 9/3/20 6:49 AM, Kp k wrote: > Hi, > > Can you please provide me Contributor access to Kafka JIRA, as I am > interested in contributing. > > Thanks, > Kalpitha > signature.asc Description: OpenPGP

[VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hi, I would like to start the voting on KIP-663 that proposes to add methods to the Kafka Streams client to add and remove stream threads during execution. https://cwiki.apache.org/confluence/display/KAFKA/KIP-663%3A+API+to+Start+and+Shut+Down+Stream+Threads Best, Bruno

Re: Need contributor access to Kafka Improvement Proposals

Done. On 9/3/20 5:08 AM, Sandeep Kumar wrote: > Hi Matthias, > > Can you please grant me contributor access to create KIP ? > >  UserId : sndp2693 >  EmailId : sndp2...@gmail.com > > > Regards, > Sandeep >   > > On Thu, Sep 3, 2020 at 1:26 PM Sandeep Kumar

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

I think this issue can actually be resolved. - We need a flag on the stream-threads if global-restore is in progress; for this case, the stream-thread may go into RUNNING state, but it's not allowed to actually process data -- it will be allowed to update standby-task though. - If a

Re: [DISCUSS] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

All, Gentle reminder - any comments on the line of thinking I mentioned in the last email? I've updated the Exception to be named "TransactionAbortedException" on the KIP confluence page. -Gokul On 01-09-2020 18:34, Gokul Srinivas wrote: Matthias, Sophie, Jason, Took another pass at

Re: Contributor Access to JIRA

Hi, Please approve Contributor access to Kafka JIRA, as I am interested in contributing. Thanks, Nag

Re: Contributor Access to JIRA

Here it is username : nag9s On Thu, Sep 3, 2020 at 8:36 PM Matthias J. Sax wrote: > Please create an account (self-service) and share you account info here, > so we can add you. > > On 9/3/20 6:49 AM, Kp k wrote: > > Hi, > > > > Can you please provide me Contributor access to Kafka JIRA, as I

[jira] [Created] (KAFKA-10460) ReplicaListValidator format checking is incomplete

Robin Palotai created KAFKA-10460: - Summary: ReplicaListValidator format checking is incomplete Key: KAFKA-10460 URL: https://issues.apache.org/jira/browse/KAFKA-10460 Project: Kafka Issue

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Thanks! SGTM. -Matthias On 9/3/20 3:17 AM, Bruno Cadonna wrote: > Hi Matthias, > > I replied inline. > > Best, > Bruno > > On 02.09.20 22:06, Matthias J. Sax wrote: >> Thanks for updating the KIP. >> >> Why do you propose to return `boolean` from addStreamThread() if the >> thread could not

Re: [VOTE] KIP-614: Add Prefix Scan support for State Stores

Hi Sagar, Yes! Congratulations :) Now, you can mark the status of the KIP as "Accepted" and we can move on to reviewing your PRs. One quick note: Matthias didn't have time to review the KIP in full, but he did point out to me that there's a lot of information about the RocksDB implementation

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

+1 (binding) On 9/3/20 6:16 AM, Bruno Cadonna wrote: > Hi, > > I would like to start the voting on KIP-663 that proposes to add methods > to the Kafka Streams client to add and remove stream threads during > execution. > >

Re: [DISCUSS] KIP-656: MirrorMaker2 Exactly-once Semantics

Hi Ning, Thanks for the updates. 1. If you have to run a Sink (the new MirrorSinkConnector) and Source (MirrorCheckpoint) connector for MM2 you will need 2 Connect runtimes. So this does not work well for users of Connect. I've not really looked into it yet but I wonder if we should include a

Re: Discussion on KIP-670 : Add ConsumerGroupCommand to delete static members

Hello Sandeep, Reading through your kip it seems like a good idea and pretty straight forward. So I have no problems with this proposal. Thanks for the Kip, Walker On Thu, Sep 3, 2020 at 8:28 AM Sandeep Kumar wrote: > Hi All, > > I am new to the Kafka contribution community. I have picked

Re: [DISCUSS] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

I think the current proposal looks good to me. One minor suggestion I have is to consider keeping the same error message: Failing batch since transaction was aborted When we were running into this issue in Streams and accidentally rethrowing the KafkaException as fatal, we ended up checking the

Re: [DISCUSS] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

Appreciate the help! On 04-09-2020 00:46, Sophie Blee-Goldman wrote: Yep, you can go ahead and call for a vote on the KIP On Thu, Sep 3, 2020 at 12:09 PM Gokul Srinivas wrote: Sophie, That sounds fair. I've updated the KIP to state the same message for backward compatibility to

Re: [VOTE] KIP-614: Add Prefix Scan support for State Stores

Hi John, Thank you! I have marked the KIP as Accepted :) Regarding the point on InMemoryKeyValueStore, in the PR I had added the implementation for InMemoryKeyValueStore as well. I hadn't mentioned about it in the KIP which I have done now as you suggested. Thanks! Sagar. On Thu, Sep 3, 2020

Re: [DISCUSS] KIP-660: Pluggable ReplicaAssignor

Thanks Robert and Ryanne for the feedback. ReplicaAssignor implementations can throw an exception to indicate an assignment can't be computed. This is already what the current round robin assignor does. Unfortunately at the moment, there are no generic error codes if it fails, it's either

Re: [DISCUSS] KIP-656: MirrorMaker2 Exactly-once Semantics

Hi Mickael, Definitely we can include Sink connector for checkpoints and even heartbeats, but I am thinking if the existing 3 connectors, MirrorSourceConnector, MirrorCheckpointConnector and MirrorHeartbeatConnector are managed separately, so that we could reduce the footprint of introducing

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hey, sorry for the late reply, I just have one minor suggestion. Since we don't make any guarantees about which thread gets removed or allow the user to specify, I think we should return either the index or full name of the thread that does get removed by removeThread(). I know you just updated

[VOTE] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

Hi, I would like to call a vote on the following KIP. *KIP *- https://cwiki.apache.org/confluence/display/KAFKA/KIP-654:+Aborted+transaction+with+non-flushed+data+should+throw+a+non-fatal+exception

Re: [DISCUSS] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

Sophie, That sounds fair. I've updated the KIP to state the same message for backward compatibility to existing (albeit hacky) solutions. As this is my first ever contribution - is the next step to initiate the voting on this KIP? -Gokul On 04-09-2020 00:34, Sophie Blee-Goldman wrote: I

Re: Contributor Access to JIRA

Done. Thanks for your interest in Apache Kafka! -Bill On Thu, Sep 3, 2020 at 11:23 AM Nag Y wrote: > Here it is > > username : nag9s > > On Thu, Sep 3, 2020 at 8:36 PM Matthias J. Sax wrote: > > > Please create an account (self-service) and share you account info here, > > so we can add you.

Re: [DISCUSS] KIP-654 Aborting Transaction with non-flushed data should throw a non-fatal Exception

Yep, you can go ahead and call for a vote on the KIP On Thu, Sep 3, 2020 at 12:09 PM Gokul Srinivas wrote: > Sophie, > > That sounds fair. I've updated the KIP to state the same message for > backward compatibility to existing (albeit hacky) solutions. > > As this is my first ever contribution

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #43

See Changes: [github] KAFKA-10355: Throw error when source topic was deleted (#9191) [github] MINOR: Record all poll invocations (#9234) -- [...truncated

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #44

See Changes: [github] KAFKA-10355: Throw error when source topic was deleted (#9191) [github] MINOR: Record all poll invocations (#9234) -- [...truncated

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #45

See Changes: [github] KAFKA-10355: Throw error when source topic was deleted (#9191) [github] MINOR: Record all poll invocations (#9234) -- [...truncated

[GitHub] [kafka-site] ableegoldman opened a new pull request #301: Redo 2.6 docs commit

ableegoldman opened a new pull request #301: URL: https://github.com/apache/kafka-site/pull/301 Just noticed that all of the docs I added just before 2.6 aren't actually showing up on the site. Seems like they were accidentally reverted by [this

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

Thanks Matthias, that sounds like what I was thinking. I think we should always be able to figure out what to do in various scenarios as outlined in the previous email. > For the same reason, I wouldn't want to combine global restoring and normal restoring > because then it would make all the

[jira] [Created] (KAFKA-10461) The config of closing heartbeat is invalid.

jiwei created KAFKA-10461: - Summary: The config of closing heartbeat is invalid. Key: KAFKA-10461 URL: https://issues.apache.org/jira/browse/KAFKA-10461 Project: Kafka Issue Type: Improvement

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #42

See Changes: [github] KAFKA-9924: Add remaining property-based RocksDB metrics as described in KIP-607 (#9232) -- [...truncated 6.50 MB...]

Need contributor access to Kafka Improvement Proposals

HI, Can you please grant me access to create KIP? Thanks, Sandeep

Re: [DISCUSSION] Upgrade system tests to python 3

Hello! Just a friendly reminder. Patch to resolve some kind of technical debt - python2 in system tests is ready! Can someone, please, take a look? https://github.com/apache/kafka/pull/9196 > 28 авг. 2020 г., в 11:19, Nikolay Izhikov написал(а): > > Hello! > > Any feedback on this? > What

[jira] [Created] (KAFKA-10459) Document IQ APIs where order does not hold between stores

Jorge Esteban Quilcate Otoya created KAFKA-10459: Summary: Document IQ APIs where order does not hold between stores Key: KAFKA-10459 URL: https://issues.apache.org/jira/browse/KAFKA-10459

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hi Matthias, I replied inline. Best, Bruno On 02.09.20 22:06, Matthias J. Sax wrote: Thanks for updating the KIP. Why do you propose to return `boolean` from addStreamThread() if the thread could not be started? As an alternative, we could also throw an exception if the client is not in

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

Hi, Thanks, John, Matthias and Sophie for great feedback. On the point raised by Sophie that maybe we should allow normal restoring  during GLOBAL_RESTORING, I think it makes sense but the challenge would be what happens when normal restoring(on actives) has finished but GLOBAL_RESTORINGis