[jira] [Created] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-04-11 Thread Haruki Okada (Jira)
Haruki Okada created KAFKA-16541: Summary: Potential leader epoch checkpoint file corruption on OS crash Key: KAFKA-16541 URL: https://issues.apache.org/jira/browse/KAFKA-16541 Project: Kafka

[jira] [Created] (KAFKA-16540) Update partitions when the min isr config is updated.

2024-04-11 Thread Calvin Liu (Jira)
Calvin Liu created KAFKA-16540: -- Summary: Update partitions when the min isr config is updated. Key: KAFKA-16540 URL: https://issues.apache.org/jira/browse/KAFKA-16540 Project: Kafka Issue

[jira] [Resolved] (KAFKA-15586) Clean shutdown detection, server side

2024-04-11 Thread Calvin Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-15586. Resolution: Fixed > Clean shutdown detection, server side > -

[jira] [Created] (KAFKA-16539) Can't update specific broker configs in pre-migration mode

2024-04-11 Thread David Arthur (Jira)
David Arthur created KAFKA-16539: Summary: Can't update specific broker configs in pre-migration mode Key: KAFKA-16539 URL: https://issues.apache.org/jira/browse/KAFKA-16539 Project: Kafka

[jira] [Created] (KAFKA-16538) UpdateFeatures for kraft.version

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16538: -- Summary: UpdateFeatures for kraft.version Key: KAFKA-16538 URL: https://issues.apache.org/jira/browse/KAFKA-16538 Project: Kafka

[jira] [Created] (KAFKA-16537) RemoveVoter RPC and request handling

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16537: -- Summary: RemoveVoter RPC and request handling Key: KAFKA-16537 URL: https://issues.apache.org/jira/browse/KAFKA-16537 Project: Kafka

[jira] [Created] (KAFKA-16536) Use BeginQuorumEpoch as the leader's heartbeat

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16536: -- Summary: Use BeginQuorumEpoch as the leader's heartbeat Key: KAFKA-16536 URL: https://issues.apache.org/jira/browse/KAFKA-16536 Project:

[jira] [Created] (KAFKA-16535) AddVoter RPC and request handling

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16535: -- Summary: AddVoter RPC and request handling Key: KAFKA-16535 URL: https://issues.apache.org/jira/browse/KAFKA-16535 Project: Kafka

[jira] [Created] (KAFKA-16534) Sending UpdateVoter request and response handling

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16534: -- Summary: Sending UpdateVoter request and response handling Key: KAFKA-16534 URL: https://issues.apache.org/jira/browse/KAFKA-16534

[jira] [Created] (KAFKA-16533) UpdateVoter RPC and request handling

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16533: -- Summary: UpdateVoter RPC and request handling Key: KAFKA-16533 URL: https://issues.apache.org/jira/browse/KAFKA-16533 Project: Kafka

[jira] [Created] (KAFKA-16532) Support for first leader bootstrapping the voter set

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16532: -- Summary: Support for first leader bootstrapping the voter set Key: KAFKA-16532 URL: https://issues.apache.org/jira/browse/KAFKA-16532

[jira] [Created] (KAFKA-16531) Fix check-quorum calculation to no assume that the leader is in the voter set

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16531: -- Summary: Fix check-quorum calculation to no assume that the leader is in the voter set Key: KAFKA-16531 URL:

[jira] [Created] (KAFKA-16530) Fix high-watermark calculation to no assume the leader is in the voter set

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16530: -- Summary: Fix high-watermark calculation to no assume the leader is in the voter set Key: KAFKA-16530 URL:

[jira] [Created] (KAFKA-16529) Response handling and request sending for voters RPCs

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16529: -- Summary: Response handling and request sending for voters RPCs Key: KAFKA-16529 URL: https://issues.apache.org/jira/browse/KAFKA-16529

[jira] [Created] (KAFKA-16528) Reset member heartbeat interval when request sent

2024-04-11 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16528: -- Summary: Reset member heartbeat interval when request sent Key: KAFKA-16528 URL: https://issues.apache.org/jira/browse/KAFKA-16528 Project: Kafka Issue

[jira] [Created] (KAFKA-16527) RPC changes and request handling

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16527: -- Summary: RPC changes and request handling Key: KAFKA-16527 URL: https://issues.apache.org/jira/browse/KAFKA-16527 Project: Kafka

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-11 Thread Justine Olshan
Updated. :) Thanks for the reviews Justine On Thu, Apr 11, 2024 at 11:01 AM Jun Rao wrote: > Hi, Justine, > > Thanks for the updated KIP. > > Perhaps it's better to name the new config unstable.feature.versions.enable > since there could be multiple unstable versions. > > Other than that, the

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

2024-04-11 Thread Frédérik Rouleau
Hi everyone, I have made some changes to take in account comments. I have replaced the ConsumerRecord by Record. As it was not allowed by checkstyle, I have modified its configuration. I hope that's ok. I find this new version better. Thanks for your help. Regards, Fred

[jira] [Created] (KAFKA-16526) Change to quorum state for KIP-853

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16526: -- Summary: Change to quorum state for KIP-853 Key: KAFKA-16526 URL: https://issues.apache.org/jira/browse/KAFKA-16526 Project: Kafka

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-11 Thread Jun Rao
Hi, Justine, Thanks for the updated KIP. Perhaps it's better to name the new config unstable.feature.versions.enable since there could be multiple unstable versions. Other than that, the KIP looks good to me. Jun On Thu, Apr 11, 2024 at 9:06 AM Justine Olshan wrote: > The original config

[jira] [Created] (KAFKA-16525) Request manager and raft channel discover node endpoints

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16525: -- Summary: Request manager and raft channel discover node endpoints Key: KAFKA-16525 URL: https://issues.apache.org/jira/browse/KAFKA-16525

[jira] [Created] (KAFKA-16524) Metrics for KIP-853

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16524: -- Summary: Metrics for KIP-853 Key: KAFKA-16524 URL: https://issues.apache.org/jira/browse/KAFKA-16524 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-04-11 Thread Kamal Chandraprakash
> Is making it optional a good solution? Or should we recover the snapshot if not found before uploading it? IMO, we should recover the snapshot if it is not found. > But what if the topic is created before v2.8.0 and old log segments are deleted, how could we recover all the producer snapshot

[jira] [Created] (KAFKA-16523) kafka-metadata-quorum add voter and remove voter changes

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16523: -- Summary: kafka-metadata-quorum add voter and remove voter changes Key: KAFKA-16523 URL: https://issues.apache.org/jira/browse/KAFKA-16523

[jira] [Created] (KAFKA-16522) Implement Admin client changes for adding and removing votes

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16522: -- Summary: Implement Admin client changes for adding and removing votes Key: KAFKA-16522 URL: https://issues.apache.org/jira/browse/KAFKA-16522

[jira] [Created] (KAFKA-16521) Implement kafka-metadata-quorum describe changes for KIP-853

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16521: -- Summary: Implement kafka-metadata-quorum describe changes for KIP-853 Key: KAFKA-16521 URL: https://issues.apache.org/jira/browse/KAFKA-16521

[jira] [Created] (KAFKA-16520) Implement changes to DescribeQuorum response

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16520: -- Summary: Implement changes to DescribeQuorum response Key: KAFKA-16520 URL: https://issues.apache.org/jira/browse/KAFKA-16520 Project:

[jira] [Created] (KAFKA-16519) Expose the supported and finalized kraft.version in ApiVersions response

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16519: -- Summary: Expose the supported and finalized kraft.version in ApiVersions response Key: KAFKA-16519 URL:

[jira] [Created] (KAFKA-16518) Implement storage tool changes for KIP-853

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16518: -- Summary: Implement storage tool changes for KIP-853 Key: KAFKA-16518 URL: https://issues.apache.org/jira/browse/KAFKA-16518 Project: Kafka

[jira] [Created] (KAFKA-16517) Do not decode metadata records in the internal kraft partition listener

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16517: -- Summary: Do not decode metadata records in the internal kraft partition listener Key: KAFKA-16517 URL:

[jira] [Created] (KAFKA-16516) Fix the controller node provider for broker to control channel

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16516: -- Summary: Fix the controller node provider for broker to control channel Key: KAFKA-16516 URL: https://issues.apache.org/jira/browse/KAFKA-16516

[jira] [Created] (KAFKA-16515) Fix the ZK Metadata cache use of voter static configuration

2024-04-11 Thread Jira
José Armando García Sancio created KAFKA-16515: -- Summary: Fix the ZK Metadata cache use of voter static configuration Key: KAFKA-16515 URL: https://issues.apache.org/jira/browse/KAFKA-16515

[jira] [Created] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-04-11 Thread Sal Sorrentino (Jira)
Sal Sorrentino created KAFKA-16514: -- Summary: Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag. Key: KAFKA-16514 URL: https://issues.apache.org/jira/browse/KAFKA-16514

Re: [PR] [MINOR] Add youtube to content security policy [kafka-site]

2024-04-11 Thread via GitHub
omkreddy merged PR #597: URL: https://github.com/apache/kafka-site/pull/597 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] [MINOR] Add youtube to content security policy [kafka-site]

2024-04-11 Thread via GitHub
VedarthConfluent opened a new pull request, #597: URL: https://github.com/apache/kafka-site/pull/597 This change should fix the broken video on quickstart page https://kafka.apache.org/quickstart. Currently observing following error:- `quickstart:297 Refused to frame

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-11 Thread Justine Olshan
The original config was never actually approved in any KIP. But we can say it is deprecated. I can change the config name. Justine On Thu, Apr 11, 2024 at 8:52 AM Jun Rao wrote: > Hi, Justine, > > Thanks for the updated KIP. > > Would unstable.feature.version.enable be a clearer name? Also,

[DISCUSS] Transition Required from RemoteLogSegment to LocalLogSegment during Fetch Request

2024-04-11 Thread Arpit Goyal
Hi All, When tackling the issue outlined in https://issues.apache.org/jira/browse/KAFKA-16088, which pertains to transitioning from RemoteLogSegment to LocalLogSegment during log compaction in a fetch request, I'm seeking some suggestions or guidance from the community to advance *Current

[DISCUSS] KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission

2024-04-11 Thread Nikhil Ramakrishnan
Hi everyone, I would like to start a discussion for KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission https://cwiki.apache.org/confluence/display/KAFKA/KIP-1037%3A+Allow+WriteTxnMarkers+API+with+Alter+Cluster+Permission The WriteTxnMarkers API was originally used for

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

2024-04-11 Thread Jun Rao
Hi, Justine, Thanks for the updated KIP. Would unstable.feature.version.enable be a clearer name? Also, should we remove/deprecate unstable.metadata.versions.enable in this KIP? Jun On Tue, Apr 9, 2024 at 9:09 AM Justine Olshan wrote: > Hi Jun, > > Makes sense to me. It seems like KIP-1014

[jira] [Created] (KAFKA-16513) Allow WriteTxnMarkers API with Alter Cluster Permission

2024-04-11 Thread Nikhil Ramakrishnan (Jira)
Nikhil Ramakrishnan created KAFKA-16513: --- Summary: Allow WriteTxnMarkers API with Alter Cluster Permission Key: KAFKA-16513 URL: https://issues.apache.org/jira/browse/KAFKA-16513 Project: Kafka

[jira] [Created] (KAFKA-16512) Top level menu on Kafka homepage not working

2024-04-11 Thread Tobias Liefke (Jira)
Tobias Liefke created KAFKA-16512: - Summary: Top level menu on Kafka homepage not working Key: KAFKA-16512 URL: https://issues.apache.org/jira/browse/KAFKA-16512 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

2024-04-11 Thread Elxan Eminov
Hi Mickael! Any thoughts on this? Thanks! On Wed, 3 Apr 2024 at 13:21, Elxan Eminov wrote: > Hi Mickael, > Thanks for your response and apologies for a huge delay in mine. > > My thinking is that any partition could go stale if there are no records > being produced into it. If enough of such

[jira] [Created] (KAFKA-16511) Leaking tiered segments

2024-04-11 Thread Francois Visconte (Jira)
Francois Visconte created KAFKA-16511: - Summary: Leaking tiered segments Key: KAFKA-16511 URL: https://issues.apache.org/jira/browse/KAFKA-16511 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-04-11 Thread Damien Gasparina
Hi Matthias, Bruno, 1.a During my previous comment, by Processor Node ID, I meant Processor name. This is important information to expose in the handler as it allows users to identify the location of the exception in the topology. I assume this information could be useful in other places, that's

Re: Gentle bump on KAFKA-16371 (Unstable committed offsets after triggering commits where metadata for some partitions are over the limit)

2024-04-11 Thread Michał Łowicki
BR, Michał Łowicki On Fri, 5 Apr 2024 at 15:59, David Jacot wrote: > Thanks, Michal. Let me add it to my review queue. Gentle ping ;-) > > BR, > David > > On Fri, Apr 5, 2024 at 3:29 PM Michał Łowicki wrote: > > > Hi there! > > > > Created

[jira] [Resolved] (KAFKA-15610) Fix `CoreUtils.swallow()` test gaps

2024-04-11 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15610. Fix Version/s: 3.8.0 Resolution: Fixed > Fix `CoreUtils.swallow()` test gaps >

[jira] [Resolved] (KAFKA-16482) Eliminate the IDE warnings of accepting ClusterConfig in BeforeEach

2024-04-11 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16482. Fix Version/s: 3.8.0 Resolution: Fixed > Eliminate the IDE warnings of accepting

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-04-11 Thread Bruno Cadonna
Hi Matthias, 1.a With processor node ID, I mean the ID that is exposed in the tags of processor node metrics. That ID cannot be internal since it is exposed in metrics. I think the processor name and the processor node ID is the same thing. I followed how the processor node ID is set in

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

2024-04-11 Thread Frédérik Rouleau
Hi Kirk, I have made the test and I confirm that checkstyle is complaining (Disallowed import - org.apache.kafka.common.record.Record.) if I use Record class in the RecordDeserialisationException. An alternative might be to add key(), value(), headers() etc methods directly in the exception.

Re: [DISCUSS] KIP-899: Allow clients to rebootstrap

2024-04-11 Thread Chris Egerton
Hi Ivan, I agree with Andrew that we can save cluster ID checking for later. This feature is opt-in and if necessary we can add a note to users about only enabling it if they can be certain that the same cluster will always be resolved by the bootstrap servers. This would apply regardless of

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2024-04-11 Thread Nelson B.
Hi Colin, Thanks for the KIP! I'm sorry for reopening this old discussion thread but I don't know where else I can ask my question. I wanted to use the newly updated kafka-configs.sh tool to dynamically update the ssl keystore in the controller node, but I still couldn't figure it out. Is it

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

2024-04-11 Thread Frédérik Rouleau
Thanks for your feedback. Kirk, that's a good point. I will check if there are other ways of raising an exception than the deserialisation itself. About Record, I agree I think it would be a better choice and my initial version was using it. But then I realised that this class might not be