[jira] [Created] (KAFKA-12552) Extract segments map out of Log class into separate class

Kowshik Prakasam created KAFKA-12552: Summary: Extract segments map out of Log class into separate class Key: KAFKA-12552 URL: https://issues.apache.org/jira/browse/KAFKA-12552 Project: Kafka

[jira] [Created] (KAFKA-12553) Refactor Log layer recovery logic

Kowshik Prakasam created KAFKA-12553: Summary: Refactor Log layer recovery logic Key: KAFKA-12553 URL: https://issues.apache.org/jira/browse/KAFKA-12553 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-12513) Kafka zookeeper client can't connect when the first zookeeper server is offline

[ https://issues.apache.org/jira/browse/KAFKA-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Piecuch resolved KAFKA-12513. --- Resolution: Invalid I've just read the docs, looks like everything is fine on kafka

[jira] [Created] (KAFKA-12554) Split Log layer into UnifiedLog and LocalLog

Kowshik Prakasam created KAFKA-12554: Summary: Split Log layer into UnifiedLog and LocalLog Key: KAFKA-12554 URL: https://issues.apache.org/jira/browse/KAFKA-12554 Project: Kafka Issue

[jira] [Created] (KAFKA-12551) Refactor Kafka Log layer

Kowshik Prakasam created KAFKA-12551: Summary: Refactor Kafka Log layer Key: KAFKA-12551 URL: https://issues.apache.org/jira/browse/KAFKA-12551 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-12555) Log reason for rolling a segment

Stanislav Kozlovski created KAFKA-12555: --- Summary: Log reason for rolling a segment Key: KAFKA-12555 URL: https://issues.apache.org/jira/browse/KAFKA-12555 Project: Kafka Issue Type:

Re: Is it safe to delete old log segments manually?

Hi Sankalp, As long as you have replication, I’ve found it is safest to delete entire topic-partition directories than it is to delete individual log segments from them. For one, you get back more space. Second, you don’t have to worry about metadata corruption. When I’ve run out of disk

Re: Kafka contribution

Dear Apache Kafka team, I wrote some wrong details about myself in my previous email. So here are my details: email: *egye...@cloudera.com * github username: *egyedt* jira username: *egyed.t* Kind regards, *Tamás Egyed* | Software engineer, Hungary cloudera.com

Is it safe to delete old log segments manually?

Hi All, Brokers in one of our Apache Kafka clusters are continuously crashing as they have run out of disk space. As per my understanding, reducing the value of retention.ms and retention.bytes properties will not work because the broker is crashing before the log-retention thread can be

Kafka contribution

Dear Apache Kafka team, I would like to contribute to the Kafka project. Here are some details about me: email: *egye...@cloudera.com * github username: *egytom* (domain: github.infra.cloudera.com) jira username: *egyed.t *(https://jira.cloudera.com/) Kind regards, *Tamás Egyed* | Software

[jira] [Created] (KAFKA-12557) org.apache.kafka.clients.admin.KafkaAdminClientTest#testClientSideTimeoutAfterFailureToReceiveResponse intermittently hangs indefinitely

John Roesler created KAFKA-12557: Summary: org.apache.kafka.clients.admin.KafkaAdminClientTest#testClientSideTimeoutAfterFailureToReceiveResponse intermittently hangs indefinitely Key: KAFKA-12557 URL:

[jira] [Created] (KAFKA-12556) Add --under-preferred-replica-partitions option to describe topics command

Wenbing Shen created KAFKA-12556: Summary: Add --under-preferred-replica-partitions option to describe topics command Key: KAFKA-12556 URL: https://issues.apache.org/jira/browse/KAFKA-12556 Project:

[VOTE] KIP-712: Shallow Mirroring

Hi, I'd like to start a vote on KIP-712: Shallow Mirroring. https://cwiki.apache.org/confluence/display/KAFKA/KIP-712%3A+Shallow+Mirroring Thanks

Re: Is it safe to delete old log segments manually?

Thank you for the response Peter. However, for us all the brokers are currently offline. So if I delete the entire topic-partition directory in one of the brokers, the first broker would start with no means to replicate the data which we just deleted. What are your thoughts on this? Do you think

Re: [DISCUSS] KIP-707: The future of KafkaFuture

Hi, I've updated the KIP along the lines of my previous reply to Ismael. If no one has further comments I will likely start a vote thread next week. Kind regards, Tom On Tue, Mar 23, 2021 at 10:01 AM Tom Bentley wrote: > Hi Ryanne, > > Thanks for the reply. If there was a consensus for

Re: Kafka contribution

Hi Tamas, I've added you as a contributor to Jira. You should be able to self-assign tickets now. For more information, you can take a look at the "How To Contribute" page. Thanks for your interest in Apache Kafka. -Bill On Thu, Mar 25, 2021 at 10:29

Re: [DISCUSS] KIP-707: The future of KafkaFuture

Thanks Tom, looks reasonable to me. I'll take a closer look soon, but please go ahead with the vote whenever you're ready. Ismael On Thu, Mar 25, 2021, 8:53 AM Tom Bentley wrote: > Hi, > > I've updated the KIP along the lines of my previous reply to Ismael. If no > one has further comments I

Re: Is it safe to delete old log segments manually?

In this case, yes, for any given topic-partition on the broker, you should be able to delete the oldest log segment, its associated index and timeindex files, and the snapshot file (which will be recreated on startup) in order to gain some free space. — Peter Bukowinski > On Mar 25, 2021, at

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #668

See Changes: [github] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 3.70 MB...] AuthorizerIntegrationTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #609

See Changes: [github] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 3.68 MB...] LogTest > testDeleteSnapshotsOnIncrementLogStartOffset() STARTED

[jira] [Created] (KAFKA-12558) MM2 may not sync partition offsets correctly

Alan created KAFKA-12558: Summary: MM2 may not sync partition offsets correctly Key: KAFKA-12558 URL: https://issues.apache.org/jira/browse/KAFKA-12558 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-712: Shallow Mirroring

+1 from me. Super looking forward to this. But N.B. it looks like KIP-720 will pass, which deprecates MM1. I don't think there is any reason both KIPs can't pass, but it looks like any classes introduced in KIP-712 would get immediately deprecated. Ryanne On Thu, Mar 25, 2021, 12:34 PM Henry

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #80

See Changes: [John Roesler] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 3.62 MB...] BrokerEndPointTest > testFromJsonV1() STARTED

Re: [VOTE] KIP-712: Shallow Mirroring

I am actually fine with that. I think only the change in MM1 will be deprecated which is not a big part of the PR. Other people can see what was implemented in this PR and can port it to other use cases. On Thu, Mar 25, 2021 at 12:11 PM Ryanne Dolan wrote: > +1 from me. Super looking forward

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #637

See Changes: [github] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 3.68 MB...] ControllerEventManagerTest > testSuccessfulEvent() PASSED

Re: [DISCUSS] Apache Kafka 2.7.1 release

Hi Mickael, I hope all is well with you. FYI, I have just pushed the fix to this blocker: https://issues.apache.org/jira/browse/KAFKA-12508 to the 2.7 branch. I'll resolve the ticket after I finish pushing to 2.6. Thanks, John On Fri, 2021-02-19 at 05:29 -0800, Ismael Juma wrote: > Sounds

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #638

See Changes: [github] KAFKA-12452: Remove deprecated overloads of ProcessorContext#forward (#10300) [github] MINOR: Use Java 11 for generating aggregated javadoc in release.py (#10399)

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #139

See Changes: [John Roesler] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 6.90 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[jira] [Created] (KAFKA-12561) Fix flaky kafka.server.RaftClusterTest.testCreateClusterAndCreateListDeleteTopic()

Luke Chen created KAFKA-12561: - Summary: Fix flaky kafka.server.RaftClusterTest.testCreateClusterAndCreateListDeleteTopic() Key: KAFKA-12561 URL: https://issues.apache.org/jira/browse/KAFKA-12561

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #669

See Changes: [github] KAFKA-12452: Remove deprecated overloads of ProcessorContext#forward (#10300) -- [...truncated 3.68 MB...]

[jira] [Created] (KAFKA-12562) Remove deprecated-overloaded "KafkaStreams#metadataForKey" and "KafkaStreams#store"

Guozhang Wang created KAFKA-12562: - Summary: Remove deprecated-overloaded "KafkaStreams#metadataForKey" and "KafkaStreams#store" Key: KAFKA-12562 URL: https://issues.apache.org/jira/browse/KAFKA-12562

[jira] [Resolved] (KAFKA-12526) Remove deprecated long ms overloads

[ https://issues.apache.org/jira/browse/KAFKA-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12526. --- Resolution: Duplicate > Remove deprecated long ms overloads >

[jira] [Resolved] (KAFKA-12527) Remove deprecated "PartitionGrouper" interface

[ https://issues.apache.org/jira/browse/KAFKA-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12527. --- Resolution: Duplicate > Remove deprecated "PartitionGrouper" interface >

[jira] [Created] (KAFKA-12563) Something wrong with MM2 metrics

Bui Thanh MInh created KAFKA-12563: -- Summary: Something wrong with MM2 metrics Key: KAFKA-12563 URL: https://issues.apache.org/jira/browse/KAFKA-12563 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-12559) Add a top-level Streams config for bounding off-heap memory

A. Sophie Blee-Goldman created KAFKA-12559: -- Summary: Add a top-level Streams config for bounding off-heap memory Key: KAFKA-12559 URL: https://issues.apache.org/jira/browse/KAFKA-12559

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #108

See Changes: [John Roesler] KAFKA-12508: Disable KIP-557 (#10397) -- [...truncated 3.18 MB...] org.apache.kafka.streams.internals.WindowStoreFacadeTest >

[jira] [Resolved] (KAFKA-12508) Emit-on-change tables may lose updates on error or restart in at_least_once

[ https://issues.apache.org/jira/browse/KAFKA-12508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-12508. -- Resolution: Fixed Disabled KIP-557 entirely. > Emit-on-change tables may lose updates on

[jira] [Created] (KAFKA-12560) Accidental delete of some log files kafka-authorizer.log and kafka-request.log can break topics in cluster

Rufus Skyfii created KAFKA-12560: Summary: Accidental delete of some log files kafka-authorizer.log and kafka-request.log can break topics in cluster Key: KAFKA-12560 URL:

Re: Fw: Regarding email notification un-subscription

Hi Madan, You need to send an email (any subject or contents will do) to dev-unsubscr...@kafka.apache.org from the email address which is receiving the mailing list messages. You will then receive a message containing a link which you can use to unsubscribe. Kind regards, Tom On Thu, Mar 25,