[jira] [Created] (KAFKA-12804) In-Memory state store backed by InMemoryKeyValueStore is slow due to synchronizing reads/writes using a single lock.

2021-05-17 Thread Ki Lok Wong (Jira)
Ki Lok Wong created KAFKA-12804: --- Summary: In-Memory state store backed by InMemoryKeyValueStore is slow due to synchronizing reads/writes using a single lock. Key: KAFKA-12804 URL:

Granting permission for Create KIP

2021-05-17 Thread ping lv
Please grant permission for Create KIP to wiki ID: hiping

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #136

2021-05-17 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #154

2021-05-17 Thread Apache Jenkins Server
See Changes: [Rajini Sivaram] KAFKA-12751: Reset AlterIsr in-flight state for duplicate update requests (#10633) -- [...truncated 3.45 MB...]

[jira] [Created] (KAFKA-12803) Support reassigning partitions when in KRaft mode

2021-05-17 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12803: Summary: Support reassigning partitions when in KRaft mode Key: KAFKA-12803 URL: https://issues.apache.org/jira/browse/KAFKA-12803 Project: Kafka Issue

[jira] [Resolved] (KAFKA-12788) Improve KRaft replica placement

2021-05-17 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12788. -- Fix Version/s: 3.0.0 Reviewer: Jun Rao Resolution: Fixed > Improve KRaft

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-05-17 Thread Randall Hauch
On Mon, May 10, 2021 at 10:26 AM Chris Egerton wrote: > RE transaction boundaries: > > > First, the offset commit interval is currently 60 seconds by default, and > source connectors can produce a lot of records in that time. Until someone > operating a Connect cluster changed that to a much

[jira] [Created] (KAFKA-12802) Add a file based cache for consumed remote log metadata for each partition to avoid consuming again incase of broker restarts.

2021-05-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-12802: -- Summary: Add a file based cache for consumed remote log metadata for each partition to avoid consuming again incase of broker restarts. Key: KAFKA-12802 URL:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #134

2021-05-17 Thread Apache Jenkins Server
See Changes: -- [...truncated 341146 lines...] [2021-05-17T21:48:11.191Z] [2021-05-17T21:48:11.191Z] DescribeConsumerGroupTest > testDescribeExistingGroups() STARTED

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #133

2021-05-17 Thread Apache Jenkins Server
See

Re: Testing KRaft mode

2021-05-17 Thread Gunnar Morling
Hey Chris, Thanks a lot for your reply. I've tried with "connect.protocol", but it didn't make any difference. I've thus logged https://issues.apache.org/jira/browse/KAFKA-12801 and will also try to attach a profiling log as requested by Lucas. Best, --Gunnar Am Mo., 17. Mai 2021 um 14:32 Uhr

Request to be added as a contributor in Kafka Project

2021-05-17 Thread Abhiruchi Gupta
Hello, My name is Abhiruchi Gupta. I am a software developer with around 5 years of experience and I am interested in contributing to the open-source Apache Kafka project. Can I please be added to the contributor list? My Jira username: *abhirgup* Thanks, Abhiruchi

[jira] [Created] (KAFKA-12801) High CPU load after restarting brokers subsequent to quorum loss

2021-05-17 Thread Gunnar Morling (Jira)
Gunnar Morling created KAFKA-12801: -- Summary: High CPU load after restarting brokers subsequent to quorum loss Key: KAFKA-12801 URL: https://issues.apache.org/jira/browse/KAFKA-12801 Project: Kafka

[jira] [Resolved] (KAFKA-12794) Trailing JSON tokens in DescribeProducersRequest.json can cause parse errors in some JSON parsers

2021-05-17 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-12794. - Fix Version/s: 3.0.0 Resolution: Fixed > Trailing JSON tokens in

[jira] [Created] (KAFKA-12800) Configure jackson to to reject trailing input in the generator

2021-05-17 Thread Nathan Lincoln (Jira)
Nathan Lincoln created KAFKA-12800: -- Summary: Configure jackson to to reject trailing input in the generator Key: KAFKA-12800 URL: https://issues.apache.org/jira/browse/KAFKA-12800 Project: Kafka

[jira] [Created] (KAFKA-12799) Extend TestSecurityRollingUpgrade system test to KRaft

2021-05-17 Thread Ron Dagostino (Jira)
Ron Dagostino created KAFKA-12799: - Summary: Extend TestSecurityRollingUpgrade system test to KRaft Key: KAFKA-12799 URL: https://issues.apache.org/jira/browse/KAFKA-12799 Project: Kafka

[jira] [Created] (KAFKA-12798) Fixing MM2 rebalance timeout issue when source cluster is not available

2021-05-17 Thread Barnabas Maidics (Jira)
Barnabas Maidics created KAFKA-12798: Summary: Fixing MM2 rebalance timeout issue when source cluster is not available Key: KAFKA-12798 URL: https://issues.apache.org/jira/browse/KAFKA-12798

[jira] [Created] (KAFKA-12797) Quota to mitigate impact of clients that leak Fetch session slots

2021-05-17 Thread Martin Schneppenheim (Jira)
Martin Schneppenheim created KAFKA-12797: Summary: Quota to mitigate impact of clients that leak Fetch session slots Key: KAFKA-12797 URL: https://issues.apache.org/jira/browse/KAFKA-12797

Re: Testing KRaft mode

2021-05-17 Thread Chris Egerton
Hi Gunnar, As far as the Connect behavior goes, sounds like https://issues.apache.org/jira/browse/KAFKA-12252. To verify, you can either set the 'connect.protocol' property of your Connect cluster to 'compatible' (easy mode) or cherry-pick the recently-merged fix for it (

Re: [VOTE] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-05-17 Thread Rajini Sivaram
+1 (binding) Thanks for the KIP, Tom! Regards, Rajini On Mon, May 17, 2021 at 12:42 PM David Jacot wrote: > +1 (binding) > > Thanks for the KIP, Tom. > > Best, > David > > On Fri, Apr 23, 2021 at 12:42 PM Thomas Scott > wrote: > > > Hey all, > > > > I'm starting the voting on KIP-734. >

Re: [VOTE] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-05-17 Thread David Jacot
+1 (binding) Thanks for the KIP, Tom. Best, David On Fri, Apr 23, 2021 at 12:42 PM Thomas Scott wrote: > Hey all, > > I'm starting the voting on KIP-734. > > >

Re: [DISCUSS] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-05-17 Thread Thomas Scott
Thanks David, I've added the static method in the KIP. For the timestamps I'd prefer to keep this as a future enhancement given the extra scope it would add to this KIP. Thanks Tom On Mon, May 17, 2021 at 9:12 AM David Jacot wrote: > Hi Tom, > > Thanks for the updates. Overall, LGTM.

Re: [DISCUSS] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-05-17 Thread David Jacot
Hi Tom, Thanks for the updates. Overall, LGTM. We probably want to add a new static method in `OffsetSpec` for `MaxTimestampSpec` similarly to what we did for the other specs. I thought a bit about Jason's suggestion. I do agree that it would be convenient to include the timestamp type in the

[jira] [Created] (KAFKA-12796) Removal of deprecated classes under `streams-scala`

2021-05-17 Thread Josep Prat (Jira)
Josep Prat created KAFKA-12796: -- Summary: Removal of deprecated classes under `streams-scala` Key: KAFKA-12796 URL: https://issues.apache.org/jira/browse/KAFKA-12796 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-740: Replace the public TaskId class with an interface

2021-05-17 Thread Sophie Blee-Goldman
> > Changing `TaskId` to an abstract class and deprecate all util functions / > fields that we do not > want to expose any longer I had considered doing exactly this, where we just convert the existing public TaskId class to an interface or an abstract class rather than introducing a new one,