Build failed in Jenkins: kafka-trunk-jdk8 #4494

See Changes: [github] KAFKA-9939; Fix overcounting delayed fetches in request rate metrics [github] MINOR: Improve Sensor recording efficiency (#8593) [github] MINOR: Use min/max function when possible (#8577)

Jenkins build is back to normal : kafka-trunk-jdk14 #49

See

[jira] [Reopened] (KAFKA-8940) Flaky Test SmokeTestDriverIntegrationTest.shouldWorkWithRebalance

[ https://issues.apache.org/jira/browse/KAFKA-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-8940: Reopening. Failed again:

[jira] [Resolved] (KAFKA-9896) Flaky Test StandbyTaskEOSIntegrationTest#surviveWithOneTaskAsStandby[exactly_once_beta]

[ https://issues.apache.org/jira/browse/KAFKA-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9896. Resolution: Cannot Reproduce > Flaky Test >

Jenkins build is back to normal : kafka-trunk-jdk8 #4493

See

Re: [DISCUSS] KIP-554: Add Broker-side SCRAM Config API

On Fri, May 1, 2020, at 08:35, Aneel Nazareth wrote: > Hi Colin, > > Thanks for the KIP. Is it also in scope to add support for the new API > to the Admin interface and the implementation in KafkaAdminClient? > Hi Aneel, Yes, we will have a Java API. The new Admin API is described in the KIP.

Jenkins build is back to normal : kafka-trunk-jdk11 #1417

See

Build failed in Jenkins: kafka-trunk-jdk14 #48

See Changes: [github] KAFKA-6145: KIP 441 remove balance factor (#8597) -- [...truncated 2.86 MB...] org.apache.kafka.connect.json.JsonConverterTest > shortToJson PASSED

[jira] [Resolved] (KAFKA-8122) Flaky Test EosIntegrationTest#shouldNotViolateEosIfOneTaskFailsWithState

[ https://issues.apache.org/jira/browse/KAFKA-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8122. Resolution: Fixed > Flaky Test

[jira] [Created] (KAFKA-9947) TransactionsBounceTest may leave threads running

Jason Gustafson created KAFKA-9947: -- Summary: TransactionsBounceTest may leave threads running Key: KAFKA-9947 URL: https://issues.apache.org/jira/browse/KAFKA-9947 Project: Kafka Issue

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Sure thing Sonke, what I suggest is that usual KIPs get accepted to go into next release. It could span for a couple of releases because of engineering time, but no change has to be shipped in specific future releases, like the backward incompatible change for KafkaPrincipal. But I guess it's not

[jira] [Resolved] (KAFKA-9939) Fetch request metrics are updated twice for delayed fetches

[ https://issues.apache.org/jira/browse/KAFKA-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9939. Fix Version/s: 2.6.0 Resolution: Fixed > Fetch request metrics are updated twice

Re: [DISCUSS] KIP-317 - Add end-to-end data encryption functionality to Apache Kafka

Hi Tom, thanks for taking a look! Regarding your questions, I've answered below, but will also add more detail to the KIP around these questions. 1. The functionality in this first phase could indeed be achieved with custom serializers, that would then need to wrap the actual serializer that is

Build failed in Jenkins: kafka-trunk-jdk8 #4492

See Changes: [github] KAFKA-8410: Revert Part 1: processor context bounds (#8414) (#8595) -- [...truncated 3.06 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Hi Boyang, thanks for the update, sounds reasonable to me. Making it a breaking change is definitely the safer route to go. Just one quick question regarding your mail, I didn't fully understand what you mean by "I think this is the first time we need to introduce a KIP without having it fully

Re: KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect

Never mind, did by myself  Thanks Jun From: Jun Wang Sent: Friday, May 1, 2020 11:55 AM To: dev@kafka.apache.org Subject: KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect Hi I fixed the bug related to

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Hey Tom, thanks for the suggestion. As long as we could correctly serialize the principal and embed in the Envelope, I think we could still leverage the controller to do the client request authentication. Although this pays an extra round trip if the authorization is doomed to fail on the

Re: [DISCUSS] KIP-595: A Raft Protocol for the Metadata Quorum

Hi, Jason, Thanks for the KIP. Great writeup. A few comments below. 100. Do we need AlterQuorum in the first version? Quorum changes are rare and the implementation is involved. ZK doesn't have that until 4 years after the initial version. Dropping that in the first version could speed up this

Re: [VOTE] KIP-441: Smooth Scaling Out for Kafka Streams

Can you elaborate why to remove it? On 5/1/20 11:29 AM, Sophie Blee-Goldman wrote: > Hey all, > > We'd like to make a slight modification to the proposal in this KIP and > remove > the *balance.factor* config. We will update the KIP accordingly. Please let > us know > if you have any concerns. >

Build failed in Jenkins: kafka-trunk-jdk8 #4491

See Changes: [github] KAFKA-6145: KIP 441 remove balance factor (#8597) -- [...truncated 6.11 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [VOTE] KIP-441: Smooth Scaling Out for Kafka Streams

Hey all, We'd like to make a slight modification to the proposal in this KIP and remove the *balance.factor* config. We will update the KIP accordingly. Please let us know if you have any concerns. Cheers, Sophie On Wed, Jan 15, 2020 at 12:48 PM John Roesler wrote: > Hello all, > > After a

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

Thanks for chiming in Ryanne. Personally, I'd rather fix MM1 to have a default of not-skipping-messages, as that seems more correct, rather than fix the MM2 "legacy" switch to match the bad behavior. Especially since this won't affect currently-running mirrormakers, so there's not that much

Build failed in Jenkins: kafka-trunk-jdk11 #1416

See Changes: [github] KAFKA-6145: KIP 441 remove balance factor (#8597) -- [...truncated 3.07 MB...] org.apache.kafka.streams.TestTopicsTest > testRecordsToList PASSED

[jira] [Resolved] (KAFKA-9543) Consumer offset reset after new segment rolling

[ https://issues.apache.org/jira/browse/KAFKA-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9543. Fix Version/s: 2.5.1 2.4.2 Resolution: Fixed > Consumer offset

Re: [DISCUSS] KIP-585: Conditional SMT

Hi Tom, Looks good to me. Thanks, Andrew On 01/05/2020, 16:24, "Tom Bentley" wrote: Hi, I've updated the KIP to reflect recent discussions. Please note the following: 1. I've described a HasHeaderKey predicate rather than HeaderKeyMatches because at the moment Headers

Re: [DISCUSS] KIP-589 Add API to Update Replica State in Controller

Jose/Colin/Tom, thanks for the feedback! > Partition level errors This was an oversight on my part, I meant to include these in the response RPC. I'll update that. > INVALID_REQUEST I'll update this text description, that was a copy/paste left over > I think we should mention that the

KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect

Hi I fixed the bug related to https://issues.apache.org/jira/browse/KAFKA-8120 Please assign the JIRA to me so that I can create pull request. or let me know if there is any other options to submit the fix. Thanks Jun Wang

[jira] [Created] (KAFKA-9946) KAFKA-9539/StopReplicaRequest deletePartition changes may cause premature topic deletion handling in controller

Lucas Bradstreet created KAFKA-9946: --- Summary: KAFKA-9539/StopReplicaRequest deletePartition changes may cause premature topic deletion handling in controller Key: KAFKA-9946 URL:

Re: [DISCUSS] KIP-317 - Add end-to-end data encryption functionality to Apache Kafka

Hi Sönke, I never looked at the original version, but what you describe in the new version makes sense to me. Here are a few things which sprang to mind while I was reading: 1. It wasn't immediately obvious why this can't be achieved using custom serializers and deserializers. 2. It would be

Re: [DISCUSS] KIP-554: Add Broker-side SCRAM Config API

Hi Colin, Thanks for the KIP. Is it also in scope to add support for the new API to the Admin interface and the implementation in KafkaAdminClient? On Fri, May 1, 2020 at 1:18 AM Colin McCabe wrote: > > Hi all, > > I posted a KIP about adding a new SCRAM configuration API on the broker. >

Re: [DISCUSS] KIP-585: Conditional SMT

Hi, I've updated the KIP to reflect recent discussions. Please note the following: 1. I've described a HasHeaderKey predicate rather than HeaderKeyMatches because at the moment Headers doesn't expose the whole set of headers, only those with a specific name. Exposing this would significantly

Re: [DISCUSS] KIP-601: Configurable socket connection timeout

Hi Colin. Thanks for the discussion and feedback. I re-wrote the KIP-601 proposal following your suggestions. Now the new proposal is ready. Best, - Cheng Tan > On Apr 28, 2020, at 2:55 PM, Colin McCabe wrote: > > > Thanks again for the KIP. This seems like it has been a gap in Kaf

Build failed in Jenkins: kafka-trunk-jdk11 #1415

See Changes: [github] HOTFIX: Avoid ambiguity error of Properties#putAll in Java 11 and scala -- [...truncated 3.08 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4490

See Changes: [github] HOTFIX: Avoid ambiguity error of Properties#putAll in Java 11 and scala -- [...truncated 3.06 MB...]

Build failed in Jenkins: kafka-trunk-jdk14 #47

See Changes: [github] HOTFIX: Avoid ambiguity error of Properties#putAll in Java 11 and scala -- [...truncated 3.07 MB...]

[DISCUSS] KIP-554: Add Broker-side SCRAM Config API

Hi all, I posted a KIP about adding a new SCRAM configuration API on the broker. Check it out here if you get a chance: https://cwiki.apache.org/confluence/x/ihERCQ cheers, Colin

[DISCUSS] KIP-604: Remove ZooKeeper Flags from the Administrative Tools

Hi all, I posted a KIP about removing the deprecated --zookeeper flags from our administrative tools. Check it out here: https://cwiki.apache.org/confluence/x/kRARCQ best, Colin