[jira] [Created] (KAFKA-12777) AutoTopicCreationManager does not handle response errors

David Arthur created KAFKA-12777: Summary: AutoTopicCreationManager does not handle response errors Key: KAFKA-12777 URL: https://issues.apache.org/jira/browse/KAFKA-12777 Project: Kafka

[DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hey Folks, I just posted a new proposal in the wiki. I think we have an opportunity to improve the KafkaProducer#send user experience. It would certainly make our lives easier. Please take a look! There are two

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

Hey, sorry for arriving late, but I have a question about the rejected alternative involving configuration. I may be missing something, but we are looking at 3 new configs (one for each topic). And this rejected alternative is basically identical to what Connect already does (you can choose names

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #121

See Changes: -- [...truncated 408827 lines...] [2021-05-13T20:50:02.320Z] > Task :server-common:compileJava UP-TO-DATE [2021-05-13T20:50:02.320Z] > Task

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hey Moses, I like the direction here. My thinking is that a single additional work queue, s.t. send() can enqueue and return, seems like the lightest touch. However, I don't think we can trivially process that queue in an internal thread pool without subtly changing behavior for some users. For

[jira] [Created] (KAFKA-12778) QuorumController should honor request timeouts

Colin McCabe created KAFKA-12778: Summary: QuorumController should honor request timeouts Key: KAFKA-12778 URL: https://issues.apache.org/jira/browse/KAFKA-12778 Project: Kafka Issue Type:

[VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

Hey all, I'm just going to take this KIP straight to a vote since it should be a trivial and uncontroversial change. Of course please raise any concerns should they come up, and I can take things to a DISCUSS thread. The KIP is a simple change to move from String to TaskId for the taskID field

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hey Ryanne, I agree we should add an additional constructor (or else an additional overload in KafkaProducer#send, but the new constructor would be easier to understand) if we're targeting the "user provides the thread" approach. >From looking at the code, I think we can keep record

[jira] [Created] (KAFKA-12779) Use TaskId instead of String for the taskId field in TaskMetadata

A. Sophie Blee-Goldman created KAFKA-12779: -- Summary: Use TaskId instead of String for the taskId field in TaskMetadata Key: KAFKA-12779 URL: https://issues.apache.org/jira/browse/KAFKA-12779

[jira] [Created] (KAFKA-12780) java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0

Ireneusz Matysiewicz created KAFKA-12780: Summary: java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0 Key: KAFKA-12780 URL: https://issues.apache.org/jira/browse/KAFKA-12780

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

+1 from me! (non-binding) Walker On Thu, May 13, 2021 at 1:53 PM Sophie Blee-Goldman wrote: > Hey all, > > I'm just going to take this KIP straight to a vote since it should be a > trivial and uncontroversial change. Of course please raise any concerns > should they come up, and I can take

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

Thanks all. I updated the KIP slightly since there is some ambiguity around whether the existing TaskId class is currently part of the public API or not. To settle the matter, I have introduced a new public TaskId interface that exposes the metadata, and moved the existing TaskId class to the

[jira] [Resolved] (KAFKA-1676) Ability to cancel replica reassignment in progress

[ https://issues.apache.org/jira/browse/KAFKA-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-1676. - Fix Version/s: 2.5.0 Assignee: Colin McCabe Resolution: Fixed > Ability to

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

+1 On a hindsight, maybe TaskId should not really be in `org.apache.kafka.streams.processor` but rather just in `o.a.k.streams`, but maybe not worth pulling it up now :) Guozhang On Thu, May 13, 2021 at 1:58 PM Walker Carlson wrote: > +1 from me! (non-binding) > > Walker > > On Thu, May 13,

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #122

See

Re: [DISCUSS] Apache Kafka 3.0.0 release

Hi all, Lots of good progress recently towards the 3.0.0 release and given that we are now a little less than a month away from the first milestone, I wanted to post a status update and a reminder of the upcoming dates for this major release. According to the current release plan for Apache

[jira] [Created] (KAFKA-12782) Javadocs search sends you to a non-existent URL

A. Sophie Blee-Goldman created KAFKA-12782: -- Summary: Javadocs search sends you to a non-existent URL Key: KAFKA-12782 URL: https://issues.apache.org/jira/browse/KAFKA-12782 Project: Kafka

[jira] [Resolved] (KAFKA-8326) Add Serde> support

[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-8326. --- Fix Version/s: 3.0.0 Resolution: Fixed > Add Serde> support >

[jira] [Reopened] (KAFKA-9295) KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

[ https://issues.apache.org/jira/browse/KAFKA-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman reopened KAFKA-9295: --- Unfortunately it seems to still be failing :/ 

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

re serialization, my concern is that serialization often accounts for a lot of the cycles spent before returning the future. It's not blocking per se, but it's the same effect from the caller's perspective. Moreover, serde impls often block themselves, e.g. when fetching schemas from a registry.

[jira] [Resolved] (KAFKA-4712) kafka-reassign-partitions causes ISR to shrink

[ https://issues.apache.org/jira/browse/KAFKA-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-4712. - Resolution: Cannot Reproduce This seems to be related to overall load on the cluster as a result

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

Hi Tom, I'm fine with an implicit mapping of connector-provided null to user-exposed UNKNOWN, if the design continues down that overall path. Allowing users to assert that a connector should support exactly-once sounds reasonable; it's similar to the pre-flight checks we already do for connector

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #123

See

[jira] [Resolved] (KAFKA-9520) Deprecate ZooKeeper access for kafka-reassign-partitions.sh

[ https://issues.apache.org/jira/browse/KAFKA-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-9520. - Fix Version/s: 2.5.0 Assignee: Colin McCabe Resolution: Fixed We deprecated ZK

[jira] [Created] (KAFKA-12783) Remove the deprecated ZK-based partition reassignment API

Colin McCabe created KAFKA-12783: Summary: Remove the deprecated ZK-based partition reassignment API Key: KAFKA-12783 URL: https://issues.apache.org/jira/browse/KAFKA-12783 Project: Kafka

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

One last update: we will not actually remove the existing o.a.k.streams.processor.TaskId class, but only deprecate it, along with any methods that returned it (ie the getters on ProcessorContext and StateStoreContext) Internally, everything will still be converted to use the new internal TaskId

[jira] [Created] (KAFKA-12781) Improve the endOffsets accuracy in TaskMetadata

Walker Carlson created KAFKA-12781: -- Summary: Improve the endOffsets accuracy in TaskMetadata Key: KAFKA-12781 URL: https://issues.apache.org/jira/browse/KAFKA-12781 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #124

See

[jira] [Resolved] (KAFKA-12780) java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0

[ https://issues.apache.org/jira/browse/KAFKA-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ireneusz Matysiewicz resolved KAFKA-12780. -- Resolution: Fixed > java.lang.IllegalStateException: Tried to lookup lag for

Re: too many open files

Hi Liam I can’t reply to you directly. So I have to reply it here. We are running many kinds of customized connectors. Most of them are jdbc source and sink tasks. The error throws on the standalone KC. Here is the output of ulimit [devops@gio_server4-21 ~]$ ulimit -a core file size

[GitHub] [kafka-site] mjsax commented on a change in pull request #354: Updated downloads.html to include 2.7.1

mjsax commented on a change in pull request #354: URL: https://github.com/apache/kafka-site/pull/354#discussion_r632288752 ## File path: downloads.html ## @@ -60,23 +60,66 @@ 2.8.0https://downloads.apache.org/kafka/2.8.0/RELEASE_NOTES.html;>Release Notes. + +

[GitHub] [kafka-site] mimaison commented on pull request #354: Updated downloads.html to include 2.7.1

mimaison commented on pull request #354: URL: https://github.com/apache/kafka-site/pull/354#issuecomment-840484630 @mjsax @vvcephei can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: 2.7.1 Status

Hi Gary, I'm almost done with the release process. We just need to get a couple of PRs merged and I'll send the announcement. Thanks On Wed, May 12, 2021 at 10:11 PM Gary Russell wrote: > > Thanks; I was thrown by the age of the jars, but I see, indeed, that voting > began all the way back