Re: MirrorMaker 2 / kafka connect NullPointerException in MirrorSourceMetrics (possible missing null check))

2025-11-12 Thread Mickael Maison
Hi, It looks like you found a bug. Feel free to open a pull request if you want to fix it, or at least open a Jira to report the issue. Thanks, Mickael On Thu, Nov 6, 2025 at 12:38 AM dhidah riadh wrote: > > Hi Kafka community, > > I’m running MirrorMaker 2 (Kafka Connect, Kafk

MirrorMaker 2 / kafka connect NullPointerException in MirrorSourceMetrics (possible missing null check))

2025-11-05 Thread dhidah riadh
Hi Kafka community, I’m running MirrorMaker 2 (Kafka Connect, Kafka 4.1.0) and noticed a recurring NullPointerException in MirrorSourceMetrics during high load: exactly here : https://github.com/apache/kafka/blob/61e63f12635ad6ff50c5a4e54d51d725ae82d11a/connect/mirror/src/main/java/org/apache

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-11-05 Thread Anton Liauchuk
rote: >>>> >>>>> Hi Anton, >>>>> >>>>> I'm +1 (binding), thanks for the KIP! >>>>> >>>>> Yash >>>>> >>>>> On Thu, Sep 4, 2025 at 10:24 AM Anton Liauchuk >>>>> wrote: >>>>> >>>>> > hi >>>>> > >>>>> > I would like to start a vote on *KIP-1209: Add configuration to >>>>> control >>>>> > internal topic creation in Kafka Connect* >>>>> > >>>>> > KIP: https://cwiki.apache.org/confluence/x/GAq2Fg >>>>> > Discussion thread: >>>>> > https://lists.apache.org/thread/l89rzzm0jd4ml7xx66mkxfztst281so7 >>>>> > >>>>> >>>>

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-28 Thread Anton Liauchuk
t;> >>>> Hi Anton, >>>> >>>> I'm +1 (binding), thanks for the KIP! >>>> >>>> Yash >>>> >>>> On Thu, Sep 4, 2025 at 10:24 AM Anton Liauchuk >>>> wrote: >>>> >>>> > hi

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-21 Thread Anton Liauchuk
t;> wrote: >>> >>> > hi >>> > >>> > I would like to start a vote on *KIP-1209: Add configuration to control >>> > internal topic creation in Kafka Connect* >>> > >>> > KIP: https://cwiki.apache.org/confluence/x/GAq2Fg >>> > Discussion thread: >>> > https://lists.apache.org/thread/l89rzzm0jd4ml7xx66mkxfztst281so7 >>> > >>> >>

[jira] [Resolved] (KAFKA-19758) Weird behavior on Kafka Connect 4.1 class loading

2025-10-20 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-19758. Resolution: Fixed > Weird behavior on Kafka Connect 4.1 class load

Re: Weird behavior on Kafka Connect class loading

2025-10-18 Thread Martin Andersson
: [email protected] Subject: Weird behavior on Kafka Connect class loading You don't often get email from [email protected]. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification> EXTERNAL SENDER. Do not click links or open attachments unless you recognize

Re: Weird behavior on Kafka Connect class loading

2025-10-18 Thread Mario Fiore Vitale
t: Friday, October 3, 2025 17:14 > To: [email protected] > Subject: Weird behavior on Kafka Connect class loading > > You don't often get email from [email protected]. Learn why > this is important<https://aka.ms/LearnAboutSenderIdentification> > &g

[jira] [Created] (KAFKA-19758) Weird behavior on Kafka Connect 4.1 class loading

2025-10-18 Thread Mario Fiore Vitale (Jira)
Mario Fiore Vitale created KAFKA-19758: -- Summary: Weird behavior on Kafka Connect 4.1 class loading Key: KAFKA-19758 URL: https://issues.apache.org/jira/browse/KAFKA-19758 Project: Kafka

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-18 Thread Anton Liauchuk
gt; > I would like to start a vote on *KIP-1209: Add configuration to control > > internal topic creation in Kafka Connect* > > > > KIP: https://cwiki.apache.org/confluence/x/GAq2Fg > > Discussion thread: > > https://lists.apache.org/thread/l89rzzm0jd4ml7xx66mkxfztst281so7 > > >

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-18 Thread Chris Egerton
che.org At: 09/04/25 13:24:06 UTC-4:00To: > >> [email protected] > >> Subject: [VOTE] KIP-1209: Add configuration to control internal topic > >> creation in Kafka Connect > >> > >> hi > >> > >> I would like to s

Weird behavior on Kafka Connect class loading

2025-10-18 Thread Mario Fiore Vitale
"$MAVEN_REPO/$GROUP_ID/$ARTIFACT_ID/$DEBEZIUM_VERSION/$ARTIFACT_ID-${DEBEZIUM_VERSION}${CLASSIFIER}.tar.gz" > -o /tmp/debezium-openlineage-core-libs.tar.gz && \ > tar -xzvf /tmp/debezium-openlineage-core-libs.tar.gz -C > /tmp/openlineage-libs --strip-components=1 > &

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-18 Thread Chris Egerton
rol+internal+topic+creation+in+Kafka+Connect > > On Mon, Sep 22, 2025 at 5:56 PM Chris Egerton > wrote: > > > Hi Anton, > > > > Thanks, LGTM. Two small follow-up thoughts: > > > > 1) We could also consider changing the property name to > > internal.topics

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-17 Thread Anton Liauchuk
(non-binding) >> >> Thanks for the KIP >> >> From: [email protected] At: 09/04/25 13:24:06 UTC-4:00To: >> [email protected] >> Subject: [VOTE] KIP-1209: Add configuration to control internal topic >> creation in Kafka Connect >> >> hi >> >

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-15 Thread Anton Liauchuk
anks for the KIP! >> >> Yash >> >> On Thu, Sep 4, 2025 at 10:24 AM Anton Liauchuk >> wrote: >> >> > hi >> > >> > I would like to start a vote on *KIP-1209: Add configuration to control >> > internal topic creation

Kafka Connect and Postgres composite types

2025-10-02 Thread Liam Clarke
en that they're types that only exist in a particular DB, and there's no (AFAICT) super-type that KC could infer them to be, I was thinking that a potential solution might be to expose to users the ability to configure other types that need casting in like these existing ones? https:

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-01 Thread Yash Mayya
Hi Anton, I'm +1 (binding), thanks for the KIP! Yash On Thu, Sep 4, 2025 at 10:24 AM Anton Liauchuk wrote: > hi > > I would like to start a vote on *KIP-1209: Add configuration to control > internal topic creation in Kafka Connect* > > KIP: https://cwiki.apache.

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-25 Thread Anton Liauchuk
Hi, Thanks for the feedback. I’ve updated the KIP based on your comments, please review https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect On Mon, Sep 22, 2025 at 5:56 PM Chris Egerton wrote: > Hi An

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-23 Thread Anton Liauchuk
25, 05:39 Anton Liauchuk wrote: > > > Hi, > > > > Thanks for the feedback. I’ve updated the KIP based on your comments, > > please review > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creati

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-22 Thread Chris Egerton
eter. Please review the new version: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect#KIP1209:AddconfigurationtocontrolinternaltopiccreationinKafkaConnect-InternalTopicsManagementScript > > On Fri,

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-20 Thread Anton Liauchuk
KIP-1209: Add configuration to control internal topic > creation in Kafka Connect > > hi > > I would like to start a vote on *KIP-1209: Add configuration to control > internal topic creation in Kafka Connect* > > KIP: https://cwiki.apache.org/confluence/x/GAq2Fg >

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-19 Thread Anton Liauchuk
Hi, Thanks for the suggestion! I’ve updated the KIP to use the worker config as a command-line parameter. Please review the new version: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect#KIP1209

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-18 Thread Chris Egerton
Anton Liauchuk wrote: > Hi, > > I’ve added the CLI description to the proposal based on our discussion: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-18 Thread Anton Liauchuk
Hi, I’ve added the CLI description to the proposal based on our discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect#KIP1209:AddconfigurationtocontrolinternaltopiccreationinKafkaConnect

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-17 Thread Anton Liauchuk
total sense to have such a tool, which could be especially useful before creating a new Kafka Connect cluster. Should I update the KIP to include this proposed command-line tool? On Fri, Sep 12, 2025 at 10:21 PM Chris Egerton wrote: > Hi Anton, > > I agree that, while rare, the case you

RE: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-13 Thread Andrei D
+1 (non-binding) On 2025/09/04 17:23:47 Anton Liauchuk wrote: > hi > > I would like to start a vote on *KIP-1209: Add configuration to control > internal topic creation in Kafka Connect* > > KIP: https://cwiki.apache.org/confluence/x/GAq2Fg > Discussion thread: > https:/

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-12 Thread Chris Egerton
68b85289d9214ae1dad88865d159b8e3658a4231544de36f429bd5R248 > > > > . > > > > > > > > > > > > Please take a look at the KIP - it’s a really small configuration. > > > > > > > > Once we get the required number of votes, the PR can be merged. &

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-12 Thread Anton Liauchuk
configuration. > > > > > > Once we get the required number of votes, the PR can be merged. > > > > > > On Thu, Sep 4, 2025 at 9:49 PM Hector Geraldino (BLOOMBERG/ 919 3RD A) > < > > > [email protected]> wrote: > > > > > > &

Re: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-12 Thread Mickael Maison
rged. > > > > On Thu, Sep 4, 2025 at 9:49 PM Hector Geraldino (BLOOMBERG/ 919 3RD A) < > > [email protected]> wrote: > > > > > +1 (non-binding) > > > > > > Thanks for the KIP > > > > > > From: [email protected] At: 09/04/

RE: Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-10 Thread Andrei Rudkouski
oomberg.net> wrote: > > > +1 (non-binding) > > > > Thanks for the KIP > > > > From: [email protected] At: 09/04/25 13:24:06 UTC-4:00To: > > [email protected] > > Subject: [VOTE] KIP-1209: Add configuration to control internal topic > > creation

RE: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-08 Thread Andrei Rudkouski
Hi, +1 (non-binding) Thanks for the KIP Best regards, Andrei Rudkouski On 2025/09/04 17:23:47 Anton Liauchuk wrote: > hi > > I would like to start a vote on *KIP-1209: Add configuration to control > internal topic creation in Kafka Connect* > > KIP: https://cwiki.apach

Re:[VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-04 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
+1 (non-binding) Thanks for the KIP From: [email protected] At: 09/04/25 13:24:06 UTC-4:00To: [email protected] Subject: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect hi I would like to start a vote on *KIP-1209: Add configuration to control

[VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-04 Thread Anton Liauchuk
hi I would like to start a vote on *KIP-1209: Add configuration to control internal topic creation in Kafka Connect* KIP: https://cwiki.apache.org/confluence/x/GAq2Fg Discussion thread: https://lists.apache.org/thread/l89rzzm0jd4ml7xx66mkxfztst281so7

Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-03 Thread Anton Liauchuk
Thanks for your question. The *auto.create.topics.enable* configuration will remain a broker-level setting. The new proposed configuration,* internal.topics.creation*, will be a Kafka Connect–level setting. For Kafka Connect internal topics, there is a requirement that these topics must have

Re: Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-03 Thread Anton Liauchuk
is disabled, an exception is thrown when a > > required topic does not exist. If the topic exists, there is an > additional > > validation to ensure that it has the correct cleanup policy. > > > > Please review the KIP > > > https://cwiki.apache.org/confluence/disp

RE: Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-02 Thread Andrei Rudkouski
e review the KIP > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect > and PR. I’ll start the voting if there are no concerns > > On Tue, Aug 26, 2025 at 4:58 PM Anton Liauchuk wrote: > > > Hello everyon

Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-02 Thread Kuan Po Tseng
it has the correct cleanup policy. > > Please review the KIP > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect > and PR. I’ll start the voting if there are no concerns > > On Tue, Aug 26, 2

Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-09-02 Thread Anton Liauchuk
review the KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect and PR. I’ll start the voting if there are no concerns On Tue, Aug 26, 2025 at 4:58 PM Anton Liauchuk wrote: > Hello everyone > > I'd lik

[DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-08-26 Thread Anton Liauchuk
Hello everyone I'd like to discuss a KIP https://cwiki.apache.org/confluence/display/KAFKA/KIP-1209%3A+Add+configuration+to+control+internal+topic+creation+in+Kafka+Connect small POC with discussion: https://github.com/apache/kafka/pull/20384 Motivation: Kafka Connect requires several int

[jira] [Created] (KAFKA-19633) Kafka Connect connectors sent out zombie records during rebalance

2025-08-21 Thread Shichao An (Jira)
Shichao An created KAFKA-19633: -- Summary: Kafka Connect connectors sent out zombie records during rebalance Key: KAFKA-19633 URL: https://issues.apache.org/jira/browse/KAFKA-19633 Project: Kafka

POC: conditional creation of internal topics in Kafka Connect

2025-08-20 Thread Anton Liauchuk
Hello everyone, I’ve prepared a small POC to explore an option for disabling the automatic creation of internal topics in Kafka Connect. The goal is to validate whether this approach could help in scenarios where internal topics contain information about many connectors, and accidental removal

[jira] [Resolved] (KAFKA-19248) Plugins Test for Multiversioning in Kafka Connect

2025-07-09 Thread Mickael Maison (Jira)
Affects Versions: 4.1.0 >Reporter: Snehashis Pal >Priority: Major > Fix For: 4.1.0 > > > Add tests for plugin level isolation for Kafka connect (KIP-891). -- This message was sent by Atlassian Jira (v8.20.10#820010)

[VOTE] KIP-1097: Add Kafka Connect exception handler

2025-07-08 Thread Anton Liauchuk
hi Kafka Community, I would like to start a vote on KIP-1097. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1097%3A+Add+Kafka+Connect+exception+handler

[VOTE] KIP-1154: Extending support for Microsecond/Nanosecond Precision for Kafka Connect

2025-07-02 Thread pritam kumar
Hi Kafka Community, Since there haven't been any new comments on the DISCUSS thread recently, I'd like to move KIP-1154 — *"Extending Support for Microsecond/Nanosecond Precision for Kafka Connect <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=347933282>&qu

Discussion: Ensuring Unique client.id per Task in Kafka Connect (KAFKA-19070)

2025-06-30 Thread pritam kumar
Hi all, I'd like to raise a discussion around *[KAFKA-19070]*( https://issues.apache.org/jira/browse/KAFKA-19070), which proposes a small but impactful change to how Kafka Connect handles the `client.id` configuration when set explicitly by the user. *Problem* Currently, if a user sets a c

[DISCUSS] KIP-1097: Pluggable Error Handler for Kafka Connect (supersedes “Error Record Reporter”)

2025-06-25 Thread Anton Liauchuk
/KAFKA/KIP-1097%3A+Add+Kafka+Connect+exception+handler - POC branch: https://github.com/anton-liauchuk/kafka/pull/1/files *What changed since the first draft* 1. *API* – new `*ErrorHandler*` interface with `*ErrorResponse {DROP, FAIL, ACK}*` (inspired by

Kafka Connect on Kubernetes: Statefulset vs Deployment

2025-06-14 Thread Prateek Kohli
Hi All, I'm building a custom Docker image for kafka Connect and planning to run it on Kubernetes. I'm a bit stuck on whether I should use a Deployment or a StatefulSet. >From what I understand, the main difference that could affect Kafka Connect is >the hostname/IP b

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-05-20 Thread pritam kumar
gt; >>> Hi Chris, >>> Can you please review this one too? >>> >>> On Sat, Apr 5, 2025 at 7:00 AM pritam kumar >>> wrote: >>> >>>> Hi Kafka Community, >>>> Sorry due to some changes I had to change the link to the

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-05-19 Thread pritam kumar
due to some changes I had to change the link to the kip. >>> Here is the updated KIP link: >>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect >>> >>> On Sat, Apr 5, 2025 at 12:14 AM pri

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-05-19 Thread pritam kumar
;> Hi Kafka Community, >> Sorry due to some changes I had to change the link to the kip. >> Here is the updated KIP link: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect >> >> On Sat, Apr 5, 20

[jira] [Created] (KAFKA-19248) Plugins Test for Multiversioning in Kafka Connect

2025-05-06 Thread Snehashis Pal (Jira)
Snehashis Pal created KAFKA-19248: - Summary: Plugins Test for Multiversioning in Kafka Connect Key: KAFKA-19248 URL: https://issues.apache.org/jira/browse/KAFKA-19248 Project: Kafka Issue

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-05-03 Thread pritam kumar
3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect > > On Sat, Apr 5, 2025 at 12:14 AM pritam kumar > wrote: > >> Hi Kafka Community, >> >> I’d like to start a discussion on KIP-1153: Extending Support for >> Microsecond Precision for Kafka Connect >&

Re: Custom Kafka Connect REST Extension for Token Authentication

2025-04-22 Thread Yeikel Santana
/ workers? Many Thanks,  Jamie On Wednesday 16 April 2025 at 10:57:01 BST, Jamie <mailto:[email protected]> wrote: Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token to be used for authentication.  When I have a single inst

Re: Custom Kafka Connect REST Extension for Token Authentication

2025-04-22 Thread Chris Egerton
om/apache/kafka/blob/e78e106221e7ce72af90b32fe6d6b3b454b1667b/connect/basic-auth-extension/src/main/java/org/apache/kafka/connect/rest/basic/auth/extension/JaasBasicAuthFilter.java#L91 [2] - https://cwiki.apache.org/confluence/display/KAFKA/KIP-507%3A+Securing+Internal+Connect+REST+Endpoints Hope this helps, Chris On Tu

Re: Custom Kafka Connect REST Extension for Token Authentication

2025-04-22 Thread Jamie
Hi All,  Has anyone managed to get a REST extension working with multiple connect instances / workers? Many Thanks,  Jamie On Wednesday 16 April 2025 at 10:57:01 BST, Jamie wrote: Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-18 Thread Sudesh Wasnik
> > > > > > > > > > Thanks > > > > > Sudesh > > > > > > > > > > On 2025/04/05 01:30:49 pritam kumar wrote: > > > > > > Hi Kafka Community, > > > > > > Sorry due to some

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
t; Hi Pritam ! Thanks for the KIP ! > > > > > > Let’s extend the KIP to also add support for Nanosecond > precision! > > > > > > > > > > > > Thanks > > > > > > Sudesh > > > > > > > > > > >

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
Nanosecond precision! >>> >>> Thanks >>> Sudesh >>> >>> On 2025/04/05 01:30:49 pritam kumar wrote: >>> > Hi Kafka Community, >>> > Sorry due to some changes I had to change the link to the kip. >>> > Here is the updated KIP

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
>>> Thanks >>>> Sudesh >>>> >>>> On 2025/04/05 01:30:49 pritam kumar wrote: >>>> > Hi Kafka Community, >>>> > Sorry due to some changes I had to change the link to the kip. >>>> > Here is the updated KIP link: >&g

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread pritam kumar
Sudesh >> >> On 2025/04/05 01:30:49 pritam kumar wrote: >> > Hi Kafka Community, >> > Sorry due to some changes I had to change the link to the kip. >> > Here is the updated KIP link: >> > >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-115

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread pritam kumar
://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect > > > > On Sat, Apr 5, 2025 at 12:14 AM pritam kumar > > wrote: > > > > > Hi Kafka Community, > > > > > > I’d like to

RE: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread Sudesh Wasnik
: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect > > On Sat, Apr 5, 2025 at 12:14 AM pritam kumar > wrote: > > > Hi Kafka Community, > > > > I’d like to start a discussion on KIP-1153: Extending Suppo

Custom Kafka Connect REST Extension for Token Authentication

2025-04-16 Thread Jamie
Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token to be used for authentication.  When I have a single instance of Kafka connect running in distributed mode (i.e. 1 worker) this works as expected. However, when I add another instance (another w

Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-04 Thread pritam kumar
Hi Kafka Community, Sorry due to some changes I had to change the link to the kip. Here is the updated KIP link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1154%3A+Extending+support+for+Microsecond+Precision+for+Kafka+Connect On Sat, Apr 5, 2025 at 12:14 AM pritam kumar wrote: >

[DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-04 Thread pritam kumar
Hi Kafka Community, I’d like to start a discussion on KIP-1153: Extending Support for Microsecond Precision for Kafka Connect <https://cwiki.apache.org/confluence/display/KAFKA/KIP-1153%3A+Extending+Support+for+Microsecond+Precision+for+Kafka+Connect> . The primary motivation behind this

[jira] [Created] (KAFKA-19086) Extending support for Microsecond Precision for Kafka Connect

2025-04-04 Thread Pritam Kumar (Jira)
Pritam Kumar created KAFKA-19086: Summary: Extending support for Microsecond Precision for Kafka Connect Key: KAFKA-19086 URL: https://issues.apache.org/jira/browse/KAFKA-19086 Project: Kafka

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-02-11 Thread Mario Fiore Vitale
out. > > Thanks, > Greg > > [1] > > https://github.com/confluentinc/schema-registry/blob/e461e9659ef1532a95b3f2dfd38e843d766aa955/schema-converter/src/main/java/io/confluent/connect/schema/ConnectEnum.java > [2] > > https://github.com/confluentinc/schema-registry/blob/

[jira] [Resolved] (KAFKA-16326) Kafka Connect unable to find javax dependency on Quarkus update to 3.X

2025-01-30 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16326. - Resolution: Fixed > Kafka Connect unable to find javax dependency on Quarkus update to

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Greg Harris
schema-converter/src/main/java/io/confluent/connect/schema/ConnectEnum.java [2] https://github.com/confluentinc/schema-registry/blob/e461e9659ef1532a95b3f2dfd38e843d766aa955/schema-converter/src/main/java/io/confluent/connect/schema/ConnectUnion.java [3] https://github.com/confluentinc/kafka-connect-

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Andrew Schofield
Hi Mario, Thanks for the KIP. My view is that it would be nice for Kafka to have a data model so that Kafka could do natively the things that people use schema registries for today. I'm not convinced that the Kafka Connect data classes are really up to the job, so I'm not sure that the

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-17 Thread Mario Fiore Vitale
omberg.net> ha scritto: >> > > >> > > > Hey Mario, >> > > > >> > > > From a quick read of this KIP, it's not super clear to me what >> problem >> > it >> > > > is trying to solve. The motivation states that &

[jira] [Resolved] (KAFKA-7776) Kafka Connect values converter parsing of ISO8601 not working properly

2025-01-16 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-7776. - Resolution: Fixed > Kafka Connect values converter parsing of ISO8601 not work

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-10 Thread Mario Fiore Vitale
I'm not sure what you mean > by > > > > that. > > > > > > > > Can you maybe add one or two examples of things that are not possible > > to > > > > do today and could be achieved by this refactor. If this proposal is > &

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-09 Thread Greg Harris
not sure what you mean by > > > that. > > > > > > Can you maybe add one or two examples of things that are not possible > to > > > do today and could be achieved by this refactor. If this proposal is > more > > > about improving the ergonomics of us

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2025-01-09 Thread Mario Fiore Vitale
refactor. If this proposal is more > > about improving the ergonomics of users of these classes, that's also > > valuable IMO. > > > > From: [email protected] At: 12/18/24 08:32:28 UTC-5:00To: > > [email protected] > > Subject: [DISCUSS] KIP-1122:

Re: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2024-12-28 Thread Mario Fiore Vitale
his proposal is more > about improving the ergonomics of users of these classes, that's also > valuable IMO. > > From: [email protected] At: 12/18/24 08:32:28 UTC-5:00To: > [email protected] > Subject: [DISCUSS] KIP-1122: Create a dedicated data module for Kafka > Conn

Re:[DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2024-12-20 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
SCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes Hi Everyone, I would like to start a discussion on KIP-1122: Create a dedicated data module for Kafka Connect data classes [1]. [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-1122%3A+Create+a+dedicated +data

[DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

2024-12-18 Thread Mario Fiore Vitale
Hi Everyone, I would like to start a discussion on KIP-1122: Create a dedicated data module for Kafka Connect data classes [1]. [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-1122%3A+Create+a+dedicated+data+module+for+Kafka+Connect+data+classes Regards, -- Mario Fiore Vitale

[jira] [Created] (KAFKA-18299) Promote Kafka Connect data package as a dedicated module

2024-12-18 Thread Mario Fiore Vitale (Jira)
Mario Fiore Vitale created KAFKA-18299: -- Summary: Promote Kafka Connect data package as a dedicated module Key: KAFKA-18299 URL: https://issues.apache.org/jira/browse/KAFKA-18299 Project: Kafka

[jira] [Created] (KAFKA-18073) Data loss when Kafka Connect retriable exception raised

2024-11-22 Thread Tom Thornton (Jira)
Tom Thornton created KAFKA-18073: Summary: Data loss when Kafka Connect retriable exception raised Key: KAFKA-18073 URL: https://issues.apache.org/jira/browse/KAFKA-18073 Project: Kafka

[jira] [Created] (KAFKA-17982) Kafka Connect: Configurable JMX Port for Metrics Collection

2024-11-10 Thread Basapuram Kumar (Jira)
Basapuram Kumar created KAFKA-17982: --- Summary: Kafka Connect: Configurable JMX Port for Metrics Collection Key: KAFKA-17982 URL: https://issues.apache.org/jira/browse/KAFKA-17982 Project: Kafka

[jira] [Created] (KAFKA-17958) Publish metrics for skipped records in Kafka Connect

2024-11-07 Thread Hector Geraldino (Jira)
Hector Geraldino created KAFKA-17958: Summary: Publish metrics for skipped records in Kafka Connect Key: KAFKA-17958 URL: https://issues.apache.org/jira/browse/KAFKA-17958 Project: Kafka

[jira] [Resolved] (KAFKA-17916) Convert Kafka Connect system tests to use KRaft

2024-11-05 Thread Kevin Wu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wu resolved KAFKA-17916. -- Resolution: Fixed > Convert Kafka Connect system tests to use KR

[jira] [Created] (KAFKA-17916) Convert Kafka Connect system tests to use KRaft

2024-10-31 Thread Kevin Wu (Jira)
Kevin Wu created KAFKA-17916: Summary: Convert Kafka Connect system tests to use KRaft Key: KAFKA-17916 URL: https://issues.apache.org/jira/browse/KAFKA-17916 Project: Kafka Issue Type

[jira] [Created] (KAFKA-17424) Memory optimisation for Kafka-connect

2024-08-26 Thread Ajit Singh (Jira)
Ajit Singh created KAFKA-17424: -- Summary: Memory optimisation for Kafka-connect Key: KAFKA-17424 URL: https://issues.apache.org/jira/browse/KAFKA-17424 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-12818) Memory leakage when kafka connect 2.7 uses directory config provider

2024-08-23 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-12818. - Resolution: Duplicate > Memory leakage when kafka connect 2.7 uses directory config provi

Re: [DISCUSS] KIP-802: Validation Support for Kafka Connect SMT Options

2024-07-29 Thread Mickael Maison
Hi, I've not received a reply from Gunnar since last month, so I'll pick this KIP up. Thanks, Mickael On Tue, Jun 18, 2024 at 6:01 PM Mickael Maison wrote: > > Hi Gunnar, > > I think this KIP would be a great addition to Kafka Connect but it > looks like it'

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-20 Thread Chris Egerton
gt; > Regards, > > - Adrian > > > > From: Edoardo Comar > > Date: Sunday, 16 June 2024 at 07:57 > > To: [email protected] > > Subject: [EXTERNAL] Re: [VOTE] KIP-1017: A health check endpoint for > Kafka Connect > > Thanks for this KIP, Chris, &

Re: [DISCUSS] KIP-802: Validation Support for Kafka Connect SMT Options

2024-06-18 Thread Mickael Maison
Hi Gunnar, I think this KIP would be a great addition to Kafka Connect but it looks like it's been abandoned. Are you still interested in working on this? If you need some time or help, that's fine, just let us know. If not, no worries, I'm happy to pick it up if needed. Thanks,

[jira] [Resolved] (KAFKA-12164) ssue when kafka connect worker pod restart, during creation of nested partition directories in hdfs file system.

2024-06-17 Thread Greg Harris (Jira)
supported by the Apache Kafka project. If/when an issue with the Connect framework is implicated, a new ticket may be opened with details about that issue. > ssue when kafka connect worker pod restart, during creation of nested > partition directories in hdfs file

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-17 Thread Federico Valeri
t: [EXTERNAL] Re: [VOTE] KIP-1017: A health check endpoint for Kafka > Connect > Thanks for this KIP, Chris, > > +1 (binding) > > Edo > > On Fri, 14 Jun 2024 at 20:20, Greg Harris > wrote: > > > > Hey Chris, > > > > Thanks for the KIP. > > > &

RE: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-17 Thread Adrian Preston
Hi Chris, +1 (non-binding) Regards, - Adrian From: Edoardo Comar Date: Sunday, 16 June 2024 at 07:57 To: [email protected] Subject: [EXTERNAL] Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect Thanks for this KIP, Chris, +1 (binding) Edo On Fri, 14 Jun 2024 at 20:20, Greg

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-15 Thread Edoardo Comar
4 at 8:44 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) < > [email protected]> wrote: > > > Thanks Chris, > > > > +1 (non-binding) > > > > From: [email protected] At: 06/14/24 11:43:02 UTC-4:00To: > > [email protected] > > Subj

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-15 Thread Chris Egerton
t; > > itself as a log about the workers' behavior. I understand if you > think > > > > it's > > > > > such a scope change that it should be an improvement KIP, but would > > > like > > > > to > > > > > gauge wha

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Greg Harris
At: 06/14/24 11:43:02 UTC-4:00To: > [email protected] > Subject: Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect > > Hi Chris, > > +1 (binding) > > Thanks, > Mickael > > On Fri, Jun 14, 2024 at 5:01 PM Andrew Schofield > wrote: > >

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Edoardo Comar
scope change that it should be an improvement KIP, but would > > like > > > to > > > > gauge what you think about this. > > > > > > > > Regards, > > > > Viktor > > > > > > > > On Tue, Jun 11, 2024 at 4:34 PM Chris Eg

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Thanks Chris, +1 (non-binding) From: [email protected] At: 06/14/24 11:43:02 UTC-4:00To: [email protected] Subject: Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect Hi Chris, +1 (binding) Thanks, Mickael On Fri, Jun 14, 2024 at 5:01 PM Andrew Schofield wrote: > &

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Mickael Maison
> > > Happy Friday! I'd like to kick off a vote on KIP-1017. > > > > Design doc: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1017%3A+Health+check+endpoint+for+Kafka+Connect > > > > Discussion thread: > > https://lists.apache.org/thread/95nto84wtogdgk3v97rxcwxr258wnjnt > > > > Cheers, > > > > Chris >

Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Andrew Schofield
Hi Chris, Thanks for the KIP. +1 (non-binding) Thanks, Andrew > On 14 Jun 2024, at 15:48, Chris Egerton wrote: > > Hi all, > > Happy Friday! I'd like to kick off a vote on KIP-1017. > > Design doc: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1017%3A+He

[VOTE] KIP-1017: A health check endpoint for Kafka Connect

2024-06-14 Thread Chris Egerton
Hi all, Happy Friday! I'd like to kick off a vote on KIP-1017. Design doc: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1017%3A+Health+check+endpoint+for+Kafka+Connect Discussion thread: https://lists.apache.org/thread/95nto84wtogdgk3v97rxcwxr258wnjnt Cheers, Chris

  1   2   3   4   5   6   7   8   9   10   >