[jira] [Created] (FLINK-35379) File merging manager is not properly notified about checkpoint

2024-05-16 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35379: --- Summary: File merging manager is not properly notified about checkpoint Key: FLINK-35379 URL: https://issues.apache.org/jira/browse/FLINK-35379 Project: Flink

Re: [RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-16 Thread João Boto
Hmm sorry, I will try to search consensus.. I read 3 Votes but miss the binding part.. On 2024/05/16 01:36:46 Rui Fan wrote: > Thanks Joao Boto for driving the FLIP. We need 3 +1(binding) > votes according to Flink Bylaws[1] before the community accepts it. > > You can search "Consensus"

[jira] [Created] (FLINK-35378) [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunc

2024-05-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35378: -- Summary: [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunc Key: FLINK-35378 URL: https://issues.apache.org/jira/browse/FLINK-35378 Project:

Re: [DISCUSS] FLINK-35369: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-16 Thread Martijn Visser
Hi Keith Lee, There is actually an open and accepted FLIP [1] that was just never implemented. I think that needs to be taken into account as well, since it was voted on. I think it also makes more sense to have a proposal as a FLIP, instead of under a Jira. Best regards, Martijn [1]

[jira] [Created] (FLINK-35377) debezium-json support soft deletion.

2024-05-16 Thread Tongkai Yin (Jira)
Tongkai Yin created FLINK-35377: --- Summary: debezium-json support soft deletion. Key: FLINK-35377 URL: https://issues.apache.org/jira/browse/FLINK-35377 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35376) When flink submits the job by calling the rest api, the dependent jar package generated to the tmp is not removed

2024-05-16 Thread Jira
中国无锡周良 created FLINK-35376: -- Summary: When flink submits the job by calling the rest api, the dependent jar package generated to the tmp is not removed Key: FLINK-35376 URL:

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-05-16 Thread Rui Fan
Hi Piotr, > we checked in the firing timers benchmark [1] and we didn't observe any > performance regression. Thanks for the feedback, it's good news to hear that. I didn't notice we already have fireProcessingTimers benchmark. If so, we can follow it after this FLIP is merged. +1 for this

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-05-16 Thread Piotr Nowojski
Hi Zakelly, > I'm suggesting skipping the continuation mail during draining of async state access. I see. That makes sense to me now. I will later update the FLIP. > the code path will become more complex after this FLIP due to the addition of shouldIntterupt() checks, right? Yes, that's

Re: [DISCUSS] FLIP-444: Native file copy support

2024-05-16 Thread Piotr Nowojski
Hi Lorenzo, > • concerns about memory and CPU used out of Flink's control Please note that using AWS SDKv2 would have the same concerns. In both cases Flink can control only to a certain extent what either the SDKv2 library does under the hood or the s5cmd process, via configuration parameters.

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-16 Thread Jingsong Li
+1 (binding) - Verified signature and checksum hash - Verified that no binaries exist in the source archive - Build source code successful - Reviewed the release web PR - Check tag and branch exist Best, Jingsong On Thu, May 16, 2024 at 4:25 PM Jark Wu wrote: > > +1 (binding) > > - checked

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-16 Thread Jark Wu
+1 (binding) - checked signatures - checked hashes - checked release notes - reviewed the release web PR - checked the jars in the staging repo - build and compile the source code locally with jdk8 Best, Jark On Wed, 15 May 2024 at 16:05, gongzhongqiang wrote: > +1 (non-binding) > > -

[jira] [Created] (FLINK-35375) About a question report "Failed to deserialize data of EventHeaderV4" of flink cdc2.4.2

2024-05-16 Thread Jira
田元志 created FLINK-35375: --- Summary: About a question report "Failed to deserialize data of EventHeaderV4" of flink cdc2.4.2 Key: FLINK-35375 URL: https://issues.apache.org/jira/browse/FLINK-35375 Project: Flink

[jira] [Created] (FLINK-35374) Flink 1.14 kafka connector Demo Error

2024-05-16 Thread hongxu han (Jira)
hongxu han created FLINK-35374: -- Summary: Flink 1.14 kafka connector Demo Error Key: FLINK-35374 URL: https://issues.apache.org/jira/browse/FLINK-35374 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35373) Beautify Flink CDC Paimon Sink web ui

2024-05-16 Thread JunboWang (Jira)
JunboWang created FLINK-35373: - Summary: Beautify Flink CDC Paimon Sink web ui Key: FLINK-35373 URL: https://issues.apache.org/jira/browse/FLINK-35373 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35372) flink-cdc from mysql to doris, gives an error Unsupported type:TIME(0) when mysql data type is TIME and synchronise table structure or data.

2024-05-16 Thread joeb (Jira)
joeb created FLINK-35372: Summary: flink-cdc from mysql to doris, gives an error Unsupported type:TIME(0) when mysql data type is TIME and synchronise table structure or data. Key: FLINK-35372 URL:

Re: [RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-16 Thread lorenzo . affetti
Well, I give my +1 (non-binding), but we need more binding votes :) Looking forward to see this approved and see the changes. On May 16, 2024 at 03:37 +0200, Rui Fan <1996fan...@gmail.com>, wrote: > Thanks Joao Boto for driving the FLIP. We need 3 +1(binding) > votes according to Flink Bylaws[1]

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-16 Thread Jark Wu
Hi Jane, Thanks for the proposal. +1 from my side. Best, Jark On Thu, 16 May 2024 at 10:28, Xuannan Su wrote: > Hi Jane, > > Thanks for driving this effort! And +1 for the proposed changes. > > I have one comment on the migration plan. > > For options to be moved to another module/package, I

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-16 Thread lorenzo . affetti
Also reviewed your PubSub PR, thanks you for the great job! On May 15, 2024 at 17:28 +0200, Muhammet Orazov , wrote: > Thanks Ahmed! > > I have reviewed your PubSub and RabbitMQ PRs, please have a look. > > Best, > Muhammet

Re: [DISCUSS] FLIP-444: Native file copy support

2024-05-16 Thread lorenzo . affetti
Hello Piotr and thanks for this proposal! The idea sounds smart and very well grounded thank you! Also here, as others, I have some doubts about invoking an external binary (namely s5cmd): • concerns about memory and CPU used out of Flink's control • deployment concerns from the usability

[jira] [Created] (FLINK-35371) Allow the keystore and truststore type to configured for SSL

2024-05-15 Thread Ammar Master (Jira)
Ammar Master created FLINK-35371: Summary: Allow the keystore and truststore type to configured for SSL Key: FLINK-35371 URL: https://issues.apache.org/jira/browse/FLINK-35371 Project: Flink

[jira] [Created] (FLINK-35370) Create a temp module to test backward compatibility

2024-05-15 Thread Jira
João Boto created FLINK-35370: - Summary: Create a temp module to test backward compatibility Key: FLINK-35370 URL: https://issues.apache.org/jira/browse/FLINK-35370 Project: Flink Issue Type:

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi David, Thanks for the feedback! > For the proposed deprecations, will there be a proposed recommended > alternatives that will be mentioned in the deprecation. If they are going to > be removed for v2, it would be good to explicitly document the thinking and > impact of the deprecations

Re:Confirmation on Lambda Support for UDFs in FlinkSQL / Table API

2024-05-15 Thread Xuyang
Hi, Tucker. Could you provide some examples of how you use lambda expressions? Currently, if you try to use a lambda expression as a member variable of a UDF class, it will fail because UDF classes are required to be serializable, and lambda expressions are not serializable. However,

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi Jane, Thanks for driving this effort! And +1 for the proposed changes. I have one comment on the migration plan. For options to be moved to another module/package, I think we have to mark the old option deprecated in 1.20 for it to be removed in 2.0, according to the API compatibility

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xintong Song
+1 (binding) Best, Xintong On Wed, May 15, 2024 at 6:53 PM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Rui Fan <1996fan...@gmail.com> 于2024年5月15日周三 17:50写道: > > > +1(binding) > > > > Best, > > Rui > > > > On Wed, May 15, 2024 at 5:01 PM Xuannan Su > wrote: > > > > >

Re: [RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-15 Thread Rui Fan
Thanks Joao Boto for driving the FLIP. We need 3 +1(binding) votes according to Flink Bylaws[1] before the community accepts it. You can search "Consensus" and "FLIP (Major Change)" keywords in this wiki. [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws Best, Rui On Thu, May

Re: [VOTE] Release flink-connector-opensearch v2.0.0, release candidate #1

2024-05-15 Thread Andrey Redko
+1 (non-binding), thanks Sergey! On Wed, May 15, 2024, 6:00 p.m. Sergey Nuyanzin wrote: > Hi everyone, > Please review and vote on release candidate #1 for > flink-connector-opensearch v2.0.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide

Re: [VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-05-15 Thread Andrey Redko
+1 (non-binding), thanks Sergey! On Wed, May 15, 2024, 5:56 p.m. Sergey Nuyanzin wrote: > Hi everyone, > Please review and vote on release candidate #1 for > flink-connector-opensearch v1.2.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide

[VOTE] Release flink-connector-opensearch v2.0.0, release candidate #1

2024-05-15 Thread Sergey Nuyanzin
Hi everyone, Please review and vote on release candidate #1 for flink-connector-opensearch v2.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release

[VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-05-15 Thread Sergey Nuyanzin
Hi everyone, Please review and vote on release candidate #1 for flink-connector-opensearch v1.2.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release

[DISCUSS] FLINK-35369: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-15 Thread Keith Lee
Hello everyone, I'd like to start a discussion on improving `Table API and SQL` overview page or add a new page to give new users quick overview of options available. I've opted for improvement Jira instead of a FLIP as the change does not affect public interfaces or Flink runtime.

[jira] [Created] (FLINK-35369) Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-15 Thread Keith Lee (Jira)
Keith Lee created FLINK-35369: - Summary: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option Key: FLINK-35369 URL: https://issues.apache.org/jira/browse/FLINK-35369

[RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-15 Thread Joao Boto
Hi, I am happy to say that FLIP-449: Reorganization of flink-connector-jdbc [1] has been accepted. The proposal has been accepted with 5 approving votes (1 binding) and there are no disapproval (voted on this thread [2]): Rui Fan (binding) Yuepeng Pan (non-binding) Aleksandr Pilipenko

[jira] [Created] (FLINK-35368) Reorganize table code

2024-05-15 Thread Jira
João Boto created FLINK-35368: - Summary: Reorganize table code Key: FLINK-35368 URL: https://issues.apache.org/jira/browse/FLINK-35368 Project: Flink Issue Type: Sub-task Reporter:

[jira] [Created] (FLINK-35367) Reorganize datastream sink and source

2024-05-15 Thread Jira
João Boto created FLINK-35367: - Summary: Reorganize datastream sink and source Key: FLINK-35367 URL: https://issues.apache.org/jira/browse/FLINK-35367 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35366) Create all database modules

2024-05-15 Thread Jira
João Boto created FLINK-35366: - Summary: Create all database modules Key: FLINK-35366 URL: https://issues.apache.org/jira/browse/FLINK-35366 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35365) Reorganize catalog and dialect code

2024-05-15 Thread Jira
João Boto created FLINK-35365: - Summary: Reorganize catalog and dialect code Key: FLINK-35365 URL: https://issues.apache.org/jira/browse/FLINK-35365 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35364) Create core module and move code

2024-05-15 Thread Jira
João Boto created FLINK-35364: - Summary: Create core module and move code Key: FLINK-35364 URL: https://issues.apache.org/jira/browse/FLINK-35364 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35362) Reorganization of flink-connector-jdbc

2024-05-15 Thread Jira
João Boto created FLINK-35362: - Summary: Reorganization of flink-connector-jdbc Key: FLINK-35362 URL: https://issues.apache.org/jira/browse/FLINK-35362 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35363) Reorganization of flink-connector-jdbc

2024-05-15 Thread Jira
João Boto created FLINK-35363: - Summary: Reorganization of flink-connector-jdbc Key: FLINK-35363 URL: https://issues.apache.org/jira/browse/FLINK-35363 Project: Flink Issue Type: Improvement

RE: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread David Radley
Hi Xuannan, I like that you are cleaning up options that I assume are not recommended or currently used in some way. I have not got experience of these options. For the proposed deprecations, will there be a proposed recommended alternatives that will be mentioned in the deprecation. If they

Confirmation on Lambda Support for UDFs in FlinkSQL / Table API

2024-05-15 Thread Tucker Harvey
Hi Flink Community, I’m writing to confirm whether lambda expressions are supported with User Defined Functions (UDFs) in FlinkSQL and the Table API. My current understanding is that they are not supported. Can anyone verify this, or let me know if there have been any recent changes regarding

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Ahmed! I have reviewed your PubSub and RabbitMQ PRs, please have a look. Best, Muhammet

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Ahmed Hamdy
Hi Lorenzo, yes it is pretty useful to start tackling the ones that still don't implement the new interface, happy so sync offline to close this task, additionally a volunteer to review the migrations would be highly appreciated. Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 10:01, wrote: >

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-15 Thread Ahmed Hamdy
Hi Lorenzo, This seems like a very useful addition. +1 (non-binding) from my side. I echo Jeyhun's question about backward compatibility as it is not mentioned in the FLIP. Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 08:12, wrote: > Hello Muhammet and Jeyhun! > Thanks for your comments! >

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Ahmed Hamdy
+1 (non-binding). Thanks Martijn! Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 14:11, Jing Ge wrote: > +1(binding) Thanks Martijn! > > Best regards, > Jing > > On Wed, May 15, 2024 at 7:00 PM Muhammet Orazov > wrote: > > > Thanks Martijn driving this! +1 (non-binding) > > > > Best, > >

[jira] [Created] (FLINK-35361) Delete Flinkhistory files that failed to write to the local directory

2024-05-15 Thread dengxaing (Jira)
dengxaing created FLINK-35361: - Summary: Delete Flinkhistory files that failed to write to the local directory Key: FLINK-35361 URL: https://issues.apache.org/jira/browse/FLINK-35361 Project: Flink

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Jing Ge
+1(binding) Thanks Martijn! Best regards, Jing On Wed, May 15, 2024 at 7:00 PM Muhammet Orazov wrote: > Thanks Martijn driving this! +1 (non-binding) > > Best, > Muhammet > > On 2024-05-14 06:43, Martijn Visser wrote: > > Hi everyone, > > > > With no more discussions being open in the thread

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Martijn driving this! +1 (non-binding) Best, Muhammet On 2024-05-14 06:43, Martijn Visser wrote: Hi everyone, With no more discussions being open in the thread [1] I would like to start a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction [2] The vote

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread weijie guo
+1(binding) Best regards, Weijie Rui Fan <1996fan...@gmail.com> 于2024年5月15日周三 17:50写道: > +1(binding) > > Best, > Rui > > On Wed, May 15, 2024 at 5:01 PM Xuannan Su wrote: > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-450: Improve Runtime > > Configuration for Flink

[DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-15 Thread Jane Chan
Hi all, I'd like to start a discussion on FLIP-457: Improve Table/SQL Configuration for Flink 2.0 [1]. This FLIP revisited all Table/SQL configurations to improve user-friendliness and maintainability as Flink moves toward 2.0. I am looking forward to your feedback. Best regards, Jane [1]

[jira] [Created] (FLINK-35360) [Feature] Submit Flink CDC pipeline job to yarn Application mode

2024-05-15 Thread Jira
王俊博 created FLINK-35360: --- Summary: [Feature] Submit Flink CDC pipeline job to yarn Application mode Key: FLINK-35360 URL: https://issues.apache.org/jira/browse/FLINK-35360 Project: Flink Issue Type:

[jira] [Created] (FLINK-35359) General Improvement to Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-35359: -- Summary: General Improvement to Configuration for Flink 2.0 Key: FLINK-35359 URL: https://issues.apache.org/jira/browse/FLINK-35359 Project: Flink Issue Type:

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Rui Fan
+1(binding) Best, Rui On Wed, May 15, 2024 at 5:01 PM Xuannan Su wrote: > Hi everyone, > > Thanks for all the feedback about the FLIP-450: Improve Runtime > Configuration for Flink 2.0 [1] [2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours(excluding

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread lorenzo . affetti
As said on the discussion thread, +1 (non-binding) Thank you! On May 14, 2024 at 23:03 +0200, Rodrigo Meneses , wrote: > +1 (non-binding) > Thanks a lot for driving this effort!! > -Rodrigo > > > On Tue, May 14, 2024 at 11:00 AM Péter Váry > wrote: > > > +1 (non-binding) > > Thanks, Peter > > >

[VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi everyone, Thanks for all the feedback about the FLIP-450: Improve Runtime Configuration for Flink 2.0 [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until MAY 20, 12:00AM GMT) unless there is an objection or an insufficient number of

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread lorenzo . affetti
Thank you Martijn for the detailed FLIP. Will save this for the future as an example for these kind of FLIPs :) This also shakes the adoption of the new interface for downstream connectors. Volunteered for the pubsub port (table API), and trying to assess the current status of pending PRs. I

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-15 Thread gongzhongqiang
+1 (non-binding) - Verified signature and checksum hash - Verified that no binaries exist in the source archive - Build source code successful on ubuntu 22.04 with jdk8 - Check tag and branch exist - Check jars are built by jdk8 Best, Zhongqiang Gong Qingsheng Ren 于2024年5月11日周六 10:10写道: > Hi

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-15 Thread Jiabao Sun
+1 (non-binding) - Tag is present - Verified checksums and hashes - Verified signatures - Verified no binaries in source - Build successful with jdk8, jdk11 - Checked the dist jar was built by jdk8 Best, Jiabao Leonard Xu 于2024年5月14日周二 19:53写道: > +1 (binding) > > - verified signatures > -

[jira] [Created] (FLINK-35358) Breaking change when loading artifacts

2024-05-15 Thread Rasmus Thygesen (Jira)
Rasmus Thygesen created FLINK-35358: --- Summary: Breaking change when loading artifacts Key: FLINK-35358 URL: https://issues.apache.org/jira/browse/FLINK-35358 Project: Flink Issue Type: New

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-15 Thread lorenzo . affetti
Hello Muhammet and Jeyhun! Thanks for your comments! @Jeyhun: > Could you please elaborate more on how the new approach will be backwards compatible? In the FLIP I provide how the current Factories in JDBC would be changed with this refactor, do you mean something different? Can you be more

Re: [DISCUSS] FLIP suggestion: Flink SQL Scalar Functions.

2024-05-15 Thread Сергей Парышев
Hello dev!   Previously I send the FLIP[1] suggestion about creating scalar funcitons in SQL syntax and still want to discuss expediency of creating scalar (may be in future anothers functions like TableFunction) functions from SQL. Something like this already maked by DataBricks[2] in AWS

[DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-15 Thread Jerry
Hi all My name is ZhengjunZhou, an user and developer of FlinkCDC. In my recent projects, I realized that we could enhance the capabilities of Flink-CDC-Pipeline by introducing a JDBC Sink plugin, enabling FlinkCDC to directly output change data capture (CDC) to various JDBC-supported database

Proposal to Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-15 Thread Jerry
Hi all My name is ZhengjunZhou, an user and developer of FlinkCDC. In my recent projects, I realized that we could enhance the capabilities of Flink-CDC-Pipeline by introducing a JDBC Sink plugin, enabling FlinkCDC to directly output change data capture (CDC) to various JDBC-supported database

[jira] [Created] (FLINK-35357) Add "kubernetes.operator.plugins.listeners" parameter description to the Operator configuration document

2024-05-14 Thread Yang Zhou (Jira)
Yang Zhou created FLINK-35357: - Summary: Add "kubernetes.operator.plugins.listeners" parameter description to the Operator configuration document Key: FLINK-35357 URL:

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Rodrigo Meneses
+1 (non-binding) Thanks a lot for driving this effort!! -Rodrigo On Tue, May 14, 2024 at 11:00 AM Péter Váry wrote: > +1 (non-binding) > Thanks, Peter > > On Tue, May 14, 2024, 09:50 gongzhongqiang > wrote: > > > +1 (non-binding) > > > > Best. > > Zhongqiang Gong > > > > Martijn Visser

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Péter Váry
+1 (non-binding) Thanks, Peter On Tue, May 14, 2024, 09:50 gongzhongqiang wrote: > +1 (non-binding) > > Best. > Zhongqiang Gong > > Martijn Visser 于2024年5月14日周二 14:45写道: > > > Hi everyone, > > > > With no more discussions being open in the thread [1] I would like to > start > > a vote on

RE: [VOTE] FLIP-454: New Apicurio Avro format

2024-05-14 Thread David Radley
Hi Danny, Thankyou so much for supporting this flip and for your feedback. I have copied your points and responded on the discussion thread here: https://lists.apache.org/thread/rmcc67z35ysk0sv2jhz2wq0mwzjorhjb kind regards, David. From: Danny Cranmer Date: Tuesday, 14 May 2024 at 11:58 To:

[DISCUSS] FLIP-XXX Apicurio-avro format

2024-05-14 Thread David Radley
Hi Danny, Thank you very much for the feedback and your support. I have copied your feedback from the VOTE thread to this discussion thread, so we can continue our discussions off the VOTE thread. Your feedback: Thanks for Driving this David. I am +1 for adding support for the new format,

Community over Code EU 2024: The countdown has started!

2024-05-14 Thread Ryan Skraba
[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] We are very close to Community Over Code EU -- check out the amazing program and the special discounts that we have for you. Special discounts You still

[jira] [Created] (FLINK-35356) Async reducing state

2024-05-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35356: --- Summary: Async reducing state Key: FLINK-35356 URL: https://issues.apache.org/jira/browse/FLINK-35356 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35355) Async aggregating state

2024-05-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35355: --- Summary: Async aggregating state Key: FLINK-35355 URL: https://issues.apache.org/jira/browse/FLINK-35355 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35354) [discuss] Support host mapping in Flink tikv cdc

2024-05-14 Thread ouyangwulin (Jira)
ouyangwulin created FLINK-35354: --- Summary: [discuss] Support host mapping in Flink tikv cdc Key: FLINK-35354 URL: https://issues.apache.org/jira/browse/FLINK-35354 Project: Flink Issue Type:

[jira] [Created] (FLINK-35353) Translate "Profiler" page into Chinese

2024-05-14 Thread Juan Zifeng (Jira)
Juan Zifeng created FLINK-35353: --- Summary: Translate "Profiler" page into Chinese Key: FLINK-35353 URL: https://issues.apache.org/jira/browse/FLINK-35353 Project: Flink Issue Type:

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-14 Thread Leonard Xu
+1 (binding) - verified signatures - verified hashsums - checked Github release tag - checked release notes - Run pipeline from MySQL to StarRocks with fields projection, the result is expected - Run pipeline from MySQL to StarRocks with filter, the result is expected - reviewed Jira issues for

Re: [VOTE] FLIP-454: New Apicurio Avro format

2024-05-14 Thread Danny Cranmer
Hello all, Thanks for Driving this David. I am +1 for adding support for the new format, however have some questions/suggestions on the details. 1. Passing around Map additionalInputProperties feels a bit dirty. It looks like this is mainly for the Kafka connector. This connector already has a

Re: [VOTE] FLIP-454: New Apicurio Avro format

2024-05-14 Thread Danny Cranmer
Hello all, Thanks for Driving this David. I am +1 for adding support for the new format, however have some questions/suggestions on the details. 1. Passing around Map additionalInputProperties feels a bit dirty. It looks like this is mainly for the Kafka connector. This connector already has a

RE: [VOTE] FLIP-451: Introduce timeout configuration to AsyncSink

2024-05-14 Thread David Radley
Thanks for the clarification Ahmed +1 (non-binding) From: Ahmed Hamdy Date: Monday, 13 May 2024 at 19:58 To: dev@flink.apache.org Subject: [EXTERNAL] Re: [VOTE] FLIP-451: Introduce timeout configuration to AsyncSink Thanks David, I have replied to your question in the discussion thread. Best

Re: [VOTE] FLIP-451: Introduce timeout configuration to AsyncSink

2024-05-14 Thread Danny Cranmer
Thanks for driving this Ahmed. This is a nice improvement to the API: +1 (binding) Thanks, Danny On Mon, May 13, 2024 at 7:58 PM Ahmed Hamdy wrote: > Thanks David, > I have replied to your question in the discussion thread. > Best Regards > Ahmed Hamdy > > > On Mon, 13 May 2024 at 16:21,

Re: [DISCUSS] Connector releases for Flink 1.19

2024-05-14 Thread Danny Cranmer
Hello, @Sergey Nuyanzin , it looks like opensearch-2.0.0 has been created now, all good. @Hongshun Wang, thanks, since the CDC connectors are not yet released I had omitted them from this task. But happy to include them, thanks for the support. Thanks, Danny On Mon, May 13, 2024 at 3:40 AM

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-14 Thread Jeyhun Karimov
Hi Lorenzo, Thanks for driving this FLIP. +1 for it. Could you please elaborate more on how the new approach will be backwards compatible? Regards, Jeyhun On Tue, May 14, 2024 at 10:00 AM Muhammet Orazov wrote: > Hey Lorenzo, > > Thanks for driving this FLIP! +1 > > It will improve the user

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-14 Thread Yanquan Lv
+1 (non-binding) - Validated checksum hash - Build the source with Maven and jdk8 - Verified web PR - Check that the jar is built by jdk8 - Check synchronizing from mysql to paimon - Check synchronizing from mysql to kafka Hang Ruan 于2024年5月13日周一 13:55写道: > +1 (non-binding) > > - Validated

[jira] [Created] (FLINK-35352) Add -sae submit task to run for a period of time and automatically cancel

2024-05-14 Thread Jira
谷金城 created FLINK-35352: --- Summary: Add -sae submit task to run for a period of time and automatically cancel Key: FLINK-35352 URL: https://issues.apache.org/jira/browse/FLINK-35352 Project: Flink

[jira] [Created] (FLINK-35351) Restore from unaligned checkpoint with custom partitioner fails.

2024-05-14 Thread Dmitriy Linevich (Jira)
Dmitriy Linevich created FLINK-35351: Summary: Restore from unaligned checkpoint with custom partitioner fails. Key: FLINK-35351 URL: https://issues.apache.org/jira/browse/FLINK-35351 Project:

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-14 Thread Muhammet Orazov
Hey Lorenzo, Thanks for driving this FLIP! +1 It will improve the user experience of using JDBC based connectors and help developers to build with different drivers. Best, Muhammet On 2024-05-13 10:20, lorenzo.affe...@ververica.com.INVALID wrote: Hello dev! I want to share a draft of my

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread gongzhongqiang
+1 (non-binding) Best. Zhongqiang Gong Martijn Visser 于2024年5月14日周二 14:45写道: > Hi everyone, > > With no more discussions being open in the thread [1] I would like to start > a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate > SinkFunction [2] > > The vote will be open for

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Rui Fan
Thanks Martijn for driving this proposal! +1(binding) Best, Rui On Tue, May 14, 2024 at 3:30 PM Ferenc Csaky wrote: > +1 (non-binding) > > Thanks, > Ferenc > > > > > On Tuesday, 14 May 2024 at 08:51, weijie guo > wrote: > > > > > > > Thanks Martijn for the effort! > > > > +1(binding) > > > >

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Ferenc Csaky
+1 (non-binding) Thanks, Ferenc On Tuesday, 14 May 2024 at 08:51, weijie guo wrote: > > > Thanks Martijn for the effort! > > +1(binding) > > Best regards, > > Weijie > > > Martijn Visser martijnvis...@apache.org 于2024年5月14日周二 14:45写道: > > > Hi everyone, > > > > With no more

[jira] [Created] (FLINK-35350) Add documentation for Kudu

2024-05-14 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-35350: -- Summary: Add documentation for Kudu Key: FLINK-35350 URL: https://issues.apache.org/jira/browse/FLINK-35350 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread weijie guo
Thanks Martijn for the effort! +1(binding) Best regards, Weijie Martijn Visser 于2024年5月14日周二 14:45写道: > Hi everyone, > > With no more discussions being open in the thread [1] I would like to start > a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate > SinkFunction [2] >

[VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Martijn Visser
Hi everyone, With no more discussions being open in the thread [1] I would like to start a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction [2] The vote will be open for at least 72 hours unless there is an objection or insufficient votes. Best regards,

[jira] [Created] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2024-05-14 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35349: - Summary: Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect Key: FLINK-35349 URL: https://issues.apache.org/jira/browse/FLINK-35349

[jira] [Created] (FLINK-35348) Implement materialized table refresh rest api

2024-05-13 Thread dalongliu (Jira)
dalongliu created FLINK-35348: - Summary: Implement materialized table refresh rest api Key: FLINK-35348 URL: https://issues.apache.org/jira/browse/FLINK-35348 Project: Flink Issue Type:

[jira] [Created] (FLINK-35347) Implement InMemory workflow scheduler service and plugin to support materialized table

2024-05-13 Thread dalongliu (Jira)
dalongliu created FLINK-35347: - Summary: Implement InMemory workflow scheduler service and plugin to support materialized table Key: FLINK-35347 URL: https://issues.apache.org/jira/browse/FLINK-35347

[jira] [Created] (FLINK-35346) Introduce pluggable workflow scheduler interface for materialized table

2024-05-13 Thread dalongliu (Jira)
dalongliu created FLINK-35346: - Summary: Introduce pluggable workflow scheduler interface for materialized table Key: FLINK-35346 URL: https://issues.apache.org/jira/browse/FLINK-35346 Project: Flink

[jira] [Created] (FLINK-35345) FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-13 Thread dalongliu (Jira)
dalongliu created FLINK-35345: - Summary: FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table Key: FLINK-35345 URL: https://issues.apache.org/jira/browse/FLINK-35345 Project:

[RESULT][VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-13 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table[1] has been accepted with 8 approving votes (4 binding) [2]. - Xuyang - Feng Jin - Lincoln Lee(binding) - Jark Wu(binding) - Ron Liu(binding) - Shengkai Fang(binding) - Keith Lee

[jira] [Created] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2024-05-13 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35344: - Summary: Move same code from multiple subclasses to JdbcSourceChunkSplitter Key: FLINK-35344 URL: https://issues.apache.org/jira/browse/FLINK-35344 Project: Flink

[jira] [Created] (FLINK-35343) NullPointerException in SourceReaderBase

2024-05-13 Thread zyh (Jira)
zyh created FLINK-35343: --- Summary: NullPointerException in SourceReaderBase Key: FLINK-35343 URL: https://issues.apache.org/jira/browse/FLINK-35343 Project: Flink Issue Type: Bug Components:

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-13 Thread Xuannan Su
Hi all, Thank you for all the comments and suggestions! If there are no further comments, I'd like to close the discussion and start the voting in two days. Best regards, Xuannan On Mon, May 13, 2024 at 3:10 PM Jeyhun Karimov wrote: > > Hi Xuannan, > > Thanks a lot for the update. The FLIP

  1   2   3   4   5   6   7   8   9   10   >