Re: [DISCUSS] FLIP-444: Native file copy support

2024-05-09 Thread Hangxiang Yu
Hi Piotr. Thanks for your proposal. I have some comments, PTAL: 1. +1 about unifying the interface with DuplicatingFileSystem. IIUC, DuplicatingFileSystem also covers the logic from/to both local and remote paths. The implementations could define their own logic about how to fast copy/duplicate

[jira] [Created] (FLINK-35329) Support modify table/column comments

2024-05-09 Thread melin (Jira)
melin created FLINK-35329: - Summary: Support modify table/column comments Key: FLINK-35329 URL: https://issues.apache.org/jira/browse/FLINK-35329 Project: Flink Issue Type: New Feature

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Ron Liu
+1(binding) Best, Ron Jark Wu 于2024年5月10日周五 09:51写道: > +1 (binding) > > Best, > Jark > > On Thu, 9 May 2024 at 21:27, Lincoln Lee wrote: > > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > Feng Jin 于2024年5月9日周四 19:45写道: > > > > > +1 (non-binding) > > > > > > > > > Best, > > > Feng >

[jira] [Created] (FLINK-35328) AutoScale supports setting the maximum floating parallelism by the number of Pulsar partitions

2024-05-09 Thread Wenbing Shen (Jira)
Wenbing Shen created FLINK-35328: Summary: AutoScale supports setting the maximum floating parallelism by the number of Pulsar partitions Key: FLINK-35328 URL: https://issues.apache.org/jira/browse/FLINK-35328

[jira] [Created] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35327: - Summary: SQL Explain show push down condition Key: FLINK-35327 URL: https://issues.apache.org/jira/browse/FLINK-35327 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35326) Implement lineage interface for hive connector

2024-05-09 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-35326: - Summary: Implement lineage interface for hive connector Key: FLINK-35326 URL: https://issues.apache.org/jira/browse/FLINK-35326 Project: Flink Issue Type:

[jira] [Created] (FLINK-35325) Paimon connector miss the position of AddColumnEvent

2024-05-09 Thread LvYanquan (Jira)
LvYanquan created FLINK-35325: - Summary: Paimon connector miss the position of AddColumnEvent Key: FLINK-35325 URL: https://issues.apache.org/jira/browse/FLINK-35325 Project: Flink Issue Type:

[jira] [Created] (FLINK-35324) Avro format can not perform projection pushdown for specific fields

2024-05-09 Thread SuDewei (Jira)
SuDewei created FLINK-35324: --- Summary: Avro format can not perform projection pushdown for specific fields Key: FLINK-35324 URL: https://issues.apache.org/jira/browse/FLINK-35324 Project: Flink

[jira] [Created] (FLINK-35323) Only the schema of the first hit table is recorded when the source-table of the transformer hits multiple tables

2024-05-09 Thread Wenkai Qi (Jira)
Wenkai Qi created FLINK-35323: - Summary: Only the schema of the first hit table is recorded when the source-table of the transformer hits multiple tables Key: FLINK-35323 URL:

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Jark Wu
+1 (binding) Best, Jark On Thu, 9 May 2024 at 21:27, Lincoln Lee wrote: > +1 (binding) > > Best, > Lincoln Lee > > > Feng Jin 于2024年5月9日周四 19:45写道: > > > +1 (non-binding) > > > > > > Best, > > Feng > > > > > > On Thu, May 9, 2024 at 7:37 PM Xuyang wrote: > > > > > +1 (non-binding) > > > > >

Re: [VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-09 Thread Yuepeng Pan
Hi, Boto. +1 (non-binding). Thanks for your driving it. Best regards, Yuepeng Pan. On 2024/05/09 12:01:04 Joao Boto wrote: > Hi everyone, > > Thanks for all the feedback, I'd like to start a vote on the FLIP-449: > Reorganization of flink-connector-jdbc [1]. > The discussion thread is here

[jira] [Created] (FLINK-35322) PubSub Connector Weekly build fails

2024-05-09 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-35322: --- Summary: PubSub Connector Weekly build fails Key: FLINK-35322 URL: https://issues.apache.org/jira/browse/FLINK-35322 Project: Flink Issue Type: Bug

Re: [DISCUSSION] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-05-09 Thread Jim Hughes
Hi Alexey, Overall, the FLIP looks good and makes sense to me. 1. For the testing, I'd call the tests "execution" tests rather than "restore" tests. For streaming execution, restore tests have the compiled plan and intermediate state; the tests verify that those can work together and continue

Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-09 Thread Peter Huang
Thanks Qingsheng for driving the release! +1. I also would like to provide some help on CDC 3.2. Best Regards Peter Huang On Thu, May 9, 2024 at 3:21 AM Xiqian YU wrote: > Thanks Qingsheng for driving the release! > > +1. Would love to provide my help on CDC 3.2. > > Regards, > Xiqian > > De

Re: [VOTE] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

2024-05-09 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Benchao Li 于2024年5月9日周四 13:02写道: > +1 (binding) > > Timo Walther 于2024年5月8日周三 17:15写道: > > > > +1 (binding) > > > > Thanks, > > Timo > > > > On 08.05.24 11:10, Stefan Richter wrote: > > > Hi Alan, > > > > > > Thanks for this proposal, the ability to exclude

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Feng Jin 于2024年5月9日周四 19:45写道: > +1 (non-binding) > > > Best, > Feng > > > On Thu, May 9, 2024 at 7:37 PM Xuyang wrote: > > > +1 (non-binding) > > > > > > -- > > > > Best! > > Xuyang > > > > > > > > > > > > At 2024-05-09 13:57:07, "Ron Liu" wrote: > >

[jira] [Created] (FLINK-35321) CheckpointCommittableManagerImpl re-registers pendingCommittables gauge on every commit operation

2024-05-09 Thread Lennon Yu (Jira)
Lennon Yu created FLINK-35321: - Summary: CheckpointCommittableManagerImpl re-registers pendingCommittables gauge on every commit operation Key: FLINK-35321 URL: https://issues.apache.org/jira/browse/FLINK-35321

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-09 Thread Aleksandr Pilipenko
Thanks for driving this! +1 (non-binding) Thanks, Aleksandr On Thu, 9 May 2024 at 12:21, Ahmed Hamdy wrote: > Thanks for the effort and the data provided. > > +1 (non-binding) > Best Regards > Ahmed Hamdy > > > On Thu, 9 May 2024 at 08:20, Keith Lee > wrote: > > > +1 (non-binding) > > > >

[VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-09 Thread Joao Boto
Hi everyone, Thanks for all the feedback, I'd like to start a vote on the FLIP-449: Reorganization of flink-connector-jdbc [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Feng Jin
+1 (non-binding) Best, Feng On Thu, May 9, 2024 at 7:37 PM Xuyang wrote: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > At 2024-05-09 13:57:07, "Ron Liu" wrote: > >Sorry for the re-post, just to format this email content. > > > >Hi Dev > > > >Thank you to everyone for

Re:Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Xuyang
+1 (non-binding) -- Best! Xuyang At 2024-05-09 13:57:07, "Ron Liu" wrote: >Sorry for the re-post, just to format this email content. > >Hi Dev > >Thank you to everyone for the feedback on FLIP-448: Introduce Pluggable >Workflow Scheduler Interface for Materialized Table[1][2].

Re: Question around Flink's AdaptiveBatchScheduler

2024-05-09 Thread Venkatakrishnan Sowrirajan
Xia, Thanks for the reviews. Unfortunately due to work commitments I am little delayed in addressing your review comments. Mostly will be done by end of this week. Just a quick heads up. Jinrui, Thanks, that would be great. On Mon, May 6, 2024, 12:45 AM Junrui Lee wrote: > Hi, > Thanks for

Request for access

2024-05-09 Thread Vikas Garg
Hello, Our product Vertica is one of the most widely used analytical database and is supported by wide range of BI/ETL tools. We have developed a connector for connecting Flink with Vertica and are looking for its approval by Flink. Our organization will be providing support for connector.

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-09 Thread Ahmed Hamdy
Thanks for the effort and the data provided. +1 (non-binding) Best Regards Ahmed Hamdy On Thu, 9 May 2024 at 08:20, Keith Lee wrote: > +1 (non-binding) > > Great work on the benchmark data. > > Keith > > On Thu, May 9, 2024 at 4:53 AM 周仁祥 wrote: > > > +1 (non-binding) > > > > ConradJam

[jira] [Created] (FLINK-35320) RabbitMQ Source fails to consume from quorum queues when prefetch Count is set

2024-05-09 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-35320: --- Summary: RabbitMQ Source fails to consume from quorum queues when prefetch Count is set Key: FLINK-35320 URL: https://issues.apache.org/jira/browse/FLINK-35320

Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-09 Thread Xiqian YU
Thanks Qingsheng for driving the release! +1. Would love to provide my help on CDC 3.2. Regards, Xiqian De : Hang Ruan Date : jeudi, 9 mai 2024 à 17:50 À : dev@flink.apache.org Objet : Re: [DISCUSS] Flink CDC 3.2 Release Planning Thanks Qinsheng for driving. I would like to provide some

Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-09 Thread Hang Ruan
Thanks Qinsheng for driving. I would like to provide some helps for this verison too. +1. Best, Hang Hongshun Wang 于2024年5月9日周四 14:16写道: > Thanks Qinsheng for driving, > +1 from my side. > > Besi, > Hongshun > > On Wed, May 8, 2024 at 11:41 PM Leonard Xu wrote: > > > +1 for the proposal code

[jira] [Created] (FLINK-35319) Specific Operator getting stuck in Initialization for a long time

2024-05-09 Thread Kartikey Pant (Jira)
Kartikey Pant created FLINK-35319: - Summary: Specific Operator getting stuck in Initialization for a long time Key: FLINK-35319 URL: https://issues.apache.org/jira/browse/FLINK-35319 Project: Flink

RE: [RESULT][VOTE] FLIP-454: New Apicurio Avro format

2024-05-09 Thread David Radley
Hi Leonard, OK thanks ?C I missed that. Are any committers/PMC members prepared to back this Flip? Kind regards, David. From: Leonard Xu Date: Wednesday, 8 May 2024 at 16:43 To: dev Subject: [EXTERNAL] Re: [RESULT][VOTE] FLIP-454: New Apicurio Avro format Thanks David for driving the

Re: [DISCUSS] FLIP-444: Native file copy support

2024-05-09 Thread Keith Lee
Hi Piotr, Thank you for the proposal. Looks great. Along similar line of Aleks' question on memory usage. The proposal mentions that s5cmd utilises 100% of CPU similar to Flink 1.18. However, this will be a native process outside of the JVM. Are there risk of large/long state download starving

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-09 Thread Keith Lee
+1 (non-binding) Great work on the benchmark data. Keith On Thu, May 9, 2024 at 4:53 AM 周仁祥 wrote: > +1 (non-binding) > > ConradJam 于2024年5月7日周二 11:35写道: > > > +1 (no-binding) > > > > Piotr Nowojski 于2024年5月6日周一 20:17写道: > > > > > +1 (binding) > > > > > > Piotrek > > > > > > pon., 6 maj

[jira] [Created] (FLINK-35318) incorrect timezone handling for TIMESTAMP_WITH_LOCAL_TIME_ZONE type during predicate pushdown

2024-05-09 Thread linshangquan (Jira)
linshangquan created FLINK-35318: Summary: incorrect timezone handling for TIMESTAMP_WITH_LOCAL_TIME_ZONE type during predicate pushdown Key: FLINK-35318 URL: https://issues.apache.org/jira/browse/FLINK-35318

[jira] [Created] (FLINK-35317) Flink CDC CLI Supports submitting multiple YAML job at once

2024-05-09 Thread yux (Jira)
yux created FLINK-35317: --- Summary: Flink CDC CLI Supports submitting multiple YAML job at once Key: FLINK-35317 URL: https://issues.apache.org/jira/browse/FLINK-35317 Project: Flink Issue Type:

Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-09 Thread Hongshun Wang
Thanks Qinsheng for driving, +1 from my side. Besi, Hongshun On Wed, May 8, 2024 at 11:41 PM Leonard Xu wrote: > +1 for the proposal code freeze date and RM candidate. > > Best, > Leonard > > > 2024年5月8日 下午10:27,gongzhongqiang 写道: > > > > Hi Qingsheng > > > > Thank you for driving the

[jira] [Created] (FLINK-35316) Add CDC e2e test case for on Flink 1.19

2024-05-09 Thread yux (Jira)
yux created FLINK-35316: --- Summary: Add CDC e2e test case for on Flink 1.19 Key: FLINK-35316 URL: https://issues.apache.org/jira/browse/FLINK-35316 Project: Flink Issue Type: Bug Components: