Re: [2.0] Help needed for release 2.0 work items

2024-01-03 Thread Zakelly Lan
Thanks for the information Xintong! I'll consider working on this if I have time later this month. Best, Zakelly On Wed, Jan 3, 2024 at 11:54 AM Xintong Song wrote: > > > > I would like to ask if there is any plan to review and refactor the CLI > in > > Flink 2.0. > > > > Not that I'm aware

[jira] [Created] (FLINK-33987) Flink Table API Support file extention or suffix

2024-01-03 Thread haojie (Jira)
haojie created FLINK-33987: -- Summary: Flink Table API Support file extention or suffix Key: FLINK-33987 URL: https://issues.apache.org/jira/browse/FLINK-33987 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-33986) Introduce SupportsBatchSnapshot for shuffle master

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33986: - Summary: Introduce SupportsBatchSnapshot for shuffle master Key: FLINK-33986 URL: https://issues.apache.org/jira/browse/FLINK-33986 Project: Flink Issue Type:

[jira] [Created] (FLINK-33985) Extend ShuffleMaster to fetch all partition

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33985: - Summary: Extend ShuffleMaster to fetch all partition Key: FLINK-33985 URL: https://issues.apache.org/jira/browse/FLINK-33985 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33984) Introduce SupportsBatchSnapshot for operator coordinator

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33984: - Summary: Introduce SupportsBatchSnapshot for operator coordinator Key: FLINK-33984 URL: https://issues.apache.org/jira/browse/FLINK-33984 Project: Flink Issue

[jira] [Created] (FLINK-33983) Introduce JobEvent and JobEventStore for Job Recovery

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33983: - Summary: Introduce JobEvent and JobEventStore for Job Recovery Key: FLINK-33983 URL: https://issues.apache.org/jira/browse/FLINK-33983 Project: Flink Issue Type:

[jira] [Created] (FLINK-33982) Introduce new config options for Job Recovery.

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33982: - Summary: Introduce new config options for Job Recovery. Key: FLINK-33982 URL: https://issues.apache.org/jira/browse/FLINK-33982 Project: Flink Issue Type:

[jira] [Created] (FLINK-33981) File Descriptor References Not Released After Job Execution in MiniCluster Mode

2024-01-03 Thread Feng Jiajie (Jira)
Feng Jiajie created FLINK-33981: --- Summary: File Descriptor References Not Released After Job Execution in MiniCluster Mode Key: FLINK-33981 URL: https://issues.apache.org/jira/browse/FLINK-33981

Re: [VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread xiangyu feng
+1 (non-binding) Regards, Xiangyu Feng Rui Fan <1996fan...@gmail.com> 于2024年1月4日周四 13:03写道: > +1 (binding) > > Best, > Rui > > On Thu, Jan 4, 2024 at 11:45 AM Benchao Li wrote: > > > +1 (binding) > > > > Zhanghao Chen 于2024年1月4日周四 10:30写道: > > > > > > Hi everyone, > > > > > > Thanks for all

Re: [VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread Rui Fan
+1 (binding) Best, Rui On Thu, Jan 4, 2024 at 11:45 AM Benchao Li wrote: > +1 (binding) > > Zhanghao Chen 于2024年1月4日周四 10:30写道: > > > > Hi everyone, > > > > Thanks for all the feedbacks on FLIP-397 [1], which proposes to add a > set of default JVM options for administrator use that prepends

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Zhanghao Chen
Thanks for driving this. I'm not familiar with the listed advanced Curator configs, but the previous added switch for disabling ensemble tracking [1] saved us when deploying Flink in a cloud env where ZK can only be accessible via URLs. That being said, +1 for the overall idea, these configs

[jira] [Created] (FLINK-33980) Reorganize job configuration

2024-01-03 Thread Junrui Li (Jira)
Junrui Li created FLINK-33980: - Summary: Reorganize job configuration Key: FLINK-33980 URL: https://issues.apache.org/jira/browse/FLINK-33980 Project: Flink Issue Type: Technical Debt

Re: [VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread Benchao Li
+1 (binding) Zhanghao Chen 于2024年1月4日周四 10:30写道: > > Hi everyone, > > Thanks for all the feedbacks on FLIP-397 [1], which proposes to add a set of > default JVM options for administrator use that prepends the user-set extra > JVM options for easier platform-wide JVM pre-tuning. It has been

[VOTE] FLIP-397: Add config options for administrator JVM options

2024-01-03 Thread Zhanghao Chen
Hi everyone, Thanks for all the feedbacks on FLIP-397 [1], which proposes to add a set of default JVM options for administrator use that prepends the user-set extra JVM options for easier platform-wide JVM pre-tuning. It has been discussed in [2]. I'd like to start a vote. The vote will be

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread Jane Chan
Congratulations, Alex! Best, Jane On Thu, Jan 4, 2024 at 10:03 AM Junrui Lee wrote: > Congratulations, Alex! > > Best, > Junrui > > weijie guo 于2024年1月4日周四 09:57写道: > > > Congratulations, Alex! > > > > Best regards, > > > > Weijie > > > > > > Steven Wu 于2024年1月4日周四 02:07写道: > > > > > Congra,

Re: [DISCUSS][FLINK-31830] Align the Nullability Handling of ROW between SQL and TableAPI

2024-01-03 Thread Jane Chan
Hi Timo, Thanks for your valuable feedback. How about we work together on this topic and create a FLIP for this? We > need more examples in a unified document. Currently, the proposal is split > across multiple Flink and Calcite JIRA issues and a ML discussion. That sounds like a great idea. A

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread Junrui Lee
Congratulations, Alex! Best, Junrui weijie guo 于2024年1月4日周四 09:57写道: > Congratulations, Alex! > > Best regards, > > Weijie > > > Steven Wu 于2024年1月4日周四 02:07写道: > > > Congra, Alex! Well deserved! > > > > On Wed, Jan 3, 2024 at 2:31 AM David Radley > > wrote: > > > > > Sorry for my typo. > >

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread weijie guo
Congratulations, Alex! Best regards, Weijie Steven Wu 于2024年1月4日周四 02:07写道: > Congra, Alex! Well deserved! > > On Wed, Jan 3, 2024 at 2:31 AM David Radley > wrote: > > > Sorry for my typo. > > > > Many congratulations Alex! > > > > From: David Radley > > Date: Wednesday, 3 January 2024 at

[jira] [Created] (FLINK-33979) Implement restore tests for TableSink node

2024-01-03 Thread Bonnie Varghese (Jira)
Bonnie Varghese created FLINK-33979: --- Summary: Implement restore tests for TableSink node Key: FLINK-33979 URL: https://issues.apache.org/jira/browse/FLINK-33979 Project: Flink Issue Type:

[jira] [Created] (FLINK-33978) FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2024-01-03 Thread Alan Sheinberg (Jira)
Alan Sheinberg created FLINK-33978: -- Summary: FLIP-400: AsyncScalarFunction for asynchronous scalar function support Key: FLINK-33978 URL: https://issues.apache.org/jira/browse/FLINK-33978 Project:

[RESULT][VOTE] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2024-01-03 Thread Alan Sheinberg
The vote for FLIP-400: AsyncScalarFunction for asynchronous scalar function support [1] has concluded (discussion thread [2]). The vote will be closed [3]. There were 7 approving votes, 4 binding and 3 non-binding, and there were no disapprovals: - Martijn Visser (binding) - Lincoln Lee

Re: [VOTE] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2024-01-03 Thread Alan Sheinberg
Thank you everyone for participating in the vote. I'm closing this vote now and will announce the results in a separate thread. -Alan On Tue, Jan 2, 2024 at 8:40 AM Piotr Nowojski wrote: > +1 (binding) > > Best, > Piotrek > > czw., 28 gru 2023 o 09:19 Timo Walther napisał(a): > > > +1

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread Steven Wu
Congra, Alex! Well deserved! On Wed, Jan 3, 2024 at 2:31 AM David Radley wrote: > Sorry for my typo. > > Many congratulations Alex! > > From: David Radley > Date: Wednesday, 3 January 2024 at 10:23 > To: David Anderson > Cc: dev@flink.apache.org > Subject: Re: [EXTERNAL] [ANNOUNCE] New

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Martijn Visser
Hi Oleksandr, You're right, I was misreading the POM files because Curator is coming in via Flink-Shaded and not directly. So the POM files only contain references directly to Curator as test dependencies. Then I'll defer to others with experience on this topic to chime in. Cheers, Martijn On

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Alex Nitavsky
Hello Martjin, Thank you for reviewing the document. I'm under the impression that Flink utilizes Apache Curator to handle high-availability leader elections for Job Managers with Zookeeper Services [0]. In the most recent master version, it seems that Curator is instantiated at [1]

[jira] [Created] (FLINK-33977) Adaptive scheduler may not minimize the number of TMs during downscaling

2024-01-03 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-33977: - Summary: Adaptive scheduler may not minimize the number of TMs during downscaling Key: FLINK-33977 URL: https://issues.apache.org/jira/browse/FLINK-33977 Project:

[jira] [Created] (FLINK-33976) AdaptiveScheduler cooldown period is taken from a wrong configuration

2024-01-03 Thread Jira
David Morávek created FLINK-33976: - Summary: AdaptiveScheduler cooldown period is taken from a wrong configuration Key: FLINK-33976 URL: https://issues.apache.org/jira/browse/FLINK-33976 Project:

[jira] [Created] (FLINK-33975) Tests for the new Sink V2 transformations

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33975: -- Summary: Tests for the new Sink V2 transformations Key: FLINK-33975 URL: https://issues.apache.org/jira/browse/FLINK-33975 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33974) Implement the Sink transformation depending on the new SinkV2 interfaces

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33974: -- Summary: Implement the Sink transformation depending on the new SinkV2 interfaces Key: FLINK-33974 URL: https://issues.apache.org/jira/browse/FLINK-33974 Project: Flink

[jira] [Created] (FLINK-33973) Add new interfaces for SinkV2 to synchronize the API with the SourceV2 API

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33973: -- Summary: Add new interfaces for SinkV2 to synchronize the API with the SourceV2 API Key: FLINK-33973 URL: https://issues.apache.org/jira/browse/FLINK-33973 Project:

[jira] [Created] (FLINK-33972) Enhance and synchronize Sink API to match the Source API

2024-01-03 Thread Peter Vary (Jira)
Peter Vary created FLINK-33972: -- Summary: Enhance and synchronize Sink API to match the Source API Key: FLINK-33972 URL: https://issues.apache.org/jira/browse/FLINK-33972 Project: Flink Issue

Re: [RESULT][VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2024-01-03 Thread Martijn Visser
Thank you for driving this! On Wed, Jan 3, 2024 at 1:02 PM Péter Váry wrote: > > Hi All, > > `FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the > type of the Committable` [1], which has been renamed to `FLIP-372: Enhance > and synchronize Sink API to match the Source API`

[VOTE] FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving

2024-01-03 Thread Hongshun Wang
Dear Flink Developers, Thank you for providing feedback on FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving[1] on the discussion thread[2]. The goal of the FLIP is as follows: - To expose the SplitFetcherManager / SingleThreadFetcheManager as Public, allowing connector

[RESULT][VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2024-01-03 Thread Péter Váry
Hi All, `FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable` [1], which has been renamed to `FLIP-372: Enhance and synchronize Sink API to match the Source API` has been accepted and voted through this thread [2]. The proposal received 6 binding

FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread David Radley
Sorry for my typo. Many congratulations Alex! From: David Radley Date: Wednesday, 3 January 2024 at 10:23 To: David Anderson Cc: dev@flink.apache.org Subject: Re: [EXTERNAL] [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov Many Congratulations David . From: Maximilian Michels

Re: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread David Radley
Many Congratulations David . From: Maximilian Michels Date: Tuesday, 2 January 2024 at 12:16 To: dev Cc: Alexander Fedulov Subject: [EXTERNAL] [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov Happy New Year everyone, I'd like to start the year off by announcing Alexander Fedulov as a

Re: [Discuss] FLIP-407: Improve Flink Client performance in interactive scenarios

2024-01-03 Thread Zhanghao Chen
Thanks for driving this effort on improving the interactive use experience of Flink. The proposal overall looks good to me. Best, Zhanghao Chen From: xiangyu feng Sent: Tuesday, December 26, 2023 16:51 To: dev@flink.apache.org Subject: [Discuss] FLIP-407: