[jira] [Created] (FLINK-34520) Confusing MIT language in the NOTICE file

2024-02-26 Thread Henri Yandell (Jira)
Henri Yandell created FLINK-34520: - Summary: Confusing MIT language in the NOTICE file Key: FLINK-34520 URL: https://issues.apache.org/jira/browse/FLINK-34520 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread weijie guo
+1(binding) Best regards, Weijie Xintong Song 于2024年2月27日周二 09:37写道: > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-410: Config, Context and > > Processing Timer

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread weijie guo
+1(binding) Best regards, Weijie Xintong Song 于2024年2月27日周二 09:38写道: > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:09 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-409: DataStream V2 Building > > Blocks: DataStream,

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread weijie guo
+1(binding) Best regards, Weijie Xintong Song 于2024年2月27日周二 09:36写道: > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:08 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-408: [Umbrella] Introduce > > DataStream API V2

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread Rui Fan
+1(binding) Best, Rui On Tue, Feb 27, 2024 at 9:45 AM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Xintong Song 于2024年2月27日周二 09:37写道: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > > wrote: > > > > > Hi

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread Rui Fan
+1(binding) Best, Rui On Tue, Feb 27, 2024 at 9:44 AM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Xintong Song 于2024年2月27日周二 09:38写道: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:09 PM weijie guo > > wrote: > > > > > Hi

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread Rui Fan
+1(binding) Best, Rui On Tue, Feb 27, 2024 at 9:43 AM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Xintong Song 于2024年2月27日周二 09:36写道: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:08 PM weijie guo > > wrote: > > > > > Hi

Confluence access request

2024-02-26 Thread jialiang tan
Hi, devs! I want to prepare a FLIP and start a discussion on the dev mailing list, but I find I don't have the access, can someone give me access to confluence? My Confluence username: tanjialiang Best regards, tanjialiang

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread Xintong Song
+1 (binding) Best, Xintong On Mon, Feb 26, 2024 at 6:10 PM weijie guo wrote: > Hi everyone, > > > Thanks for all the feedback about the FLIP-410: Config, Context and > Processing Timer Service of DataStream API V2 [1]. The discussion > thread is here [2]. > > > The vote will be open for at

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread Xintong Song
+1 (binding) Best, Xintong On Mon, Feb 26, 2024 at 6:09 PM weijie guo wrote: > Hi everyone, > > > Thanks for all the feedback about the FLIP-409: DataStream V2 Building > Blocks: DataStream, Partitioning and ProcessFunction [1]. The > discussion thread is here [2]. > > > The vote will be

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread Xuannan Su
+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:36 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:08 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-408: [Umbrella] Introduce > >

Re: Confluence access request

2024-02-26 Thread Rui Fan
Hi tanjialiang, The Flink community recently discussed how non-flink-committer create FLIP[1], the process has been updated in the wiki[2], please check the "Create your Own FLIP" part, thank you. [1] https://lists.apache.org/thread/rkpvlnwj9gv1hvx1dyklx6k88qpnvk2t [2]

[jira] [Created] (FLINK-34522) StateTtlConfig#cleanupInRocksdbCompactFilter still use the deprecated Time

2024-02-26 Thread Rui Fan (Jira)
Rui Fan created FLINK-34522: --- Summary: StateTtlConfig#cleanupInRocksdbCompactFilter still use the deprecated Time Key: FLINK-34522 URL: https://issues.apache.org/jira/browse/FLINK-34522 Project: Flink

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread Xintong Song
+1 (binding) Best, Xintong On Mon, Feb 26, 2024 at 6:08 PM weijie guo wrote: > Hi everyone, > > > Thanks for all the feedback about the FLIP-408: [Umbrella] Introduce > DataStream API V2 [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless there

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread Xuannan Su
+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:37 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-410: Config, Context and > >

Re: Confluence access request

2024-02-26 Thread jialiang tan
Hi, Rui Thank you for your guidance. Best, tanjialiang Rui Fan <1996fan...@gmail.com> 于2024年2月27日周二 10:28写道: > Hi tanjialiang, > > The Flink community recently discussed how non-flink-committer create > FLIP[1], > the process has been updated in the wiki[2], please check the "Create your > Own

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread Guowei Ma
+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:09 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Tue, Feb 27, 2024 at 9:37 AM Xintong Song > wrote: > > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > >

[jira] [Created] (FLINK-34521) Using the Duration instead of the deprecated Time classes

2024-02-26 Thread Rui Fan (Jira)
Rui Fan created FLINK-34521: --- Summary: Using the Duration instead of the deprecated Time classes Key: FLINK-34521 URL: https://issues.apache.org/jira/browse/FLINK-34521 Project: Flink Issue Type:

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-26 Thread Hangxiang Yu
Hi, Zakelly. Thanks for driving this. Moving this class to flink-core makes sense to me which could make the code path and configs clearer. It's marked as @Public from 1.0 and 1.20 should be the next long-term version, so 1.19 should have been a suitable version to do it. And also look forward to

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread Xuannan Su
+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:38 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:09 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-409: DataStream V2 Building > >

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread Guowei Ma
+1(binding) Best, Guowei On Tue, Feb 27, 2024 at 10:06 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:43 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:36写道: > > > >

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread Guowei Ma
+1 (binding) Best, Guowei On Tue, Feb 27, 2024 at 10:08 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Tue, Feb 27, 2024 at 9:44 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年2月27日周二 09:38写道: > > > >

Re: Flink's treatment to "hadoop" and "yarn" configuration overrides seems unintuitive

2024-02-26 Thread Venkatakrishnan Sowrirajan
Thanks for sharing your thoughts, Ferenc. Just my 2 cents, coming from Spark background that uses "spark.hadoop." prefix to handle all Hadoop configs, I prefer the "flink.hadoop." prefix and "flink.yarn." prefix. Generally, users use both these systems and I prefer to be consistent that way.

[jira] [Created] (FLINK-34525) When redundant task managers are enabled, it will still take a considerable amount of time to restart a job if a task manager is killed.

2024-02-26 Thread junzhong qin (Jira)
junzhong qin created FLINK-34525: Summary: When redundant task managers are enabled, it will still take a considerable amount of time to restart a job if a task manager is killed. Key: FLINK-34525 URL:

[jira] [Created] (FLINK-34523) org.apache.maven.surefire:surefire-shared-utils:jar:3.2.2 couldn't be downloaded

2024-02-26 Thread lincoln lee (Jira)
lincoln lee created FLINK-34523: --- Summary: org.apache.maven.surefire:surefire-shared-utils:jar:3.2.2 couldn't be downloaded Key: FLINK-34523 URL: https://issues.apache.org/jira/browse/FLINK-34523

[jira] [Created] (FLINK-34524) Scale down JobManager deployment to 0 before deletion

2024-02-26 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-34524: -- Summary: Scale down JobManager deployment to 0 before deletion Key: FLINK-34524 URL: https://issues.apache.org/jira/browse/FLINK-34524 Project: Flink Issue

Re: Flink's treatment to "hadoop" and "yarn" configuration overrides seems unintuitive

2024-02-26 Thread Ferenc Csaky
Thanks for the more shared details Venkata, I did not used spark widely myself, but if there are more examples like follows that approach it makes sense to comply and be consistent. Regarding the planned release schedule on the 2.0 wiki page [1] the expected releases are 1.19 -> 1.20 -> 2.0. I

[jira] [Created] (FLINK-34526) Without shuffling data, when a Task Manager is killed, restarting the Flink job takes a considerable amount of time

2024-02-26 Thread junzhong qin (Jira)
junzhong qin created FLINK-34526: Summary: Without shuffling data, when a Task Manager is killed, restarting the Flink job takes a considerable amount of time Key: FLINK-34526 URL:

Re: [DISCUSS] Alternative way of posting FLIPs

2024-02-26 Thread Martijn Visser
Hi all, I've created https://issues.apache.org/jira/browse/FLINK-34515 and updated https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals to update the instructions for the community. Best regards, Martijn On Thu, Feb 15, 2024 at 10:04 AM Martijn Visser wrote: > > Hi

[jira] [Created] (FLINK-34516) Move CheckpointingMode to flink-core

2024-02-26 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34516: --- Summary: Move CheckpointingMode to flink-core Key: FLINK-34516 URL: https://issues.apache.org/jira/browse/FLINK-34516 Project: Flink Issue Type: Sub-task

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-26 Thread yh z
Congratulations Jiabao! Best, Yunhong Zheng (SwufeHong) yu'an huang 于2024年2月26日周一 10:28写道: > Congratulations, Jiabao! > > Best, > Yuan > > > On Mon, 26 Feb 2024 at 9:38 AM, Ron liu wrote: > > > Congratulations, Jiabao! > > > > Best, > > Ron > > > > Yun Tang 于2024年2月23日周五 19:59写道: > > > > >

[jira] [Created] (FLINK-34515) Document new FLIP process

2024-02-26 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-34515: -- Summary: Document new FLIP process Key: FLINK-34515 URL: https://issues.apache.org/jira/browse/FLINK-34515 Project: Flink Issue Type: New Feature

Re: Flink's treatment to "hadoop" and "yarn" configuration overrides seems unintuitive

2024-02-26 Thread Ferenc Csaky
Hi Venkata krishnan, Thanks for starting a discussion on this topic. I completely agree with you on that, this behavior can create confusion and cause debugging sessions that could be spared with aligning how Flink parses external properties. Personally, I find the Yarn props prefixing more

[jira] [Created] (FLINK-34519) Refine checkpoint scheduling and canceling logic

2024-02-26 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-34519: Summary: Refine checkpoint scheduling and canceling logic Key: FLINK-34519 URL: https://issues.apache.org/jira/browse/FLINK-34519 Project: Flink Issue Type:

[jira] [Created] (FLINK-34517) environment configs ignored when calling ProcedureOperation

2024-02-26 Thread JustinLee (Jira)
JustinLee created FLINK-34517: - Summary: environment configs ignored when calling ProcedureOperation Key: FLINK-34517 URL: https://issues.apache.org/jira/browse/FLINK-34517 Project: Flink Issue

[VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread weijie guo
Hi everyone, Thanks for all the feedback about the FLIP-408: [Umbrella] Introduce DataStream API V2 [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] Apache Bahir retired

2024-02-26 Thread Leonard Xu
Hey, Ferenc Thanks for initiating this discussion. Apache Bahir is a great project that provided significant assistance to many Apache Flink/Spark users. It's pity news that it has been retired. I believe that connectivity is crucial for building the ecosystem of the Flink such a computing

[VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-02-26 Thread weijie guo
Hi everyone, Thanks for all the feedback about the FLIP-410: Config, Context and Processing Timer Service of DataStream API V2 [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

[VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-02-26 Thread weijie guo
Hi everyone, Thanks for all the feedback about the FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

[DISCUSS] Move CheckpointingMode to flink-core

2024-02-26 Thread Zakelly Lan
Hi devs, When working on the FLIP-406[1], I realized that moving all options of ExecutionCheckpointingOptions(flink-streaming-java) to CheckpointingOptions(flink-core) depends on relocating the enum CheckpointingMode(flink-streaming-java) to flink-core module. However, the CheckpointingMode is

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-02-26 Thread Guowei Ma
Hi, Thanks for your reply! I have no other comments! Best, Guowei On Mon, Feb 26, 2024 at 3:43 PM weijie guo wrote: > Hi Guowei, > > thanks for your reply! > > > Do connectors and SQL currently have similar problems? > > - Connectors: > The APIs for FLIP-27 based source and Sink-V2 are

[jira] [Created] (FLINK-34518) Adaptive Scheduler restores from empty state if JM fails during restarting state

2024-02-26 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-34518: -- Summary: Adaptive Scheduler restores from empty state if JM fails during restarting state Key: FLINK-34518 URL: https://issues.apache.org/jira/browse/FLINK-34518

Re: [DISCUSS]FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes

2024-02-26 Thread Jinzhong Li
Hi all, Thanks for all the feedback. It seems there are no more questions unaddressed. I would like to open the voting thread after three days. Please let me know if you have any concerns, thanks! Best, Jinzhong Li On Mon, Feb 26, 2024 at 11:29 AM Yanfei Lei wrote: > @Yun Tang > Thanks for

Re: [DISCUSS] Support the Ozone Filesystem

2024-02-26 Thread Ferenc Csaky
Hi, gentle reminder on this thread, any opinions or thoughts? Regards, Ferenc On Thursday, February 8th, 2024 at 18:02, Ferenc Csaky wrote: > > > Hello devs, > > I would like to start a discussion regarding Apache Ozone FS support. The > jira [1] is stale for quite a while, but