Re: [VOTE] FLIP-530: Dynamic job configuration

+1 (binding) Best, Junrui Hao Li 于2025年5月21日周三 03:42写道： > +1 (non-binding) > > Thanks, > Hao > > On Tue, May 20, 2025 at 12:39 PM Piotr Nowojski > wrote: > > > Hi, > > > > +1 (binding) > > > > Best, Piotrek > > > > wt., 20 maj 2025 o 20:29 Roman Khachatryan > napisał(a): > > > > > Hi everyone

Re: [DISCUSS] FLIP-530: Dynamic job configuration

Hi Roman Thanks for driving this feature. +1 for this proposal. I also agree with the suggestion made by Feifan. Currently, not all configuration items are job-level configurations [1]. Even for those that are, not all job-level config options can be updated at runtime through the Adaptive Sched

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

Congratulation, Zakelly! Best, Junrui Leonard Xu 于2025年4月1日周二 17:22写道： > Congratulation, Zakelly! > > Best, > Leonard > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Xuyang

Congratulations! Best, Junrui yh z 于2025年2月20日周四 10:00写道： > Congratulations > > Best, > Ron > > Ron Liu 于2025年2月20日周四 09:56写道： > > > Congratulations, you deserve it. > > > > Best, > > Ron > > > > > > Lincoln Lee 于2025年2月20日周四 09:50写道： > > > > > Hi everyone, > > > > > > On behalf of the PMC, I

[jira] [Created] (FLINK-37284) ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch.

Junrui Lee created FLINK-37284: -- Summary: ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch. Key: FLINK-37284 URL: https://issues.apache.org/jira/browse/FLINK-37284 Project: Flink

[jira] [Created] (FLINK-37218) Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions.

Junrui Lee created FLINK-37218: -- Summary: Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions. Key: FLINK-37218 URL

[jira] [Created] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

Junrui Lee created FLINK-37161: -- Summary: Cross-team verification for "Adaptive skewed join optimization for batch jobs" Key: FLINK-37161 URL: https://issues.apache.org/jira/browse/FLINK-37161

[jira] [Created] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

Junrui Lee created FLINK-37160: -- Summary: Cross-team verification for "Adaptive broadcast join for batch jobs" Key: FLINK-37160 URL: https://issues.apache.org/jira/browse/FLINK-37160 Proj

[jira] [Created] (FLINK-37150) Adjust the documentation of the configuration file to remove the support for the old configuration file."

Junrui Lee created FLINK-37150: -- Summary: Adjust the documentation of the configuration file to remove the support for the old configuration file." Key: FLINK-37150 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (FLINK-37149) Add Adaptive Batch Execution Documentation

Junrui Lee created FLINK-37149: -- Summary: Add Adaptive Batch Execution Documentation Key: FLINK-37149 URL: https://issues.apache.org/jira/browse/FLINK-37149 Project: Flink Issue Type: Sub-task

Re: [VOTE] FLIP-500: Support Join Extension in DataStream V2 API

+1(binding) Best, Junrui weijie guo 于2025年1月14日周二 10:32写道： > +1(binding) > > Best regards, > > Weijie > > > Xu Huang 于2025年1月13日周一 14:55写道： > > > Hi, all. > > > > I'd like to start a vote on FLIP-500: Support Join Extension in > DataStream > > V2 API [1]. You can find the discussion on it here

Re: [VOTE] FLIP-501: Support Window Extension in DataStream V2 API

+1(binding) Best, Junrui weijie guo 于2025年1月14日周二 10:32写道： > +1(binding) > > Best regards, > > Weijie > > > Xu Huang 于2025年1月13日周一 14:37写道： > > > Hi, all. > > > > I'd like to start a vote on FLIP-501: Support Window Extension in > > DataStream V2 API [1]. You can find the discussion on it here

[jira] [Created] (FLINK-37092) Enable skewed join optimization in the TPC-DS e2e test.

Junrui Lee created FLINK-37092: -- Summary: Enable skewed join optimization in the TPC-DS e2e test. Key: FLINK-37092 URL: https://issues.apache.org/jira/browse/FLINK-37092 Project: Flink Issue

[jira] [Created] (FLINK-37090) Introduce tpc-ds e2e case for adaptive broadcast join

Junrui Lee created FLINK-37090: -- Summary: Introduce tpc-ds e2e case for adaptive broadcast join Key: FLINK-37090 URL: https://issues.apache.org/jira/browse/FLINK-37090 Project: Flink Issue Type

Re: [DISCUSS] FLIP-501: Support Window Extension in DataStream V2 API

Hi, Xu, The FLIP mentions that currently three types of Windows are supported: GlobalWindow, TimeWindow, and SessionWindow. Is custom Window not supported on Window extension? Best, Junrui wenjin 于2025年1月10日周五 10:42写道： > Hi, Xu > > I've noticed that the Window API provided in the FLIP differs

Re: [VOTE] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

+1 (binding) Best, Junrui Yuepeng Pan 于2025年1月10日周五 10:05写道： > +1 non-binding > > Thanks for driving it ! > > > > Best, > Yuepeng Pan > > > > > > > > > 在 2025-01-10 09:57:20，"weijie guo" 写道： > >+1(binding) > > > >Best regards, > > > >Weijie > > > > > >Xu Huang 于2025年1月7日周二 22:49写道： > > > >> H

Re: [DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

Hi Xu, Thanks for your work. I have a small question: In JoinExtension, when a record is received, is it immediately joined with all the data received from the other side, or does it wait until both streams are finished before joining? Also, does it work on both bounded and unbounded streams? Xu

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

Hi, Xu Thanks for your work, I noticed that in this FLIP, event-time watermark is created and sent through a separate WatermarkGenerator. I would like to know if there is support for Source to send event-time watermark? Best, Junrui Xu Huang 于2025年1月6日周一 10:31写道： > Hi, Anil > > Maybe the water

[jira] [Created] (FLINK-36959) Computing readable buffer offsets and sizes when including empty buffers fails.

Junrui Lee created FLINK-36959: -- Summary: Computing readable buffer offsets and sizes when including empty buffers fails. Key: FLINK-36959 URL: https://issues.apache.org/jira/browse/FLINK-36959 Project

Re: [VOTE] FLIP-467: Introduce Generalized Watermarks

+1 (binding) Best, Junrui Xintong Song 于2024年12月20日周五 17:49写道： > +1 (binding) > > Best, > > Xintong > > > > On Fri, Dec 20, 2024 at 3:53 PM Xu Huang wrote: > > > Hi, all. > > > > > > I'd like to start a vote on FLIP-467: Introduce Generalized Watermarks > [1]. > > > > You can find the discussi

Re: [DISCUSS] FLIP-467: Introduce Generalized Watermarks

Hi Xu Huang, Thanks for the proposal! I have a question: If I have a large number of generalized watermarks that need to be created, where should they be declared? Should they be declared only once in a single Source, or in all operators that need to send, receive, and process them? Best regards

[jira] [Created] (FLINK-36850) Adapting batch job progress recovery with StreamGraph adaptive optimization

Junrui Lee created FLINK-36850: -- Summary: Adapting batch job progress recovery with StreamGraph adaptive optimization Key: FLINK-36850 URL: https://issues.apache.org/jira/browse/FLINK-36850 Project

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

Thank you so much for your kind congratulations and warm welcome! Looking forward to contributing more to the community. Best, Junrui Ron Liu 于2024年11月7日周四 17:00写道： > Congratulations Junrui > > Best, > Ron > > wenjin 于2024年11月7日周四 11:57写道： > > > Congratulations Junrui~ > > > > Best regards, >

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

Thanks Shengakai for driving this proposal. Supporting the deployment of sql scripts in application mode is important for improving SQL job submission. This FLIP design looks good to me. Best, Junrui Ron Liu 于2024年10月31日周四 10:20写道： > Hi, Shengkai > > Thanks for your quick response. It looks goo

[RESULT][VOTE] FLIP-478: Introduce Config Option Scope

Hi everyone, I'm glad to announce that FLIP-478: Introduce Config Option Scope[1] has been accepted. There are 3 approving votes, all of which are binding: - Zhu Zhu (binding) - Rui Fan (binding) - Shengkai Fang (binding) There were no votes against it. Best, Junrui [1] https://cwiki.apache.or

[VOTE] FLIP-478: Introduce Config Option Scope

Hi devs, I'd like to start a vote on the FLIP-478: Introduce Config Option Scope[1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-478+Introduce+Config+

Re: [DISCUSS] FLIP-478: Introduce Config Option Scope

] https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/ Best, Junrui Rui Fan <1996fan...@gmail.com> 于2024年10月10日周四 11:33写道： > Thanks Junrui for the quick clarification! > > Sounds good to me, +1 for this FLIP. > > Best, > Rui > > On Thu, Oct 1

Re: [VOTE] Release 2.0-preview1, release candidate #1

+1 (non-binding) - Verified checksums - Checked GitHub release tag - Reviewed web PR and release note - Built from source - Started the flink cluster locally and run an example job, and everything looks fine Best, Junrui Xintong Song 于2024年10月13日周日 00:46写道： > Hi everyone, > > Please review and

Re: [DISCUSS] FLIP-478: Introduce Config Option Scope

g the > > > scopes of various configurations, such as attempting to retrieve > > > job-specific settings from `TaskExecutor#taskManagerConfiguration`. > > > Clarifying the options' scopes in documentation can be a good reference > > > and

[DISCUSS] FLIP-478: Introduce Config Option Scope

igure each config option. And the scopes should be displayed in Flink configuration documentation. For more details, please refer to FLIP-478 [1]. Looking forward to your feedback. Best, Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-478+Introduce+Config+Option+Scope

Re: [ANNOUNCE] New Apache Flink Committer - Xuannan Su

Congratulations, Xuannan! Best, Junrui Feng Jin 于2024年8月18日周日 16:34写道： > Congratulations, Xuannan! > > Best, > Feng > > > On Sun, Aug 18, 2024 at 3:08 PM Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations, Xuannan! > > > > Best, > > Rui > > > > On Sun, Aug 18, 2024 at 2:20 PM Leonard X

[RESULT][VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi everyone, I'm delighted to announce that FLIP-469 [1] has been accepted. There were 3 votes in favor: - Weijie Guo (binding) - Zhu Zhu (binding) - Ron Liu (binding) There were no votes against it. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-469%3A+Supports+Adaptive+Optimizatio

[RESULT][VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

Hi everyone, I'm delighted to announce that FLIP-468 [1] has been accepted. There were 6 votes in favor: - Rui Fan (binding) - Zhu Zhu (binding) - Ron Liu (binding) - David Moravek (binding) - Zhanghao Chen (non-binding) - Yuepeng Pan (non-binding) There were no votes against it. [1] https://cw

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi Yu Chen, Apologies for the late reply. Thanks for your feedback and for emphasizing the importance of this work for FLINK-33230. Looking forward to your contributions. Best, Junrui Junrui Lee 于 2024年8月6日周二 22:05写道： > Hi everyone, > > David, Zhu and I had an offline discussion a

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

le work and > > risk to turn it into a serializable. Directly serializing and submitting > > transformations is also acceptable at the first glance, but > > SinkTransformation seems to be a blocker, as Junrui just mentioned. > > > > Thanks, > > Zhu > > >

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

t; > On Fri, Jul 26, 2024 at 9:30 AM Zhanghao Chen > wrote: > > > Thanks for driving it. +1 (non-binding) > > > > Best, > > Zhanghao Chen > > > > From: Junrui Lee > > Sent: Friday, July 26, 2024 11:02 > > To:

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

o explore the job > > they submitted. > > > > It's an important cornerstone of the FLINK-33230 since there are no > > stream-graph informations serialized. > > I'd like to base on this flip to expose operator level metrics and the > > present

[VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi everyone, Thanks for all the feedback about FLIP-469: Supports Adaptive Optimization of StreamGraph [1]. The discussion thread can be found here [2]. The vote will be open for at least 72 hours unless there are any objections or insufficient votes. Best, Junrui [1] https://cwiki.apache.org/

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi all, Thank you for all the feedback and suggestions so far. If there are no further comments, we will open the voting thread next Monday, July 29, 2024. Best regards, Junrui Ron Liu 于2024年7月26日周五 14:17写道： > Thanks for your updated, the FLIP looks good to me. > > Junrui Lee 于202

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

. Best, Junrui Junrui Lee 于2024年7月24日周三 15:46写道： > Hi Ron, > > Thank you for your questions regarding the > StreamGraphOptimizationStrategy. Here are my responses: > > 1.is there a better way to pass it to the > runtime? > > At the moment, we have not thought of a

[VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

Hi everyone, Thanks for all the feedback about FLIP-468: Introducing StreamGraph-Based Job Submission [1]. The discussion thread can be found here [2]. The vote will be open for at least 72 hours unless there are any objections or insufficient votes. Best, Junrui [1] https://cwiki.apache.org/c

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

pdated FLIP-468 & FLIP-470, I see that the design looks > good. > > > Best. > Ron > > Junrui Lee 于2024年7月18日周四 14:26写道： > > > Hi all, > > > > I would like to follow up on my previous email regarding your feedback. > > Below > > is a c

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

se two optimization > > strategies a, b are executed in order, a must be executed first, then b. > > How do you let the user perceive that a must be in front of a when > setting > > parameters, and a must be behind, and can the list type always be >

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

regards, Junrui Junrui Lee 于2024年7月12日周五 20:29写道： > Hi all, > > Thanks for your feedback. Below are my thoughts on the questions you've > raised > > @Fabian > > - What is the future plan for job submissions in Flink? With the current >> proposal, Flink will su

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

9写道： > > > Thanks Junrui for the updates. The proposal looks good to me. > > With the stream graph added to the REST API result, I think we are > > also quite close to enable Flink to expand a job vertex to show its > > operator-chain topology. > > >

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

uld also involve the public interface, so instead of > postponing > it to a later FLIP, I prefer to have a design for it in this FLIP. WDYT? > > Thanks, > Zhu > > Junrui Lee 于2024年7月11日周四 11:27写道： > > > Hi devs, > > > > Xia Sun, Lei Yang, and I would like t

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi all, Thanks for your feedback. Below are my thoughts on the questions you've raised @Fabian - What is the future plan for job submissions in Flink? With the current > proposal, Flink will support JobGraph/StreamGraph/compiled plan > submissions? It might be confusing for users and complicate

[DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

]. We look forward to your feedback. Best, Xia Sun, Lei Yang and Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-468%3A+Introducing+StreamGraph-Based+Job+Submission [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-469%3A+Supports+Adaptive+Optimization+of+StreamGraph

[DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

the job at runtime, to enhance the job's execution performance and observability. For more details, please refer to FLIP-468 [1]. We look forward to your feedback. Best, Xia Sun, Lei Yang and Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-468%3A+Introducing+Stream

Re: [VOTE] FLIP-464: Merge "flink run" and "flink run-application"

+1 (non-binding) Best, Junrui Biao Geng 于2024年6月13日周四 09:54写道： > Thanks for driving this. > +1 (non-binding) > > Best, > Biao Geng > > > weijie guo 于2024年6月13日周四 09:48写道： > > > Thanks for driving this! > > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年6月1

Re: [VOTE] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

+1 (non-binding) Best, Junrui Venkatakrishnan Sowrirajan 于2024年6月10日周一 02:37写道： > Thanks for adding this new support. +1 (non-binding) > > On Sat, Jun 8, 2024, 3:26 PM Ahmed Hamdy wrote: > > > +1 (non-binding) > > Best Regards > > Ahmed Hamdy > > > > > > On Sat, 8 Jun 2024 at 22:26, Jeyhun Kar

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

ecovery, I propose that this FLIP > doesn't involve these particular changes. Moreover, considering that > the Tier interfaces are not public currently, it is also feasible to add > the interfaces directly if necessary. > WDYT? > > Best, > Yuxin > > > Junrui Lee

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

Congratulations, Rui. Best, Junrui Hang Ruan 于2024年6月6日周四 10:35写道： > Congratulations, Rui! > > Best, > Hang > > Samrat Deb 于2024年6月6日周四 10:28写道： > > > Congratulations Rui > > > > Bests, > > Samrat > > > > On Thu, 6 Jun 2024 at 7:45 AM, Yuxin Tan wrote: > > > > > Congratulations, Rui! > > > >

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

Thanks Yuxin for driving this proposal! I have a question about the public interface compatibility in the context of FLIP-459. As we've supported batch job recovery from jobMaster failures in FLIP-383 which will be released in Flink 1.20. I wonder if the current interface design support the future

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

Congratulations Weijie! Best, Junrui Xintong Song 于2024年6月4日周二 14:46写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has joined > the Flink PMC! > > Weijie has been an active member of the Apache Flink community for many > years. He has made significant co

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

Thanks Xuannan for driving this! +1 for this proposal. Best, Junrui Rui Fan <1996fan...@gmail.com> 于2024年5月6日周一 11:27写道： > Thanks Xuannan for driving this proposal! > > > taskmanager.network.memory.max-overdraft-buffers-per-gate will be removed > and hard-coded to either 10 or 20. > > Currently,

Re: Question around Flink's AdaptiveBatchScheduler

gt; vsowr...@asu.edu> wrote: > > > >> Filed https://issues.apache.org/jira/browse/FLINK-35165 to address the > >> above described issue. Will share the PR here once it is ready for > review. > >> > >> Regards > >> Venkata krishnan &

Re: Question around Flink's AdaptiveBatchScheduler

t; > > be bound by the overall job's max parallelism, it can lead to following > > > issues: > > > > > >- High filter selectivity with huge amounts of data to read - > setting > > >high "*jobmanager.adaptive-batch-scheduler.max-parallelism*

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

Congratulations, Zakelly! Best, Junrui yue ma 于2024年4月15日周一 12:00写道： > Congratulations Zakelly! > > Best, > Yue >

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

Congratulations, Lincoln! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:29写道： > Congratulations, Lincoln! > > Best Regards > Aleksandr >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

Congratulations, Jing! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:28写道： > Congratulations, Jing! > > Best Regards, > Aleksandr >

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

+1 （non-binding) Best, Junrui Lijie Wang 于2024年4月12日周五 12:43写道： > +1 (binding) > > Thanks for driving. > > Best, > Lijie > > Zakelly Lan 于2024年4月12日周五 11:08写道： > > > +1 non-binding > > > > > > Best, > > Zakelly > > > > On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan > > wrote: > > > > > Hi Rui,

Re: Question around Flink's AdaptiveBatchScheduler

ices other than the > > source vertex. As you mentioned above ("Source can actually ignore this > > limit because it has no upstream"), therefore I feel " > > jobmanager.adaptive-batch-scheduler.default-source-parallelism" need not > > be upper bounded by

Re: Question around Flink's AdaptiveBatchScheduler

Hi Venkat, As Lijie mentioned, in Flink, the parallelism is required to be less than or equal to the maximum parallelism. The config option jobmanager.adaptive-batch-scheduler.max-parallelism and jobmanager.adaptive-batch-scheduler.default-source-parallelism will be set as the source's parallelis

Re: [DISCUSS] Move CheckpointingMode to flink-core

tion 3 if we all > agree, since the new getter/setter may also bring in confusions thus we > cannot make the API purely clean. WDYT? > > > Best, > Zakelly > > On Wed, Feb 28, 2024 at 10:14 AM Junrui Lee wrote: > > > Hi Zakelly, > > > > I agree with Chesn

Re: [DISCUSS] Move CheckpointingMode to flink-core

Hi Zakelly, I agree with Chesnay's response. I would suggest that during the process of moving CheckpointingMode from the flink-streaming-java module to the flink-core module, we should keep the package name unchanged. This approach would be completely transparent to users. In fact, this practice

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

Congratulations, Alex! Best, Junrui weijie guo 于2024年1月4日周四 09:57写道： > Congratulations, Alex! > > Best regards, > > Weijie > > > Steven Wu 于2024年1月4日周四 02:07写道： > > > Congra, Alex! Well deserved! > > > > On Wed, Jan 3, 2024 at 2:31 AM David Radley > > wrote: > > > > > Sorry for my typo. > > >

Re: [DISCUSS] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

Hi Zakelly, Thanks for driving this. I agree that the proposed restructuring of the configuration options is largely positive. It will make understanding and working with Flink configurations more intuitive. Most of the proposed changes look great. Just a heads-up, as Rui Fan mentioned, Flink cur

[RESULT][VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

The voting time of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] has passed. I'm closing the vote now. There were 5 +1 votes, 4 of which are binding: Rui Fan (binding) Weijie Guo (binding) Jing Ge (binding) Zhu Zhu (binding) Zhanghao Chen (non-binding) There were no -1 votes. Thus F

[VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

Hi everyone, Thank you to everyone for the feedback on FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] http

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

more than 30 methods > offered flat by the RuntimeContext. I am not sure if this could help users > find the right method in the context of execution config better than > before. > > I might miss something and look forward to your thoughts. Thanks! > > Best regards, >

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

clean up the codebase. > > > +1 (non-binding). > > > Best, > Wencong > > > > > > > > > > > > > > > > > > > > At 2023-11-15 16:51:15, "Junrui Lee" wrote: > >Hi all, > > > >I'd like to start a disc

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

u Zhu wrote: > >> Thanks Junrui for creating the FLIP and kicking off this discussion. >> >> Exposing a mutable ExecutionConfig which is even shared by multiple >> operators is truly a defect which can result in weird results. >> >> +1 >> >> Thanks, >&

[DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

Hi all, I'd like to start a discussion of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1]. Currently, the FLINK RuntimeContext is important for connecting user functions to the underlying runtime details. It provides users with necessary runtime information during job execution. However,

[RESULT][VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Hi all, The voting time of FLIP-381[1]: Deprecate configuration getters/setters that return/set complex Java objects has passed. I'm closing the vote now. There were 12 +1 votes, 6 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (bin

[VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Hi everyone, Thank you to everyone for the feedback on FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends) unles

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

t; approach to configuring Flink applications. > > > > +1 for this proposal. > > > > Best, > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-11-02 10:10:1

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

> presents a great opportunity to accomplish this goal. > > > > > > > > > > +1 for the proposal. > > > > > > > > > > Thanks, > > > > > Zhu > > > > > > > > > > Rui Fan <1996fan...@gmail.com&g

[DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

on this proposal are highly appreciated. Best regards, Junrui Lee [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=278464992

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

Hi Zhanghao, Thank you for the proposal. +1 from my side. It would be more user-friendly to have the deprecated options in the same section as the non-deprecated ones. Therefore, adding them in the same section sounds good to me. Best regards, Junrui Zhanghao Chen 于2023年11月1日周三 21:10写道： > Hi

[RESULT][VOTE] FLIP-366: Support standard YAML for FLINK configuration

Hi all, The voting time of FLIP-366 [1]:Support standard YAML for FLINK configuration has passed. I'm closing the vote now. There were 18 +1 votes, 9 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (binding) Zhu Zhu (binding) Chesnay

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

Congratulations Jane ! Best, Junrui Yun Tang 于2023年10月16日周一 10:21写道： > Congratulations, Jane! > > Best > Yun Tang > > From: Rui Fan <1996fan...@gmail.com> > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: qingyue@gmail.com > Subject:

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

Congratulations Ron ! Best, Junrui Yun Tang 于2023年10月16日周一 10:22写道： > Congratulations, Ron! > > Best > Yun Tang > > From: yu zelin > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: ron9@gmail.com > Subject: Re: [ANNOUNCE] New Apache

[VOTE] FLIP-366: Support standard YAML for FLINK configuration

Hi all, Thank you to everyone for the feedback on FLIP-366[1]: Support standard YAML for FLINK configuration in the discussion thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends, unless there is an objection or an insufficient number of

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

Hi everyone, Thanks for all the comments! Based on the discussion so far, I will proceed to initiate the vote tomorrow if there are no further discussions or objections. Best regards, Junrui Junrui Lee 于2023年10月9日周一 11:52写道： > Hi, Chesnay and David, sorry for the late reply. > > T

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

;> Yangze Guo > >>>>> > >>>>> > >>>>> On Fri, Sep 22, 2023 at 11:59 AM Lijie Wang < > >> wangdachui9...@gmail.com> > >>>>> wrote: > >>>>>> Hi Junrui, > >>>>>> &

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

determine which one uses the standard syntax at a glance. How about > using `flink-conf-default.yaml` to represent the default yaml file for > Flink 1.x? > > Best, > Jane > > On Wed, Sep 20, 2023 at 11:06 AM Junrui Lee wrote: > > > Hi devs, > > > > I wo

[Discuss] FLIP-366: Support standard YAML for FLINK configuration

Hi devs, I would like to start a discussion about FLIP-366: Support standard YAML for FLINK configuration[1] The current flink-conf.yaml parser in FLINK is not a standard YAML parser, which has some shortcomings. Firstly, it does not support nested structure configuration items and only supports

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congratulations, Hangxiang! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道： > Congratulations, Hangxiang! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:11 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congratulations Yanfei! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道： > Congratulations, Yanfei! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:10 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei > > Cong

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

Congrats, Weihua! Best, Junrui Geng Biao 于2023年8月4日周五 14:25写道： > Congrats, Weihua! > Best, > Biao Geng > > 发送自 Outlook for iOS > > 发件人: 周仁祥 > 发送时间: Friday, August 4, 2023 2:23:42 PM > 收件人: dev@flink.apache.org > 抄送: Weihua Hu > 主题: Re: [

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

+1 Best, Junrui weijie guo 于2023年7月24日周一 10:25写道： > +1 for this. > > Best regards, > > Weijie > > > liu ron 于2023年7月24日周一 09:58写道： > > > +1 > > > > Best, > > Ron > > > > Yuxin Tan 于2023年7月21日周五 16:21写道： > > > > > +1 > > > > > > Best, > > > Yuxin > > > > > > > > > Jing Ge 于2023年7月21日周五 15:41写

Re: Re: [DISCUSS][2.0] FLIP-344: Remove parameter in RichFunction#open

+1 Best, Junrui Wencong Liu 于2023年7月24日周一 20:12写道： > Hi Timo, > > > Thanks for you reply. I think adding an empty OpenContext to keep the > signature is > reasonable. I'll modify the FLIP at a later time. > > > Best, > Wencong Liu > > > > > > > > > > > > > > > > > > At 2023-07-24 17:11:44, "Tim

Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

+1 Best, Junrui Jing Ge 于2023年7月24日周一 23:28写道： > agree, since we want to try our best to deprecate APIs in 1.18, it makes > sense. > > > Best regards, > Jing > > On Mon, Jul 24, 2023 at 12:11 PM Wencong Liu wrote: > > > Hi Jing and Matthias, > > > > > > I believe it is reasonable to examin

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

Congratulations, Qingsheng! Best, Junrui Wencong Liu 于2023年4月23日周日 11:07写道： > Congratulations, Qingsheng! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink PMC

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

Congratulations, Leonard! Best, Junrui Wencong Liu 于2023年4月23日周日 11:05写道： > Congratulations, Leonard! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink PMC! >

Re: [VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

+1 (non-binding) Best regards, Junrui Weihua Hu 于2023年3月20日周一 14:24写道： > +1 (non-binding) > > Best, > Weihua > > > On Mon, Mar 20, 2023 at 12:39 PM Wencong Liu wrote: > > > +1 (non-binding) > > > > Best regards, > > > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >

Re: [VOTE] Release 1.17.0, release candidate #2

Thanks Qingsheng for driving this. +1 (non-binding) - built from source code - run some batch jobs, query results are expected, the default batch scheduler is AdaptiveBatchScheduler, WebUI looks good, no suspicious output/log. - start a Flink yarn session cluster, run the 10TB tpc-ds, all job can

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

Congratulations, Yuxia! Best, Junrui Yanfei Lei 于2023年3月13日周一 10:42写道： > Congratulations, Yuxia! > > Best, > Yanfei > > > Samrat Deb 于2023年3月13日周一 10:41写道： > > > > congratulations Yuxia > > > > Bests, > > Samrat > > > > On Mon, 13 Mar 2023 at 8:06 AM, Yuxin Tan > wrote: > > > > > Congratulati

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi Yuxin, This FLIP looks quite reasonable. Flink can solve the problem of Batch shuffle by combining local and remote storage, and can use fixed local disks for better performance in most scenarios, while using remote storage as a supplement when local disks are not sufficient, avoiding wastefu

  1   2   >