Re: [VOTE] FLIP-464: Merge "flink run" and "flink run-application"

2024-06-12 Thread Junrui Lee
+1 (non-binding) Best, Junrui Biao Geng 于2024年6月13日周四 09:54写道: > Thanks for driving this. > +1 (non-binding) > > Best, > Biao Geng > > > weijie guo 于2024年6月13日周四 09:48写道: > > > Thanks for driving this! > > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song

Re: [VOTE] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-11 Thread Junrui Lee
+1 (non-binding) Best, Junrui Venkatakrishnan Sowrirajan 于2024年6月10日周一 02:37写道: > Thanks for adding this new support. +1 (non-binding) > > On Sat, Jun 8, 2024, 3:26 PM Ahmed Hamdy wrote: > > > +1 (non-binding) > > Best Regards > > Ahmed Hamdy > > > > > > On Sat, 8 Jun 2024 at 22:26, Jeyhun

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-05 Thread Junrui Lee
ecovery, I propose that this FLIP > doesn't involve these particular changes. Moreover, considering that > the Tier interfaces are not public currently, it is also feasible to add > the interfaces directly if necessary. > WDYT? > > Best, > Yuxin > > > Junrui Lee 于20

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-05 Thread Junrui Lee
Congratulations, Rui. Best, Junrui Hang Ruan 于2024年6月6日周四 10:35写道: > Congratulations, Rui! > > Best, > Hang > > Samrat Deb 于2024年6月6日周四 10:28写道: > > > Congratulations Rui > > > > Bests, > > Samrat > > > > On Thu, 6 Jun 2024 at 7:45 AM, Yuxin Tan wrote: > > > > > Congratulations, Rui! > > > >

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-05 Thread Junrui Lee
Thanks Yuxin for driving this proposal! I have a question about the public interface compatibility in the context of FLIP-459. As we've supported batch job recovery from jobMaster failures in FLIP-383 which will be released in Flink 1.20. I wonder if the current interface design support the

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Junrui Lee
Congratulations Weijie! Best, Junrui Xintong Song 于2024年6月4日周二 14:46写道: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has joined > the Flink PMC! > > Weijie has been an active member of the Apache Flink community for many > years. He has made significant

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-10 Thread Junrui Lee
Thanks Xuannan for driving this! +1 for this proposal. Best, Junrui Rui Fan <1996fan...@gmail.com> 于2024年5月6日周一 11:27写道: > Thanks Xuannan for driving this proposal! > > > taskmanager.network.memory.max-overdraft-buffers-per-gate will be removed > and hard-coded to either 10 or 20. > >

Re: Question around Flink's AdaptiveBatchScheduler

2024-05-06 Thread Junrui Lee
gt; vsowr...@asu.edu> wrote: > > > >> Filed https://issues.apache.org/jira/browse/FLINK-35165 to address the > >> above described issue. Will share the PR here once it is ready for > review. > >> > >> Regards > >> Venkata krishnan &

Re: Question around Flink's AdaptiveBatchScheduler

2024-04-17 Thread Junrui Lee
's max parallelism, it can lead to following > > > issues: > > > > > >- High filter selectivity with huge amounts of data to read - > setting > > >high "*jobmanager.adaptive-batch-scheduler.max-parallelism*" so that > > > source paral

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Junrui Lee
Congratulations, Zakelly! Best, Junrui yue ma 于2024年4月15日周一 12:00写道: > Congratulations Zakelly! > > Best, > Yue >

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Junrui Lee
Congratulations, Lincoln! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:29写道: > Congratulations, Lincoln! > > Best Regards > Aleksandr >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Junrui Lee
Congratulations, Jing! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:28写道: > Congratulations, Jing! > > Best Regards, > Aleksandr >

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Junrui Lee
+1 (non-binding) Best, Junrui Lijie Wang 于2024年4月12日周五 12:43写道: > +1 (binding) > > Thanks for driving. > > Best, > Lijie > > Zakelly Lan 于2024年4月12日周五 11:08写道: > > > +1 non-binding > > > > > > Best, > > Zakelly > > > > On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan > > wrote: > > > > > Hi Rui,

Re: Question around Flink's AdaptiveBatchScheduler

2024-04-11 Thread Junrui Lee
ices other than the > > source vertex. As you mentioned above ("Source can actually ignore this > > limit because it has no upstream"), therefore I feel " > > jobmanager.adaptive-batch-scheduler.default-source-parallelism" need not > > be upper bounded by

Re: Question around Flink's AdaptiveBatchScheduler

2024-02-29 Thread Junrui Lee
Hi Venkat, As Lijie mentioned, in Flink, the parallelism is required to be less than or equal to the maximum parallelism. The config option jobmanager.adaptive-batch-scheduler.max-parallelism and jobmanager.adaptive-batch-scheduler.default-source-parallelism will be set as the source's

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-28 Thread Junrui Lee
setter may also bring in confusions thus we > cannot make the API purely clean. WDYT? > > > Best, > Zakelly > > On Wed, Feb 28, 2024 at 10:14 AM Junrui Lee wrote: > > > Hi Zakelly, > > > > I agree with Chesnay's response. I would suggest that during the pro

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-27 Thread Junrui Lee
Hi Zakelly, I agree with Chesnay's response. I would suggest that during the process of moving CheckpointingMode from the flink-streaming-java module to the flink-core module, we should keep the package name unchanged. This approach would be completely transparent to users. In fact, this practice

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

2024-01-03 Thread Junrui Lee
Congratulations, Alex! Best, Junrui weijie guo 于2024年1月4日周四 09:57写道: > Congratulations, Alex! > > Best regards, > > Weijie > > > Steven Wu 于2024年1月4日周四 02:07写道: > > > Congra, Alex! Well deserved! > > > > On Wed, Jan 3, 2024 at 2:31 AM David Radley > > wrote: > > > > > Sorry for my typo. > >

Re: [DISCUSS] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2023-12-25 Thread Junrui Lee
Hi Zakelly, Thanks for driving this. I agree that the proposed restructuring of the configuration options is largely positive. It will make understanding and working with Flink configurations more intuitive. Most of the proposed changes look great. Just a heads-up, as Rui Fan mentioned, Flink

[RESULT][VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-30 Thread Junrui Lee
The voting time of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] has passed. I'm closing the vote now. There were 5 +1 votes, 4 of which are binding: Rui Fan (binding) Weijie Guo (binding) Jing Ge (binding) Zhu Zhu (binding) Zhanghao Chen (non-binding) There were no -1 votes. Thus

[VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-27 Thread Junrui Lee
Hi everyone, Thank you to everyone for the feedback on FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1]

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-19 Thread Junrui Lee
more than 30 methods > offered flat by the RuntimeContext. I am not sure if this could help users > find the right method in the context of execution config better than > before. > > I might miss something and look forward to your thoughts. Thanks! > > Best regards, >

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-18 Thread Junrui Lee
clean up the codebase. > > > +1 (non-binding). > > > Best, > Wencong > > > > > > > > > > > > > > > > > > > > At 2023-11-15 16:51:15, "Junrui Lee" wrote: > >Hi all, > > > >I'd like to start a discussio

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-15 Thread Junrui Lee
M Zhu Zhu wrote: > >> Thanks Junrui for creating the FLIP and kicking off this discussion. >> >> Exposing a mutable ExecutionConfig which is even shared by multiple >> operators is truly a defect which can result in weird results. >> >> +1 >> >> Thanks, >&

[DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-15 Thread Junrui Lee
Hi all, I'd like to start a discussion of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1]. Currently, the FLINK RuntimeContext is important for connecting user functions to the underlying runtime details. It provides users with necessary runtime information during job execution.

[RESULT][VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-14 Thread Junrui Lee
Hi all, The voting time of FLIP-381[1]: Deprecate configuration getters/setters that return/set complex Java objects has passed. I'm closing the vote now. There were 12 +1 votes, 6 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge

[VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-09 Thread Junrui Lee
Hi everyone, Thank you to everyone for the feedback on FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends)

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-05 Thread Junrui Lee
t; approach to configuring Flink applications. > > > > +1 for this proposal. > > > > Best, > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-11-02 10:10:1

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-02 Thread Junrui Lee
nity to accomplish this goal. > > > > > > > > > > +1 for the proposal. > > > > > > > > > > Thanks, > > > > > Zhu > > > > > > > > > > Rui Fan <1996fan...@gmail.com> 于2023年11月2日周四 10:27写道: >

[DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-01 Thread Junrui Lee
on this proposal are highly appreciated. Best regards, Junrui Lee [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=278464992

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Junrui Lee
Hi Zhanghao, Thank you for the proposal. +1 from my side. It would be more user-friendly to have the deprecated options in the same section as the non-deprecated ones. Therefore, adding them in the same section sounds good to me. Best regards, Junrui Zhanghao Chen 于2023年11月1日周三 21:10写道: > Hi

[RESULT][VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-17 Thread Junrui Lee
Hi all, The voting time of FLIP-366 [1]:Support standard YAML for FLINK configuration has passed. I'm closing the vote now. There were 18 +1 votes, 9 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (binding) Zhu Zhu (binding)

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread Junrui Lee
Congratulations Jane ! Best, Junrui Yun Tang 于2023年10月16日周一 10:21写道: > Congratulations, Jane! > > Best > Yun Tang > > From: Rui Fan <1996fan...@gmail.com> > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: qingyue@gmail.com > Subject:

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread Junrui Lee
Congratulations Ron ! Best, Junrui Yun Tang 于2023年10月16日周一 10:22写道: > Congratulations, Ron! > > Best > Yun Tang > > From: yu zelin > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: ron9@gmail.com > Subject: Re: [ANNOUNCE] New Apache

[VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Junrui Lee
Hi all, Thank you to everyone for the feedback on FLIP-366[1]: Support standard YAML for FLINK configuration in the discussion thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends, unless there is an objection or an insufficient number

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Junrui Lee
Hi everyone, Thanks for all the comments! Based on the discussion so far, I will proceed to initiate the vote tomorrow if there are no further discussions or objections. Best regards, Junrui Junrui Lee 于2023年10月9日周一 11:52写道: > Hi, Chesnay and David, sorry for the late reply. > &g

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-10-08 Thread Junrui Lee
;>>>> > >>>>> > >>>>> On Fri, Sep 22, 2023 at 11:59 AM Lijie Wang < > >> wangdachui9...@gmail.com> > >>>>> wrote: > >>>>>> Hi Junrui, > >>>>>> > >>>>&

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-09-20 Thread Junrui Lee
rmine which one uses the standard syntax at a glance. How about > using `flink-conf-default.yaml` to represent the default yaml file for > Flink 1.x? > > Best, > Jane > > On Wed, Sep 20, 2023 at 11:06 AM Junrui Lee wrote: > > > Hi devs, > > > > I would l

[Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-09-19 Thread Junrui Lee
Hi devs, I would like to start a discussion about FLIP-366: Support standard YAML for FLINK configuration[1] The current flink-conf.yaml parser in FLINK is not a standard YAML parser, which has some shortcomings. Firstly, it does not support nested structure configuration items and only supports

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread Junrui Lee
Congratulations, Hangxiang! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道: > Congratulations, Hangxiang! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:11 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Junrui Lee
Congratulations Yanfei! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道: > Congratulations, Yanfei! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:10 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei > >

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-04 Thread Junrui Lee
Congrats, Weihua! Best, Junrui Geng Biao 于2023年8月4日周五 14:25写道: > Congrats, Weihua! > Best, > Biao Geng > > 发送自 Outlook for iOS > > 发件人: 周仁祥 > 发送时间: Friday, August 4, 2023 2:23:42 PM > 收件人: dev@flink.apache.org > 抄送: Weihua Hu > 主题: Re:

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-25 Thread Junrui Lee
+1 Best, Junrui weijie guo 于2023年7月24日周一 10:25写道: > +1 for this. > > Best regards, > > Weijie > > > liu ron 于2023年7月24日周一 09:58写道: > > > +1 > > > > Best, > > Ron > > > > Yuxin Tan 于2023年7月21日周五 16:21写道: > > > > > +1 > > > > > > Best, > > > Yuxin > > > > > > > > > Jing Ge 于2023年7月21日周五

Re: Re: [DISCUSS][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-25 Thread Junrui Lee
+1 Best, Junrui Wencong Liu 于2023年7月24日周一 20:12写道: > Hi Timo, > > > Thanks for you reply. I think adding an empty OpenContext to keep the > signature is > reasonable. I'll modify the FLIP at a later time. > > > Best, > Wencong Liu > > > > > > > > > > > > > > > > > > At 2023-07-24 17:11:44,

Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-25 Thread Junrui Lee
+1 Best, Junrui Jing Ge 于2023年7月24日周一 23:28写道: > agree, since we want to try our best to deprecate APIs in 1.18, it makes > sense. > > > Best regards, > Jing > > On Mon, Jul 24, 2023 at 12:11 PM Wencong Liu wrote: > > > Hi Jing and Matthias, > > > > > > I believe it is reasonable to

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-22 Thread Junrui Lee
Congratulations, Qingsheng! Best, Junrui Wencong Liu 于2023年4月23日周日 11:07写道: > Congratulations, Qingsheng! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-22 Thread Junrui Lee
Congratulations, Leonard! Best, Junrui Wencong Liu 于2023年4月23日周日 11:05写道: > Congratulations, Leonard! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink PMC! >

Re: [VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-20 Thread Junrui Lee
+1 (non-binding) Best regards, Junrui Weihua Hu 于2023年3月20日周一 14:24写道: > +1 (non-binding) > > Best, > Weihua > > > On Mon, Mar 20, 2023 at 12:39 PM Wencong Liu wrote: > > > +1 (non-binding) > > > > Best regards, > > > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >

Re: [VOTE] Release 1.17.0, release candidate #2

2023-03-15 Thread Junrui Lee
Thanks Qingsheng for driving this. +1 (non-binding) - built from source code - run some batch jobs, query results are expected, the default batch scheduler is AdaptiveBatchScheduler, WebUI looks good, no suspicious output/log. - start a Flink yarn session cluster, run the 10TB tpc-ds, all job

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Junrui Lee
Congratulations, Yuxia! Best, Junrui Yanfei Lei 于2023年3月13日周一 10:42写道: > Congratulations, Yuxia! > > Best, > Yanfei > > > Samrat Deb 于2023年3月13日周一 10:41写道: > > > > congratulations Yuxia > > > > Bests, > > Samrat > > > > On Mon, 13 Mar 2023 at 8:06 AM, Yuxin Tan > wrote: > > > > >

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-07 Thread Junrui Lee
Hi Yuxin, This FLIP looks quite reasonable. Flink can solve the problem of Batch shuffle by combining local and remote storage, and can use fixed local disks for better performance in most scenarios, while using remote storage as a supplement when local disks are not sufficient, avoiding

Re: [VOTE] Flink minor version support policy for old releases

2023-02-28 Thread Junrui Lee
Thanks Danny for driving it. +1 (non-binding) Best regards, Junrui yuxia 于2023年2月28日周二 14:04写道: > Thanks Danny for driving it. > > +1 (non-binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Weihua Hu" > 收件人: "dev" > 发送时间: 星期二, 2023年 2 月 28日 下午 12:48:09 > 主题: Re: [VOTE] Flink

Re: [ANNOUNCE] Flink project website is now powered by Hugo

2023-02-23 Thread Junrui Lee
Thanks Martijn for your great work. Best regards, Junrui Jane Chan 于2023年2月24日周五 10:37写道: > Thanks Martijn for your great work. > > Best regards, > Jane > > On Fri, Feb 24, 2023 at 10:24 AM weijie guo > wrote: > > > Thanks Martijn for your great work. > > > > Best regards, > > > > Weijie > >

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-21 Thread Junrui Lee
Congratulations Sergey! weijie guo 于2023年2月21日周二 20:54写道: > Congratulations, Sergey~ > > Best regards, > > Weijie > > > Jing Ge 于2023年2月21日周二 20:52写道: > > > congrats Sergey! > > > > On Tue, Feb 21, 2023 at 1:15 PM Matthias Pohl > > wrote: > > > > > Congratulations, Sergey! Good job &

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Junrui Lee
Congratulations, Rui Best, Junrui Matt Wang 于2023年2月21日周二 09:51写道: > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan | > Congrats Rui >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Junrui Lee
Congratulations, Anton! Best, Junrui Rui Fan 于2023年2月21日周二 10:02写道: > Congratulations, Anton! > > Best, > Rui Fan > > On Tue, Feb 21, 2023 at 9:23 AM yuxia wrote: > > > Congrats Anton! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Matthias Pohl" > > 收件人: "dev" > > 发送时间:

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-15 Thread Junrui Lee
Congratulations, Dong! Best, Junrui Guowei Ma 于2023年2月16日周四 14:21写道: > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Dong Lin as a new > Flink PMC. > > Dong is currently the main driver of Flink ML. He reviewed a large > number of Flink ML related PRs and also

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-12 Thread Junrui Lee
Congratulations, Weijie! Best, Junrui

[RESULT][VOTE] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-12 Thread Junrui Lee
Hi all: FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs [1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 2 non-bindings as follows: Lijie Wang (binding) Zhu Zhu (binding) yuxia (non-binding) weijie guo (non-binding) Xintong Song

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-10 Thread Junrui Lee
aming > dedicated. That should significantly simplify the default scheduler, > benefiting both the maintenance of the default scheduler and the > development of new features in the batch area. > > So +1 from my side. > > Best, > > Xintong > > > > On Wed, Jan

Re: Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Junrui Lee
Congratulations, Lincoln! Best regards, Junrui Wencong Liu 于2023年1月10日周二 14:40写道: > Congratulations, Lincoln! > > Best regards, > Wencong > > > > > > > > > > > > > > > 在 2023-01-10 13:25:09,"Yanfei Lei" 写道: > >Congratulations, well deserved! > > > >Best, > >Yanfei > > > >Yuan Mei

[VOTE] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-09 Thread Junrui Lee
Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a consensus, so I would like to start a vote on FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs[2]. The vote will last for at least 72 hours (Jan 12th at 12:00 GMT) unless there is

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-03 Thread JunRui Lee
> > So generally +1 for this proposal. > > > > Regarding the configuration key renaming, like yuxia mentioned, we should > > deprecate the old ones and add new ones with new names, to guarantee > > compatibility. > > > > Thanks, > > Zhu > > > &

[DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2022-12-29 Thread JunRui Lee
]:https://issues.apache.org/jira/browse/FLINK-29663 [4]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-168%3A+Speculative+Execution+for+Batch+Job Best regards, JunRui Lee

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-07 Thread JunRui Lee
@Guyla, Thanks for the explanation and the follow up actions. That sounds good to me. Thanks, JunRui Lee Yanfei Lei 于2022年11月7日周一 12:20写道: > Hi Max, > > Thanks for the proposal. This proposal makes Flink better adapted to > cloud-native applications! > > After reading the

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-05 Thread JunRui Lee
triggering rules are necessary to avoid unnecessary autoscaling caused by temporary large changes in data, and in this case, it will lead to at least two meaningless resubmissions of jobs, which will negatively affect users. Thanks, JunRui Lee Gyula Fóra 于2022年11月5日周六 20:38写道: > Hey! > &g

Re: [VOTE] Release 1.16.0, release candidate #2

2022-10-24 Thread JunRui Lee
+1 (non-binding) for this candidate * Built from the source code. * Ran batch wordcount jobs with slow nodes of different source types on the yarn cluster. * The new source speculative execution works as expected, the result is expected, no suspicious log output. * Slow nodes are

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-17 Thread JunRui Lee
Congratulations, Lijie! Best, JunRui Timo Walther 于2022年8月17日周三 19:30写道: > Congratulations and welcome to the committer team :-) > > Regards, > Timo > > > On 17.08.22 12:50, Yuxin Tan wrote: > > Congratulations, Lijie! > > > > Best, > > Yuxin > > > > > > Guowei Ma 于2022年8月17日周三 18:42写道: > > >