[jira] [Created] (FLINK-27256) Log the root exception in closing the task manager connection

2022-04-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-27256: -- Summary: Log the root exception in closing the task manager connection Key: FLINK-27256 URL: https://issues.apache.org/jira/browse/FLINK-27256 Project: Flink

[jira] [Created] (FLINK-26675) Parallelized heavy serialization operations in StreamingJobGraphGenerator

2022-03-16 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-26675: -- Summary: Parallelized heavy serialization operations in StreamingJobGraphGenerator Key: FLINK-26675 URL: https://issues.apache.org/jira/browse/FLINK-26675 Project: Flink

[jira] [Created] (FLINK-26641) Optimize the time of fetching job status in the job submission of session cluster

2022-03-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-26641: -- Summary: Optimize the time of fetching job status in the job submission of session cluster Key: FLINK-26641 URL: https://issues.apache.org/jira/browse/FLINK-26641

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-14 Thread Yangze Guo
Congratulations! Best, Yangze Guo On Mon, Mar 14, 2022 at 4:08 PM Martijn Visser wrote: > > Congratulations Yuan! > > On Mon, 14 Mar 2022 at 09:02, Yu Li wrote: > > > Hi all! > > > > I'm very happy to announce that Yuan Mei has joined the Flink PMC! > >

[jira] [Created] (FLINK-26627) Allow user to config the init/max wait time in the ExponentialWaitStrategy of job submission

2022-03-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-26627: -- Summary: Allow user to config the init/max wait time in the ExponentialWaitStrategy of job submission Key: FLINK-26627 URL: https://issues.apache.org/jira/browse/FLINK-26627

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

2022-03-03 Thread Yangze Guo
Congratulations! Best, Yangze Guo On Fri, Mar 4, 2022 at 11:23 AM Lincoln Lee wrote: > > Congratulations Martijn! > > Best, > Lincoln Lee > > > Yu Li 于2022年3月4日周五 11:09写道: > > > Congratulations! > > > > Best Regards, > > Yu > > >

Re: Change of focus

2022-02-28 Thread Yangze Guo
Thanks a lot for your great efforts, Till. It's been a pleasure working with you! Good luck! Best, Yangze Guo On Tue, Mar 1, 2022 at 11:40 AM Paul Lam wrote: > > Thanks Till, for everything! I learned a lot from you. Wish lots of joys in > your new journey. > > Best, > Paul L

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Yangze Guo
Congratulations! Well deserved! Best, Yangze Guo On Thu, Feb 17, 2022 at 12:22 AM Matthias Pohl wrote: > > Congratulations :-) > > Best, Matthias > > On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: > > > Congratulations Feng and Zhipeng :-) > > > >

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Yangze Guo
Congratulations! Well deserved. Best, Yangze Guo On Thu, Feb 17, 2022 at 10:15 AM Paul Lam wrote: > > Congrats to all of you! > > Best, > Paul Lam > > > 2022年2月17日 01:24,Roman Khachatryan 写道: > > > > Congratulations! > > > > Regards, > >

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-07 Thread Yangze Guo
Thanks @Thomas and @Gyula. +1 to only introduce necessary and reasonable shorthand proxy parameters. Best, Yangze Guo On Tue, Feb 8, 2022 at 12:47 PM Thomas Weise wrote: > > @Yangze thanks for bringing up the configuration priority. This is > quite important indeed and should be

Re: [VOTE] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-07 Thread Yangze Guo
+1 (binding) Best, Yangze Guo On Mon, Feb 7, 2022 at 5:04 PM K Fred wrote: > > +1 (non-binding) > > Best Regards > Peng Yuan > > On Mon, Feb 7, 2022 at 4:49 PM Danny Cranmer > wrote: > > > +1 (binding) > > > > Thanks for this effort! > > D

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-06 Thread Yangze Guo
ry.process.size" and "taskmanager.numberOfTaskSlots", and override the one in "flinkConfiguration". Am I understanding this correctly? Best, Yangze Guo On Mon, Feb 7, 2022 at 10:22 AM Xintong Song wrote: > > Sorry for the late reply. We were out due to the public holidays in China

[jira] [Created] (FLINK-25742) Remove the redundant serialization of RPC invocation at Flink side.

2022-01-20 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-25742: -- Summary: Remove the redundant serialization of RPC invocation at Flink side. Key: FLINK-25742 URL: https://issues.apache.org/jira/browse/FLINK-25742 Project: Flink

[jira] [Created] (FLINK-25741) Ignore buffer pools which have no floating buffer in buffer redistributing

2022-01-20 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-25741: -- Summary: Ignore buffer pools which have no floating buffer in buffer redistributing Key: FLINK-25741 URL: https://issues.apache.org/jira/browse/FLINK-25741 Project

Re: [ANNOUNCE] New Apache Flink Committer - Ingo Bürk

2021-12-02 Thread Yangze Guo
Congratulations, Ingo! Best, Yangze Guo On Fri, Dec 3, 2021 at 3:35 AM Konstantin Knauf wrote: > > Congratulations, Ingo! > > On Thu, Dec 2, 2021 at 7:13 PM Johannes Moser wrote: > > > What Martijn said,  > > > > > On 02.12.2021, at 18:32, Martijn Viss

Re: [ANNOUNCE] New Apache Flink Committer - Matthias Pohl

2021-12-02 Thread Yangze Guo
Congratulations, Matthias! Best, Yangze Guo On Fri, Dec 3, 2021 at 3:41 AM Konstantin Knauf wrote: > > Congratulations, Matthias! > > On Thu, Dec 2, 2021 at 8:03 PM Johannes Moser wrote: > > > Congrats Matthias. > > > > > On 02.12.2

Re: [VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

2021-11-24 Thread Yangze Guo
+1 (binding) Also, this will further slim down the TaskDeploymentDescriptor. Best, Yangze Guo On Wed, Nov 24, 2021 at 3:57 PM Yun Tang wrote: > > +1 (binding) > > Best > Yun Tang > > On 2021/11/24 07:50:15 Sergey Nuyanzin wrote: > > +1 (non-binding) > > &g

[jira] [Created] (FLINK-24951) Allow watch bookmarks to mitigate frequent watcher rebuilding

2021-11-18 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-24951: -- Summary: Allow watch bookmarks to mitigate frequent watcher rebuilding Key: FLINK-24951 URL: https://issues.apache.org/jira/browse/FLINK-24951 Project: Flink

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao

2021-11-16 Thread Yangze Guo
Congratulations and welcome on board! Best, Yangze Guo On Wed, Nov 17, 2021 at 1:26 PM Yun Gao wrote: > > Congratulations Yingjie! > > Best, > Yun > > > > --Original Mail -- > Sender:Lijie Wang > Send Date:Wed Nov 17 13:

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Yangze Guo
Congrats & well deserved! Best, Yangze Guo On Tue, Nov 16, 2021 at 10:18 AM Jing Zhang wrote: > > Congratulations Fabian! > > Best, > Jing Zhang > > Yuepeng Pan 于2021年11月16日周二 上午10:16写道: > > > Congratulations Fabian! > > > > Best, > > Yuep

Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang

2021-11-15 Thread Yangze Guo
Congrats & well deserved! Best, Yangze Guo On Tue, Nov 16, 2021 at 10:14 AM Yuepeng Pan wrote: > > Congrats. > > > Best, > Yuepeng Pan > > > > > > > > > > > > At 2021-11-15 21:39:47, "Timo Walther" wrote: > >Hi ev

Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-15 Thread Yangze Guo
Thank you all very much! It's my honor to work with you in such a great community. Best, Yangze Guo On Mon, Nov 15, 2021 at 2:08 PM Yang Wang wrote: > > Congratulations Yangze! > > Best, > Yang > > Yu Li 于2021年11月15日周一 下午2:01写道: >> >> Congratulations,

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-11 Thread Yangze Guo
Congrats, Leonard! Jingsong Li 于 2021年11月12日周五 下午12:15写道: > Congrats & well deserved, Leonard! > > Thank you for your exciting contributions to Flink! > > Best, > Jingsong > > On Fri, Nov 12, 2021 at 12:13 PM Jark Wu wrote: > > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to

Re: [DISCUSS] Improve the name and structure of job vertex and operator name for job

2021-11-11 Thread Yangze Guo
+1. That's gonna help a lot for debugging. Best, Yangze Guo On Thu, Nov 11, 2021 at 7:37 PM Till Rohrmann wrote: > > This improvement looks like it makes the life of our users a lot easier > when it comes to understanding logs and reading the UI. Hence +1. > > Cheers, > Till

Re: [ANNOUNCE] Apache Flink 1.13.3 released

2021-10-22 Thread Yangze Guo
Thank Chesnay, Martijn, and everyone involved! Best, Yangze Guo On Fri, Oct 22, 2021 at 4:25 PM Yun Tang wrote: > > Thanks for Chesnay & Martijn and everyone who made this release happen. > > Best > Yun Tang > > From: JING ZHANG > Se

[jira] [Created] (FLINK-24541) ConfigurationUtils#assembleDynamicConfigsStr should consider special characters

2021-10-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-24541: -- Summary: ConfigurationUtils#assembleDynamicConfigsStr should consider special characters Key: FLINK-24541 URL: https://issues.apache.org/jira/browse/FLINK-24541 Project

Re: [NOTICE] CiBot improvements

2021-10-10 Thread Yangze Guo
Thanks for that great job, Chesnay! "Rerun failed jobs" will help a lot. Best, Yangze Guo On Sun, Oct 10, 2021 at 4:56 PM Chesnay Schepler wrote: > > I made a number of changes to the CiBot over the weekend. > > - '@flinkbot run azure' previously triggered an en

[jira] [Created] (FLINK-24380) Flink should handle the state transition of the pod from Pending to Failed

2021-09-26 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-24380: -- Summary: Flink should handle the state transition of the pod from Pending to Failed Key: FLINK-24380 URL: https://issues.apache.org/jira/browse/FLINK-24380 Project

Re: [VOTE] Release 1.14.0, release candidate #3

2021-09-26 Thread Yangze Guo
+1 (non-binding) - built from source - executed example jobs with standalone / yarn / native kubernetes deployments, nothing unexpected - test the fine-grained resource management, nothing unexpected Best, Yangze Guo On Fri, Sep 24, 2021 at 5:45 PM Xintong Song wrote: > > +1 (b

Re: [DISCUSS] Releasing Flink 1.13.3

2021-09-22 Thread Yangze Guo
, if not, I don't think it should block the release. Best, Yangze Guo On Wed, Sep 22, 2021 at 8:44 PM Konstantin Knauf wrote: > > Hi Martijn, > > Thanks for starting the discussion. +1 for a soon Flink 1.13.3. IMHO we > don't need to block the release on FLINK-23519 (an improvement)

Re: [DISCUSS] Purpose of release notes

2021-09-13 Thread Yangze Guo
+1 Thanks Dawid for the clarification. Best, Yangze Guo On Mon, Sep 13, 2021 at 4:18 PM Jark Wu wrote: > > +1 > > I think the purpose of the release note page has not changed over the > previous releases. > It's a guideline for users to upgrade flink which just contains

[jira] [Created] (FLINK-24262) Remove unused ContainerOverlays

2021-09-12 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-24262: -- Summary: Remove unused ContainerOverlays Key: FLINK-24262 URL: https://issues.apache.org/jira/browse/FLINK-24262 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-24161) Can not stop the job with savepoint while a task is finishing

2021-09-05 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-24161: -- Summary: Can not stop the job with savepoint while a task is finishing Key: FLINK-24161 URL: https://issues.apache.org/jira/browse/FLINK-24161 Project: Flink

[jira] [Created] (FLINK-23921) WindowJoinITCase.testInnerJoinWithIsNotDistinctFromOnWTF is not stable

2021-08-23 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23921: -- Summary: WindowJoinITCase.testInnerJoinWithIsNotDistinctFromOnWTF is not stable Key: FLINK-23921 URL: https://issues.apache.org/jira/browse/FLINK-23921 Project: Flink

[jira] [Created] (FLINK-23912) Remove unnecessary "Clearing resource requirements of job"

2021-08-23 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23912: -- Summary: Remove unnecessary "Clearing resource requirements of job" Key: FLINK-23912 URL: https://issues.apache.org/jira/browse/FLINK-23912 Project: Flink

Re: Feature Freeze and Release Testing for 1.14

2021-08-12 Thread Yangze Guo
Thanks for the information, Joe, Dawid and Xintong! I've created the ticket for testing the fine-grained resource management and updated the wiki page. Best, Yangze Guo On Thu, Aug 12, 2021 at 4:59 PM Xintong Song wrote: > > Hi devs, > > We are approaching the feature freeze of

[jira] [Created] (FLINK-23743) Test the fine-grained resource management

2021-08-12 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23743: -- Summary: Test the fine-grained resource management Key: FLINK-23743 URL: https://issues.apache.org/jira/browse/FLINK-23743 Project: Flink Issue Type

Re: Looking for Maintainers for Flink on YARN

2021-08-04 Thread Yangze Guo
Thanks Konstantin for bringing this up, and thanks Marton and Gabor for stepping up! Both dates work for me. If there is something our team can help with for the kick-off, please let me know. Best, Yangze Guo On Thu, Aug 5, 2021 at 9:39 AM Xintong Song wrote: > > Yangze will join the ki

[jira] [Created] (FLINK-23463) Replace the tag with ShortCodes in document

2021-07-21 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23463: -- Summary: Replace the tag with ShortCodes in document Key: FLINK-23463 URL: https://issues.apache.org/jira/browse/FLINK-23463 Project: Flink Issue Type: Bug

Re: [DISCUSS] Address deprecation warnings when upgrading dependencies

2021-07-14 Thread Yangze Guo
+1 for fixing deprecation warnings when bumping/changing dependencies. Not only for the dependencies, we also use the deprecated API of Flink itself in `flink-examples` and the document, e.g. the #writeAsText. I think it would be good to do a clean-up for usability. WDYT? Best, Yangze Guo

[jira] [Created] (FLINK-23359) Fix the number of available slots in testResourceCanBeAllocatedForDifferentJobAfterFree

2021-07-12 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23359: -- Summary: Fix the number of available slots in testResourceCanBeAllocatedForDifferentJobAfterFree Key: FLINK-23359 URL: https://issues.apache.org/jira/browse/FLINK-23359

Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei

2021-07-07 Thread Yangze Guo
Congrats, Yuan! Best, Yangze Guo On Thu, Jul 8, 2021 at 9:49 AM Qingsheng Ren wrote: > > Congratulations Yuan! > > -- > Best Regards, > > Qingsheng Ren > Email: renqs...@gmail.com > 2021年7月8日 +0800 09:45 Xintong Song ,写道: > > Congratulations Yuan~! > &

Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yangze Guo
Congrats, Yang Wang! Best, Yangze Guo On Wed, Jul 7, 2021 at 10:27 AM Leonard Xu wrote: > > Congratulations! Yang Wang > > > Best, > Leonard > > 在 2021年7月7日,10:23,tison 写道: > > > > Congratulations and well deserved! > > > > It is my pressure to

Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yangze Guo
Congrats, Guowei! Best, Yangze Guo On Wed, Jul 7, 2021 at 10:24 AM tison wrote: > > Congrats! NB. > > Best, > tison. > > > Jark Wu 于2021年7月7日周三 上午10:20写道: > > > Congratulations Guowei! > > > > Best, > > Jark > > > > On Wed,

[jira] [Created] (FLINK-23265) Support evenly spread out in fine-grained resource management

2021-07-05 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23265: -- Summary: Support evenly spread out in fine-grained resource management Key: FLINK-23265 URL: https://issues.apache.org/jira/browse/FLINK-23265 Project: Flink

[jira] [Created] (FLINK-23264) Fine Grained Resource Management Phase 2

2021-07-05 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23264: -- Summary: Fine Grained Resource Management Phase 2 Key: FLINK-23264 URL: https://issues.apache.org/jira/browse/FLINK-23264 Project: Flink Issue Type: New Feature

Re: [VOTE] Release 1.13.2, release candidate #1

2021-07-04 Thread Yangze Guo
+1 (non-binding) - built from sources - run example jobs with standalone and yarn. - check TaskManager's rest API from the JM master and its standby, everything looks good Best, Yangze Guo On Mon, Jul 5, 2021 at 10:10 AM Xintong Song wrote: > > +1 (binding) > > - verifi

Re: [DISCUSS] Do not merge PRs with "unrelated" test failures.

2021-06-28 Thread Yangze Guo
+1 Thanks Xintong for drafting this doc. Best, Yangze Guo On Mon, Jun 28, 2021 at 5:42 PM JING ZHANG wrote: > > Thanks Xintong for giving detailed documentation. > > The best practice for handling test failure is very detailed, it's a good > guidelines document with clear actio

[jira] [Created] (FLINK-23165) Add StreamExecutionEnvironment#registerSlotSharingGroup to PyFlink

2021-06-28 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23165: -- Summary: Add StreamExecutionEnvironment#registerSlotSharingGroup to PyFlink Key: FLINK-23165 URL: https://issues.apache.org/jira/browse/FLINK-23165 Project: Flink

Re: [DISCUSS] Do not merge PRs with "unrelated" test failures.

2021-06-24 Thread Yangze Guo
a branch that is periodically synced with the master branch while enabling the unstable test. So that they can catch the breaking changes asap. Best, Yangze Guo On Thu, Jun 24, 2021 at 9:52 PM Till Rohrmann wrote: > > I like the idea of creating a blocker issue for a disabled test. This will &

[RESULT][VOTE] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-24 Thread Yangze Guo
votes. Thus, FLIP-169 has been accepted. Thanks everyone for joining the discussion and giving feedback! [1] https://lists.apache.org/thread.html/r8c73fc1081bd56979e3a5b1e28d80c1956eabccc080014d32241d169%40%3Cdev.flink.apache.org%3E Best, Yangze Guo

Re: CONTENTS DELETED in nabble frontend

2021-06-23 Thread Yangze Guo
Ahh. It seems nabble has updated mailing lists to regular forums this week[1]. [1] http://support.nabble.com/Mailing-Lists-will-be-updated-to-regular-forums-next-week-td7609458.html Best, Yangze Guo On Wed, Jun 23, 2021 at 2:37 PM Yangze Guo wrote: > > It seems the post will rema

Re: CONTENTS DELETED in nabble frontend

2021-06-23 Thread Yangze Guo
-tt44391.html Best, Yangze Guo On Wed, Jun 23, 2021 at 2:16 PM Matthias Pohl wrote: > > Hi everyone, > Is it only me or does anyone else have the same problem with messages being > not available anymore in the nabble frontend? I get multiple messages like > the following one for indi

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-22 Thread Yangze Guo
FYI, I updated the FLIP accordingly. To sum up, Flink will throw an exception and tell user to configure an internal "fine-grained.shuffle-mode.all-blocking" to be true in this scenario. Best, Yangze Guo On Tue, Jun 22, 2021 at 2:20 PM Yangze Guo wrote: > > Thanks for the

Re: [DISCUSS] Drop Mesos in 1.14

2021-06-22 Thread Yangze Guo
+1 for dropping if there is no strong demand from the community. I'm willing to help with the removal of e2e tests part. Best, Yangze Guo On Wed, Jun 23, 2021 at 10:09 AM Xintong Song wrote: > > +1 for dropping. > > I like Seth's idea. I don't have any real Mesos experience either.

Re: [DISCUSS] Do not merge PRs with "unrelated" test failures.

2021-06-22 Thread Yangze Guo
that this judgment can be made by the committers, but no one can ensure the judgment is always precise and so that we have this discussion thread. Regarding the unstable tests, how about adding another exception: committers verify it in their local environment and comment in such cases? Best, Yangze Guo

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-22 Thread Yangze Guo
Thanks for the comment, Xintong. I used to wonder if it was reasonable or worthwhile to introduce a configuration like "table.exec.shuffle-mode" for DataStream API. Narrow down the scope of effect sounds good to me. Best, Yangze Guo On Tue, Jun 22, 2021 at 2:08 PM Xintong Song wr

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-21 Thread Yangze Guo
-blocking job graph, which already exists since 1.11 and should have been considered by the following features. I admit we cannot assume the all-edges-blocking job graph will exist forever in Flink, but AFAIK there is no seeable feature that will intend to deprecate it. WDYT? Best, Yangze Guo On Mon

Re: [VOTE] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-21 Thread Yangze Guo
-for-Fine-Grained-Resource-Requirements-td51071.html Best, Yangze Guo On Tue, Jun 15, 2021 at 7:53 PM Xintong Song wrote: > > +1 (binding) > > > Thank you~ > > Xintong Song > > > > On Tue, Jun 15, 2021 at 6:21 PM Arvid Heise wrote: > > > LGTM +1 (binding) from m

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-21 Thread Yangze Guo
Thanks, I append it to the known limitations of this FLIP. Best, Yangze Guo On Mon, Jun 21, 2021 at 3:20 PM Zhu Zhu wrote: > > Thanks for the quick response Yangze. > The proposal sounds good to me. > > Thanks, > Zhu > > Yangze Guo 于2021年6月21日周一 下午3:01写道: >> &

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-21 Thread Yangze Guo
the cost of that usage and make their decision. WDYT? Best, Yangze Guo On Mon, Jun 21, 2021 at 2:24 PM Zhu Zhu wrote: > > Thanks for proposing this @Yangze Guo and sorry for joining the discussion so > late. > The proposal generally looks good to me. But I find one problem that

Re: [ANNOUNCE] New PMC member: Arvid Heise

2021-06-16 Thread Yangze Guo
Congrats, Arvid! Best, Yangze Guo On Wed, Jun 16, 2021 at 5:27 PM Qingsheng Ren wrote: > > Congratulations Arvid! > > -- > Best Regards, > > Qingsheng Ren > Email: renqs...@gmail.com > On Jun 16, 2021, 5:21 PM +0800, Dawid Wysakowicz , > wrote: > > Hi all

Re: [ANNOUNCE] New PMC member: Xintong Song

2021-06-16 Thread Yangze Guo
Congrats, Xintong! Best, Yangze Guo On Wed, Jun 16, 2021 at 5:23 PM Dawid Wysakowicz wrote: > > Hi all! > > I'm very happy to announce that Xintong Song has joined the Flink PMC! > > Congratulations and welcome Xintong! > > Best, > Dawid

Re: Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-15 Thread Yangze Guo
Thanks for the supplement, Arvid and Yun. I've annotated these two points in the FLIP. The vote is now started in [1]. [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-169-DataStream-API-for-Fine-Grained-Resource-Requirements-td51381.html Best, Yangze Guo On Fri

[VOTE] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-15 Thread Yangze Guo
/display/FLINK/FLIP-169+DataStream+API+for+Fine-Grained+Resource+Requirements [2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-169-DataStream-API-for-Fine-Grained-Resource-Requirements-td51071.html Best, Yangze Guo

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-09 Thread Yangze Guo
) and StreamExecutionEnvironment#registerSlotSharingGroup(SlotSharingGroup). If there is no more feedback, I'd start a vote next week. Best, Yangze Guo On Wed, Jun 9, 2021 at 10:46 AM Yangze Guo wrote: > > Thanks for the valuable suggestion, Arvid. > > 1) Yes, we can add a new SlotSharin

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-08 Thread Yangze Guo
? Best, Yangze Guo On Tue, Jun 8, 2021 at 6:51 PM Arvid Heise wrote: > > Hi Yangze, > > I like the general approach to bind requirements to slotsharing groups. I > think the current approach is also flexible enough that a user could simply > use ParameterTool or similar to

Re: Request to open the contributor permission!

2021-06-08 Thread Yangze Guo
-to-contribute.html Best, Yangze Guo On Wed, Jun 9, 2021 at 12:53 AM w.gh123 wrote: > > Hi, > > > I want to contribute to Apache Flink. Would you please give me the > contributor permission? My JIRA ID is hapihu

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-08 Thread Yangze Guo
ormation of external resources it requires in the future. But that is out of the scope of this PR. Best, Yangze Guo On Tue, Jun 8, 2021 at 4:20 PM Yang Wang wrote: > > Thanks @Yangze for preparing this FLIP. > > I think this is a good start point for the community users to have a taste

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-08 Thread Yangze Guo
l the above arguments. One preliminary idea is introducing a separate "job-conf.yaml". All in all, I agree that this topic requires more careful designs and deserved a separate discussion thread. Best, Yangze Guo On Tue, Jun 8, 2021 at 1:47 PM Xintong Song wrote: > > I think b

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-07 Thread Yangze Guo
( String pathToResourceJson); ``` WDYT? Best, Yangze Guo On Tue, Jun 8, 2021 at 12:12 PM Yangze Guo wrote: > > Thanks for the feedbacks, Xintong and Wenlong! > > @Wenlong > I think that is a good idea, adjust the resource without re-compiling > the job will facilitate the tuning

Re: [DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-07 Thread Yangze Guo
e resource spec config of a slot sharing group. Then, user can set the ResourceSpec of SSG "ssg1" by adding "slot-sharing-group.resource.ssg1: {cpu: 1.0, heap: 100m, off-heap: 100m....}". WDYT? Best, Yangze Guo On Tue, Jun 8, 2021 at 10:37 AM wenlong.lwl wrote: > > Tha

[DISCUSS] FLIP-169: DataStream API for Fine-Grained Resource Requirements

2021-06-03 Thread Yangze Guo
i document [1]. Looking forward to your feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-169+DataStream+API+for+Fine-Grained+Resource+Requirements Best, Yangze Guo

Re: [ANNOUNCE] Apache Flink 1.13.1 released

2021-05-31 Thread Yangze Guo
Thanks, Dawid for the great work, thanks to everyone involved. Best, Yangze Guo On Mon, May 31, 2021 at 4:14 PM Youngwoo Kim (김영우) wrote: > > Got it. > Thanks Dawid for the clarification. > > - Youngwoo > > On Mon, May 31, 2021 at 4:50 PM Dawid Wysakowicz >

[jira] [Created] (FLINK-22683) The total Flink/process memory of memoryConfiguration in /taskmanagers can be null or incorrect value

2021-05-17 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22683: -- Summary: The total Flink/process memory of memoryConfiguration in /taskmanagers can be null or incorrect value Key: FLINK-22683 URL: https://issues.apache.org/jira/browse/FLINK-22683

[jira] [Created] (FLINK-22627) Remove SlotManagerImpl

2021-05-11 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22627: -- Summary: Remove SlotManagerImpl Key: FLINK-22627 URL: https://issues.apache.org/jira/browse/FLINK-22627 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-22624) Default resource allocation strategy will allocate more pending task managers than demand

2021-05-10 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22624: -- Summary: Default resource allocation strategy will allocate more pending task managers than demand Key: FLINK-22624 URL: https://issues.apache.org/jira/browse/FLINK-22624

[jira] [Created] (FLINK-22618) Fix incorrect free resource metrics of task managers

2021-05-10 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22618: -- Summary: Fix incorrect free resource metrics of task managers Key: FLINK-22618 URL: https://issues.apache.org/jira/browse/FLINK-22618 Project: Flink Issue Type

Re: [ANNOUNCE] Apache Flink 1.13.0 released

2021-05-07 Thread Yangze Guo
Thanks, Dawid & Guowei for the great work, thanks to everyone involved. Best, Yangze Guo On Thu, May 6, 2021 at 5:51 PM Rui Li wrote: > > Thanks to Dawid and Guowei for the great work! > > On Thu, May 6, 2021 at 4:48 PM Zhu Zhu wrote: >> >> Thanks Dawid and

[jira] [Created] (FLINK-22536) Promote the critical log in FineGrainedSlotManager to INFO level

2021-04-29 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22536: -- Summary: Promote the critical log in FineGrainedSlotManager to INFO level Key: FLINK-22536 URL: https://issues.apache.org/jira/browse/FLINK-22536 Project: Flink

[jira] [Created] (FLINK-22505) Limit the precision of Resource

2021-04-28 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22505: -- Summary: Limit the precision of Resource Key: FLINK-22505 URL: https://issues.apache.org/jira/browse/FLINK-22505 Project: Flink Issue Type: Bug

Re: when should `FlinkYarnSessionCli` be included for parsing CLI arguments?

2021-04-26 Thread Yangze Guo
If the GenericCLI is selected, then the execution.target should have been overwritten to "yarn-application" in GenericCLI#toConfiguration. It is odd that why the GenericCLI#isActive return false as the execution.target is defined in both flink-conf and command line. Best, Yangze Guo O

Re: when should `FlinkYarnSessionCli` be included for parsing CLI arguments?

2021-04-26 Thread Yangze Guo
Hi, Tony. What is the version of your flink-dist. AFAIK, this issue should be addressed in FLINK-15852[1]. Could you give the client log of case 2(set the log level to DEBUG would be better). [1] https://issues.apache.org/jira/browse/FLINK-15852 Best, Yangze Guo On Sun, Apr 25, 2021 at 11:33

[jira] [Created] (FLINK-22351) Promote the log level of the resource declaration to INFO in FineGrainedSlotManager

2021-04-19 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-22351: -- Summary: Promote the log level of the resource declaration to INFO in FineGrainedSlotManager Key: FLINK-22351 URL: https://issues.apache.org/jira/browse/FLINK-22351

Re: [VOTE] Deprecating Mesos support

2021-04-14 Thread Yangze Guo
+1 Best, Yangze Guo On Wed, Apr 14, 2021 at 4:56 PM Chesnay Schepler wrote: > > +1 > > On 4/14/2021 10:11 AM, Till Rohrmann wrote: > > +1 > > > > Cheers, > > Till > > > > On Wed, Apr 14, 2021 at 10:10 AM Konstantin Knauf wrote: > > >

Re: [BULK]Re: [SURVEY] Remove Mesos support

2021-03-28 Thread Yangze Guo
+1 Best, Yangze Guo On Mon, Mar 29, 2021 at 11:31 AM Xintong Song wrote: > > +1 > It's already a matter of fact for a while that we no longer port new features > to the Mesos deployment. > > Thank you~ > > Xintong Song > > > > On Fri, Mar 26, 2021 at 10:

[jira] [Created] (FLINK-21633) Index pending task managers in TaskManagerTracker

2021-03-05 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21633: -- Summary: Index pending task managers in TaskManagerTracker Key: FLINK-21633 URL: https://issues.apache.org/jira/browse/FLINK-21633 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committers - Wei Zhong and Xingbo Huang

2021-02-22 Thread Yangze Guo
Congrats, Wei and Xingbo! Well deserved! Best, Yangze Guo On Mon, Feb 22, 2021 at 6:47 PM Yang Wang wrote: > > Congratulations Wei & Xingbo! > > Best, > Yang > > Rui Li 于2021年2月22日周一 下午6:23写道: > > > Congrats Wei & Xingbo! > > > &g

[jira] [Created] (FLINK-21312) SavepointITCase.testStopSavepointWithBoundedInputConcurrently is unstable

2021-02-06 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21312: -- Summary: SavepointITCase.testStopSavepointWithBoundedInputConcurrently is unstable Key: FLINK-21312 URL: https://issues.apache.org/jira/browse/FLINK-21312 Project: Flink

[jira] [Created] (FLINK-21273) Remove unused ExecutionVertexSchedulingRequirements

2021-02-03 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21273: -- Summary: Remove unused ExecutionVertexSchedulingRequirements Key: FLINK-21273 URL: https://issues.apache.org/jira/browse/FLINK-21273 Project: Flink Issue Type

Re: [RESULT] [VOTE] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Yangze Guo
Edit: The voting time of FLIP-156[1] has passed. Best, Yangze Guo On Thu, Feb 4, 2021 at 1:25 PM Yangze Guo wrote: > > Hi all, > > The voting time for changing the Public API of FLIP-156[1] has passed. > I'm closing the vote now. > > There were five +1 votes, 4

[RESULT] [VOTE] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Yangze Guo
, FLIP-156 has been accepted. Thanks everyone for joining the discussion and giving feedback! [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-156-Runtime-Interfaces-for-Fine-Grained-Resource-Requirements-td48419.html Best, Yangze Guo

[jira] [Created] (FLINK-21270) Generate the slot request respect to the resource specification of SlotSharingGroup if present

2021-02-03 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21270: -- Summary: Generate the slot request respect to the resource specification of SlotSharingGroup if present Key: FLINK-21270 URL: https://issues.apache.org/jira/browse/FLINK-21270

[jira] [Created] (FLINK-21269) Introduce runtime interfaces for specifying SSG-based resource requirements

2021-02-03 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21269: -- Summary: Introduce runtime interfaces for specifying SSG-based resource requirements Key: FLINK-21269 URL: https://issues.apache.org/jira/browse/FLINK-21269 Project

[jira] [Created] (FLINK-21267) FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21267: -- Summary: FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements Key: FLINK-21267 URL: https://issues.apache.org/jira/browse/FLINK-21267 Project: Flink

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-02 Thread Yangze Guo
uration. So, as written in the future plan, I tend to first collect feedbacks on the operator-level resource configuration interface when the fine-grained resource management is ready. Then, we consider further optimization, such as your proposal. Best, Yangze Guo On Wed, Feb 3, 2021 at 1:28 P

[VOTE] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-31 Thread Yangze Guo
/display/FLINK/FLIP-156%3A+Runtime+Interfaces+for+Fine-Grained+Resource+Requirements [2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-156-Runtime-Interfaces-for-Fine-Grained-Resource-Requirements-td47650.html Best, Yangze Guo

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-31 Thread Yangze Guo
d resource management is exposed to users. I'll start a vote in another thread. Best, Yangze Guo On Fri, Jan 29, 2021 at 10:07 PM Till Rohrmann wrote: > > Thanks for summarizing the discussion, Yangze. I agree that setting > resource requirements per operator is not very user friendly. Moreover

[jira] [Created] (FLINK-21221) Deduplication of ResourceCounter

2021-01-31 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21221: -- Summary: Deduplication of ResourceCounter Key: FLINK-21221 URL: https://issues.apache.org/jira/browse/FLINK-21221 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-21220) Change the type of cpuCores in ResourceProfile to CPUResource

2021-01-31 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-21220: -- Summary: Change the type of cpuCores in ResourceProfile to CPUResource Key: FLINK-21220 URL: https://issues.apache.org/jira/browse/FLINK-21220 Project: Flink

<    1   2   3   4   >