回复:[DISCUSS] Proposal of external shuffle service

2018-11-01 Thread zhijiang
Thanks for the efficient response till! Thanks sunjin for the good feedbacks, we will further confirm with the comments then! :) -- 发件人:Jin Sun 发送时间:2018年11月1日(星期四) 06:42 收件人:dev 抄 送:Zhijiang(wangzhijiang999) ; Nico Kruber

回复:[DISCUSS] Proposal of external shuffle service

2018-10-31 Thread zhijiang
-6cLRQxJzo6VNQQVxn3hwf9Zqmv5pcb34/edit?usp=sharing Best, Zhijiang -- 发件人:Zhijiang(wangzhijiang999) 发送时间:2018年9月11日(星期二) 15:21 收件人:dev 抄 送:dev 主 题:回复:[DISCUSS] Proposal of external shuffle service Many thanks Till! I would create a JIRA for this feature

回复:Memory size for network buffers

2018-11-12 Thread zhijiang
obs. Best, Zhijiang -- 发件人:Thomas Weise 发送时间:2018年11月13日(星期二) 13:11 收件人:dev 主 题:Memory size for network buffers Hi, I'm trying to understand the intention behind the size parameters for network buffers, specifically max, min an

回复:[DISCUSS] Task speculative execution for Flink batch

2018-11-05 Thread zhijiang
, then we can discussion further. Best, Zhijiang -- 发件人:Tao Yangyu 发送时间:2018年11月6日(星期二) 11:01 收件人:dev 主 题:[DISCUSS] Task speculative execution for Flink batch Hi everyone, We propose task speculative execution for Flink batch

回复:Memory size for network buffers

2018-11-13 Thread zhijiang
parameters for network memory are more flexible than before that just config the extract "numberOfBuffers", so it may not be changed again if we make some improments in future . Best, Zhijiang -- 发件人:Thomas Weise 发送时间:2018年

Re: [DISCUSS] Proposal of external shuffle service

2019-01-20 Thread zhijiang
://issues.apache.org/jira/browse/FLINK-10653 Best, Zhijiang -- From:zhijiang Send Time:2019年1月15日(星期二) 17:55 To:Andrey Zagrebin Cc:dev Subject:Re: [DISCUSS] Proposal of external shuffle service Hi all, After continuous discussion with Andrey

Re: [ANNOUNCE] Contributing Alibaba's Blink

2019-01-22 Thread zhijiang
Blink/Flink reach the same point, users might use Blink for enjoying some advantages earily. So from the user experience aspect, Blink might have to push the changes such as bug fix before completely merging into Flink. This issue should be concerned when making the decision. Best, Zhijiang

Re: [DISCUSS] Proposal of external shuffle service

2019-01-15 Thread zhijiang
and suggestions! :) [1] https://docs.google.com/document/d/1l7yIVNH3HATP4BnjEOZFkO2CaHf1sVn_DSxS2llmkd8/edit?usp=sharing Best, Zhijiang -- From:zhijiang Send Time:2018年12月25日(星期二) 15:33 To:Andrey Zagrebin Cc:dev Subject:Re: [DISCUSS

Re: [DISCUSS] Proposal of external shuffle service

2018-12-24 Thread zhijiang
conclusions which cover not only the first step, but also all the future extensions described and listed in priority. BTW, do you think it is necessary that we further co-author a FLIP for this feature? It is actually involved in many changes on both TM, JM sides. :) Best, Zhijiang

Re: [DISCUSS] Proposal of external shuffle service

2018-12-24 Thread zhijiang
& JMGateway for current implementation. Certainly it can also rely on other ways for different ShuffleManager implementations. I would update the google doc to make this process clear if you also think so. :) Best, Zhij

回复:[DISCUSS] Proposal of external shuffle service

2018-11-28 Thread zhijiang
://issues.apache.org/jira/browse/FLINK-10653 [2] https://docs.google.com/document/d/1ssTu8QE8RnF31zal4JHM1VaVENow-PweUtXSRr68nGg/edit?usp=sharing -- 发件人:zhijiang 发送时间:2018年11月1日(星期四) 17:19 收件人:dev ; Jin Sun 抄 送:Nico Kruber ; Piotr Nowojski

回复:[DISCUSS] Proposal of external shuffle service

2018-12-09 Thread zhijiang
ght need double check if I understand correctly. Wish your further feedbacks then I can adjust the docs based on it. Also welcome any other person's feedbacks! Best, Zhijiang -- 发件人:Andrey Zagrebin 发送时间:2018年12月10日(星期一) 05:18

回复:JIRA notifications

2018-11-25 Thread zhijiang
+1 -- 发件人:Maximilian Michels 发送时间:2018年11月26日(星期一) 01:51 收件人:dev 主 题:Re: JIRA notifications It seems that some people find it useful to receive JIRA mails for new issues only. The "issues" mailing list gets all JIRA notifications,

回复:[DISCUSS]Enhancing flink scheduler by implementing blacklist mechanism

2018-11-26 Thread zhijiang
. Wish this feature working in the next major release. :) Best, Zhijiang -- 发件人:Till Rohrmann 发送时间:2018年11月5日(星期一) 18:43 收件人:dev 主 题:Re: [DISCUSS]Enhancing flink scheduler by implementing blacklist mechanism Thanks for sharing

Re: Request multiple subpartitions of one partition

2019-01-09 Thread zhijiang
subpartitions as you required. Best, Zhijiang -- From:Chris Miller Send Time:2019年1月9日(星期三) 20:46 To:dev Subject:Request multiple subpartitions of one partition Hello, let's image we do a hash join of two DataSources. For the join

Re: [DISCUSS] Detection Flink Backpressure

2019-01-07 Thread zhijiang
reflecting the ratio as backpressure if not affect theperformance. Best, Zhijiang -- From:Piotr Nowojski Send Time:2019年1月4日(星期五) 17:01 To:dev Subject:Re: [DISCUSS] Detection Flink Backpressure Hi, In that case I think instead o

Re: Disable local data transportation

2019-01-13 Thread zhijiang
this behaviour, it is better to change the logic or limit in scheduler instead of network stack. Another simple way for your requirement is setting only one slot per task manager, then there would be only one task running in each task manager. Best, Zhijiang

Re: Identify the task within PartitionRequestQueue

2019-01-13 Thread zhijiang
and task name, then you can get all the created views from PartitionRequestQueue. Best, Zhijiang -- From:Chris Miller Send Time:2019年1月12日(星期六) 16:13 To:dev Subject:Identify the task within PartitionRequestQueue Hi all, I just made

回复:[DISCUSS] Unified Core API for Streaming and Batch

2018-12-03 Thread zhijiang
the unification of stream and batch firstly. Best, Zhijiang -- 发件人:孙海波 发送时间:2018年12月3日(星期一) 10:52 收件人:dev 主 题:[DISCUSS] Unified Core API for Streaming and Batch Hi all, This post proposes unified core API for Streaming and Batch. Currently

Re: [DISCUSS] Shall we make SpillableSubpartition repeatedly readable to support fine grained recovery

2019-01-24 Thread zhijiang
, then it is natural to solve the above problems based on this architecuture. You can refer to the flip [1] if interested. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-31%3A+Pluggable+Shuffle+Manager Best, Zhijiang

Re: [DISCUSS] Shall we make SpillableSubpartition repeatedly readable to support fine grained recovery

2019-01-28 Thread zhijiang
, and I think it would solve all your concerns based on this architecuture. Best, Zhijiang -- From:Bo WANG Send Time:2019年1月28日(星期一) 15:11 To:dev Cc:wangzhijiang999 ; Kurt Young Subject:Re: [DISCUSS] Shall we make

[DISCUSS] Flip-31: Pluggable Shuffle Manager

2019-01-28 Thread zhijiang
document/d/1l7yIVNH3HATP4BnjEOZFkO2CaHf1sVn_DSxS2llmkd8/edit?usp=sharing [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-31%3A+Pluggable+Shuffle+Manager [3] https://issues.apache.org/jira/browse/FLINK-10653 Best, Zhijiang

Re: [DISCUSS] Proposal of external shuffle service

2019-01-28 Thread zhijiang
component in JM side. You can regard that as a simple and special implementation version. And the YarnShuffleService can further be refactored within this proposed shuffle manager architecture. Best, Zhijiang -- From:qi luo Send

Re: [Proposal] Shuffle resources lifecycle management

2019-04-03 Thread zhijiang
further focus on them in specific PRs considering the feasibility in next 1.9 release. Best, Zhijiang -- From:Andrey Zagrebin Send Time:2019年3月29日(星期五) 18:38 To:dev Subject:[Proposal] Shuffle resources lifecycle management Hi All

Re: [DISCUSS] Releasing Flink 1.8 / Feature Freeze

2019-02-13 Thread zhijiang
it is not the blocker for the release. [1] https://issues.apache.org/jira/browse/FLINK-10745 [2] https://issues.apache.org/jira/browse/FLINK-10653 Best, Zhijiang -- From:Ufuk Celebi Send Time:2019年2月13日(星期三) 16:01 To:dev

Re: [DISCUSS] Adding a mid-term roadmap to the Flink website

2019-02-14 Thread zhijiang
of the interested one and handle the progress of it. Best, Zhijiang -- From:Jeff Zhang Send Time:2019年2月14日(星期四) 18:03 To:Stephan Ewen Cc:dev ; user ; jincheng sun ; Shuyi Chen ; Rong Rong Subject:Re: [DISCUSS] Adding a mid-term

Re: [DISCUSS] Proposal of external shuffle service

2019-01-28 Thread zhijiang
and specific process for this improvement. I am in favor of launching a separate thread for this discussion again, thanks for the advice! Best, Zhijiang -- From:Till Rohrmann Send Time:2019年1月28日(星期一) 19:14 To:dev ; zhijiang Cc:Andrey

Re: [ANNOUNCE] Apache Flink 1.8.0 released

2019-04-10 Thread zhijiang
Cool! Finally see the FLINK 1.8.0 release. Thanks Aljoscha for this excellent work and efforts for other contributors. We would continue working hard for FLINK 1.9.0 Best, Zhijiang -- From:vino yang Send Time:2019年4月10日(星期三) 17

Re: [PROGRESS-UPDATE] Redesign Flink Scheduling, introducing dedicated Scheduler Component

2019-04-15 Thread zhijiang
Thanks for sharing the latest updates for the scheduler refactoring Gary. It is really good to me and wish seeing the new interface ready soon. Best, Zhijiang -- From:Guowei Ma Send Time:2019年4月15日(星期一) 09:25 To:dev Subject:Re

Re: [DISCUSS] Releasing Flink 1.8.1

2019-05-28 Thread zhijiang
Thanks for launching this discussion Jincheng. +1 for releasing 1.8.1 and wish the following deadlock bug [1] reported by users would be coverd in this release. I could submit the fix today. [1] https://issues.apache.org/jira/browse/FLINK-12544 Best, Zhijiang

Re: [DISCUSS] Features for Apache Flink 1.9.0

2019-05-28 Thread zhijiang
Hi Gordon, Thanks for the kind reminder of feature freeze date for 1.9.0. I think the date makes sense on my side. For FLIP-31, I and Andrey could be done within two weeks or so. And I already finished my side work for FLIP-1. Best, Zhijiang

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-06-11 Thread zhijiang
components. We ever made big efforts to adjust the network behavior for this issue and still seems not very clean. Because atm if one task fails, the corresponding consumer/producer sides would also fail via network communication and releases the partition/gate completely. Best, Zhijiang

Re: [DISCUSS] Deprecate previous Python APIs

2019-06-11 Thread zhijiang
It is reasonable as stephan explained. +1 from my side! -- From:Jeff Zhang Send Time:2019年6月11日(星期二) 22:11 To:Stephan Ewen Cc:user ; dev Subject:Re: [DISCUSS] Deprecate previous Python APIs +1 Stephan Ewen 于2019年6月11日周二

Re: [ANNOUNCE] Jincheng Sun is now part of the Flink PMC

2019-06-24 Thread zhijiang
Congratulations Jincheng! Best, Zhijiang -- From:Kurt Young Send Time:2019年6月25日(星期二) 10:10 To:dev Subject:Re: [ANNOUNCE] Jincheng Sun is now part of the Flink PMC Congratulations Jincheng! Best, Kurt On Tue, Jun 25, 2019 at 9

Re: A Question About Flink Network Stack

2019-06-18 Thread zhijiang
issue. Then when the record is emmited, we select the fastest subpartition to take this record based on the current backlog size instead of previous round-robin way. Then it could bing benefits for some scenarios. Best, Zhijiang

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread zhijiang
Congratulations Rong! Best, Zhijiang -- From:Kurt Young Send Time:2019年7月11日(星期四) 22:54 To:Kostas Kloudas Cc:Jark Wu ; Fabian Hueske ; dev ; user Subject:Re: [ANNOUNCE] Rong Rong becomes a Flink committer Congratulations Rong

Re: Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread zhijiang
+1 and thanks for Chesnay' work on this. Best, Zhijiang -- From:Haibo Sun Send Time:2019年7月4日(星期四) 18:21 To:dev Cc:priv...@flink.apache.org Subject:Re:Re: [VOTE] Migrate to sponsored Travis account +1. Thank Chesnay for pushing

Re: Introducing Flink's Plugin mechanism

2019-04-10 Thread zhijiang
Thanks Piotr for proposing this new feature. The solution for class loader issue is really helpful in production, and we ofen encountered this pain point before. It might bring more possibilities based on this pluggable mechanism. Hope to see the progress soon. :) Best, Zhijiang

Re: Checkpointing under backpressure

2019-08-13 Thread zhijiang
proposed suggestion is helpful on my side, especially considering some implementation details . Best, Zhijiang -- From:Paris Carbone Send Time:2019年8月13日(星期二) 14:03 To:dev Cc:zhijiang Subject:Re: Checkpointing under backpressure

Re: Checkpointing under backpressure

2019-08-14 Thread zhijiang
queue. Actually we ever implemented this improvement in Alibaba's private branch and it was running long time in real prodcution. It indeeds speed up barrier alignment a bit if the blocked input channels have some buffers. Best, Zhijiang

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread zhijiang
Congratulations Andrey, great work and well deserved! Best, Zhijiang -- From:Till Rohrmann Send Time:2019年8月14日(星期三) 15:26 To:dev ; user Subject:[ANNOUNCE] Andrey Zagrebin becomes a Flink committer Hi everyone, I'm very happy

[DISCUSS] Integrate new SourceReader with Mailbox Model in StreamTask

2019-08-10 Thread zhijiang
/1eDpsUKv2FqwZiS1Pm6gYO5eFHScBHfULKmH1-ZEWB4g/edit [3] https://docs.google.com/document/d/13x9M7k1SRqkOFXP0bETcJemIRyJzoqGgkdy11pz5qHM/edit?usp=sharing Best, Zhijiang

Re: Checkpointing under backpressure

2019-08-12 Thread zhijiang
improvments for the release-1.10. [1] https://issues.apache.org/jira/browse/FLINK-8523 Best, Zhijiang -- From:Thomas Weise Send Time:2019年8月12日(星期一) 21:38 To:dev Subject:Checkpointing under backpressure Hi, One of the major

Re: Checkpointing under backpressure

2019-08-14 Thread zhijiang
and we only need to wait it finish. Then are there still any other problems/concerns if checkpoint takes long time to finish? Althougn we already knew some issues before, it is better to gather more user feedbacks to confirm which aspects could be solved in this feature design.

Re: CiBot Update

2019-08-22 Thread zhijiang
It is really very convenient now. Valuable work, Chesnay! Best, Zhijiang -- From:Till Rohrmann Send Time:2019年8月22日(星期四) 10:13 To:dev Subject:Re: CiBot Update Thanks for the continuous work on the CiBot Chesnay! Cheers, Till

Re: [DISCUSS] Simplify Flink's cluster level RestartStrategy configuration

2019-09-01 Thread zhijiang
. Best, Zhijiang -- From:Zhu Zhu Send Time:2019年9月2日(星期一) 05:18 To:dev Subject:Re: [DISCUSS] Simplify Flink's cluster level RestartStrategy configuration +1 to simplify the RestartStrategy configuration One thing to confirm

Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and FailureRateRestartStrategy to 1s

2019-09-04 Thread zhijiang
+1 Best, Zhijiang -- From:Jark Wu Send Time:2019年9月4日(星期三) 13:45 To:dev Subject:Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and FailureRateRestartStrategy to 1s +1 Best, Jark > 在 2019年9月4日,19:43,David Morá

Re: [VOTE] FLIP-61 Simplify Flink's cluster level RestartStrategy configuration

2019-09-04 Thread zhijiang
+1 -- From:Till Rohrmann Send Time:2019年9月4日(星期三) 13:39 To:dev Cc:Zhu Zhu Subject:Re: [VOTE] FLIP-61 Simplify Flink's cluster level RestartStrategy configuration +1 (binding) On Wed, Sep 4, 2019 at 12:39 PM Chesnay Schepler

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-11 Thread zhijiang
Congratulations Zili! -- From:Becket Qin Send Time:2019年9月12日(星期四) 03:43 To:Paul Lam Cc:Rong Rong ; dev ; user Subject:Re: [ANNOUNCE] Zili Chen becomes a Flink committer Congrats, Zili! On Thu, Sep 12, 2019 at 9:39 AM Paul Lam

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-09-17 Thread zhijiang
with ShuffleMaster to release global partitions. Then it might be better to move ShuffleMaster outside of JM, and the lifecycle of ShuffleMaster should be consistent with RM. 5. Nit: TM->TE in the section of Proposed Changes: "TMs retain global partitions for succ

Re: [DISCUSS] Features for Apache Flink 1.10

2019-09-06 Thread zhijiang
priority if possible. [1] https://issues.apache.org/jira/browse/FLINK-10745 [2] https://issues.apache.org/jira/browse/FLINK-10742 Best, Zhijiang -- From:Gary Yao Send Time:2019年9月6日(星期五) 17:06 To:dev Cc:carp84 Subject:[DISCUSS

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread zhijiang
Congratulations Klou! Best, Zhijiang -- From:Zhu Zhu Send Time:2019年9月6日(星期五) 17:19 To:dev Subject:Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC Congratulations Kostas! Thanks, Zhu Zhu Yu Li 于2019年9月6日周五 下午10:49写道

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-07-27 Thread zhijiang
. Best, Zhijiang -- From:Tzu-Li (Gordon) Tai Send Time:2019年7月27日(星期六) 10:41 To:dev Subject:Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release Hi all, It's been a while since our last update for the release testing

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread zhijiang
Congratulations Hequn! Best, Zhijiang -- From:Xuefu Z Send Time:2019年8月7日(星期三) 20:35 To:dev Subject:Re: [ANNOUNCE] Hequn becomes a Flink committer Congratulations, Hequn! On Wed, Aug 7, 2019 at 11:08 AM Yun Tang wrote

Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

2019-07-18 Thread zhijiang
Congrats Becket! Best, Zhijiang -- From:Zhu Zhu Send Time:2019年7月18日(星期四) 16:35 To:dev Subject:Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project Congratulations Becket! Xintong Song 于2019年7

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread zhijiang
Congrats Kurt! Best, Zhijiang -- From:Till Rohrmann Send Time:2019年7月23日(星期二) 21:08 To:dev Subject:Re: [ANNOUNCE] Kete Young is now part of the Flink PMC Congrats Kurt! Cheers, Till On Tue, Jul 23, 2019 at 3:00 PM Dawid

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-23 Thread zhijiang
Thanks everyone! This is definitely a honor for me. It is very pleasant to work with you guys and I would try my best to contribute to the community future. Best, Zhijiang -- From:Dawid Wysakowicz Send Time:2019年7月23日(星期二) 21:01

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-06-14 Thread zhijiang
Thanks for providing this useful guide for benefiting both contributors and committers in consistency. I just reviewed and learned the whole doc which covers a lot of information. Wish it further categoried and put onto somewhere for easily traced future. Best, Zhijiang

Re: [VOTE] FLIP-83: Flink End-to-end Performance Testing Framework

2019-11-18 Thread Zhijiang
+1 (binding)! It is a good thing to enhance our testing work. Best, Zhijiang -- From:Hequn Cheng Send Time:2019 Nov. 18 (Mon.) 18:22 To:dev Subject:Re: [VOTE] FLIP-83: Flink End-to-end Performance Testing Framework +1 (binding

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-08 Thread Zhijiang
Congratulations Jark! Best, Zhijiang -- From:bupt_ljy Send Time:2019 Nov. 8 (Fri.) 19:21 To:dev ; dev@flink.apache.org Yun Gao Subject:Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC Congratulations Jark! Best, Jiayi Liao

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Zhijiang
Congratulations Zhu Zhu! -- From:Congxian Qiu Send Time:2019 Dec. 16 (Mon.) 10:23 To:dev@flink.apache.org Subject:Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer Congrats, Zhu Zhu! Best, Congxian aihua li 于2019年12月16日周一

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Zhijiang
+1 (non-binding) Best, Zhijiang -- From:Zhu Zhu Send Time:2019 Oct. 22 (Tue.) 16:33 To:dev Subject:Re: [VOTE] Accept Stateful Functions into Apache Flink +1 (non-binding) Thanks, Zhu Zhu Biao Liu 于2019年10月22日周二 上午11:06写道

Re: [VOTE] FLINK-67: Cluster partition life-cycle

2019-10-16 Thread Zhijiang
+1 Best, Zhijiang -- From:Chesnay Schepler Send Time:2019年10月16日(星期三) 21:01 To:dev@flink.apache.org Subject:[VOTE] FLINK-67: Cluster partition life-cycle Hello, please vote for FLIP-67 <https://cwiki.apache.org/conflue

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2019-10-09 Thread zhijiang
Thanks for writing up this FLIP, Arvid! Many users would expect this feature and also +1 from my side. Best, Zhijiang -- From:Piotr Nowojski Send Time:2019年10月7日(星期一) 10:13 To:dev Subject:Re: [DISCUSS] FLIP-76: Unaligned

Re: [SURVEY] Dropping non Credit-based Flow Control

2019-10-09 Thread zhijiang
in many versions. In Alibaba we are always using the default credit-based mode in all products. It can reduce much overhead of maintaining non credit-based code path, so +1 from my side to drop it. Best, Zhijiang -- From:Piotr

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-10-11 Thread zhijiang
artitions directly not via ShuffleMaster. Even the RM could also pass the global released partitions via payloads in heartbeat with TE to reduce additional explict RPC call, but this would bring some delays for releasing partition based on heartbeat interval. Best,

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-10-13 Thread Zhijiang
conclusion. Moreover, Till's recent reply already dispels my previous concern. :) Best, Zhijiang -- From:Chesnay Schepler Send Time:2019年10月14日(星期一) 07:00 To:dev ; Till Rohrmann ; zhijiang Subject:Re: [DISCUSS] FLIP-67: Global

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-10-13 Thread Zhijiang
. Best, Zhijiang -- From:Till Rohrmann Send Time:2019年10月13日(星期日) 17:04 To:zhijiang Cc:dev Subject:Re: [DISCUSS] FLIP-67: Global partitions lifecycle I think we won't necessarily run multiple ShuffleMasters. I think it would

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-25 Thread Zhijiang
, Zhijiang -- From:Yu Li Send Time:2020 Feb. 26 (Wed.) 12:59 To:dev Subject:Re: [DISCUSS] FLIP-76: Unaligned checkpoints Hi All, Sorry for being late to the discussion. I've gone through the latest FLIP document and have below questions

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2020-02-26 Thread Zhijiang
the checkpoint duration without obvious performance regression in our previous POC testing. So the backpressure might not be the only factor to switch to the unaligned way in practice I guess. Anyway your inputs are valuable for us to make the final decision. Best, Zhijiang

Re: Flink dev blog

2020-03-04 Thread Zhijiang
Big +1 for this proposal and second Ufuk's feeling! I guess "Engine room" section in Wiki would attract lots of technical fans.:) Best, Zhijiang -- From:Yu Li Send Time:2020 Mar. 4 (Wed.) 14:42 To:dev Cc:vthinkxie

Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

2020-03-05 Thread Zhijiang
ormation and message of "This closes #", etc. Even it might cause unexpected format of long commit content description if not handled carefully in the text box. Best, Zhijiang -- From:tison Send Time:2020 Mar. 5 (Thu.) 21:3

Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

2020-03-05 Thread Zhijiang
ng to rely on it. My previously mentioned other side effects is not serious and can still work around. Best Zhijiang -- From:Dian Fu Send Time:2020 Mar. 6 (Fri.) 12:31 To:dev Subject:Re: [DISCUSS] Disable "Squash and merge&qu

Re: Flink dev blog

2020-03-05 Thread Zhijiang
Thanks for this proposal Arvid! +1 and looking forward to the wiki structure and more following blogs. Best, Zhijiang -- From:Dian Fu Send Time:2020 Mar. 5 (Thu.) 19:08 To:dev Subject:Re: Flink dev blog +1 to Arvid's proposal

Re: connection timeout during shuffle initialization

2020-02-02 Thread Zhijiang
. Let's forward the further solutions on the jira page as Piotr suggested. :) Best, Zhijiang -- From:Piotr Nowojski Send Time:2020 Jan. 30 (Thu.) 19:29 To:dev ; zhijiang Subject:Re: connection timeout during shuffle initialization

Re: [VOTE] FLIP-27 - Refactor Source Interface

2020-02-03 Thread Zhijiang
+1 (binding), we are waiting too long for it. :) Best, Zhijiang -- From:Guowei Ma Send Time:2020 Feb. 4 (Tue.) 12:34 To:dev Subject:Re: [VOTE] FLIP-27 - Refactor Source Interface +1 (non-binding), thanks for driving. Best

Re: [VOTE] Release 1.10.0, release candidate #1

2020-02-05 Thread Zhijiang
Hi Thomas, The reason of missing barrier alignment metric is found and I create the ticket [1] for tracing the progress. I guess it would be fixed soon. Thanks for reporting this. [1] https://issues.apache.org/jira/browse/FLINK-15914 Best, Zhijiang

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-02-02 Thread Zhijiang
Congratulations Yu! Best, Zhijiang -- From:lining jing Send Time:2020 Feb. 3 (Mon.) 09:52 To:dev Subject:Re: [ANNOUNCE] Yu Li became a Flink committer Congratulations Yu, well deserved. Jared Li 于2020年2月1日周六 下午12:10写道: > n

Re: [VOTE] Support Python ML Pipeline API

2020-02-14 Thread Zhijiang
+1 (binding), it is valuable to enhance the python API for supporting ML well. Best, Zhijiang -- From:Dian Fu Send Time:2020 Feb. 14 (Fri.) 15:07 To:dev Subject:Re: [VOTE] Support Python ML Pipeline API +1 (binding) Regards

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-18 Thread Zhijiang
work was always well done, and I can learn a lot from these rich experiences. +1 for the "feature freeze date" around end of April. Although we have the FF SF in the meantime, fortunately there are no long public holidays during this period in China. Best

Re: [VOTE] FLIP-98: Better Back Pressure Detection

2020-02-20 Thread Zhijiang
+1 (binding). It seems more clearly and directly to highlight the back pressured vertex in topology, which can raise the attention of users. Best, Zhijiang -- From:Congxian Qiu Send Time:2020 Feb. 20 (Thu.) 21:49 To:dev

Re: [VOTE] FLIP-75: Flink Web UI Improvement Proposal

2020-02-19 Thread Zhijiang
+1 for splitting the vote thread as @Till mentioned. I was also wondering whether need to review all the listed FLIPs before voting. If making them separately, then I am very willing to take some interested ones for vote. :) Best, Zhijiang

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-20 Thread Zhijiang
Congrats Jingsong! Welcome on board! Best, Zhijiang -- From:Zhenghua Gao Send Time:2020 Feb. 21 (Fri.) 12:49 To:godfrey he Cc:dev ; user Subject:Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer Congrats Jingsong! Best

Re: [VOTE] FLIP-101: Add Pending Slots Detail

2020-02-21 Thread Zhijiang
the respective vertex which slot is pending and the detailed slot id info. I am curious that is it feasible to do some valid analysis from logs based on the slot id? Or what's the expectation to use these infos? Best, Zhijiang -- From:Kurt

Re: [Discuss] Update the pull request description template.

2020-02-21 Thread Zhijiang
t of the users do not need to touch these sections by default , which means without implication. I guess it would save some efforts. My above concern is tiny and might not be the key motivation of this discussion. Just share my thoughts by this chance. :) Best, Zhijiang

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-15 Thread Zhijiang
+1 (non-binding) - Checked the release notes - Downloaded the source and built successfully - Verified the signature and checksum - Verified the artifacts in the Maven Central Repository Best, Zhijiang -- From:Robert Metzger Send

Re: [ANNOUNCE] New Documentation Style Guide

2020-02-15 Thread Zhijiang
ne/benefit for other writings. It also reminded me to extend the Flink glossary if necessary. Best, Zhijiang -- From:Jingsong Li Send Time:2020 Feb. 15 (Sat.) 23:21 To:dev Subject:Re: [ANNOUNCE] New Documentation Style Guide Than

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Zhijiang
Thanks Chesnay for making the release efficiently and also thanks to all the other participants! Best, Zhijiang -- From:Till Rohrmann Send Time:2020 Feb. 19 (Wed.) 22:21 To:dev Subject:Re: [ANNOUNCE] Apache Flink-shaded 10.0

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Zhijiang
Really great work and thanks everyone involved, especially for the release managers! Best, Zhijiang -- From:Kurt Young Send Time:2020 Feb. 13 (Thu.) 11:06 To:[None] Cc:user ; dev Subject:Re: [ANNOUNCE] Apache Flink 1.10.0 released

Re: [DISCUSS] Improvements on FLIP Process

2020-02-18 Thread Zhijiang
for some people who prefer to google doc or willing to provide it in some corner cases. Of course I am also happy to eliminate google doc completely. Best, Zhijiang -- From:Kostas Kloudas Send Time:2020 Feb. 18 (Tue.) 23:03 To:dev

Re: [VOTE] FLIP-92: Add N-Ary Stream Operator in Flink

2020-01-10 Thread Zhijiang
+1, it is really nice to have the N-Ary stream operator which is meaningful in some scenarios. best, Zhijiang -- From:Jingsong Li Send Time:2020 Jan. 10 (Fri.) 11:00 To:dev Subject:Re: [VOTE] FLIP-92: Add N-Ary Stream Operator

Re: [DISCUSS] Releasing Flink 1.10.1

2020-03-10 Thread Zhijiang
Thanks for driving this release, Yu! +1 on my side Best, Zhijiang -- From:Yu Li Send Time:2020 Mar. 10 (Tue.) 20:25 To:dev Subject:Re: [DISCUSS] Releasing Flink 1.10.1 Thanks for the supplement Hequn. Yes will also keep

[DISCUSS] Features of Apache Flink 1.11

2020-03-10 Thread Zhijiang
rict capacity limit for memory usage for RocksDB [48] Your release managers, Zhijiang & Piotr Nowojski [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-42%3A+Rework+Flink+Documentation [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-65%3A+New+type+inference+for+Table+API

Re: [DISCUSS] Features of Apache Flink 1.11

2020-03-11 Thread Zhijiang
Thanks for all the feedbacks @Hequn @Timo @Godfrey ! We will note your updates and adjust the feature list accordingly in the next progress announcement. Best, Zhijiang -- From:godfrey he Send Time:2020 Mar. 11 (Wed.) 17:20

Re: [DISCUSS] Link Stateful Functions from the Flink Website

2020-03-12 Thread Zhijiang
for developing it well. Best, Zhijiang -- From:Hequn Cheng Send Time:2020 Mar. 11 (Wed.) 15:36 To:dev Subject:Re: [DISCUSS] Link Stateful Functions from the Flink Website Hi, Thanks a lot for raising the discussion @Stephan. +1

Re: [VOTE] [FLIP-76] Unaligned checkpoints

2020-03-11 Thread Zhijiang
+1 (binding). As for David's concern of smaller buffers after recovery, I ever had a draft design [1] to solve this issue. You can take a look and leave comments if still have concerns. :) [1] https://docs.google.com/document/d/16_MOQymzxrKvUHXh6QFr2AAXIKt_2vPUf8vzKy4H_tU/edit Best, Zhijiang

Re: [DISCUSS] Drop Bucketing Sink

2020-03-12 Thread Zhijiang
Thanks for driving this discussion, Robert! This e2e test really fails frequently. +1 to drop bucketing sink, it is not worth paying more efforts since deprecated. Best, Zhijiang -- From:Jeff Zhang Send Time:2020 Mar. 12 (Thu

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Zhijiang
+1 for the proposal. Best, Zhijiang -- From:Robert Metzger Send Time:2020 Apr. 10 (Fri.) 02:15 To:dev Subject:Re: [DISCUSS] Creating a new repo to host Flink benchmarks +1 on creating the repo. On Thu, Apr 9, 2020 at 5:54 PM

Re: [VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Zhijiang
` in `ExecutionAttemptID`, so we do not need to further consider this issue now. +1 (binding). Best, Zhijiang -- From:Till Rohrmann Send Time:2020 Apr. 16 (Thu.) 21:39 To:dev Subject:Re: [VOTE] FLIP-118: Improve Flink’s ID system Thanks

Re: [ANNOUNCE] New Flink committer: Seth Wiesman

2020-04-07 Thread Zhijiang
Congratulations, Seth! Best, Zhijiang -- From:tison Send Time:2020 Apr. 7 (Tue.) 19:26 To:dev Subject:Re: [ANNOUNCE] New Flink committer: Seth Wiesman Congratulations, Seth! Best, tison. Yu Li 于2020年4月7日周二 下午6:57写道

  1   2   3   4   >