Re: [DISCUSS] Proposal of external shuffle service

2018-12-24 Thread zhijiang
Hi Andrey, Thanks for efficient response for the UnknownShuffleDeploymentDescriptor issue. It is reasonable for considering this special case on both ShuffleMaster and ShuffleService sides. On upstream ShuffleService side, the created ResultPartitionWriter decides whether to notify

[jira] [Created] (FLINK-11215) TaskExecutor RegistrationTimeoutException within the specified maximum registration duration 300000ms

2018-12-24 Thread Liu (JIRA)
Liu created FLINK-11215: --- Summary: TaskExecutor RegistrationTimeoutException within the specified maximum registration duration 30ms Key: FLINK-11215 URL: https://issues.apache.org/jira/browse/FLINK-11215

Apply for flink contributor permission

2018-12-24 Thread Bo WANG
Hi, everyone We would like to make contribution to JIRA(FLINK-10644). Would anyone kindly give me and my team member the contribution permission? Our JIRA id: Ryantaocer, eaglewatcher. Best regards Bo

Re: [ANNOUNCE] Apache Flink 1.7.1 released

2018-12-24 Thread jincheng sun
Thanks for being the release manager Chesnay! Thanks a lot for made this release possible! Thanks, Jincheng Chesnay Schepler 于2018年12月23日周日 上午3:34写道: > The Apache Flink community is very happy to announce the release of > Apache Flink 1.7.1, which is the first bugfix release for the Apache >

Re: [ANNOUNCE] Apache Flink 1.6.3 released

2018-12-24 Thread jincheng sun
Thanks a lot for being our release manager Gordon. Thanks a lot for made this release possible! Cheers, Jincheng Tzu-Li (Gordon) Tai 于2018年12月23日周日 下午9:35写道: > Hi, > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.6.3, which is the third bugfix release

[jira] [Created] (FLINK-11214) Support non mergable aggregates for group windows on batch table

2018-12-24 Thread Dian Fu (JIRA)
Dian Fu created FLINK-11214: --- Summary: Support non mergable aggregates for group windows on batch table Key: FLINK-11214 URL: https://issues.apache.org/jira/browse/FLINK-11214 Project: Flink

Re: [DISCUSS] Proposal of external shuffle service

2018-12-24 Thread Andrey Zagrebin
Hi Zhijiang, Thanks for considering my thoughts and concerns. Those are just suggestions for your design document. My understanding about 2.1 was initially that shuffle service is also treated as unknown in case of *UnknownShuffleDeploymentDescriptor *which is not quite true. Thinking about it

Re: [ANNOUNCE] Apache Flink 1.6.3 released

2018-12-24 Thread Till Rohrmann
Thanks a lot for being our release manager Gordon. Great job! And also a big thanks to the community for making this release possible. Cheers, Till On Mon, Dec 24, 2018 at 2:11 AM vino yang wrote: > Thanks for being the release manager Gordon. And glad to see Flink 1.6.3 > released. > > Best,

[jira] [Created] (FLINK-11213) Is there any condition that large amount of redis connection created on each TM?

2018-12-24 Thread lzh9 (JIRA)
lzh9 created FLINK-11213: Summary: Is there any condition that large amount of redis connection created on each TM? Key: FLINK-11213 URL: https://issues.apache.org/jira/browse/FLINK-11213 Project: Flink

[jira] [Created] (FLINK-11212) operator metric key can repalce operator name by operator id

2018-12-24 Thread lining (JIRA)
lining created FLINK-11212: -- Summary: operator metric key can repalce operator name by operator id Key: FLINK-11212 URL: https://issues.apache.org/jira/browse/FLINK-11212 Project: Flink Issue

Re: [DISCUSS] Proposal of external shuffle service

2018-12-24 Thread zhijiang
Hi Andrey, Thanks for further research on this topic and providing very helpful summaries. As we discussed before, I really like the idea of dividing two separate components on both JM and TM sides. 1. On JM side, the ShuffleMaster componenet created from ShuffleManager can manage and