Re: [ANNOUNCE] Weekly Community Update 2019/45

2019-11-10 Thread Bowen Li
FYI, I'll be at the ScaleByTheBay conference in Oakland on 11/14-15 to give a Flink talk (https://sched.co/RoSY). Shoot me an email if anyone is also there and would like to meet in person and talk about Flink, data, AI/ML, etc. On Sun, Nov 10, 2019 at 8:17 AM Konstantin Knauf wrote: > Dear

[jira] [Created] (FLINK-14698) Refactor the SQL CLI parser to reuse flink-sql-parser

2019-11-10 Thread Danny Chen (Jira)
Danny Chen created FLINK-14698: -- Summary: Refactor the SQL CLI parser to reuse flink-sql-parser Key: FLINK-14698 URL: https://issues.apache.org/jira/browse/FLINK-14698 Project: Flink Issue

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-10 Thread SHI Xiaogang
Congratulations, Jark. You make a great job of improving the community. Regards, Xiaogang Benchao Li 于2019年11月10日周日 下午4:14写道: > Congratulations, Jark! > > Yun Tang 于2019年11月10日 周日下午3:25写道: > > > Congratulations, Jark > > > > Best > > Yun Tang > > > > On 11/10/19, 10:40 AM, "vino yang" wrote:

[jira] [Created] (FLINK-14697) Connection timeout occurs while checkpointing

2019-11-10 Thread dmgkeke (Jira)
dmgkeke created FLINK-14697: --- Summary: Connection timeout occurs while checkpointing Key: FLINK-14697 URL: https://issues.apache.org/jira/browse/FLINK-14697 Project: Flink Issue Type: Bug

Re: [DISCUSS] Stateful Functions - Contribution Details

2019-11-10 Thread tison
I second Chesnay's opinions, which I'd like to pick up is that I highly recommend reuse existing mailing lists. We can always build a separated list when the specific community grows, but it is hard to do it in the contract direction. I don't stick to the name but vote my coin to "statefun".

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-10 Thread Danny Chan
Congrats Jark! Well deserved ! Best, Danny Chan 在 2019年11月11日 +0800 AM9:59,dev@flink.apache.org,写道: > > Congrats Jark!

[jira] [Created] (FLINK-14695) Elasticsearch 5.1.2 doesn't work on Ubuntu 18.04

2019-11-10 Thread wangxiyuan (Jira)
wangxiyuan created FLINK-14695: -- Summary: Elasticsearch 5.1.2 doesn't work on Ubuntu 18.04 Key: FLINK-14695 URL: https://issues.apache.org/jira/browse/FLINK-14695 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14696) Support precision of TimestampType in built-in SQL functions and operators

2019-11-10 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-14696: Summary: Support precision of TimestampType in built-in SQL functions and operators Key: FLINK-14696 URL: https://issues.apache.org/jira/browse/FLINK-14696 Project:

Re: [DISCUSS] Releasing Flink 1.8.3

2019-11-10 Thread jincheng sun
Thanks for all of your feedback! Hi Yang, great thanks for working on FLINK-13184 and advancing this issue, we hope that more problems can be solved in 1.8.3. Hi Hequn, glad to hear that you want to be the Release Manager of flink 1.8.3. I believe that you will be a great RM, and I am very

Re: [DISCUSS] PyFlink User-Defined Function Resource Management

2019-11-10 Thread jincheng sun
Hi all, +1, Thanks for bring up this discussion Dian! The Resource Management is very important for PyFlink UDF. So, It's great if anyone can add more comments or inputs in the design doc or feedback in ML. :) Best, Jincheng Dian Fu 于2019年11月5日周二 上午11:32写道: > Hi everyone, > > In FLIP-58[1]

[jira] [Created] (FLINK-14699) Move ClosureCleaner to flink-core

2019-11-10 Thread Zili Chen (Jira)
Zili Chen created FLINK-14699: - Summary: Move ClosureCleaner to flink-core Key: FLINK-14699 URL: https://issues.apache.org/jira/browse/FLINK-14699 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-10 Thread Zhenghua Gao
Congratulations Jark! *Best Regards,* *Zhenghua Gao* On Mon, Nov 11, 2019 at 8:54 AM SHI Xiaogang wrote: > Congratulations, Jark. > You make a great job of improving the community. > > Regards, > Xiaogang > > Benchao Li 于2019年11月10日周日 下午4:14写道: > > > Congratulations, Jark! > > > > Yun Tang

Re: [DISCUSS] Releasing Flink 1.8.3

2019-11-10 Thread Danny Chan
Thanks Hequn to be in change of the release ! Best, Danny Chan 在 2019年11月9日 +0800 PM3:59,Hequn Cheng ,写道: > Hi Jincheng, > > Thanks for kicking this discussion off! > > +1 to the 1.8.3 release as it would be nice to have these important fixes > and also two > months have passed since the last

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-10 Thread Yadong Xie
Congratulations Jark! Danny Chan 于2019年11月11日周一 上午10:41写道: > Congrats Jark! Well deserved ! > > Best, > Danny Chan > 在 2019年11月11日 +0800 AM9:59,dev@flink.apache.org,写道: > > > > Congrats Jark! >

[jira] [Created] (FLINK-14700) Consider to set the random listen port in e2e flink cluster.

2019-11-10 Thread Zheng Hu (Jira)
Zheng Hu created FLINK-14700: Summary: Consider to set the random listen port in e2e flink cluster. Key: FLINK-14700 URL: https://issues.apache.org/jira/browse/FLINK-14700 Project: Flink Issue

[jira] [Created] (FLINK-14701) Slot leaks if SharedSlotOversubscribedException happens

2019-11-10 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14701: --- Summary: Slot leaks if SharedSlotOversubscribedException happens Key: FLINK-14701 URL: https://issues.apache.org/jira/browse/FLINK-14701 Project: Flink Issue Type:

[jira] [Created] (FLINK-14702) Rewrite the tpch ( test_tpch.sh ) e2e tests by using the newly introduced java framework

2019-11-10 Thread Zheng Hu (Jira)
Zheng Hu created FLINK-14702: Summary: Rewrite the tpch ( test_tpch.sh ) e2e tests by using the newly introduced java framework Key: FLINK-14702 URL: https://issues.apache.org/jira/browse/FLINK-14702

Re: [DISCUSS] Releasing Flink 1.8.3

2019-11-10 Thread Yang Wang
Hi Jincheng, Hequn I am now working on FLINK-13184 and already attach a PR to fix this issue. I think it is important for large scale deployment on yarn(1000+ containers). It will accelerate TaskExecutor launch and reduce the pressure of hdfs. I hope it could be merge to 1.8.3. Best, Yang Yu

[jira] [Created] (FLINK-14693) python tox checks fails on travis

2019-11-10 Thread Kurt Young (Jira)
Kurt Young created FLINK-14693: -- Summary: python tox checks fails on travis Key: FLINK-14693 URL: https://issues.apache.org/jira/browse/FLINK-14693 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC

2019-11-10 Thread Benchao Li
Congratulations, Jark! Yun Tang 于2019年11月10日 周日下午3:25写道: > Congratulations, Jark > > Best > Yun Tang > > On 11/10/19, 10:40 AM, "vino yang" wrote: > > Congratulations, Jark. > > Best, > Vino > > Leonard Xu 于2019年11月8日周五 下午8:40写道: > > > Congratulations, Jark. > > Thanks

[jira] [Created] (FLINK-14694) Most tests from package o.a.f.table.planner.functions.aggfunctions are not executed during mvn test

2019-11-10 Thread Kurt Young (Jira)
Kurt Young created FLINK-14694: -- Summary: Most tests from package o.a.f.table.planner.functions.aggfunctions are not executed during mvn test Key: FLINK-14694 URL: https://issues.apache.org/jira/browse/FLINK-14694

[ANNOUNCE] Weekly Community Update 2019/45

2019-11-10 Thread Konstantin Knauf
Dear community, happy to share this week's community digest with updates on stateful functions & Flink 1.8.3, a discussion on a connector for Hortonworks/Cloudera's schema registry, a couple of meetups and a bit more. Flink Development == * [stateful functions] After the successful

Flink Read thousands of files with batch

2019-11-10 Thread Dominik Wosiński
Hey, I have a very specific use case. I have a history of records stored as Parquet in S3. I would like to read and process them with Flink. The issue is that the number of files is quite large ( >100k). If I provide the full list of files to HadoopInputFormat that I am using it will fail with