Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Xintong Song
Congratulations Zhu Zhu~ Thank you~ Xintong Song On Mon, Dec 16, 2019 at 12:34 PM Danny Chan wrote: > Congrats Zhu Zhu! > > Best, > Danny Chan > 在 2019年12月14日 +0800 AM12:51,dev@flink.apache.org,写道: > > > > Congrats Zhu Zhu and welcome on board! >

[jira] [Created] (FLINK-15271) Add documentation about the Python environment requirements

2019-12-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-15271: --- Summary: Add documentation about the Python environment requirements Key: FLINK-15271 URL: https://issues.apache.org/jira/browse/FLINK-15271 Project: Flink Issue

[jira] [Created] (FLINK-15270) Add documentation about how to specify third-party dependencies via API for Python UDFs

2019-12-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-15270: --- Summary: Add documentation about how to specify third-party dependencies via API for Python UDFs Key: FLINK-15270 URL: https://issues.apache.org/jira/browse/FLINK-15270

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-15 Thread Danny Chan
Also -1 on separate builds. After referencing some other BigData engines for distribution[1], i didn't find strong needs to publish a separate build for just a separate Hive version, indeed there are builds for different Hadoop version. Just like Seth and Aljoscha said, we could push a

[jira] [Created] (FLINK-15269) Fix hive dialect limitation to overwrite and partition syntax

2019-12-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15269: Summary: Fix hive dialect limitation to overwrite and partition syntax Key: FLINK-15269 URL: https://issues.apache.org/jira/browse/FLINK-15269 Project: Flink

[jira] [Created] (FLINK-15268) Shaded Hadoop S3A end-to-end test fails on travis

2019-12-15 Thread Yu Li (Jira)
Yu Li created FLINK-15268: - Summary: Shaded Hadoop S3A end-to-end test fails on travis Key: FLINK-15268 URL: https://issues.apache.org/jira/browse/FLINK-15268 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-15267) Streaming SQL end-to-end test (Blink planner) fails on travis

2019-12-15 Thread Yu Li (Jira)
Yu Li created FLINK-15267: - Summary: Streaming SQL end-to-end test (Blink planner) fails on travis Key: FLINK-15267 URL: https://issues.apache.org/jira/browse/FLINK-15267 Project: Flink Issue Type:

Re: [DISCUSS] Overwrite and partition inserting support in 1.10

2019-12-15 Thread Jingsong Li
Thanks all, As your suggestion, I'd like to do: - FLIP-63: move "CREATE TABLE ... PARTITIONED BY" and "MSCK REPAIR TABLE" to further discussion chapter. - Remove hive dialect limitation for supported "INSERT OVERWRITE" and "INSERT ... PARTITION(...)". - Limit "CREATE TABLE ... PARTITIONED BY" to

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-15 Thread Jingsong Li
Thanks all for explaining. I misunderstood the original proposal. -1 to put them in our distributions +1 to have provide hive uber jars as Seth and Aljoscha advice Hive is just a connector no matter how important it is. So I totally agree that we shouldn't put them in our distributions. We can

Re: [ANNOUNCE] Weekly Community Update 2019/50

2019-12-15 Thread Hequn Cheng
Hi Konstantin, Happy holidays and thanks a lot for your great job on the updates continuously. With the updates, it is easier for us to catch up with what's going on in the community, which I think is quite helpful. I'm wondering if I can do some help and cover this during your vocation. :)

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Danny Chan
Congrats Zhu Zhu! Best, Danny Chan 在 2019年12月14日 +0800 AM12:51,dev@flink.apache.org,写道: > > Congrats Zhu Zhu and welcome on board!

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Haibo Sun
Congratulations, Zhu Zhu! Best, Haibo 在 2019-12-16 11:16:55,"Yun Tang" 写道: >Congratulations ZZ > >Best >Yun Tang > >From: Guowei Ma >Sent: Monday, December 16, 2019 11:15 >To: dev >Subject: Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer > >Congrats Zhuzhu!

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Yun Tang
Congratulations ZZ Best Yun Tang From: Guowei Ma Sent: Monday, December 16, 2019 11:15 To: dev Subject: Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer Congrats Zhuzhu! Best, Guowei Zhenghua Gao 于2019年12月16日周一 上午10:47写道: > Congrats! > > *Best Regards,* >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Yun Gao
Congratulations Zhuzhu! Best, Yun -- From:Guowei Ma Send Time:2019 Dec. 16 (Mon.) 11:16 To:dev Subject:Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer Congrats Zhuzhu! Best, Guowei Zhenghua Gao 于2019年12月16日周一

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Guowei Ma
Congrats Zhuzhu! Best, Guowei Zhenghua Gao 于2019年12月16日周一 上午10:47写道: > Congrats! > > *Best Regards,* > *Zhenghua Gao* > > > On Mon, Dec 16, 2019 at 10:36 AM Biao Liu wrote: > > > Congrats Zhu Zhu! > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Mon, 16 Dec 2019 at 10:23, Congxian Qiu >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Zhenghua Gao
Congrats! *Best Regards,* *Zhenghua Gao* On Mon, Dec 16, 2019 at 10:36 AM Biao Liu wrote: > Congrats Zhu Zhu! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Mon, 16 Dec 2019 at 10:23, Congxian Qiu wrote: > > > Congrats, Zhu Zhu! > > > > Best, > > Congxian > > > > > > aihua li 于2019年12月16日周一

Re: Worst-case optimal join processing on Streams

2019-12-15 Thread Kurt Young
Hi Laurens, Good to hear that you are interested with optimizing Flink's join strategy. If you want to learn more about the lifecycle of a query in Flink, I would recommend you to read the original design doc of Flink Table module [1], hope it helps. Best, Kurt [1]

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Biao Liu
Congrats Zhu Zhu! Thanks, Biao /'bɪ.aʊ/ On Mon, 16 Dec 2019 at 10:23, Congxian Qiu wrote: > Congrats, Zhu Zhu! > > Best, > Congxian > > > aihua li 于2019年12月16日周一 上午10:16写道: > > > Congratulations, zhuzhu! > > > > > 在 2019年12月16日,上午10:04,Jingsong Li 写道: > > > > > > Congratulations Zhu Zhu! >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Zhijiang
Congratulations Zhu Zhu! -- From:Congxian Qiu Send Time:2019 Dec. 16 (Mon.) 10:23 To:dev@flink.apache.org Subject:Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer Congrats, Zhu Zhu! Best, Congxian aihua li 于2019年12月16日周一

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Congxian Qiu
Congrats, Zhu Zhu! Best, Congxian aihua li 于2019年12月16日周一 上午10:16写道: > Congratulations, zhuzhu! > > > 在 2019年12月16日,上午10:04,Jingsong Li 写道: > > > > Congratulations Zhu Zhu! > > > > Best, > > Jingsong Lee > > > > On Mon, Dec 16, 2019 at 10:01 AM Yang Wang > wrote: > > > >> Congratulations,

Re: NPE in blink planner code gen

2019-12-15 Thread Benchao Li
Hi Jingsong, Leonard, Thanks for your response, I'll created an issue ( https://issues.apache.org/jira/browse/FLINK-15266) to track this. And further discussions can be moved to JIRA. Jingsong Li 于2019年12月16日周一 上午10:17写道: > Hi Benchao, > > Thanks for your reporting. > As Leonard said, you can

[jira] [Created] (FLINK-15266) NPE in blink planner code gen

2019-12-15 Thread Benchao Li (Jira)
Benchao Li created FLINK-15266: -- Summary: NPE in blink planner code gen Key: FLINK-15266 URL: https://issues.apache.org/jira/browse/FLINK-15266 Project: Flink Issue Type: Bug

Re: NPE in blink planner code gen

2019-12-15 Thread Jingsong Li
Hi Benchao, Thanks for your reporting. As Leonard said, you can create an issue in JIRA. We can go on discussing in JIRA. The answer is #1, Blink's behavior ensures that the job runs as much as possible without interrupting it, so null is returned here to make it possible to continue running. In

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread aihua li
Congratulations, zhuzhu! > 在 2019年12月16日,上午10:04,Jingsong Li 写道: > > Congratulations Zhu Zhu! > > Best, > Jingsong Lee > > On Mon, Dec 16, 2019 at 10:01 AM Yang Wang wrote: > >> Congratulations, Zhu Zhu! >> >> wenlong.lwl 于2019年12月16日周一 上午9:56写道: >> >>> Congratulations, Zhu Zhu! >>> >>>

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Jingsong Li
Congratulations Zhu Zhu! Best, Jingsong Lee On Mon, Dec 16, 2019 at 10:01 AM Yang Wang wrote: > Congratulations, Zhu Zhu! > > wenlong.lwl 于2019年12月16日周一 上午9:56写道: > > > Congratulations, Zhu Zhu! > > > > On Mon, 16 Dec 2019 at 09:14, Leonard Xu wrote: > > > > > Congratulations, Zhu Zhu ! ! >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread vino yang
Congratulations, Zhu Zhu! Best, Vino Yang Wang 于2019年12月16日周一 上午10:01写道: > Congratulations, Zhu Zhu! > > wenlong.lwl 于2019年12月16日周一 上午9:56写道: > > > Congratulations, Zhu Zhu! > > > > On Mon, 16 Dec 2019 at 09:14, Leonard Xu wrote: > > > > > Congratulations, Zhu Zhu ! ! > > > > > > Best, > > >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Yang Wang
Congratulations, Zhu Zhu! wenlong.lwl 于2019年12月16日周一 上午9:56写道: > Congratulations, Zhu Zhu! > > On Mon, 16 Dec 2019 at 09:14, Leonard Xu wrote: > > > Congratulations, Zhu Zhu ! ! > > > > Best, > > Leonard Xu > > > > > On Dec 16, 2019, at 07:53, Becket Qin wrote: > > > > > > Congrats, Zhu Zhu!

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread wenlong.lwl
Congratulations, Zhu Zhu! On Mon, 16 Dec 2019 at 09:14, Leonard Xu wrote: > Congratulations, Zhu Zhu ! ! > > Best, > Leonard Xu > > > On Dec 16, 2019, at 07:53, Becket Qin wrote: > > > > Congrats, Zhu Zhu! > > > > On Sun, Dec 15, 2019 at 10:26 PM Dian Fu wrote: > > > >> Congrats Zhu Zhu! > >>

Re: NPE in blink planner code gen

2019-12-15 Thread Leonard Xu
Hi, Benchao, thank you for your report. It looks egacy planner and blink planner have different behavior. Could you create an issue in https://issues.apache.org/jira/browse/FLINK ? > On Dec 15, 2019, at 16:17, Benchao Li wrote: > > hi all, > >

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Leonard Xu
Congratulations, Zhu Zhu ! ! Best, Leonard Xu > On Dec 16, 2019, at 07:53, Becket Qin wrote: > > Congrats, Zhu Zhu! > > On Sun, Dec 15, 2019 at 10:26 PM Dian Fu wrote: > >> Congrats Zhu Zhu! >> >>> 在 2019年12月15日,下午6:23,Zhu Zhu 写道: >>> >>> Thanks everyone for the warm welcome! >>> It's my

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Becket Qin
Congrats, Zhu Zhu! On Sun, Dec 15, 2019 at 10:26 PM Dian Fu wrote: > Congrats Zhu Zhu! > > > 在 2019年12月15日,下午6:23,Zhu Zhu 写道: > > > > Thanks everyone for the warm welcome! > > It's my honor and pleasure to improve Flink with all of you in the > > community! > > > > Thanks, > > Zhu Zhu > > > >

[jira] [Created] (FLINK-15265) Remove "-executor" suffix from executor names

2019-12-15 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-15265: Summary: Remove "-executor" suffix from executor names Key: FLINK-15265 URL: https://issues.apache.org/jira/browse/FLINK-15265 Project: Flink Issue

[ANNOUNCE] Weekly Community Update 2019/50

2019-12-15 Thread Konstantin Knauf
Dear community, happy to share this week's brief community digest with updates on Flink 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive setups, a couple of blog posts and a bit more. *Personal Note:* Thank you for reading these updates since I started them early this

Re: [DISCUSS] Improve documentation / tooling around security of Flink

2019-12-15 Thread Konstantin Knauf
Hi Robert, we could also add a warning (or a general "security" section) to the "production readiness checklist" in the documentation. Generally, I like d) in combination with an informative log message. Do you think this would cause a lot of friction? Cheers, Konstantin On Fri, Dec 13, 2019

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Dian Fu
Congrats Zhu Zhu! > 在 2019年12月15日,下午6:23,Zhu Zhu 写道: > > Thanks everyone for the warm welcome! > It's my honor and pleasure to improve Flink with all of you in the > community! > > Thanks, > Zhu Zhu > > Benchao Li 于2019年12月15日周日 下午3:54写道: > >> Congratulations!:) >> >> Hequn Cheng

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2019-12-15 Thread Becket Qin
Hi Dawid and Jark, I think the discussion ultimately boils down to the question that which one of the following two final states do we want? Once we make this decision, everything else can be naturally derived. *Final state 1*: Separate API for bounded / unbounded DataStream & Table. That means

[jira] [Created] (FLINK-15264) Job Manager TASK_SLOTS_TOTAL metrics does not shows the Job ID

2019-12-15 Thread xiaogang zhou (Jira)
xiaogang zhou created FLINK-15264: - Summary: Job Manager TASK_SLOTS_TOTAL metrics does not shows the Job ID Key: FLINK-15264 URL: https://issues.apache.org/jira/browse/FLINK-15264 Project: Flink

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-15 Thread Zhu Zhu
Thanks everyone for the warm welcome! It's my honor and pleasure to improve Flink with all of you in the community! Thanks, Zhu Zhu Benchao Li 于2019年12月15日周日 下午3:54写道: > Congratulations!:) > > Hequn Cheng 于2019年12月15日周日 上午11:47写道: > > > Congrats, Zhu Zhu! > > > > Best, Hequn > > > > On Sun,

[jira] [Created] (FLINK-15263) add dedicated page for HiveCatalog

2019-12-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-15263: Summary: add dedicated page for HiveCatalog Key: FLINK-15263 URL: https://issues.apache.org/jira/browse/FLINK-15263 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15262) kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset'

2019-12-15 Thread Bowen Li (Jira)
Bowen Li created FLINK-15262: Summary: kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset' Key: FLINK-15262 URL:

NPE in blink planner code gen

2019-12-15 Thread Benchao Li
hi all, We are using 1.9.0 blink planner, and find flink will throw NPE when we use the following SQL: ``` create table source { age int, id varchar }; select *case when age < 20 then cast(id as bigint) else 0 end* from source; ``` After debugging the Janino generated code, I find that