Re: [DISCUSS] Set default planner for SQL Client to Blink planner in 1.10 release

2020-01-02 Thread Terry Wang
Since what blink planner can do is a superset of flink planner, big +1 for changing the default planner to Blink planner from my side. Best, Terry Wang > 2020年1月3日 15:00,Jark Wu 写道: > > Hi everyone, > > In 1.10 release, Flink SQL supports many awesome features and improvements, >

[DISCUSS] Set default planner for SQL Client to Blink planner in 1.10 release

2020-01-02 Thread Jark Wu
Hi everyone, In 1.10 release, Flink SQL supports many awesome features and improvements, including: - support watermark statement and computed column in DDL - fully support all data types in Hive - Batch SQL performance improvements (TPC-DS 7x than Hive MR) - support INSERT OVERWRITE and INSERT

[jira] [Created] (FLINK-15466) `FlinkAggregateExpandDistinctAggregatesRule` generates wrong plan for cases that have distinct aggs with filter.

2020-01-02 Thread Shuo Cheng (Jira)
Shuo Cheng created FLINK-15466: -- Summary: `FlinkAggregateExpandDistinctAggregatesRule` generates wrong plan for cases that have distinct aggs with filter. Key: FLINK-15466 URL:

Re: [DISCUSS] FLIP-91 - Support SQL Client Gateway

2020-01-02 Thread Yangze Guo
Thanks for driving this, Xiaoling! +1 for supporting SQL client gateway. Best, Yangze Guo On Thu, Jan 2, 2020 at 9:58 AM 贺小令 wrote: > > Hey everyone, > FLIP-24 > > proposes the whole conception and architecture of SQL

[jira] [Created] (FLINK-15465) Avoid failing when required memory calculation not accurate in BinaryHashTable

2020-01-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15465: Summary: Avoid failing when required memory calculation not accurate in BinaryHashTable Key: FLINK-15465 URL: https://issues.apache.org/jira/browse/FLINK-15465

Re: [VOTE] Rename terminology "Time-windowed Join" to "Interval Join" in Table API & SQL

2020-01-02 Thread Jingsong Li
+1 for this documentation change. Hope less confuse to users. Best, Jingsong Lee On Fri, Jan 3, 2020 at 12:09 PM Benchao Li wrote: > +1 > > It's good to align the terminology between Table API & SQL and DataStream. > > Jark Wu 于2020年1月3日周五 下午12:04写道: > > > Hi everyone, > > > > As we discussed

Re: [ANNOUNCE] Progress of Apache Flink 1.10 #3

2020-01-02 Thread Jingsong Li
Thanks Yu and Gary, Table and hive layer have resolved all blockers and critical issues. (38 blockers and 33 critical issues) Look forward to the first RC. Best, Jingsong Lee On Fri, Jan 3, 2020 at 11:16 AM Danny Chan wrote: > Thanks for the great work ~ > > Best, > Danny Chan > 在 2020年1月2日

[jira] [Created] (FLINK-15464) HiveTableSourceTest::testPartitionFilterDateTimestamp fails with Hive 1.x

2020-01-02 Thread Rui Li (Jira)
Rui Li created FLINK-15464: -- Summary: HiveTableSourceTest::testPartitionFilterDateTimestamp fails with Hive 1.x Key: FLINK-15464 URL: https://issues.apache.org/jira/browse/FLINK-15464 Project: Flink

[jira] [Created] (FLINK-15463) export table sql jar ,meet error: java.lang.ClassNotFoundException: org.apache.flink.calcite.shaded.com.google.protobuf.MessageOrBuilder

2020-01-02 Thread xiexinyuan (Jira)
xiexinyuan created FLINK-15463: -- Summary: export table sql jar ,meet error: java.lang.ClassNotFoundException: org.apache.flink.calcite.shaded.com.google.protobuf.MessageOrBuilder Key: FLINK-15463 URL:

Re: [VOTE] Rename terminology "Time-windowed Join" to "Interval Join" in Table API & SQL

2020-01-02 Thread Benchao Li
+1 It's good to align the terminology between Table API & SQL and DataStream. Jark Wu 于2020年1月3日周五 下午12:04写道: > Hi everyone, > > As we discussed in the mailing list[1], the current "Time-windowed Join" in > Table API & SQL is a little misleading which is not the same to "Window > Join" in

[VOTE] Rename terminology "Time-windowed Join" to "Interval Join" in Table API & SQL

2020-01-02 Thread Jark Wu
Hi everyone, As we discussed in the mailing list[1], the current "Time-windowed Join" in Table API & SQL is a little misleading which is not the same to "Window Join" in DataStream, but the same to "Interval Join" in DataStream. So I would like to start a vote to rename the terminology of

Re: [DISCUSS] Correct the terminology of "Time-windowed Join" to "Interval Join" in Table API & SQL

2020-01-02 Thread Jark Wu
Thanks all for the feedbacks. I will start a VOTE soon. Best, Jark On Mon, 23 Dec 2019 at 15:45, Jark Wu wrote: > I agree with Jingsong, we are discussing to align the "concepts", not > align the "implementations". > > For the "concepts", the "Time-windowed Join" in SQL and "Interval Join" in

[jira] [Created] (FLINK-15462) Support Prestosql JDBC source/sink

2020-01-02 Thread li yu (Jira)
li yu created FLINK-15462: - Summary: Support Prestosql JDBC source/sink Key: FLINK-15462 URL: https://issues.apache.org/jira/browse/FLINK-15462 Project: Flink Issue Type: Wish Components:

Re: [ANNOUNCE] Progress of Apache Flink 1.10 #3

2020-01-02 Thread Danny Chan
Thanks for the great work ~ Best, Danny Chan 在 2020年1月2日 +0800 PM8:48,Yu Li ,写道: > Hi community, > > It has been three weeks since we cut the release-1.10 branch and kicked off > the release testing phase [1]. Thanks to all the efforts of the community, > 46 blocker and 11 critical issues [2]

[jira] [Created] (FLINK-15461) Add Stream SQL end2end test to cover connecting to external systems

2020-01-02 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-15461: -- Summary: Add Stream SQL end2end test to cover connecting to external systems Key: FLINK-15461 URL: https://issues.apache.org/jira/browse/FLINK-15461 Project: Flink

[jira] [Created] (FLINK-15460) planner dependencies won't be necessary for JDBC connector

2020-01-02 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-15460: Summary: planner dependencies won't be necessary for JDBC connector Key: FLINK-15460 URL: https://issues.apache.org/jira/browse/FLINK-15460 Project: Flink

Re: [DISCUSS] FLIP-85: Delayed Job Graph Generation

2020-01-02 Thread Peter Huang
Hi Dian, Thanks for giving us valuable feedbacks. 1) It's better to have a whole design for this feature For the suggestion of enabling the cluster mode also session cluster, I think Flink already supported it. WebSubmissionExtension already allows users to start a job with the specified jar by

Re: [DISCUSS] FLIP-85: Delayed Job Graph Generation

2020-01-02 Thread Peter Huang
Hi Yang, I understand your point. As for Kubernates per job cluster, users only have the image path for starting the job. The user code is inaccessible. I think it is a common question for containerized deployment (For example yanr with docker image) after FLIP-73. Let's get some feedback from <

[jira] [Created] (FLINK-15459) Drop vendor specific repositories from pom.xml

2020-01-02 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15459: - Summary: Drop vendor specific repositories from pom.xml Key: FLINK-15459 URL: https://issues.apache.org/jira/browse/FLINK-15459 Project: Flink Issue Type:

Re: [DISCUSS] Drop vendor specific repositories from pom.xml

2020-01-02 Thread Till Rohrmann
Thanks for the feedback. As I haven't heard any objections, I'll open a JIRA issue and a PR to remove the vendor specific repositories. Cheers, Till On Thu, Jan 2, 2020 at 12:28 PM Aljoscha Krettek wrote: > +1 to remove > > > On 20. Dec 2019, at 10:34, Robert Metzger wrote: > > > > Okay, I

[jira] [Created] (FLINK-15458) Add whitelist for ambiguous config options

2020-01-02 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15458: Summary: Add whitelist for ambiguous config options Key: FLINK-15458 URL: https://issues.apache.org/jira/browse/FLINK-15458 Project: Flink Issue

[ANNOUNCE] Progress of Apache Flink 1.10 #3

2020-01-02 Thread Yu Li
Hi community, It has been three weeks since we cut the release-1.10 branch and kicked off the release testing phase [1]. Thanks to all the efforts of the community, 46 blocker and 11 critical issues [2] have been resolved during this period, and now we are left with only 12 blocker issues [3].

[jira] [Created] (FLINK-15457) Remove the finished TODO in the YarnEntrypointUtils

2020-01-02 Thread Yang Wang (Jira)
Yang Wang created FLINK-15457: - Summary: Remove the finished TODO in the YarnEntrypointUtils Key: FLINK-15457 URL: https://issues.apache.org/jira/browse/FLINK-15457 Project: Flink Issue Type:

Re: [DISCUSS] Drop vendor specific repositories from pom.xml

2020-01-02 Thread Aljoscha Krettek
+1 to remove > On 20. Dec 2019, at 10:34, Robert Metzger wrote: > > Okay, I understand. I'm okay with removing the profile. > > On Thu, Dec 19, 2019 at 11:34 AM Till Rohrmann wrote: > >> The profiles make bumping ZooKeeper's version a bit more cumbersome. I >> would be interested for this

Re: Error:java: 无效的标记: --add-exports=java.base/sun.net.util=ALL-UNNAMED

2020-01-02 Thread Chesnay Schepler
For future reference, this issue (and the solution) are documented here . On 30/12/2019 08:32, Jark Wu wrote: I have the same problem when upgrade my IDEA to 2019.3.1. And the Biao's solution works for me too.

Re: Watermark options for TwoInputStreamOperator

2020-01-02 Thread Victor Wong
Hi Jocean, How about assigning the control data stream with Long.MAX_VALUE as watermark? Best, Victor Jocean shi 于2019年12月25日周三 上午9:53写道: > Hi Congxian, > > It is not the same with Idling Source > > Best > Ocean > > Congxian Qiu 于2019年12月24日周二 下午4:39写道: > > > > Hi > > > > Maybe the doc[1]

[jira] [Created] (FLINK-15456) Job keeps failing on slot allocation timeout due to RM not allocating new TMs for slot requests

2020-01-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-15456: --- Summary: Job keeps failing on slot allocation timeout due to RM not allocating new TMs for slot requests Key: FLINK-15456 URL: https://issues.apache.org/jira/browse/FLINK-15456

[jira] [Created] (FLINK-15455) Enable TCP connection reuse across multiple jobs.

2020-01-02 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-15455: --- Summary: Enable TCP connection reuse across multiple jobs. Key: FLINK-15455 URL: https://issues.apache.org/jira/browse/FLINK-15455 Project: Flink Issue Type:

[jira] [Created] (FLINK-15454) ClusterEntrypoint#installSecurityContext is now unique

2020-01-02 Thread Zili Chen (Jira)
Zili Chen created FLINK-15454: - Summary: ClusterEntrypoint#installSecurityContext is now unique Key: FLINK-15454 URL: https://issues.apache.org/jira/browse/FLINK-15454 Project: Flink Issue Type: