Re: [DISCUSS] Support temporary tables in SQL API

2019-07-25 Thread Aljoscha Krettek
Thanks for pushing the discussion, Dawid! I’m also fine with option #3. Aljoscha > On 24. Jul 2019, at 12:04, Dawid Wysakowicz wrote: > > Hi all, > > Thank you Xuefu for clarifying your opinion. Now we have 3 votes for both of > the options. To conclude this discussion I am willing to change

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2019-07-25 Thread Biao Liu
Hi devs, Since 1.9 is nearly released, I think we could get back to FLIP-27. I believe it should be included in 1.10. There are so many things mentioned in document of FLIP-27. [1] I think we'd better discuss them separately. However the wiki is not a good place to discuss. I wrote google doc

[jira] [Created] (FLINK-13422) git doc file's link display correct

2019-07-25 Thread richt richt (JIRA)
richt richt created FLINK-13422: --- Summary: git doc file's link display correct Key: FLINK-13422 URL: https://issues.apache.org/jira/browse/FLINK-13422 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-13423) Unable to find aggregation function in hive 1

2019-07-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-13423: -- Summary: Unable to find aggregation function in hive 1 Key: FLINK-13423 URL: https://issues.apache.org/jira/browse/FLINK-13423 Project: Flink Issue Type:

[jira] [Created] (FLINK-13420) Supported hive versions are hard coded

2019-07-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-13420: -- Summary: Supported hive versions are hard coded Key: FLINK-13420 URL: https://issues.apache.org/jira/browse/FLINK-13420 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-13421) Unexpected ConcurrentModificationException when RM notify JM about allocation failure

2019-07-25 Thread Zhu Zhu (JIRA)
Zhu Zhu created FLINK-13421: --- Summary: Unexpected ConcurrentModificationException when RM notify JM about allocation failure Key: FLINK-13421 URL: https://issues.apache.org/jira/browse/FLINK-13421 Project:

[jira] [Created] (FLINK-13424) HiveCatalog should add hive version in conf

2019-07-25 Thread Rui Li (JIRA)
Rui Li created FLINK-13424: -- Summary: HiveCatalog should add hive version in conf Key: FLINK-13424 URL: https://issues.apache.org/jira/browse/FLINK-13424 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13418) Avoid InfluxdbReporter to report uncessray tags

2019-07-25 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13418: Summary: Avoid InfluxdbReporter to report uncessray tags Key: FLINK-13418 URL: https://issues.apache.org/jira/browse/FLINK-13418 Project: Flink Issue Type:

[jira] [Created] (FLINK-13417) Bump Zookeeper to 3.5.5

2019-07-25 Thread Konstantin Knauf (JIRA)
Konstantin Knauf created FLINK-13417: Summary: Bump Zookeeper to 3.5.5 Key: FLINK-13417 URL: https://issues.apache.org/jira/browse/FLINK-13417 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-13416) Refactor documentation of CLI option for yarn cluster mode

2019-07-25 Thread vinoyang (JIRA)
vinoyang created FLINK-13416: Summary: Refactor documentation of CLI option for yarn cluster mode Key: FLINK-13416 URL: https://issues.apache.org/jira/browse/FLINK-13416 Project: Flink Issue

[jira] [Created] (FLINK-13419) TableEnvironment.explain() has side-effects on ExecutionConfig

2019-07-25 Thread Timo Walther (JIRA)
Timo Walther created FLINK-13419: Summary: TableEnvironment.explain() has side-effects on ExecutionConfig Key: FLINK-13419 URL: https://issues.apache.org/jira/browse/FLINK-13419 Project: Flink

[jira] [Created] (FLINK-13426) TaskExecutor uses the wrong Registrationid in the heartbeat with RM.

2019-07-25 Thread Guowei Ma (JIRA)
Guowei Ma created FLINK-13426: - Summary: TaskExecutor uses the wrong Registrationid in the heartbeat with RM. Key: FLINK-13426 URL: https://issues.apache.org/jira/browse/FLINK-13426 Project: Flink

Re: Probing of simple repartition hash join

2019-07-25 Thread Benjamin Burkhardt
Hi, while doing a join, a MutableHashTable is created and filled while building. After building it is closed and the probing can begin. I would like to start probing while building the hash table still runs. (ignoring the fact that this would lead to join misses...) Anyone having an idea how

[jira] [Created] (FLINK-13425) Table api sqlUpdate execute case when expression occur data error

2019-07-25 Thread pingle wang (JIRA)
pingle wang created FLINK-13425: --- Summary: Table api sqlUpdate execute case when expression occur data error Key: FLINK-13425 URL: https://issues.apache.org/jira/browse/FLINK-13425 Project: Flink

[jira] [Created] (FLINK-13427) HiveCatalog's createFunction not work when function name is upper

2019-07-25 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13427: Summary: HiveCatalog's createFunction not work when function name is upper Key: FLINK-13427 URL: https://issues.apache.org/jira/browse/FLINK-13427 Project: Flink

[jira] [Created] (FLINK-13428) StreamingFileSink allow part file name to be configurable

2019-07-25 Thread Joao Boto (JIRA)
Joao Boto created FLINK-13428: - Summary: StreamingFileSink allow part file name to be configurable Key: FLINK-13428 URL: https://issues.apache.org/jira/browse/FLINK-13428 Project: Flink Issue

[jira] [Created] (FLINK-13429) SQL Client end-to-end test fails on Travis

2019-07-25 Thread Timo Walther (JIRA)
Timo Walther created FLINK-13429: Summary: SQL Client end-to-end test fails on Travis Key: FLINK-13429 URL: https://issues.apache.org/jira/browse/FLINK-13429 Project: Flink Issue Type: Bug

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-25 Thread Robert Metzger
The mailing list has been created, you can now subscribe to it. On Wed, Jul 24, 2019 at 1:43 PM Jark Wu wrote: > Thanks Robert for helping out that. > > Best, > Jark > > On Wed, 24 Jul 2019 at 19:16, Robert Metzger wrote: > > > I've requested the creation of the list, and made Jark, Chesnay

[jira] [Created] (FLINK-13430) Configure sending travis build notifications to bui...@flink.apache.org

2019-07-25 Thread Jark Wu (JIRA)
Jark Wu created FLINK-13430: --- Summary: Configure sending travis build notifications to bui...@flink.apache.org Key: FLINK-13430 URL: https://issues.apache.org/jira/browse/FLINK-13430 Project: Flink

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2019-07-25 Thread Stephan Ewen
Hi Biao! Thanks for reviving this. I would like to join this discussion, but am quite occupied with the 1.9 release, so can we maybe pause this discussion for a week or so? In the meantime I can share some suggestion based on prior experiments: How to do watermarks / timestamp extractors in a

Re: Probing of simple repartition hash join

2019-07-25 Thread Stephan Ewen
Hi! The join implementations used for the DataSet API and for the Blink Planner are quite intricate. They make use of these custom memory segments, to operate as much as possible on bytes, to control JVM memory utilization and to save serialization costs. That makes the implementation super

REST API / JarRunHandler: More flexibility for launching jobs

2019-07-25 Thread Thomas Weise
Hi, While considering different options to launch Beam jobs through the Flink REST API, I noticed that the implementation of JarRunHandler places quite a few restrictions on how the entry point shall construct a Flink job, by extracting and manipulating the job graph. That's normally not a

Fine Grained Recovery / FLIP-1

2019-07-25 Thread Thomas Weise
Hi, We are using Flink for streaming and find the "stop-the-world" recovery behavior of Flink prohibitive for use cases that prioritize availability. Partial recovery as outlined in FLIP-1 would probably alleviate these concerns.

Re: Fine Grained Recovery / FLIP-1

2019-07-25 Thread Guowei Ma
Hi, 1. Currently, much work in FLINK-4256 is about failover improvements in the bouded dataset scenario. 2. For the streaming scenario, a new shuffle plugin + proper failover strategy could avoid the "stop-the-word" recovery. 3. We have already done many works about the new shuffle in the old