[jira] [Created] (FLINK-13072) RocksDBStateBachend is not thread safe and data loss silently

2019-07-02 Thread lynn1.zhang (JIRA)
lynn1.zhang created FLINK-13072: --- Summary: RocksDBStateBachend is not thread safe and data loss silently Key: FLINK-13072 URL: https://issues.apache.org/jira/browse/FLINK-13072 Project: Flink

[jira] [Created] (FLINK-13069) HiveTableSink should implement OverwritableTableSink

2019-07-02 Thread Rui Li (JIRA)
Rui Li created FLINK-13069: -- Summary: HiveTableSink should implement OverwritableTableSink Key: FLINK-13069 URL: https://issues.apache.org/jira/browse/FLINK-13069 Project: Flink Issue Type:

[jira] [Created] (FLINK-13068) HiveTableSink should implement PartitionableTableSink

2019-07-02 Thread Rui Li (JIRA)
Rui Li created FLINK-13068: -- Summary: HiveTableSink should implement PartitionableTableSink Key: FLINK-13068 URL: https://issues.apache.org/jira/browse/FLINK-13068 Project: Flink Issue Type:

[jira] [Created] (FLINK-13070) Remove TableImpl and use api.internal.TableImpl in blink

2019-07-02 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-13070: Summary: Remove TableImpl and use api.internal.TableImpl in blink Key: FLINK-13070 URL: https://issues.apache.org/jira/browse/FLINK-13070 Project: Flink

Re: [DISCUSS] solve unstable build capacity problem on TravisCI

2019-07-02 Thread Bowen Li
I responded in the INFRA ticket [1] that I believe they are using a wrong metric against Flink and the total build time is a completely different thing than guaranteed build capacity. My response: "As mentioned above, since I started to pay attention to Flink's build queue a few tens of days

[jira] [Created] (FLINK-13071) QueryOperationConverter in Blink planner support add kinds of QueryOperations.

2019-07-02 Thread Jing Zhang (JIRA)
Jing Zhang created FLINK-13071: -- Summary: QueryOperationConverter in Blink planner support add kinds of QueryOperations. Key: FLINK-13071 URL: https://issues.apache.org/jira/browse/FLINK-13071 Project:

[jira] [Created] (FLINK-13061) Support set hive table Ser/de properites in HiveCatalog

2019-07-02 Thread zjuwangg (JIRA)
zjuwangg created FLINK-13061: Summary: Support set hive table Ser/de properites in HiveCatalog Key: FLINK-13061 URL: https://issues.apache.org/jira/browse/FLINK-13061 Project: Flink Issue Type:

[jira] [Created] (FLINK-13062) Set ScheduleMode based on boundedness of streaming Pipeline

2019-07-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-13062: Summary: Set ScheduleMode based on boundedness of streaming Pipeline Key: FLINK-13062 URL: https://issues.apache.org/jira/browse/FLINK-13062 Project: Flink

[jira] [Created] (FLINK-13064) Add Python Table API to Table Api Walkthrough

2019-07-02 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-13064: Summary: Add Python Table API to Table Api Walkthrough Key: FLINK-13064 URL: https://issues.apache.org/jira/browse/FLINK-13064 Project: Flink Issue Type:

[jira] [Created] (FLINK-13065) Document example snippet correction using KeySelector

2019-07-02 Thread Mans Singh (JIRA)
Mans Singh created FLINK-13065: -- Summary: Document example snippet correction using KeySelector Key: FLINK-13065 URL: https://issues.apache.org/jira/browse/FLINK-13065 Project: Flink Issue

[jira] [Created] (FLINK-13066) append hive-site.xml to path defined in 'hive-conf-dir'

2019-07-02 Thread Bowen Li (JIRA)
Bowen Li created FLINK-13066: Summary: append hive-site.xml to path defined in 'hive-conf-dir' Key: FLINK-13066 URL: https://issues.apache.org/jira/browse/FLINK-13066 Project: Flink Issue Type:

[ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread jincheng sun
Hi, The Apache Flink community is very happy to announce the release of Apache Flink 1.8.1, which is the first bugfix release for the Apache Flink 1.8 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread jincheng sun
I've also tweeted about it from my twitter: https://twitter.com/sunjincheng121/status/1146236834344648704 later would be tweeted it from @ApacheFlink! Best, Jincheng Hequn Cheng 于2019年7月3日周三 上午9:48写道: > Thanks for being the release manager and the great work Jincheng! > Also thanks to Gorden

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread Dian Fu
Awesome! Thanks a lot for being the release manager. Great job! @Jincheng Regards, Dian > 在 2019年7月3日,上午10:08,jincheng sun 写道: > > I've also tweeted about it from my twitter: > https://twitter.com/sunjincheng121/status/1146236834344648704 >

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread Tzu-Li (Gordon) Tai
Thanks for being the release manager @jincheng sun :) On Wed, Jul 3, 2019 at 10:16 AM Dian Fu wrote: > Awesome! Thanks a lot for being the release manager. Great job! @Jincheng > > Regards, > Dian > > 在 2019年7月3日,上午10:08,jincheng sun 写道: > > I've also tweeted about it from my twitter: >

[jira] [Created] (FLINK-13067) Fix broken links to contributing docs

2019-07-02 Thread Yun Tang (JIRA)
Yun Tang created FLINK-13067: Summary: Fix broken links to contributing docs Key: FLINK-13067 URL: https://issues.apache.org/jira/browse/FLINK-13067 Project: Flink Issue Type: Bug

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
Hi JingsongLee, Thanks a lot for your feedback. It's nice discussing with you guys :-) My comments below: 1. Sorry I did not clearly state the experimental environment. The evaluations were performed on a cluster with 21 N42 nodes (64 core, 256 GB memory, 10 Gb/s network card). I will add such

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread Hequn Cheng
Thanks for being the release manager and the great work Jincheng! Also thanks to Gorden and the community making this release possible! Best, Hequn On Wed, Jul 3, 2019 at 9:40 AM jincheng sun wrote: > Hi, > > The Apache Flink community is very happy to announce the release of Apache > Flink

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread Kurt Young
Thanks for being the release manager and great job! @Jincheng Best, Kurt On Wed, Jul 3, 2019 at 10:19 AM Tzu-Li (Gordon) Tai wrote: > Thanks for being the release manager @jincheng sun > :) > > On Wed, Jul 3, 2019 at 10:16 AM Dian Fu wrote: > >> Awesome! Thanks a lot for being the release

Re: [ANNOUNCE] Apache Flink 1.8.1 released

2019-07-02 Thread Jark Wu
Thanks for being the release manager and the great job! Cheers, Jark On Wed, 3 Jul 2019 at 10:16, Dian Fu wrote: > Awesome! Thanks a lot for being the release manager. Great job! @Jincheng > > Regards, > Dian > > 在 2019年7月3日,上午10:08,jincheng sun 写道: > > I've also tweeted about it from my

[DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
Hi all, We have opened an issue about vectorization in Flink (FLINK-13053 ). Would you please give your valuable feedback? Thank you in advance. Vectorization is a popular technique in SQL engines today. Compared with traditional row-based

Re: [DISCUSS] solve unstable build capacity problem on TravisCI

2019-07-02 Thread Chesnay Schepler
As a short-term stopgap, since we can assume this issue to become much worse in the following days/weeks, we could disable IT cases in PRs and only run them on master. On 02/07/2019 12:03, Chesnay Schepler wrote: People really have to stop thinking that just because something works for us it

[jira] [Created] (FLINK-13057) Correct comments in ListState class

2019-07-02 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-13057: --- Summary: Correct comments in ListState class Key: FLINK-13057 URL: https://issues.apache.org/jira/browse/FLINK-13057 Project: Flink Issue Type: Bug

Re: RE: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-07-02 Thread vino yang
Hi all, In the past, I have tried to further refine the design of this topic thread and wrote a design document to give more detailed design images and text description, so that it is more conducive to discussion.[1] Note: The document is not yet completed, for example, the "Implementation"

Re: [DISCUSS] solve unstable build capacity problem on TravisCI

2019-07-02 Thread Chesnay Schepler
People really have to stop thinking that just because something works for us it is also a good solution. Also, please remember that our builds run for 2h from start to finish, and not the 14 _minutes_ it takes for zeppelin. We are dealing with an entirely different scale here, both in terms of

[jira] [Created] (FLINK-13058) Avoid memory copy for the trimming operations of BinaryString

2019-07-02 Thread Liya Fan (JIRA)
Liya Fan created FLINK-13058: Summary: Avoid memory copy for the trimming operations of BinaryString Key: FLINK-13058 URL: https://issues.apache.org/jira/browse/FLINK-13058 Project: Flink Issue

[jira] [Created] (FLINK-13056) Optimize region failover performance on calculating vertices to restart

2019-07-02 Thread Zhu Zhu (JIRA)
Zhu Zhu created FLINK-13056: --- Summary: Optimize region failover performance on calculating vertices to restart Key: FLINK-13056 URL: https://issues.apache.org/jira/browse/FLINK-13056 Project: Flink

[jira] [Created] (FLINK-13059) Cassandra Connector leaks Semaphore on Exception; hangs on close

2019-07-02 Thread Mads Chr. Olesen (JIRA)
Mads Chr. Olesen created FLINK-13059: Summary: Cassandra Connector leaks Semaphore on Exception; hangs on close Key: FLINK-13059 URL: https://issues.apache.org/jira/browse/FLINK-13059 Project:

[jira] [Created] (FLINK-13060) FailoverStrategies should respect restart constraints

2019-07-02 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-13060: Summary: FailoverStrategies should respect restart constraints Key: FLINK-13060 URL: https://issues.apache.org/jira/browse/FLINK-13060 Project: Flink

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread JingsongLee
Thank liya for bringing this discussion. As the changes are very big and has a great impact on architecture. I think we should be more clear about the benchmark. We need to be cautious about testing to ensure that we really benefit from it. About the benchmark: 1.Can you make the test report

[jira] [Created] (FLINK-13055) Leverage JM side partition state to improve region failover experience

2019-07-02 Thread Zhu Zhu (JIRA)
Zhu Zhu created FLINK-13055: --- Summary: Leverage JM side partition state to improve region failover experience Key: FLINK-13055 URL: https://issues.apache.org/jira/browse/FLINK-13055 Project: Flink

[jira] [Created] (FLINK-13053) Vectorization Support in Flink

2019-07-02 Thread Liya Fan (JIRA)
Liya Fan created FLINK-13053: Summary: Vectorization Support in Flink Key: FLINK-13053 URL: https://issues.apache.org/jira/browse/FLINK-13053 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Jeff Zhang
Hi Liya, Displaying image is not supported in apache mail list, you need to put it elsewhere and post link in mail list. Fan Liya 于2019年7月2日周二 下午3:40写道: > Performance chart. FYI. > > Best, > Liya Fan > [image: image.png] > > On Tue, Jul 2, 2019 at 3:37 PM Fan Liya wrote: > >> Hi all, >> >>

[jira] [Created] (FLINK-13051) Drop the non-selectable two-input StreamTask and Processor

2019-07-02 Thread Haibo Sun (JIRA)
Haibo Sun created FLINK-13051: - Summary: Drop the non-selectable two-input StreamTask and Processor Key: FLINK-13051 URL: https://issues.apache.org/jira/browse/FLINK-13051 Project: Flink Issue

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
@Ji Liu, thanks a lot for your feedback. This work must be performed in a progressive manner, so as not to break existing code. Best, Liya Fan On Tue, Jul 2, 2019 at 3:57 PM Ji Liu wrote: > Hi Liya, > Thanks for opening this discuss. > +1 for this, vectorization makes sense for Flink

[jira] [Created] (FLINK-13054) [Java] Support compact fixed-width vectors

2019-07-02 Thread Ji Liu (JIRA)
Ji Liu created FLINK-13054: -- Summary: [Java] Support compact fixed-width vectors Key: FLINK-13054 URL: https://issues.apache.org/jira/browse/FLINK-13054 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-13052) Supporting multi-topic when using kafkaTableSourceSinkFactoryBase.createStreamTableSource

2019-07-02 Thread chaiyongqiang (JIRA)
chaiyongqiang created FLINK-13052: - Summary: Supporting multi-topic when using kafkaTableSourceSinkFactoryBase.createStreamTableSource Key: FLINK-13052 URL: https://issues.apache.org/jira/browse/FLINK-13052

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
@Jeff Zhang, thanks for your kind reminder. The image can be found from our proposal or the JIRA . Best, Liya Fan On Tue, Jul 2, 2019

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Ji Liu
Hi Liya, Thanks for opening this discuss. +1 for this, vectorization makes sense for Flink especially for batch work loads, I think Flink should look into supporting it progressively. Thanks, Ji Liu -- From:Jeff Zhang Send

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
Performance chart. FYI. Best, Liya Fan [image: image.png] On Tue, Jul 2, 2019 at 3:37 PM Fan Liya wrote: > Hi all, > > We have opened an issue about vectorization in Flink (FLINK-13053 > ). Would you please > give your valuable feedback? Thank

[jira] [Created] (FLINK-13063) AsyncWaitOperator can loose data during checkpointing

2019-07-02 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-13063: -- Summary: AsyncWaitOperator can loose data during checkpointing Key: FLINK-13063 URL: https://issues.apache.org/jira/browse/FLINK-13063 Project: Flink