[jira] [Created] (FLINK-16953) TableEnvHiveConnectorTest is unstable on travis.

2020-04-02 Thread Xintong Song (Jira)
Xintong Song created FLINK-16953: Summary: TableEnvHiveConnectorTest is unstable on travis. Key: FLINK-16953 URL: https://issues.apache.org/jira/browse/FLINK-16953 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-120: Support conversion between PyFlink Table and Pandas DataFrame

2020-04-02 Thread jincheng sun
+1, Thanks for bring up this discussion @Dian Fu Best, Jincheng Jeff Zhang 于2020年4月1日周三 下午1:27写道: > Thanks for the reply, Dian, that make sense to me. > > Dian Fu 于2020年4月1日周三 上午11:53写道: > > > Hi Jeff, > > > > Thanks for your feedback. > > > > ArrowTableSink is a Flink sink which is

Re: [VOTE] FLIP-114: Support Python UDF in SQL Client

2020-04-02 Thread Dian Fu
+1 (binding) Regards, Dian > 在 2020年4月3日,上午11:12,Hequn Cheng 写道: > > +1 (binding) > > Best, > Hequn > > On Fri, Apr 3, 2020 at 10:20 AM jincheng sun > wrote: > >> +1(binding) >> >> Best, >> Jincheng >> >> >> >> Xingbo Huang 于2020年4月1日周三 下午5:36写道: >> >>> Hi Wei, >>> >>> +1

[jira] [Created] (FLINK-16952) Parquet file system format support filter pushdown

2020-04-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16952: Summary: Parquet file system format support filter pushdown Key: FLINK-16952 URL: https://issues.apache.org/jira/browse/FLINK-16952 Project: Flink Issue

Re: [VOTE] FLIP-119: Pipelined Region Scheduling

2020-04-02 Thread Zhijiang
+1 (binding) Best, Zhijiang -- From:Till Rohrmann Send Time:2020 Apr. 2 (Thu.) 23:09 To:dev Cc:zhuzh Subject:Re: [VOTE] FLIP-119: Pipelined Region Scheduling +1 Cheers, Till On Tue, Mar 31, 2020 at 5:52 PM Gary Yao wrote: >

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #5

2020-04-02 Thread Tzu-Li (Gordon) Tai
This RC is officially cancelled. Please visit the vote thread for the new RC6: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Apache-Flink-Stateful-Functions-Release-2-0-0-release-candidate-6-td39776.html On Fri, Apr 3, 2020 at 10:45 AM Tzu-Li (Gordon) Tai wrote: > Thanks

[VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #6

2020-04-02 Thread Tzu-Li (Gordon) Tai
Hi everyone, Please review and vote on the *release candidate #6* for the version 2.0.0 of Apache Flink Stateful Functions, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Testing Guideline** You can find here [1] a doc that we can

Re: [VOTE] FLIP-114: Support Python UDF in SQL Client

2020-04-02 Thread Hequn Cheng
+1 (binding) Best, Hequn On Fri, Apr 3, 2020 at 10:20 AM jincheng sun wrote: > +1(binding) > > Best, > Jincheng > > > > Xingbo Huang 于2020年4月1日周三 下午5:36写道: > > > Hi Wei, > > > > +1 (non-binding) > > Thanks a lot for driving this. > > > > Best, > > Xingbo > > > > Wei Zhong 于2020年3月31日周二

Re: [DISCUSS] FLIP-111: Docker image unification

2020-04-02 Thread Yang Wang
Hi Ufuk, Thanks for make the conclusion and directly point out what need to be done in FLIP-111. I agree with you that we should narrow down the scope and focus the most important and basic part about docker image unification. (1) Extend the entrypoint script in apache/flink-docker to start the

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #5

2020-04-02 Thread Tzu-Li (Gordon) Tai
Thanks everyone, all issues mentioned above are now resolved. I'll proceed to create a new RC now. On Thu, Apr 2, 2020 at 10:36 AM Tzu-Li (Gordon) Tai wrote: > Good catch @Dian, > that was because we changed some dependencies in > statefun-flink-distribution to provided scope from the previous

[jira] [Created] (FLINK-16951) Integrate parquet to file system connector

2020-04-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-16951: Summary: Integrate parquet to file system connector Key: FLINK-16951 URL: https://issues.apache.org/jira/browse/FLINK-16951 Project: Flink Issue Type:

Re: [VOTE] FLIP-114: Support Python UDF in SQL Client

2020-04-02 Thread jincheng sun
+1(binding) Best, Jincheng Xingbo Huang 于2020年4月1日周三 下午5:36写道: > Hi Wei, > > +1 (non-binding) > Thanks a lot for driving this. > > Best, > Xingbo > > Wei Zhong 于2020年3月31日周二 上午10:34写道: > > > Hi all, > > > > I would like to start the vote for FLIP-114[1] which is discussed and > > reached

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Leonard Xu
+1 (non-binding) It’s time to simplify connector properties. Best, Leonard Xu > 在 2020年4月3日,10:02,LakeShen 写道: > > +1 (non-binding) > > Benchao Li 于2020年4月3日周五 上午9:50写道: > >> +1 (non-binding) >> >> Dawid Wysakowicz 于2020年4月3日周五 上午12:33写道: >> >>> +1 >>> >>> Best, >>> >>> Dawid >>> >>>

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread LakeShen
+1 (non-binding) Benchao Li 于2020年4月3日周五 上午9:50写道: > +1 (non-binding) > > Dawid Wysakowicz 于2020年4月3日周五 上午12:33写道: > > > +1 > > > > Best, > > > > Dawid > > > > On 02/04/2020 18:28, Timo Walther wrote: > > > +1 > > > > > > Thanks, > > > Timo > > > > > > On 02.04.20 17:22, Jark Wu wrote: > > >>

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Jingsong Li
+1 Best, Jingsong Lee On Fri, Apr 3, 2020 at 9:50 AM Benchao Li wrote: > +1 (non-binding) > > Dawid Wysakowicz 于2020年4月3日周五 上午12:33写道: > > > +1 > > > > Best, > > > > Dawid > > > > On 02/04/2020 18:28, Timo Walther wrote: > > > +1 > > > > > > Thanks, > > > Timo > > > > > > On 02.04.20 17:22,

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Benchao Li
+1 (non-binding) Dawid Wysakowicz 于2020年4月3日周五 上午12:33写道: > +1 > > Best, > > Dawid > > On 02/04/2020 18:28, Timo Walther wrote: > > +1 > > > > Thanks, > > Timo > > > > On 02.04.20 17:22, Jark Wu wrote: > >> Hi all, > >> > >> I would like to start the vote for FLIP-122 [1], which is discussed

[jira] [Created] (FLINK-16950) Kafka console consumer displays uncommitted records.

2020-04-02 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16950: Summary: Kafka console consumer displays uncommitted records. Key: FLINK-16950 URL: https://issues.apache.org/jira/browse/FLINK-16950 Project: Flink Issue

[jira] [Created] (FLINK-16949) Enhance AbstractStreamOperatorTestHarness to use customized TtlTimeProvider

2020-04-02 Thread Yun Tang (Jira)
Yun Tang created FLINK-16949: Summary: Enhance AbstractStreamOperatorTestHarness to use customized TtlTimeProvider Key: FLINK-16949 URL: https://issues.apache.org/jira/browse/FLINK-16949 Project: Flink

Re: [DISCUSS] FLIP-111: Docker image unification

2020-04-02 Thread Ufuk Celebi
Hey all, thanks for the proposal and the detailed discussion. In particular, thanks to Andrey for starting this thread and to Patrick for the additional ideas in the linked Google doc. I find many of the improvements proposed during the discussion (such as the unified entrypoint in Flink, proper

[jira] [Created] (FLINK-16948) Change docs to better highlight embedded vs remote module configurations

2020-04-02 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-16948: Summary: Change docs to better highlight embedded vs remote module configurations Key: FLINK-16948 URL: https://issues.apache.org/jira/browse/FLINK-16948 Project:

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Dawid Wysakowicz
+1 Best, Dawid On 02/04/2020 18:28, Timo Walther wrote: > +1 > > Thanks, > Timo > > On 02.04.20 17:22, Jark Wu wrote: >> Hi all, >> >> I would like to start the vote for FLIP-122 [1], which is discussed and >> reached a consensus in the discussion thread [2]. >> >> The vote will be open for at

Re: [VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Timo Walther
+1 Thanks, Timo On 02.04.20 17:22, Jark Wu wrote: Hi all, I would like to start the vote for FLIP-122 [1], which is discussed and reached a consensus in the discussion thread [2]. The vote will be open for at least 72h, unless there is an objection or not enough votes. Thanks, Timo [1]

[jira] [Created] (FLINK-16947) ArtifactResolutionException: Could not transfer artifact. Entry [...] has not been leased from this poo

2020-04-02 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-16947: -- Summary: ArtifactResolutionException: Could not transfer artifact. Entry [...] has not been leased from this poo Key: FLINK-16947 URL:

[VOTE] FLIP-122: New Connector Property Keys for New Factory

2020-04-02 Thread Jark Wu
Hi all, I would like to start the vote for FLIP-122 [1], which is discussed and reached a consensus in the discussion thread [2]. The vote will be open for at least 72h, unless there is an objection or not enough votes. Thanks, Timo [1]

Re: [VOTE] FLIP-95: New TableSource and TableSink interfaces

2020-04-02 Thread Jark Wu
Hi Timo, I don't think source should work with `CatalogTableSchema`. So far, a table source doesn't need to know the logic information of computed column and watermark. IMO, we should provide a method to convert from `CatalogTableSchema` into `TableSchema` without computed columns in source

Re: Question about the ReadableConfigToConfigurationAdapter

2020-04-02 Thread Canbin Zheng
Thanks for your feedback, Till & Dawid. Dawid Wysakowicz 于2020年4月2日周四 下午11:11写道: > Hi, > > Yes this is a bug that is tracked here: > https://issues.apache.org/jira/browse/FLINK-16913. I am working on it > right now. > > You should expect a fix very soon. > > Best, > > Dawid > On 02/04/2020

Re: [ANNOUNCE] New Committers and PMC member

2020-04-02 Thread Till Rohrmann
Congratulations to all of you! Cheers, Till On Thu, Apr 2, 2020 at 7:57 AM Biao Liu wrote: > Congrats! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Thu, 2 Apr 2020 at 11:59, Yuan Mei wrote: > > > Congrats :-) > > > > On Wed, Apr 1, 2020 at 4:52 PM Stephan Ewen wrote: > > > > > Hi all! > > > > > >

Re: Configuring autolinks to Flink JIRA ticket in github repos

2020-04-02 Thread Till Rohrmann
Nice, this is a cool feature. Thanks for asking INFRA for it. Cheers, Till On Wed, Apr 1, 2020 at 6:52 PM Yun Tang wrote: > Hi community. > > I noticed that Github supports autolink reference recently [1]. This is > helpful to allow developers could open Jira ticket link from pull requests >

Re: Question about the ReadableConfigToConfigurationAdapter

2020-04-02 Thread Dawid Wysakowicz
Hi, Yes this is a bug that is tracked here: https://issues.apache.org/jira/browse/FLINK-16913. I am working on it right now. You should expect a fix very soon. Best, Dawid On 02/04/2020 17:07, Till Rohrmann wrote: > Hi Canbin, > > this looks indeed like a bug to me. I'm pulling in Dawid who

Re: [VOTE] FLIP-108: Add GPU support in Flink

2020-04-02 Thread Till Rohrmann
Thanks for driving this effort Yangze. +1 Cheers, Till On Wed, Apr 1, 2020 at 12:41 PM Canbin Zheng wrote: > Thanks Yangze for driving the initial CPU support! > +1 (non-binding) from my side. > > > Xintong Song 于2020年4月1日周三 下午6:36写道: > > > Thanks Yangze, the FLIP looks good to me. > > +1

Re: Question about the ReadableConfigToConfigurationAdapter

2020-04-02 Thread Till Rohrmann
Hi Canbin, this looks indeed like a bug to me. I'm pulling in Dawid who worked on this part and might be able to tell us more about it. If he agrees, then I would suggest to open a JIRA issue and to fix it. Cheers, Till On Wed, Apr 1, 2020 at 11:26 AM Canbin Zheng wrote: > Hi everyone, > >

Re: [VOTE] FLIP-119: Pipelined Region Scheduling

2020-04-02 Thread Till Rohrmann
+1 Cheers, Till On Tue, Mar 31, 2020 at 5:52 PM Gary Yao wrote: > Hi all, > > I would like to start the vote for FLIP-119 [1], which is discussed and > reached a consensus in the discussion thread [2]. > > The vote will be open until April 3 (72h) unless there is an objection > or not enough

[jira] [Created] (FLINK-16946) Update user documentation for job manager memory model

2020-04-02 Thread Andrey Zagrebin (Jira)
Andrey Zagrebin created FLINK-16946: --- Summary: Update user documentation for job manager memory model Key: FLINK-16946 URL: https://issues.apache.org/jira/browse/FLINK-16946 Project: Flink

Re: [DISCUSS] FLIP-111: Docker image unification

2020-04-02 Thread Patrick Lucas
Thanks Andrey for working on this, and everyone else for your feedback. This FLIP inspired me to discuss and write down some ideas I've had for a while about configuring and running Flink (especially in Docker) that go beyond the scope of this FLIP, but don't contradict what it sets out to do.

Re: [DISCUSS]FLIP-113: Support SQL and planner hints

2020-04-02 Thread Aljoscha Krettek
I think we're designing ourselves into ever more complicated corners here. Maybe we need to take a step back and reconsider. What would you think about this (somewhat) simpler proposal: - introduce a hint called CONNECTOR_OPTIONS(k=v,...). or CONNECTOR_PROPERTIES, depending on what naming we

Re: [VOTE] FLIP-95: New TableSource and TableSink interfaces

2020-04-02 Thread Timo Walther
Hi Jark, if catalogs use `CatalogTableSchema` in the future. The source would internally also work with `CatalogTableSchema`. I'm fine with cleaning up the `TableSchema` class but should a source deal with two different schema classes then? Another problem that I see is that connectors

[jira] [Created] (FLINK-16945) Execute CheckpointFailureManager.FailJobCallback directly in main thread executor

2020-04-02 Thread Biao Liu (Jira)
Biao Liu created FLINK-16945: Summary: Execute CheckpointFailureManager.FailJobCallback directly in main thread executor Key: FLINK-16945 URL: https://issues.apache.org/jira/browse/FLINK-16945 Project:

Re: [VOTE] FLIP-95: New TableSource and TableSink interfaces

2020-04-02 Thread Jark Wu
Hi Dawid, > How to express projections with TableSchema? The TableSource holds the original TableSchema (i.e. from DDL) and the pushed TableSchema represents the schema after projection. Thus the table source can compare them to figure out changed field orders or not matched types. For most

Re: [VOTE] FLIP-95: New TableSource and TableSink interfaces

2020-04-02 Thread Timo Walther
Hi Dawid, thanks for your feedback. I agree with your concerns. I also observed that TableSchema might be used at too many different places for different responsibilities. How about we introduce a helper class for `SupportsProjectionPushDown` and also `LookupTableSource#Context#getKeys()`

Re: [VOTE] FLIP-95: New TableSource and TableSink interfaces

2020-04-02 Thread Dawid Wysakowicz
Generally +1 One slight concern I have is about the |SupportsProjectionPushDown.|I don't necessarily understand how can we express projections with TableSchema. It's unclear for me what happens when a type of a field changes, fields are in a different order, when types do not match. How do we

[jira] [Created] (FLINK-16944) Compile error in. DumpCompiledPlanTest and PreviewPlanDumpTest

2020-04-02 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-16944: -- Summary: Compile error in. DumpCompiledPlanTest and PreviewPlanDumpTest Key: FLINK-16944 URL: https://issues.apache.org/jira/browse/FLINK-16944 Project: Flink

[jira] [Created] (FLINK-16943) Support adding jars in PyFlink

2020-04-02 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-16943: - Summary: Support adding jars in PyFlink Key: FLINK-16943 URL: https://issues.apache.org/jira/browse/FLINK-16943 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16942) ES 5 sink should allows users to select netty transport client

2020-04-02 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16942: Summary: ES 5 sink should allows users to select netty transport client Key: FLINK-16942 URL: https://issues.apache.org/jira/browse/FLINK-16942 Project:

[jira] [Created] (FLINK-16941) Bump netty 4.X to 4.1.44+

2020-04-02 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-16941: Summary: Bump netty 4.X to 4.1.44+ Key: FLINK-16941 URL: https://issues.apache.org/jira/browse/FLINK-16941 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-16940) Avoid creating currentRegion HashSet with manually set initialCapacity

2020-04-02 Thread Gary Yao (Jira)
Gary Yao created FLINK-16940: Summary: Avoid creating currentRegion HashSet with manually set initialCapacity Key: FLINK-16940 URL: https://issues.apache.org/jira/browse/FLINK-16940 Project: Flink

[jira] [Created] (FLINK-16939) TaskManagerMessageParameters#taskManagerIdParameter is not declared final

2020-04-02 Thread Gary Yao (Jira)
Gary Yao created FLINK-16939: Summary: TaskManagerMessageParameters#taskManagerIdParameter is not declared final Key: FLINK-16939 URL: https://issues.apache.org/jira/browse/FLINK-16939 Project: Flink

[jira] [Created] (FLINK-16938) SqlTimestamp has lag when convert long to Timestamp

2020-04-02 Thread YufeiLiu (Jira)
YufeiLiu created FLINK-16938: Summary: SqlTimestamp has lag when convert long to Timestamp Key: FLINK-16938 URL: https://issues.apache.org/jira/browse/FLINK-16938 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16936) TablEnv creation and planner execution must be in the same thread

2020-04-02 Thread Jeff Zhang (Jira)
Jeff Zhang created FLINK-16936: -- Summary: TablEnv creation and planner execution must be in the same thread Key: FLINK-16936 URL: https://issues.apache.org/jira/browse/FLINK-16936 Project: Flink

Re: [DISCUSS] Change default planner to blink planner in 1.11

2020-04-02 Thread Kurt Young
Thanks all for your feedback! I've created FLINK-16934 [1] to track this effort. @Timo I created a sub-task to this issue to track ignored test cases. Any further suggestions or feedbacks are still appreciated. [1] https://issues.apache.org/jira/browse/FLINK-16934 Best, Kurt On Thu, Apr 2,

[jira] [Created] (FLINK-16935) Open or delete ignored test cases in blink planner

2020-04-02 Thread Kurt Young (Jira)
Kurt Young created FLINK-16935: -- Summary: Open or delete ignored test cases in blink planner Key: FLINK-16935 URL: https://issues.apache.org/jira/browse/FLINK-16935 Project: Flink Issue Type:

[jira] [Created] (FLINK-16934) Change default planner to blink

2020-04-02 Thread Kurt Young (Jira)
Kurt Young created FLINK-16934: -- Summary: Change default planner to blink Key: FLINK-16934 URL: https://issues.apache.org/jira/browse/FLINK-16934 Project: Flink Issue Type: Improvement