[jira] [Created] (FLINK-21238) Support to close PythonFunctionFactory manually

2021-02-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-21238: --- Summary: Support to close PythonFunctionFactory manually Key: FLINK-21238 URL: https://issues.apache.org/jira/browse/FLINK-21238 Project: Flink Issue Type:

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Timo Walther
+1 @Jane Can you summarize our discussion in the JIRA issue? Thanks, Timo On 02.02.21 03:50, Jark Wu wrote: Hi Timo, Another question is whether a LOAD operation also adds the module to the enabled list by default? I would like to add the module to the enabled list by default, the main

[jira] [Created] (FLINK-21237) Reflects the actual running state of the job

2021-02-01 Thread liuzhuo (Jira)
liuzhuo created FLINK-21237: --- Summary: Reflects the actual running state of the job Key: FLINK-21237 URL: https://issues.apache.org/jira/browse/FLINK-21237 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-21236) Don't explicitly use HeapMemorySegment in row format serde

2021-02-01 Thread Kurt Young (Jira)
Kurt Young created FLINK-21236: -- Summary: Don't explicitly use HeapMemorySegment in row format serde Key: FLINK-21236 URL: https://issues.apache.org/jira/browse/FLINK-21236 Project: Flink Issue

[jira] [Created] (FLINK-21235) leaderChange_withBlockingJobManagerTermination_doesNotAffectNewLeader hang

2021-02-01 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21235: - Summary: leaderChange_withBlockingJobManagerTermination_doesNotAffectNewLeader hang Key: FLINK-21235 URL: https://issues.apache.org/jira/browse/FLINK-21235 Project: Flink

[jira] [Created] (FLINK-21234) testKafkaSourceSinkWithKeyAndPartialValue[legacy = false, format = csv] hang

2021-02-01 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21234: - Summary: testKafkaSourceSinkWithKeyAndPartialValue[legacy = false, format = csv] hang Key: FLINK-21234 URL: https://issues.apache.org/jira/browse/FLINK-21234 Project:

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Jingsong Li
+1 for the default "auto" to the "table.exec.time-function-evaluation". >From the definition of these functions, in my opinion: - Batch is the instant execution of all records, which is the meaning of the word "BATCH", so there is only one time at query-start. - Stream only executes a single

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-01 Thread Jingsong Li
Thanks for the proposal, yes, sql-client is too outdated. +1 for improving it. About "SET" and "RESET", Why not be "SET" and "UNSET"? Best, Jingsong On Mon, Feb 1, 2021 at 2:46 PM Rui Li wrote: > Thanks Shengkai for the update! The proposed changes look good to me. > > On Fri, Jan 29, 2021

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Jark Wu
Hi Leonard, Timo, I just did some investigation and found all the other batch processing systems evaluate the time functions at query-start, including Snowflake, Hive, Spark, Trino. I'm wondering whether the default 'per-record' mode will still be weird for batch users. I know we proposed the

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jark Wu
Hi Timo, > Another question is whether a LOAD operation also adds the module to the enabled list by default? I would like to add the module to the enabled list by default, the main reasons are: 1) Reordering is an advanced requirement, adding modules needs additional USE statements with "core"

[jira] [Created] (FLINK-21233) Race condition in CheckpointCoordinator in finishing sync savepoint

2021-02-01 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21233: - Summary: Race condition in CheckpointCoordinator in finishing sync savepoint Key: FLINK-21233 URL: https://issues.apache.org/jira/browse/FLINK-21233

Re: [DISCUSS] Support obtaining Hive delegation tokens when submitting application to Yarn

2021-02-01 Thread Jack W
Hi Rui, I agree with you that we can implement puggable DT providers firstly, I have created a new ticket to track it: https://issues.apache.org/jira/browse/FLINK-21232. Spark’s HadoopDelegationTokenManager could run on both client and driver(Application master) sides. On the client side,

Re: [Announce] Documentation Freeze Feb 2nd

2021-02-01 Thread Seth Wiesman
Reminder On Thu, Jan 28, 2021 at 9:07 AM Seth Wiesman wrote: > Hi Everyone, > > As part of migrating the flink documentation to Hugo, I need to ask the > community for a short documentation freeze. This will keep us from losing > any contributions during the migration. I am proposing the

[jira] [Created] (FLINK-21232) Introduce pluggable Hadoop delegation token providers

2021-02-01 Thread jackwangcs (Jira)
jackwangcs created FLINK-21232: -- Summary: Introduce pluggable Hadoop delegation token providers Key: FLINK-21232 URL: https://issues.apache.org/jira/browse/FLINK-21232 Project: Flink Issue

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Timo Walther
Not the module itself but the ModuleManager should handle this case, yes. Regards, Timo On 01.02.21 17:35, Jane Chan wrote: +1 to Jark's proposal To make it clearer, will `module#getFunctionDefinition()` return empty suppose the module is loaded but not enabled? Best, Jane On Mon, Feb

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jane Chan
+1 to Jark's proposal To make it clearer, will `module#getFunctionDefinition()` return empty suppose the module is loaded but not enabled? Best, Jane On Mon, Feb 1, 2021 at 10:02 PM Timo Walther wrote: > +1 to Jark's proposal > > I like the difference between just loading and actually

[jira] [Created] (FLINK-21231) add "SHOW VIEWS" to SQL client

2021-02-01 Thread tim yu (Jira)
tim yu created FLINK-21231: -- Summary: add "SHOW VIEWS" to SQL client Key: FLINK-21231 URL: https://issues.apache.org/jira/browse/FLINK-21231 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Timo Walther
Hi Leonard, thanks for considering this issue as well. +1 for the proposed config option. Let's start a voting thread once the FLIP document has been updated if there are no other concerns? Thanks, Timo On 01.02.21 15:07, Leonard Xu wrote: Hi, all I’ve discussed with @Timo @Jark about

[jira] [Created] (FLINK-21230) Add protobuf wrapper types for the StateFun SDK types.

2021-02-01 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21230: Summary: Add protobuf wrapper types for the StateFun SDK types. Key: FLINK-21230 URL: https://issues.apache.org/jira/browse/FLINK-21230 Project: Flink Issue

[jira] [Created] (FLINK-21229) Support ssl connection with schema registry format

2021-02-01 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21229: Summary: Support ssl connection with schema registry format Key: FLINK-21229 URL: https://issues.apache.org/jira/browse/FLINK-21229 Project: Flink

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Leonard Xu
Hi, all I’ve discussed with @Timo @Jark about the time function evaluation further. We reach a consensus that we’d better address the time function evaluation(function value materialization) in this FLIP as well. We’re fine with introducing an option table.exec.time-function-evaluation to

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Timo Walther
+1 to Jark's proposal I like the difference between just loading and actually enabling these modules. @Rui: I would use the same behavior as catalogs here. You cannot `USE` a catalog without creating it before. Another question is whether a LOAD operation also adds the module to the

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Rui Li
If `USE MODULES` implies unloading modules that are not listed, does it also imply loading modules that are not previously loaded, especially since we're mapping modules by name now? On Mon, Feb 1, 2021 at 8:20 PM Jark Wu wrote: > I agree with Timo that the USE implies the specified modules are

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jark Wu
I agree with Timo that the USE implies the specified modules are in use in the specified order and others are not used. This would be easier to know what's the result list and order after the USE statement. That means: if current modules in order are x, y, z. And `USE MODULES z, y` means current

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jane Chan
Hi Timo, thanks for the discussion. It seems to reach an agreement regarding #3 that <1> Module name should better be a simple identifier rather than a string literal. <2> Property `type` is redundant and should be removed, and mapping will rely on the module name because loading a module

[jira] [Created] (FLINK-21228) [Kinesis][Producer] Deadlock in KinesisProducer

2021-02-01 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-21228: - Summary: [Kinesis][Producer] Deadlock in KinesisProducer Key: FLINK-21228 URL: https://issues.apache.org/jira/browse/FLINK-21228 Project: Flink Issue

[jira] [Created] (FLINK-21227) Fixed: Upgrade Version com.google.protobuf:protoc:3.5.1:exe to 3.7.0 for (power)ppc64le support

2021-02-01 Thread Bivas (Jira)
Bivas created FLINK-21227: - Summary: Fixed: Upgrade Version com.google.protobuf:protoc:3.5.1:exe to 3.7.0 for (power)ppc64le support Key: FLINK-21227 URL: https://issues.apache.org/jira/browse/FLINK-21227

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Timo Walther
IMHO I would rather unload the not mentioned modules. The statement expresses `USE` that implicilty implies that the other modules are "not used". What do others think? Regards, Timo On 01.02.21 11:28, Jane Chan wrote: Hi Jark and Rui, Thanks for the discussions. Regarding #1, I'm fine

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jane Chan
Hi Jark and Rui, Thanks for the discussions. Regarding #1, I'm fine with `USE MODULES` syntax, and > It can be interpreted as "setting the current order of modules", which is > similar to "setting the current catalog" for `USE CATALOG`. > I would like to confirm that the unmentioned modules

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Timo Walther
Parts of the FLIP can already be implemented without a completed voting, e.g. there is no doubt that we should support TIME(9). However, I don't see a benefit of reworking the time functions to rework them again later. If we lock the time on query-start the implementation of the previsouly

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Timo Walther
Thanks for starting the discussion Jane. I'm fine with using `USE` for reordering the modules. I agree with Jark to not use a string literal for the module name but an identifer. However, to simplify the design I would completely remove the `type=` property because having multiple ways of

[jira] [Created] (FLINK-21226) Reintroduce TableColumn.of for backwards compatibility

2021-02-01 Thread Timo Walther (Jira)
Timo Walther created FLINK-21226: Summary: Reintroduce TableColumn.of for backwards compatibility Key: FLINK-21226 URL: https://issues.apache.org/jira/browse/FLINK-21226 Project: Flink Issue

Re: [VOTE] FLIP-160: Declarative scheduler

2021-02-01 Thread Matthias Pohl
+1 (non-binding) Thanks, Matthias On Mon, Feb 1, 2021 at 4:22 AM Zhu Zhu wrote: > +1 (binding) > > Thanks, > Zhu > > Yang Wang 于2021年2月1日周一 上午11:04写道: > > > +1 (non-binding) > > > > Best, > > Yang > > > > Yangze Guo 于2021年2月1日周一 上午9:50写道: > > > > > +1 (non-binding) > > > > > > Best, > > >

Re: [VOTE] FLIP-159: Reactive Mode

2021-02-01 Thread Matthias Pohl
Thanks Robert and congratulations on your first FLIP. +1 (non-binding) Matthias On Mon, Feb 1, 2021 at 4:22 AM Zhu Zhu wrote: > +1 (binding) > > Thanks, > Zhu > > Till Rohrmann 于2021年1月29日周五 下午10:23写道: > > > LGTM. Thanks for the work Robert! > > > > +1 (binding) > > > > Cheers, > > Till > > >

[jira] [Created] (FLINK-21225) OverConvertRule does not consider distinct

2021-02-01 Thread Timo Walther (Jira)
Timo Walther created FLINK-21225: Summary: OverConvertRule does not consider distinct Key: FLINK-21225 URL: https://issues.apache.org/jira/browse/FLINK-21225 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Rui Li
Thanks Jane for starting the discussion. Regarding #1, I also prefer `USE MODULES` syntax. It can be interpreted as "setting the current order of modules", which is similar to "setting the current catalog" for `USE CATALOG`. Regarding #3, I'm fine to map modules purely by name because I think it

Re: [ANNOUNCE] Apache Flink 1.10.3 released

2021-02-01 Thread Matthias Pohl
Yes, thanks for taking over the release! Best, Matthias On Mon, Feb 1, 2021 at 5:04 AM Zhu Zhu wrote: > Thanks Xintong for being the release manager and everyone who helped with > the release! > > Cheers, > Zhu > > Dian Fu 于2021年1月29日周五 下午5:56写道: > >> Thanks Xintong for driving this release!