[jira] [Created] (FLINK-22316) Support MODIFY column/constraint/watermark for ALTER TABLE statement

2021-04-16 Thread Jark Wu (Jira)
Jark Wu created FLINK-22316: --- Summary: Support MODIFY column/constraint/watermark for ALTER TABLE statement Key: FLINK-22316 URL: https://issues.apache.org/jira/browse/FLINK-22316 Project: Flink

[jira] [Created] (FLINK-22315) Support ADD column/constraint/watermark for ALTER TABLE statement

2021-04-16 Thread Jark Wu (Jira)
Jark Wu created FLINK-22315: --- Summary: Support ADD column/constraint/watermark for ALTER TABLE statement Key: FLINK-22315 URL: https://issues.apache.org/jira/browse/FLINK-22315 Project: Flink

[jira] [Created] (FLINK-22314) AggRecordsCombiner should combine buffered records first instead of accumulate on state directly

2021-04-16 Thread Jark Wu (Jira)
Jark Wu created FLINK-22314: --- Summary: AggRecordsCombiner should combine buffered records first instead of accumulate on state directly Key: FLINK-22314 URL: https://issues.apache.org/jira/browse/FLINK-22314

[jira] [Created] (FLINK-22302) Restructure SQL "Queries" documentation into one page per operation

2021-04-16 Thread Jark Wu (Jira)
Jark Wu created FLINK-22302: --- Summary: Restructure SQL "Queries" documentation into one page per operation Key: FLINK-22302 URL: https://issues.apache.org/jira/browse/FLINK-22302 Proj

[jira] [Created] (FLINK-22261) Python StreamingModeDataStreamTests is failed on Azure

2021-04-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-22261: --- Summary: Python StreamingModeDataStreamTests is failed on Azure Key: FLINK-22261 URL: https://issues.apache.org/jira/browse/FLINK-22261 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22161) 'Run Mesos WordCount test' failed on Azure

2021-04-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-22161: --- Summary: 'Run Mesos WordCount test' failed on Azure Key: FLINK-22161 URL: https://issues.apache.org/jira/browse/FLINK-22161 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-22160) Test Window TVF based aggregation and TopN

2021-04-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-22160: --- Summary: Test Window TVF based aggregation and TopN Key: FLINK-22160 URL: https://issues.apache.org/jira/browse/FLINK-22160 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-22159) Add documentation for the new window TVF based operations

2021-04-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-22159: --- Summary: Add documentation for the new window TVF based operations Key: FLINK-22159 URL: https://issues.apache.org/jira/browse/FLINK-22159 Project: Flink Issue Type

[jira] [Created] (FLINK-22080) Refactor SqlClient for better testing

2021-03-31 Thread Jark Wu (Jira)
Jark Wu created FLINK-22080: --- Summary: Refactor SqlClient for better testing Key: FLINK-22080 URL: https://issues.apache.org/jira/browse/FLINK-22080 Project: Flink Issue Type: Improvement

Re: Apply external 3 days for FLINK-20387 after feature freeze

2021-03-31 Thread Jark Wu
+1 for more days for this FLIP. Changing data type is a massive work, and supporting windowing on timestamp_ltz is also a very complex job when considering DST. Would be great if we can have more days to finalize this work. Best, Jark On Thu, 1 Apr 2021 at 03:46, Timo Walther wrote: > Hi

[jira] [Created] (FLINK-22011) Support local global optimization for window aggregation in runtime

2021-03-29 Thread Jark Wu (Jira)
Jark Wu created FLINK-22011: --- Summary: Support local global optimization for window aggregation in runtime Key: FLINK-22011 URL: https://issues.apache.org/jira/browse/FLINK-22011 Project: Flink

[jira] [Created] (FLINK-21997) Add back missing jdbc.md zh docs

2021-03-26 Thread Jark Wu (Jira)
Jark Wu created FLINK-21997: --- Summary: Add back missing jdbc.md zh docs Key: FLINK-21997 URL: https://issues.apache.org/jira/browse/FLINK-21997 Project: Flink Issue Type: Task Components

[jira] [Created] (FLINK-21909) Unify API and implementation for Hive and Filesystem source connector

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21909: --- Summary: Unify API and implementation for Hive and Filesystem source connector Key: FLINK-21909 URL: https://issues.apache.org/jira/browse/FLINK-21909 Project: Flink

[jira] [Created] (FLINK-21908) Support HiveSource to emit watermarks which is extract from partition values

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21908: --- Summary: Support HiveSource to emit watermarks which is extract from partition values Key: FLINK-21908 URL: https://issues.apache.org/jira/browse/FLINK-21908 Project: Flink

[jira] [Created] (FLINK-21907) Support watermark syntax for Hive DDL dialect

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21907: --- Summary: Support watermark syntax for Hive DDL dialect Key: FLINK-21907 URL: https://issues.apache.org/jira/browse/FLINK-21907 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21906) Support computed column syntax for Hive DDL dialect

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21906: --- Summary: Support computed column syntax for Hive DDL dialect Key: FLINK-21906 URL: https://issues.apache.org/jira/browse/FLINK-21906 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-21905) Hive streaming source should use FIFO FileSplitAssigner instead of LIFO

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21905: --- Summary: Hive streaming source should use FIFO FileSplitAssigner instead of LIFO Key: FLINK-21905 URL: https://issues.apache.org/jira/browse/FLINK-21905 Project: Flink

[jira] [Created] (FLINK-21899) Introduce SOURCE_WATERMARK built-infunction to preserve watermark from source

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21899: --- Summary: Introduce SOURCE_WATERMARK built-infunction to preserve watermark from source Key: FLINK-21899 URL: https://issues.apache.org/jira/browse/FLINK-21899 Project: Flink

[jira] [Created] (FLINK-21894) Update type of HiveTablePartition#partitionSpec from Map to Map

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21894: --- Summary: Update type of HiveTablePartition#partitionSpec from Map to Map Key: FLINK-21894 URL: https://issues.apache.org/jira/browse/FLINK-21894 Project: Flink Issue

[jira] [Created] (FLINK-21892) Add documentation for the DESC statement syntax

2021-03-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21892: --- Summary: Add documentation for the DESC statement syntax Key: FLINK-21892 URL: https://issues.apache.org/jira/browse/FLINK-21892 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21881) Support local global optimization for window aggregation

2021-03-19 Thread Jark Wu (Jira)
Jark Wu created FLINK-21881: --- Summary: Support local global optimization for window aggregation Key: FLINK-21881 URL: https://issues.apache.org/jira/browse/FLINK-21881 Project: Flink Issue Type

[jira] [Created] (FLINK-21871) Support watermark for Hive and Filesystem streaming source

2021-03-19 Thread Jark Wu (Jira)
Jark Wu created FLINK-21871: --- Summary: Support watermark for Hive and Filesystem streaming source Key: FLINK-21871 URL: https://issues.apache.org/jira/browse/FLINK-21871 Project: Flink Issue Type

[jira] [Created] (FLINK-21774) Do not display column names when retrun set is emtpy in SQL Client

2021-03-13 Thread Jark Wu (Jira)
Jark Wu created FLINK-21774: --- Summary: Do not display column names when retrun set is emtpy in SQL Client Key: FLINK-21774 URL: https://issues.apache.org/jira/browse/FLINK-21774 Project: Flink

[jira] [Created] (FLINK-21741) Support SHOW JARS statement in SQL Client

2021-03-11 Thread Jark Wu (Jira)
Jark Wu created FLINK-21741: --- Summary: Support SHOW JARS statement in SQL Client Key: FLINK-21741 URL: https://issues.apache.org/jira/browse/FLINK-21741 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21742) Support REMOVE JAR statement in SQL Client

2021-03-11 Thread Jark Wu (Jira)
Jark Wu created FLINK-21742: --- Summary: Support REMOVE JAR statement in SQL Client Key: FLINK-21742 URL: https://issues.apache.org/jira/browse/FLINK-21742 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21725) DataTypeExtractor extracts wrong fields ordering for Tuple12

2021-03-10 Thread Jark Wu (Jira)
Jark Wu created FLINK-21725: --- Summary: DataTypeExtractor extracts wrong fields ordering for Tuple12 Key: FLINK-21725 URL: https://issues.apache.org/jira/browse/FLINK-21725 Project: Flink Issue

Re: [DISCUSS] FLIP-162 follow-up discussion

2021-03-09 Thread Jark Wu
Thanks Leonard, I'm also +1 with not introducing this fallback option. It's error-prone to mix the implementation of wrong behavior and correct behavior. And it's better to educate users the right way in one version instead of spanning multiple versions. Best, Jark On Tue, 9 Mar 2021 at 15:15,

[jira] [Created] (FLINK-21669) Support "table.dml-sync" option to execute DML statements synchronizely in TableEnvironment and SQL Client

2021-03-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-21669: --- Summary: Support "table.dml-sync" option to execute DML statements synchronizely in TableEnvironment and SQL Client Key: FLINK-21669 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-21664) Support STATEMENT SET syntax in TableEnvironment

2021-03-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-21664: --- Summary: Support STATEMENT SET syntax in TableEnvironment Key: FLINK-21664 URL: https://issues.apache.org/jira/browse/FLINK-21664 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21647) 'Run kubernetes session test (default input)' failed on Azure

2021-03-07 Thread Jark Wu (Jira)
Jark Wu created FLINK-21647: --- Summary: 'Run kubernetes session test (default input)' failed on Azure Key: FLINK-21647 URL: https://issues.apache.org/jira/browse/FLINK-21647 Project: Flink Issue

[jira] [Created] (FLINK-21634) ALTER TABLE statement enhancement

2021-03-05 Thread Jark Wu (Jira)
Jark Wu created FLINK-21634: --- Summary: ALTER TABLE statement enhancement Key: FLINK-21634 URL: https://issues.apache.org/jira/browse/FLINK-21634 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-21618) Introduce a new integration test framework for SQL Client

2021-03-04 Thread Jark Wu (Jira)
Jark Wu created FLINK-21618: --- Summary: Introduce a new integration test framework for SQL Client Key: FLINK-21618 URL: https://issues.apache.org/jira/browse/FLINK-21618 Project: Flink Issue Type

[jira] [Created] (FLINK-21616) Introduce a new integration test framework for SQL Client

2021-03-04 Thread Jark Wu (Jira)
Jark Wu created FLINK-21616: --- Summary: Introduce a new integration test framework for SQL Client Key: FLINK-21616 URL: https://issues.apache.org/jira/browse/FLINK-21616 Project: Flink Issue Type

[jira] [Created] (FLINK-21614) Introduce a new integration test framework for SQL Client

2021-03-04 Thread Jark Wu (Jira)
Jark Wu created FLINK-21614: --- Summary: Introduce a new integration test framework for SQL Client Key: FLINK-21614 URL: https://issues.apache.org/jira/browse/FLINK-21614 Project: Flink Issue Type

[jira] [Created] (FLINK-21615) Introduce a new integration test framework for SQL Client

2021-03-04 Thread Jark Wu (Jira)
Jark Wu created FLINK-21615: --- Summary: Introduce a new integration test framework for SQL Client Key: FLINK-21615 URL: https://issues.apache.org/jira/browse/FLINK-21615 Project: Flink Issue Type

Re: [DISCUSS] Deprecation and removal of the legacy SQL planner

2021-03-04 Thread Jark Wu
big +1 from my side. Best, Jark On Thu, 4 Mar 2021 at 20:59, Leonard Xu wrote: > +1 for the roadmap. > > Thanks Timo for driving this. > > Best, > Leonard > > > 在 2021年3月4日,20:40,Timo Walther 写道: > > > > Last call for feedback on this topic. > > > > It seems everyone agrees to finally

[jira] [Created] (FLINK-21579) Support "SHOW USER FUNCTIONS" statement

2021-03-03 Thread Jark Wu (Jira)
Jark Wu created FLINK-21579: --- Summary: Support "SHOW USER FUNCTIONS" statement Key: FLINK-21579 URL: https://issues.apache.org/jira/browse/FLINK-21579 Project: Flink Issue Type

Re: [VOTE] FLIP-162: Consistent Flink SQL time function behavior

2021-03-02 Thread Jark Wu
+1 (binding) Best, Jark On Tue, 2 Mar 2021 at 10:42, Leonard Xu wrote: > Hi all, > > I would like to start the vote for FLIP-162 [1], which has been discussed > and > reached a consensus in the discussion thread [2]. > > Please vote +1 to approve the FLIP, or -1 with a comment. > > The vote

Re: [VOTE] FLIP-163: SQL Client Improvements

2021-03-02 Thread Jark Wu
+1 to the updated FLIP. Best, Jark On Wed, 3 Mar 2021 at 10:30, Leonard Xu wrote: > +1 (non-binding) > > The updated FLIP looks well. > > Best, > Leonard > > > > 在 2021年3月2日,22:27,Shengkai Fang 写道: > > > > already updated the FLIP[2]. It seems the vote has lasted for a long > time. > >

[jira] [Created] (FLINK-21553) WindowDistinctAggregateITCase#testHopWindow_Cube is unstable

2021-03-01 Thread Jark Wu (Jira)
Jark Wu created FLINK-21553: --- Summary: WindowDistinctAggregateITCase#testHopWindow_Cube is unstable Key: FLINK-21553 URL: https://issues.apache.org/jira/browse/FLINK-21553 Project: Flink Issue

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-03-01 Thread Jark Wu
t; - benefit: clear definition. > > > >>> - drawback: Every platform needs to define its own option. Bad SQL > > > script > > > >>> portability. > > > >>> > > > >>> Just as Jark said, I think the `table.dml-sync` is a good

[jira] [Created] (FLINK-21542) Add documentation for supporting INSERT INTO specific columns

2021-03-01 Thread Jark Wu (Jira)
Jark Wu created FLINK-21542: --- Summary: Add documentation for supporting INSERT INTO specific columns Key: FLINK-21542 URL: https://issues.apache.org/jira/browse/FLINK-21542 Project: Flink Issue

Re: [DISCUSS] Splitting User support mailing list

2021-03-01 Thread Jark Wu
I also have some concerns about splitting python and sql. Because I have seen some SQL questions users reported but is related to deployment or state backend. Best, Jark On Mon, 1 Mar 2021 at 17:15, Konstantin Knauf wrote: > Hi Roman, > > I slightly +1 for a list dedicated to Statefun users,

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-23 Thread Jark Wu
>> `table.execution.mode`. Thanks for Timo's suggestions! > > >> > > >> For `SHOW CREATE TABLE`, I'm +1 with Jark's comments. We should > clarify > > the > > >> usage of the SHOW CREATE TABLE statements. It should be allowed to > > specify > > >&g

[jira] [Created] (FLINK-21456) TableResult#print() should correctly stringify values of TIMESTAMP type in SQL format

2021-02-23 Thread Jark Wu (Jira)
Jark Wu created FLINK-21456: --- Summary: TableResult#print() should correctly stringify values of TIMESTAMP type in SQL format Key: FLINK-21456 URL: https://issues.apache.org/jira/browse/FLINK-21456 Project

Re: [VOTE] FLIP-163: SQL Client Improvements

2021-02-21 Thread Jark Wu
+1 (binding) Best, Jark On Mon, 22 Feb 2021 at 11:06, Shengkai Fang wrote: > Hi devs > > It seems we have reached consensus on FLIP-163[1] in the discussion[2]. So > I'd like to start the vote for this FLIP. > > Please vote +1 to approve the FLIP, or -1 with a comment. > > The vote will be

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-15 Thread Jark Wu
> On Tue, Feb 9, 2021 at 5:39 PM Shengkai Fang > wrote: > > >> > > >>> Hi, Timo, Jark. > > >>> > > >>> I am fine with the new option name. > > >>> > > >>> Best, > > >>> Shengkai > > >>> &g

Re: [VOTE] FLIP-164: Improve Schema Handling in Catalogs

2021-02-12 Thread Jark Wu
+1 (binding) Best, Jark > 2021年2月12日 20:37,Dawid Wysakowicz 写道: > > +1 (binding) > > Best, > > Dawid > > On 12/02/2021 13:33, Timo Walther wrote: >> Hi everyone, >> >> I'd like to start a vote on FLIP-164 [1] which was discussed in [2]. >> >> The vote will be open for at least 72 hours.

Re: [DISCUSS] FLIP-164: Improve Schema Handling in Catalogs

2021-02-09 Thread Jark Wu
t; >> > > >> 2) `ComputedColumn` and `WatermarkSpec` of the new generation will > store > > >> `ResolvedExpression`. > > >> > > >> 3) I adopted most of the methods from `TableSchema` in > `ResolvedSchema`. > > >> However

Re: [DISCUSS] FLIP-164: Improve Schema Handling in Catalogs

2021-02-09 Thread Jark Wu
Hi Timo, The messy TableSchema confuses many developers. It's great to see we can finally come up with a clean interface hierarchy and still backward compatible. Thanks for preparing the nice FLIP. It looks good to me. I have some minor comments: 1) Should `ResolvedSchema#getColumn(int)`

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-09 Thread Jark Wu
I'm fine with `table.multi-dml-sync`. My previous concern about "multi" is that DML in CLI looks like single statement. But we can treat CLI as a multi-line accepting statements from opening to closing. Thus, I'm fine with `table.multi-dml-sync`. So the conclusion is `table.multi-dml-sync`

[jira] [Created] (FLINK-21327) Support window TVF in batch mode

2021-02-08 Thread Jark Wu (Jira)
Jark Wu created FLINK-21327: --- Summary: Support window TVF in batch mode Key: FLINK-21327 URL: https://issues.apache.org/jira/browse/FLINK-21327 Project: Flink Issue Type: Sub-task

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-08 Thread Jark Wu
o applies to table API. E.g. if a user > sets table.dml-async=false and calls TableEnvironment::executeSql to run a > DML, will he get sync behavior? > > On Mon, Feb 8, 2021 at 11:28 PM Jark Wu wrote: > >> Ah, I just forgot the option name. >> >> I'm also fine with

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-08 Thread Jark Wu
ould quickly discuss how we would like to name the config option > for the async/sync mode. I heared voices internally that are strongly > against calling it "detach" due to historical reasons with a Flink job > detach mode. How about `table.dml-async`? > > Thanks, > Tim

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-08 Thread Jark Wu
expect that users have > long-running jobs and prefer async execution in most cases. > > Regards, > Timo > > > On 08.02.21 14:15, Jark Wu wrote: > > Hi Timo, > > > > Actually, I'm not in favor of explicit syntax `BEGIN ASYNC;... END;`. > > Because it makes

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-08 Thread Jark Wu
ySQL. If we want to support that > in > > the future, it's a little tricky to decide whether that should be treated > > as CLI or file. > > > > I actually prefer a config option and let users decide what's the > > desirable behavior. But if we have agreed not to use options, I

Re: [VOTE] FLIP-152: Hive Query Syntax Compatibility

2021-02-07 Thread Jark Wu
Thanks for driving this. +1 Best, Jark On Mon, 8 Feb 2021 at 09:47, Kurt Young wrote: > +1 > > Best, > Kurt > > > On Sun, Feb 7, 2021 at 7:24 PM Rui Li wrote: > > > Hi everyone, > > > > I think we have reached some consensus on FLIP-152 [1] in the discussion > > thread [2]. So I'd like to

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-06 Thread Jark Wu
e statements > and close the CLI afterwards. > > Alternative 1: > - We consider batch/streaming mode and block for batch INSERT INTO and > async for streaming INSERT INTO/STATEMENT SET > > What do others think? > > Regards, > Timo > > > > > On 05.02.21

[jira] [Created] (FLINK-21305) Cumulative window should accumulate late events belonging to the cleaned slice

2021-02-05 Thread Jark Wu (Jira)
Jark Wu created FLINK-21305: --- Summary: Cumulative window should accumulate late events belonging to the cleaned slice Key: FLINK-21305 URL: https://issues.apache.org/jira/browse/FLINK-21305 Project: Flink

[jira] [Created] (FLINK-21304) Support split distinct aggregate for window TVF based aggregate

2021-02-05 Thread Jark Wu (Jira)
Jark Wu created FLINK-21304: --- Summary: Support split distinct aggregate for window TVF based aggregate Key: FLINK-21304 URL: https://issues.apache.org/jira/browse/FLINK-21304 Project: Flink Issue

[jira] [Created] (FLINK-21290) Support Projection push down for Window TVF

2021-02-04 Thread Jark Wu (Jira)
Jark Wu created FLINK-21290: --- Summary: Support Projection push down for Window TVF Key: FLINK-21290 URL: https://issues.apache.org/jira/browse/FLINK-21290 Project: Flink Issue Type: Sub-task

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-04 Thread Jark Wu
AR, SHOW JAR for Flink dialect. But we can allow DELETE JAR, LIST JAR in Hive dialect through HiveParser. 4) We don't have a conclusion for async/sync execution behavior yet. Best, Jark On Thu, 4 Feb 2021 at 17:50, Jark Wu wrote: > Hi Ingo, > > Since we have supported the WITH

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-04 Thread Jark Wu
ency I'd find it a bit surprising that > WITH handles it differently than SET, and I wonder if that could cause > friction for developers when writing their SQL. > > > Regards > Ingo > > On Thu, Feb 4, 2021 at 9:38 AM Jark Wu wrote: > > > Hi all, > > > >

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-04 Thread Jark Wu
discussion where we selected SHOW instead of LIST. But it is true that > > > JARs are not part of the catalog which is why I would not use > > > CREATE/DROP. ADD/REMOVE are commonly siblings in the English language. > > > Take a look at the Java collection API as another example. > &

[jira] [Created] (FLINK-21265) SQLClientSchemaRegistryITCase.testReading failed with DockerClientException unauthorized

2021-02-03 Thread Jark Wu (Jira)
Jark Wu created FLINK-21265: --- Summary: SQLClientSchemaRegistryITCase.testReading failed with DockerClientException unauthorized Key: FLINK-21265 URL: https://issues.apache.org/jira/browse/FLINK-21265

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-03 Thread Jark Wu
gt; > > > > > Do we also need to add these new methods (useModules, listFullModules) > > >> to TableEnvironment? > > >> > > > Yes, indeed. > > > > > > Thank you all for polishing this proposal to make it more thorough. >

[jira] [Created] (FLINK-21261) Improve digest of physical Expand node

2021-02-03 Thread Jark Wu (Jira)
Jark Wu created FLINK-21261: --- Summary: Improve digest of physical Expand node Key: FLINK-21261 URL: https://issues.apache.org/jira/browse/FLINK-21261 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-03 Thread Jark Wu
gt; > > > I did a summary on the Jira issue page [1] since the discussion has > > achieved a consensus. If there is anything missed or not corrected, > please > > let me know. > > > > [1] https://issues.apache.org/jira/browse/FLINK-21045# > > > > Best, &g

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-02 Thread Jark Wu
Hi Timo, I will respond some of the questions: 1) SQL client specific options Whether it starts with "table" or "sql-client" depends on where the configuration takes effect. If it is a table configuration, we should make clear what's the behavior when users change the configuration in the

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-02 Thread Jark Wu
simplicity. What do you think? > > Best, > Jane > > On Tue, Feb 2, 2021 at 3:53 PM Timo Walther wrote: > > > +1 > > > > @Jane Can you summarize our discussion in the JIRA issue? > > > > Thanks, > > Timo > > > > > > On 02.02.21 03

Re: [DISCUSS] FLIP-152: Hive Query Syntax Compatibility

2021-02-02 Thread Jark Wu
Thanks Rui for the great proposal, I believe this can be very attractive for many Hive users. The FLIP looks good to me in general, I only have some minor comments: 1) BlinkParserFactory IIUC, BlinkParserFactory is located in the flink-table-api-java module with the Parser interface there. I

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-02 Thread Jark Wu
ics as all other vendors > > >> > > >> > > >> _CURRENT_TIMESTAMP -- semantics per record > > >> > > >> OR > > >> > > >> SYS_CURRENT_TIMESTAMP -- semantics per record > > >> > > >> >

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-02-01 Thread Jark Wu
so I just listed them in the excel[1] > of > >>>> this > >>>>>>>>>> FLIP references. > >>>>>>>>>> > >>>>>>>>>>> 2) Shall we add aliases for the timestamp types as

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jark Wu
o adds the module to the > >> enabled list by default? > >> > >> Regards, > >> Timo > >> > >> On 01.02.21 13:52, Rui Li wrote: > >>> If `USE MODULES` implies unloading modules that are not listed, does it > >>> also imply loa

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-02-01 Thread Jark Wu
; >> Regarding #1, I also prefer `USE MODULES` syntax. It can be > interpreted > > as > > >> "setting the current order of modules", which is similar to "setting > the > > >> current catalog" for `USE CATALOG`. > > >> > >

Re: [DISCUSS] FLINK-21045: Support 'load module' and 'unload module' SQL syntax

2021-01-31 Thread Jark Wu
specify, and `USE` sounds like a > mutual-exclusive concept. > Maybe `RELOAD MODULES` can express upgrading the priority of the loaded > module(s). > > > 2. `LOAD/UNLOAD MODULE` v.s. `CREATE/DROP MODULE` syntax > Jark Wu and Nicholas Jiang proposed to use `CREATE/DRO

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Jark Wu
s/d/1T178krh9xG-WbVpN7mRVJ8bzFnaSJx3l-eg1EWZe_X4/edit?usp=sharing > > > [2] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-162%3A+Consistent+Flink+SQL+time+function+behavior > < > https://cwiki.apache.org/confluence/display/FLINK/FLIP-162:+Consistent+Flink+SQL+time

[jira] [Created] (FLINK-21191) Support reducing buffer for upsert-kafka sink

2021-01-28 Thread Jark Wu (Jira)
Jark Wu created FLINK-21191: --- Summary: Support reducing buffer for upsert-kafka sink Key: FLINK-21191 URL: https://issues.apache.org/jira/browse/FLINK-21191 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Jark Wu
> > https://docs.snowflake.com/en/sql-reference/data-types-datetime.html#timestamp-ltz-timestamp-ntz-timestamp-tz > > [2] > > https://github.com/apache/flink/blob/master/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/utils/ClassDataTypeCon

[jira] [Created] (FLINK-21176) Translate updates on Confluent Avro Format page

2021-01-27 Thread Jark Wu (Jira)
Jark Wu created FLINK-21176: --- Summary: Translate updates on Confluent Avro Format page Key: FLINK-21176 URL: https://issues.apache.org/jira/browse/FLINK-21176 Project: Flink Issue Type: Task

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-27 Thread Jark Wu
; >>>> materialize all session time information into every record. It it > the > > most > > >>>> generic data type and allows to cast to all other timestamp data > > types. > > >>>> This generic ability can be used for filter predicates as well &g

[DISCUSS] FLINK-21109: Introduce "retractAccumulators" interface for AggregateFunction in Table/SQL API

2021-01-24 Thread Jark Wu
Hi all, I would like to propose introducing a new method "retractAccumulators()" to the `AggregateFunction` in Table/SQL. *Motivation* The motivation is to improve the performance of hopping (sliding) windows. Currently, we have paned (or called sliced) optimization for the hopping windows in

[jira] [Created] (FLINK-21109) Introduce "retractAccumulators" interface for AggregateFunction in Table/SQL API

2021-01-24 Thread Jark Wu (Jira)
Jark Wu created FLINK-21109: --- Summary: Introduce "retractAccumulators" interface for AggregateFunction in Table/SQL API Key: FLINK-21109 URL: https://issues.apache.org/jira/browse/FLINK-21109

Re: [ANNOUNCE] New formatting rules are now in effect

2021-01-23 Thread Jark Wu
ss we'd be fine with not using the IntelliJ plugin. >> >> 2) The code style has not been updated yet. >> The indent choices with the google-java-format is either 2 spaces for >> everything, or 4 spaces + 8 spaces for continuations. >> In other words, 4 spaces is simply

Re: Flink Table from KeyedStream

2021-01-21 Thread Jark Wu
Hi Dom, AFAIK, Table API will apply a key partitioner based on the join key for the join operator, [id, data] and [numbeer, metadata] in your case. So the partitioner in the KeyedStreaem is not respected. Best, Jark On Thu, 21 Jan 2021 at 21:39, Dominik Wosiński wrote: > Hey, > I was

[jira] [Created] (FLINK-21069) Configuration "parallelism.default" doesn't take effect for TableEnvironment#explainSql

2021-01-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-21069: --- Summary: Configuration "parallelism.default" doesn't take effect for TableEnvironment#explainSql Key: FLINK-21069 URL: https://issues.apache.org/jira/browse/F

Re: [DISCUSS] Correct time-related function behavior in Flink SQL

2021-01-20 Thread Jark Wu
Great examples to understand the problem and the proposed changes, @Kurt! Thanks Leonard for investigating this problem. The time-zone problems around time functions and windows have bothered a lot of users. It's time to fix them! The return value changes sound reasonable to me, and keeping the

[jira] [Created] (FLINK-21054) Implement mini-batch optimized slicing window aggregate operator

2021-01-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-21054: --- Summary: Implement mini-batch optimized slicing window aggregate operator Key: FLINK-21054 URL: https://issues.apache.org/jira/browse/FLINK-21054 Project: Flink

Re: Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-19 Thread Jark Wu
Congratulations Guowei! Cheers, Jark On Wed, 20 Jan 2021 at 14:36, SHI Xiaogang wrote: > Congratulations MA! > > Regards, > Xiaogang > > Yun Tang 于2021年1月20日周三 下午2:24写道: > > > Congratulations Guowei! > > > > Best > > Yun Tang > > > > From: Yang Wang > > Sent:

[jira] [Created] (FLINK-21027) Add isKeyValueImmutable() method to KeyedStateBackend interface

2021-01-19 Thread Jark Wu (Jira)
Jark Wu created FLINK-21027: --- Summary: Add isKeyValueImmutable() method to KeyedStateBackend interface Key: FLINK-21027 URL: https://issues.apache.org/jira/browse/FLINK-21027 Project: Flink Issue

Re: [Vote] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-18 Thread Jark Wu
+1 On Tue, 19 Jan 2021 at 01:59, Till Rohrmann wrote: > +1, > > Cheers, > Till > > On Mon, Jan 18, 2021 at 4:12 PM Chesnay Schepler > wrote: > > > +1 > > On 1/18/2021 3:50 PM, Seth Wiesman wrote: > > > Addendum, 72 hours from now is Thursday the 21st :) > > > > > > sorry for the mistake. > > >

[jira] [Created] (FLINK-21005) Introduce new provider for unified Sink API and implement in planner

2021-01-17 Thread Jark Wu (Jira)
Jark Wu created FLINK-21005: --- Summary: Introduce new provider for unified Sink API and implement in planner Key: FLINK-21005 URL: https://issues.apache.org/jira/browse/FLINK-21005 Project: Flink

[jira] [Created] (FLINK-21002) Support exactly once sink for JDBC in Table SQL API

2021-01-17 Thread Jark Wu (Jira)
Jark Wu created FLINK-21002: --- Summary: Support exactly once sink for JDBC in Table SQL API Key: FLINK-21002 URL: https://issues.apache.org/jira/browse/FLINK-21002 Project: Flink Issue Type: New

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-17 Thread Jark Wu
up for a vote on > Monday. > > Seth > > On Thu, Jan 14, 2021 at 9:03 AM Seth Wiesman wrote: > > > Happy to see there is enthusiasm for this change, let me try and answers > > each of these questions. > > > > @Jark Wu Hugo has proper support for i18n which mean

Re: [DISCUSS] Planning Flink 1.13

2021-01-14 Thread Jark Wu
Thanks for starting the 1.13 release cycle and volunteering as the release managers! The feature freeze date sounds good to me. Best, Jark On Thu, 14 Jan 2021 at 18:19, Khachatryan Roman wrote: > Thanks for doing this! > > Some teams are currently doing (or already finalizing) the "usability

Re: [VOTE] Release 1.12.1, release candidate #2

2021-01-14 Thread Jark Wu
+1 - checked/verified signatures and hashes - reviewed the release pull request - started cluster for Scala 2.11, ran examples, verified web ui and log output, nothing unexpected - started cluster and SQL CLI, run some SQL queries for kafka, upsert-kafka, elasticsearch, and mysql connectors,

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-13 Thread Jark Wu
The build time sounds impressive. Could you explain more what strong internationalization features it provides? Best, Jark On Thu, 14 Jan 2021 at 01:01, Ufuk Celebi wrote: > +1 to do this. I really like what you have build and the advantages to > Jekyll seem overwhelming to me. Hugo is very

[jira] [Created] (FLINK-20952) Changelog json formats should support inherit options from JSON format

2021-01-12 Thread Jark Wu (Jira)
Jark Wu created FLINK-20952: --- Summary: Changelog json formats should support inherit options from JSON format Key: FLINK-20952 URL: https://issues.apache.org/jira/browse/FLINK-20952 Project: Flink

Re: [ANNOUNCE] Welcome Danny Cranmer as a new Apache Flink Committer

2021-01-12 Thread Jark Wu
Congratulations Danny! Best, Jark On Tue, 12 Jan 2021 at 17:59, Yangze Guo wrote: > Congrats, Danny! > > Best, > Yangze Guo > > On Tue, Jan 12, 2021 at 5:55 PM Xingbo Huang wrote: > > > > Congratulations, Danny! > > > > Best, > > Xingbo > > > > Dian Fu 于2021年1月12日周二 下午5:48写道: > > > > >

Re: Support local aggregate push down for Blink batch planner

2021-01-08 Thread Jark Wu
e too, when you have time. And I > will push forward the relevant implementation. > > Jark Wu 于2021年1月8日周五 下午12:30写道: > >> Hi Sebastian, >> >> I assigned the issue to you. But I suggest creating sub-tasks under this >> issue. Because I think this would b

<    1   2   3   4   5   6   7   8   9   10   >