[jira] [Created] (FLINK-31194) ntroduces savepoint mechanism of Table Store

2023-02-22 Thread Nicholas Jiang (Jira)
Nicholas Jiang created FLINK-31194: -- Summary: ntroduces savepoint mechanism of Table Store Key: FLINK-31194 URL: https://issues.apache.org/jira/browse/FLINK-31194 Project: Flink Issue Type:

[jira] [Created] (FLINK-31193) The option `table.exec.hive.native-agg-function.enabled` should work at job level when using it in SqlClient side

2023-02-22 Thread dalongliu (Jira)
dalongliu created FLINK-31193: - Summary: The option `table.exec.hive.native-agg-function.enabled` should work at job level when using it in SqlClient side Key: FLINK-31193 URL:

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread Shammon FY
Hi kui Thanks for your answer and +1 to yuxia too > we should not bind the watermark-related options to a connector to ensure semantic clarity. In my opinion, adding watermark-related options to a connector is much more clear. Currently users can define simple watermark strategy in DDL, adding

[jira] [Created] (FLINK-31192) dataGen takes too long to initialize under sequence

2023-02-22 Thread xzw0223 (Jira)
xzw0223 created FLINK-31192: --- Summary: dataGen takes too long to initialize under sequence Key: FLINK-31192 URL: https://issues.apache.org/jira/browse/FLINK-31192 Project: Flink Issue Type:

[jira] [Created] (FLINK-31191) VectorIndexer should check whether doublesByColumn is null before snapshot

2023-02-22 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-31191: - Summary: VectorIndexer should check whether doublesByColumn is null before snapshot Key: FLINK-31191 URL: https://issues.apache.org/jira/browse/FLINK-31191

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Ran Tao
Hi Jingsong. thanks. i got it. In this way, there is no need to introduce new API changes. Best Regards, Ran Tao Jingsong Li 于2023年2月23日周四 12:26写道: > Hi Ran, > > I mean we can just use > TableEnvironment.getCatalog(getCurrentCatalog).get().listDatabases(). > > We don't need to provide new

[jira] [Created] (FLINK-31190) Supports Spark call procedure command on Table Store

2023-02-22 Thread Nicholas Jiang (Jira)
Nicholas Jiang created FLINK-31190: -- Summary: Supports Spark call procedure command on Table Store Key: FLINK-31190 URL: https://issues.apache.org/jira/browse/FLINK-31190 Project: Flink

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Jingsong Li
Hi Ran, I mean we can just use TableEnvironment.getCatalog(getCurrentCatalog).get().listDatabases(). We don't need to provide new apis just for utils. Best, Jingsong On Thu, Feb 23, 2023 at 12:11 PM Ran Tao wrote: > > Hi Jingsong, thanks. > > The implementation of these statements in

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Ran Tao
Hi Jingsong, thanks. The implementation of these statements in TableEnvironmentImpl is called through the catalog api. but it does support some new override methods on the catalog api side, and I will update it later. Thank you. e.g. TableEnvironmentImpl @Override public String[]

RE: Re: Re: [discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Zhongpu Chen
Hi Jing, Prettier is a versatile formatting tools with very limited options for markdown files. If we need to specify the rules, I think other tools, such as markdownlint [1], can be a better choice. As for markdownlint, we can specify many kinds of rules. Here is an example for `unordered

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Jingsong Li
Thanks for the proposal. +1 for the proposal. I am confused about "Proposed TableEnvironment SQL API Changes", can we just use catalog api for this requirement? Best, Jingsong On Thu, Feb 23, 2023 at 10:48 AM Jacky Lau wrote: > > Hi Ran: > Thanks for driving the FLIP. the google doc looks

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Ran Tao
thanks Jing. there is a small mistake.useLike it means whether to enable like. e.g. SHOW TABLES from cat1.db1 not like 't%' // useLike is true, notLike is true SHOW TABLES from cat1.db1 like 't%' // useLike is true, notLike is false useLike both are true. I have updated the flip for this.

[jira] [Created] (FLINK-31189) Allow ignore less frequent values in StringIndexer

2023-02-22 Thread Fan Hong (Jira)
Fan Hong created FLINK-31189: Summary: Allow ignore less frequent values in StringIndexer Key: FLINK-31189 URL: https://issues.apache.org/jira/browse/FLINK-31189 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread Jingsong Li
Thanks for your proposal. +1 to yuxia, consider watermark-related hints as option hints. Personally, I am cautious about adding SQL syntax, WATERMARK_PARAMS is also SQL syntax to some extent. We can use OPTIONS to meet this requirement if possible. Best, Jingsong On Thu, Feb 23, 2023 at 10:41

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Jacky Lau
Hi Ran: Thanks for driving the FLIP. the google doc looks really good. it is important to improve user interactive experience. +1 to support this feature. Jing Ge 于2023年2月23日周四 00:51写道: > Hi Ran, > > Thanks for driving the FLIP. It looks overall good. Would you like to add > a description of

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread yuxia
Hi, Yuan Kui. Thanks for driving it. IMO, the 'OPTIONS' hint may be not only specific to the connector options. Just as a reference, we also have `sink.parallelism`[1] as a connector options. It enables user to specific the writer's parallelism dynamically per-query. Personally, I perfer to

[jira] [Created] (FLINK-31188) Expose kubernetes scheduler configOption when running flink on kubernetes

2023-02-22 Thread Kelu Tao (Jira)
Kelu Tao created FLINK-31188: Summary: Expose kubernetes scheduler configOption when running flink on kubernetes Key: FLINK-31188 URL: https://issues.apache.org/jira/browse/FLINK-31188 Project: Flink

Re: Re: [discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Jing Ge
Hi Zhongpu, Thanks for the clarification. Prettier looks fine for formatting mk files. Is there any way to validate rules like e.g. only using '*' for listing items in the CI pipeline? Best regards, Jing On Wed, Feb 22, 2023 at 2:28 PM Zhongpu Chen wrote: > Hi Jing, > > Sorry for the last

[jira] [Created] (FLINK-31187) Standalone HA mode does not work if dynamic properties are supplied

2023-02-22 Thread Mate Czagany (Jira)
Mate Czagany created FLINK-31187: Summary: Standalone HA mode does not work if dynamic properties are supplied Key: FLINK-31187 URL: https://issues.apache.org/jira/browse/FLINK-31187 Project: Flink

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Jing Ge
Hi Ran, Thanks for driving the FLIP. It looks overall good. Would you like to add a description of useLike and notLike? I guess useLike true is for "LIKE" and notLike true is for "NOT LIKE" but I am not sure if I understood it correctly. Furthermore, does it make sense to support "ILIKE" too?

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-22 Thread Andrey Redko
Congrats Sergey! Well deserved!!! Best Regards, Andriy Redko On Wed, Feb 22, 2023, 9:03 AM Samrat Deb wrote: > Congratulations Sergey > > On Wed, Feb 22, 2023 at 3:31 PM Hang Ruan wrote: > > > Congratulations Sergey! > > > > Jane Chan 于2023年2月22日周三 15:53写道: > > > > > Congratulations,

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread kui yuan
Hi all, Thanks for the lively discussion and I will respond to these questions one by one. However, there are also some common questions and I will answer together. @郑 Thanks for your reply. The features mentioned in this flip are only for those source connectors that implement the

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-22 Thread Samrat Deb
Congratulations Sergey On Wed, Feb 22, 2023 at 3:31 PM Hang Ruan wrote: > Congratulations Sergey! > > Jane Chan 于2023年2月22日周三 15:53写道: > > > Congratulations, Sergey! > > > > Best regards, > > Jane > > > > > > On Wed, Feb 22, 2023 at 9:44 AM Dian Fu wrote: > > > > > Congratulations Sergey! > >

RE: Re: [discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Zhongpu Chen
Hi Jing, Sorry for the last reply in a messed up formatting, as I am not quite familiar with the mail list usage. First, as long as contributors install Prettier with the same version, markdown files can be auto-formatted in the same way without extra working via the `prettier --write **/*.md`

[jira] [Created] (FLINK-31186) Removing topic from kafka source does nothing

2023-02-22 Thread Exidex (Jira)
Exidex created FLINK-31186: -- Summary: Removing topic from kafka source does nothing Key: FLINK-31186 URL: https://issues.apache.org/jira/browse/FLINK-31186 Project: Flink Issue Type: Bug

RE: Re: [discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Zhongpu Chen
> I was wondering how we could let every contributor follow the same mk rule. As long as contributors install Prettier with the same version, markdown files can be auto-formatted in the same way without extra working via the `prettier --write **/*.md` command, and this can also be set as a part

[DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-02-22 Thread Ran Tao
Currently flink sql auxiliary statements has supported some good features such as catalog/databases/table support. But these features are not very complete compared with other popular engines such as spark, presto, hive and commercial engines such as snowflake. For example, many engines support

[jira] [Created] (FLINK-31185) Python BroadcastProcessFunction not support side output

2023-02-22 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-31185: - Summary: Python BroadcastProcessFunction not support side output Key: FLINK-31185 URL: https://issues.apache.org/jira/browse/FLINK-31185 Project: Flink Issue

[RESULT] [VOTE] Apache Flink Kubernetes Operator Release 1.4.0, release candidate #1

2023-02-22 Thread Gyula Fóra
I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Marton Balassi (binding) * Gyula Fora (binding) * Maximilian Mixhels (binding) * Jim Busche * Peter Huang * Matt Wang There are no disapproving votes. Thanks everyone!

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.4.0, release candidate #1

2023-02-22 Thread Gyula Fóra
Thank you everyone, closing this vote now! Gyula On Tue, Feb 21, 2023 at 2:19 PM Matt Wang wrote: > Thank you, Gyula. > > > +1 (non-binding) > > I tested the following: > > 1. Downloaded the archives, checksums, signatures and README file > 2. Build the source distribution to ensure all source

[jira] [Created] (FLINK-31184) Failed to get python udf runner directory via running GET_RUNNER_DIR_SCRIPT

2023-02-22 Thread Wei Zhong (Jira)
Wei Zhong created FLINK-31184: - Summary: Failed to get python udf runner directory via running GET_RUNNER_DIR_SCRIPT Key: FLINK-31184 URL: https://issues.apache.org/jira/browse/FLINK-31184 Project:

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread Shuo Cheng
Hi Kui, Thanks for driving the discussion. It's quite useful to introduce Watermark options. I have some questions: What kind of hints is "WATERMARK_PARAMS"? Currently, we have two kinds of hints in Flink: Dynamic Table Options & Query Hints. As described in the Flip, "WATERMARK_PARAMS" is more

[jira] [Created] (FLINK-31183) Flink Kinesis EFO Consumer can fail to stop gracefully

2023-02-22 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-31183: - Summary: Flink Kinesis EFO Consumer can fail to stop gracefully Key: FLINK-31183 URL: https://issues.apache.org/jira/browse/FLINK-31183 Project: Flink

Re: [discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Jing Ge
Hi Zhongpu, Thanks for starting this discussion. I was wondering how we could let every contributor follow the same mk rule. I am not familiar with Prettier. Would you like to help me understand some basic questions? Thanks. Is there any way to integrate the format check into our CI pipeline?

[jira] [Created] (FLINK-31182) CompiledPlan cannot deserialize BridgingSqlFunction correctly

2023-02-22 Thread Jane Chan (Jira)
Jane Chan created FLINK-31182: - Summary: CompiledPlan cannot deserialize BridgingSqlFunction correctly Key: FLINK-31182 URL: https://issues.apache.org/jira/browse/FLINK-31182 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

2023-02-22 Thread Hang Ruan
Congratulations Sergey! Jane Chan 于2023年2月22日周三 15:53写道: > Congratulations, Sergey! > > Best regards, > Jane > > > On Wed, Feb 22, 2023 at 9:44 AM Dian Fu wrote: > > > Congratulations Sergey! > > > > On Tue, Feb 21, 2023 at 9:07 PM Rui Fan wrote: > > > > > Congratulations, Sergey! > > > > > >

[VOTE] Flink minor version support policy for old releases

2023-02-22 Thread Danny Cranmer
I am starting a vote to update the "Update Policy for old releases" [1] to include additional bugfix support for end of life versions. As per the discussion thread [2], the change we are voting on is: - Support policy: updated to include: "Upon release of a new Flink minor version, the community

[discussion] To introduce a formatter for Markdown files

2023-02-22 Thread Zhongpu Chen
As I mentioned in FLINK-31177 ( https://issues.apache.org/jira/browse/FLINK-31177): Currently, markdown files in *docs* are maintained and updated by many contributors, and different people have varying code style taste. By the way, as the syntax of markdown is not really strict, the styles tend

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread Jane Chan
Hi Kui, Thanks for bringing this to the discussion. Toward the FLIP, I have several questions. 1. What's the behavior if there are multiple table sources, among which some do not support `SupportsWatermarkPushDown`? > So the features that this flip intends to support are only for those >

[jira](FLINK-31177) To introduce a formatter for Markdown files

2023-02-22 Thread Zhongpu Chen
As I mentioned in FLINK-31177 ( https://issues.apache.org/jira/browse/FLINK-31177): Currently, markdown files in *docs* are maintained and updated by many contributors, and different people have varying code style taste. By the way, as the syntax of markdown is not really strict, the styles tend

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-02-22 Thread Martijn Visser
Hi Yuan Kui, Thanks for creating the FLIP. A couple of questions / remarks 1. While the FLIP talks about watermark options for Table API & SQL, I only see proposed syntax for SQL, not for the Table API. What is your proposal for the Table API? 2. A rejected alternative is adding watermark

[jira] [Created] (FLINK-31181) Support LIKE operator pushdown

2023-02-22 Thread Jira
Grzegorz Kołakowski created FLINK-31181: --- Summary: Support LIKE operator pushdown Key: FLINK-31181 URL: https://issues.apache.org/jira/browse/FLINK-31181 Project: Flink Issue Type: