[jira] [Created] (FLINK-30651) Move util methods to CatalogTest and remove CatalogTestUtils class

2023-01-12 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-30651: -- Summary: Move util methods to CatalogTest and remove CatalogTestUtils class Key: FLINK-30651 URL: https://issues.apache.org/jira/browse/FLINK-30651 Project: Flink

Re: [VOTE] FLIP-279 Unified the max display column width for SqlClient and Table APi in both Streaming and Batch execMode

2023-01-12 Thread Shammon FY
+1 (no-binding) Best, Shammon On Thu, Jan 12, 2023 at 8:11 PM Shengkai Fang wrote: > +1(binding) > > Best, > Shengkai > > Jark Wu 于2023年1月12日周四 19:22写道: > > > +1 (binding) > > Thank you for driving this effort. > > > > Best, > > Jark > > > > > 2023年1月9日 15:46,Jing Ge 写道: > > > > > > Hi, > >

[jira] [Created] (FLINK-30653) Triggere resource Events on autoscaler actions

2023-01-12 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30653: -- Summary: Triggere resource Events on autoscaler actions Key: FLINK-30653 URL: https://issues.apache.org/jira/browse/FLINK-30653 Project: Flink Issue Type: New

[jira] [Created] (FLINK-30655) SqlClientITCase.testMatchRecognize failed with a 404

2023-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30655: - Summary: SqlClientITCase.testMatchRecognize failed with a 404 Key: FLINK-30655 URL: https://issues.apache.org/jira/browse/FLINK-30655 Project: Flink Issue

[jira] [Created] (FLINK-30654) start cursor issue

2023-01-12 Thread likang (Jira)
likang created FLINK-30654: -- Summary: start cursor issue Key: FLINK-30654 URL: https://issues.apache.org/jira/browse/FLINK-30654 Project: Flink Issue Type: Improvement Components:

[jira] [Created] (FLINK-30656) Provide more logs for schema compatibility check

2023-01-12 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-30656: Summary: Provide more logs for schema compatibility check Key: FLINK-30656 URL: https://issues.apache.org/jira/browse/FLINK-30656 Project: Flink Issue Type:

[RESULT][VOTE] FLIP-280: Introduce EXPLAIN PLAN_ADVICE to provide SQL advice

2023-01-12 Thread Jane Chan
Hi all, FLIP-280: Introduce EXPLAIN PLAN_ADVICE to provide SQL advice[1] has been accepted. The FLIP was voted through this thread[2]. There are four binding votes as follows: Godfrey (binding) Jark Wu (binding) Jingsong Li (binding) Lincoln Lee (binding) [1]

[jira] [Created] (FLINK-30652) Use max busytime instead of average to compute true processing rate

2023-01-12 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30652: -- Summary: Use max busytime instead of average to compute true processing rate Key: FLINK-30652 URL: https://issues.apache.org/jira/browse/FLINK-30652 Project: Flink

Re: [VOTE] Apache Flink Table Store 0.3.0, release candidate #1

2023-01-12 Thread Jingsong Li
Thanks Yu, I have created table-store-0.3.1 and move these jiras to 0.3.1. Best, Jingsong On Thu, Jan 12, 2023 at 7:41 PM Yu Li wrote: > > Thanks for the quick action Jingsong! Here is my vote with the new staging > directory: > > +1 (binding) > > > - Checked release notes: *Action Required* >

[jira] [Created] (FLINK-30650) FLIP-280: Introduce EXPLAIN PLAN_ADVICE to provide SQL advice

2023-01-12 Thread Jane Chan (Jira)
Jane Chan created FLINK-30650: - Summary: FLIP-280: Introduce EXPLAIN PLAN_ADVICE to provide SQL advice Key: FLINK-30650 URL: https://issues.apache.org/jira/browse/FLINK-30650 Project: Flink

Re: [DISCUSS] FLIP-285: Refactoring the leader election code base in Flink

2023-01-12 Thread Matthias Pohl
Thanks Yang Wang for sharing your view on this. Please find my responses below. # HA data format in the HA backend(e.g. ZK, K8s ConfigMap) > We have already changed the HA data format after introducing the multiple > component leader election in FLINK-24038. For K8s HA, > the num of ConfigMaps

[jira] [Created] (FLINK-30660) move SQLClientHiveITCase and TestHiveCatalogFactory to flink-connector-hive e2e

2023-01-12 Thread Chen Qin (Jira)
Chen Qin created FLINK-30660: Summary: move SQLClientHiveITCase and TestHiveCatalogFactory to flink-connector-hive e2e Key: FLINK-30660 URL: https://issues.apache.org/jira/browse/FLINK-30660 Project:

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-12 Thread Jing Ge
+ 1(not binding) Best Regards, Jing On Thu, Jan 12, 2023 at 10:01 AM Jing Zhang wrote: > +1 (binding) > > Best, > Jing Zhang > > Lijie Wang 于2023年1月12日周四 16:39写道: > > > +1 (binding) > > > > Best, > > Lijie > > > > Martijn Visser 于2023年1月12日周四 15:56写道: > > > > > +0 (binding) > > > > > > Op di

[jira] [Created] (FLINK-30659) move Flink-sql-parser-hive to flink-connector-hive

2023-01-12 Thread Chen Qin (Jira)
Chen Qin created FLINK-30659: Summary: move Flink-sql-parser-hive to flink-connector-hive Key: FLINK-30659 URL: https://issues.apache.org/jira/browse/FLINK-30659 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-12 Thread Jing Ge
Hi Biao, Thanks for driving this. Like Martijn already pointed out. We will spend effort to remove SinkFunction after we deprecate it. The more functionality added into it, the bigger effort we will have to deprecate and remove the SinkFunction. Commonly, It is not recommended to add new features

[jira] [Created] (FLINK-30657) Disable Shared and Key_Shared related tests in Pulsar connector

2023-01-12 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-30657: --- Summary: Disable Shared and Key_Shared related tests in Pulsar connector Key: FLINK-30657 URL: https://issues.apache.org/jira/browse/FLINK-30657 Project: Flink

[jira] [Created] (FLINK-30658) remove Flink-sql-parser-hive dependency on table-planner

2023-01-12 Thread Chen Qin (Jira)
Chen Qin created FLINK-30658: Summary: remove Flink-sql-parser-hive dependency on table-planner Key: FLINK-30658 URL: https://issues.apache.org/jira/browse/FLINK-30658 Project: Flink Issue Type:

[jira] [Created] (FLINK-30661) Introduce interfaces fro Delete/Update

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30661: Summary: Introduce interfaces fro Delete/Update Key: FLINK-30661 URL: https://issues.apache.org/jira/browse/FLINK-30661 Project: Flink Issue Type: Sub-task

[DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-01-12 Thread Qingsheng Ren
Hi devs, I’d like to start a discussion about enabling the dynamic partition discovery feature by default in Kafka source. Dynamic partition discovery [1] is a useful feature in Kafka source especially under the scenario when the consuming Kafka topic scales out, or the source subscribes to

[jira] [Created] (FLINK-30668) Introduce ExplainFormat to Explainable and TableEnvironment

2023-01-12 Thread Jane Chan (Jira)
Jane Chan created FLINK-30668: - Summary: Introduce ExplainFormat to Explainable and TableEnvironment Key: FLINK-30668 URL: https://issues.apache.org/jira/browse/FLINK-30668 Project: Flink Issue

[RESULT][VOTE] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-12 Thread Junrui Lee
Hi all: FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs [1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 2 non-bindings as follows: Lijie Wang (binding) Zhu Zhu (binding) yuxia (non-binding) weijie guo (non-binding) Xintong Song

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-01-12 Thread 何军
> > +1 for this idea, we have enabled kafka dynamic partition discovery in all > jobs. > >

[jira] [Created] (FLINK-30671) Add AlgoOperator for ClusteringEvaluator

2023-01-12 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-30671: - Summary: Add AlgoOperator for ClusteringEvaluator Key: FLINK-30671 URL: https://issues.apache.org/jira/browse/FLINK-30671 Project: Flink Issue Type:

[jira] [Created] (FLINK-30672) Support 'EXPLAIN PLAN_ADVICE' statement

2023-01-12 Thread Jane Chan (Jira)
Jane Chan created FLINK-30672: - Summary: Support 'EXPLAIN PLAN_ADVICE' statement Key: FLINK-30672 URL: https://issues.apache.org/jira/browse/FLINK-30672 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30674) When hybrid shuffle enable speculation execution, allow consume partition in advance by default

2023-01-12 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-30674: -- Summary: When hybrid shuffle enable speculation execution, allow consume partition in advance by default Key: FLINK-30674 URL: https://issues.apache.org/jira/browse/FLINK-30674

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-01-12 Thread Jark Wu
+1 for the change. I think this is beneficial for users and is compatible. Best, Jark On Fri, 13 Jan 2023 at 14:22, 何军 wrote: > > > > +1 for this idea, we have enabled kafka dynamic partition discovery in > all > > jobs. > > > > >

[jira] [Created] (FLINK-30665) Add implementation for SupportsRowLevelUpdate

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30665: Summary: Add implementation for SupportsRowLevelUpdate Key: FLINK-30665 URL: https://issues.apache.org/jira/browse/FLINK-30665 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-01-12 Thread Gyula Fóra
+1 It’s hard to imagine why someone would not enable this in prod anyways. Gyula On Fri, 13 Jan 2023 at 08:17, Jark Wu wrote: > +1 for the change. I think this is beneficial for users and is compatible. > > Best, > Jark > > On Fri, 13 Jan 2023 at 14:22, 何军 wrote: > > > > > > > +1 for this

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

2023-01-12 Thread Leonard Xu
Thanks Qingsheng for driving this, enable the dynamic partition discovery would be very useful for kafka topic scale partitions scenarios. +1 for the change. CC: Becket Best, Leonard > On Jan 13, 2023, at 3:15 PM, Jark Wu wrote: > > +1 for the change. I think this is beneficial for

[jira] [Created] (FLINK-30662) Add implementation for SupportsDeletePushDown

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30662: Summary: Add implementation for SupportsDeletePushDown Key: FLINK-30662 URL: https://issues.apache.org/jira/browse/FLINK-30662 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30667) remove the planner dependency in flink-connector-hive

2023-01-12 Thread Chen Qin (Jira)
Chen Qin created FLINK-30667: Summary: remove the planner dependency in flink-connector-hive Key: FLINK-30667 URL: https://issues.apache.org/jira/browse/FLINK-30667 Project: Flink Issue Type:

[jira] [Created] (FLINK-30670) Ignore broadcast bytes when computing parallelism and input infos

2023-01-12 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-30670: -- Summary: Ignore broadcast bytes when computing parallelism and input infos Key: FLINK-30670 URL: https://issues.apache.org/jira/browse/FLINK-30670 Project: Flink

[jira] [Created] (FLINK-30673) Add documentation for "EXPLAIN PLAN_ADVICE" statement

2023-01-12 Thread Jane Chan (Jira)
Jane Chan created FLINK-30673: - Summary: Add documentation for "EXPLAIN PLAN_ADVICE" statement Key: FLINK-30673 URL: https://issues.apache.org/jira/browse/FLINK-30673 Project: Flink Issue Type:

[jira] [Created] (FLINK-30664) [Connector/Hive] cleanup hive/haoop package ambiguous package dependencies

2023-01-12 Thread Chen Qin (Jira)
Chen Qin created FLINK-30664: Summary: [Connector/Hive] cleanup hive/haoop package ambiguous package dependencies Key: FLINK-30664 URL: https://issues.apache.org/jira/browse/FLINK-30664 Project: Flink

[jira] [Created] (FLINK-30663) Add implementation for RowLevelDelete

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30663: Summary: Add implementation for RowLevelDelete Key: FLINK-30663 URL: https://issues.apache.org/jira/browse/FLINK-30663 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30666) Add document for Delete/Update API

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30666: Summary: Add document for Delete/Update API Key: FLINK-30666 URL: https://issues.apache.org/jira/browse/FLINK-30666 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30669) Update recent job status in FlinkDeployment resource object.

2023-01-12 Thread Mohemmad Zaid Khan (Jira)
Mohemmad Zaid Khan created FLINK-30669: -- Summary: Update recent job status in FlinkDeployment resource object. Key: FLINK-30669 URL: https://issues.apache.org/jira/browse/FLINK-30669 Project:

Re: [VOTE] FLIP-274: Introduce metric group for OperatorCoordinator

2023-01-12 Thread Jark Wu
Hi Chesnay, Welcome back, and sorry for interrupting your vacation. Since there is a negative vote, I'm fine we can cancel the vote and continue the technical discussion back to the DISCUSS thread. I think we all have good intentions for the community. I hope the community collaboration can be

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-12 Thread Lijie Wang
+1 (binding) Best, Lijie Martijn Visser 于2023年1月12日周四 15:56写道: > +0 (binding) > > Op di 10 jan. 2023 om 13:11 schreef yuxia : > > > +1 (non-binding). > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Zhu Zhu" > > 收件人: "dev" > > 发送时间: 星期二, 2023年 1 月 10日 下午 5:50:39 > > 主题: Re:

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2023-01-12 Thread Yanfei Lei
Hi all, Thanks for the reminder. @Matthias any updates on the performance tests? ...or more specifically, any updates on the script for alerting on performance regressions? I create a PR for FLINK-27571[1] but it's still under review, would you like to help take a look? FLINK-27571 is just

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-12 Thread Yang Wang
Congratulations, Lincoln! Best, Yang Lincoln Lee 于2023年1月12日周四 12:13写道: > Thank you all! > > I'm honored to join the committers and look forward to continue working > with the community. > > Best, > Lincoln Lee > > > Shengkai Fang 于2023年1月12日周四 09:55写道: > > > Congratulations, Lincoln! > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-12 Thread Samrat Deb
congratulation ! Lincoln On Thu, 12 Jan 2023 at 1:32 PM, Yang Wang wrote: > Congratulations, Lincoln! > > Best, > Yang > > Lincoln Lee 于2023年1月12日周四 12:13写道: > > > Thank you all! > > > > I'm honored to join the committers and look forward to continue working > > with the community. > > > >

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-12 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Lijie Wang 于2023年1月12日周四 16:39写道: > +1 (binding) > > Best, > Lijie > > Martijn Visser 于2023年1月12日周四 15:56写道: > > > +0 (binding) > > > > Op di 10 jan. 2023 om 13:11 schreef yuxia : > > > > > +1 (non-binding). > > > > > > Best regards, > > > Yuxia > > > > > > -

[jira] [Created] (FLINK-30645) [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent.

2023-01-12 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-30645: Summary: [FLIP-286] The scope/stability annotation in AbstractStreamOperator are inconsistent. Key: FLINK-30645 URL: https://issues.apache.org/jira/browse/FLINK-30645

Re: [DISCUSS] FLIP-285: Refactoring the leader election code base in Flink

2023-01-12 Thread Yang Wang
Thanks Matthias for preparing this thorough FLIP, which has taken us reviewing the multiple component leader election. I am totally in favor of doing the code clean-up. The current implementation does not have very good readability due to legacy compatibility. And I just have a few comments. #

[jira] [Created] (FLINK-30642) CsvFileCompactionITCase>CompactionITCaseBase.testPartition timed out

2023-01-12 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-30642: -- Summary: CsvFileCompactionITCase>CompactionITCaseBase.testPartition timed out Key: FLINK-30642 URL: https://issues.apache.org/jira/browse/FLINK-30642 Project:

[jira] [Created] (FLINK-30643) docs_check fails

2023-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30643: - Summary: docs_check fails Key: FLINK-30643 URL: https://issues.apache.org/jira/browse/FLINK-30643 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-30644) ChangelogCompatibilityITCase.testRestore fails due to CheckpointCoordinator being shutdown

2023-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30644: - Summary: ChangelogCompatibilityITCase.testRestore fails due to CheckpointCoordinator being shutdown Key: FLINK-30644 URL: https://issues.apache.org/jira/browse/FLINK-30644

[DISCUSS] FLIP-286: Fix the API stability/scope annotation inconsistency in AbstractStreamOperator

2023-01-12 Thread Becket Qin
Hi flink devs, I'd like to start a discussion thread for FLIP-286[1]. As a recap, currently while AbstractStreamOperator is a class marked as @PublicEvolving, some classes exposed via its methods / fields are marked as @Internal. This FLIP wants to fix this inconsistency of stability / scope

Re: [VOTE] FLIP-279 Unified the max display column width for SqlClient and Table APi in both Streaming and Batch execMode

2023-01-12 Thread Jark Wu
+1 (binding) Thank you for driving this effort. Best, Jark > 2023年1月9日 15:46,Jing Ge 写道: > > Hi, > > I'd like to start a vote on FLIP-279 Unified the max display column width > for SqlClient and Table APi in both Streaming and Batch execMode. The > discussion can be found at [1]. > > The

Re: [VOTE] FLIP-282: Introduce Delete & Update API

2023-01-12 Thread yuxia
Hi all; FLIP-282: Introduce Delete & Update API [1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 1 non-bindings as follows: Samrat Deb (no-binding) Jingsong Li (binding) Lincoln Lee (binding) Jark (binding) There are no disapproving votes. [1]

Re: [VOTE] Apache Flink Table Store 0.3.0, release candidate #1

2023-01-12 Thread Yu Li
Thanks for the quick action Jingsong! Here is my vote with the new staging directory: +1 (binding) - Checked release notes: *Action Required* * The fix version of FLINK-30620 and FLINK-30628 are 0.3.0 but still open, please confirm whether this should be included or we should move it out of

[jira] [Created] (FLINK-30647) Add human readable datetime of watermark column in the web for better debug experience

2023-01-12 Thread Yun Tang (Jira)
Yun Tang created FLINK-30647: Summary: Add human readable datetime of watermark column in the web for better debug experience Key: FLINK-30647 URL: https://issues.apache.org/jira/browse/FLINK-30647

[jira] [Created] (FLINK-30646) Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented

2023-01-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30646: --- Summary: Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented Key: FLINK-30646 URL: https://issues.apache.org/jira/browse/FLINK-30646

[RESULT][VOTE] FLIP-282: Introduce Delete & Update API

2023-01-12 Thread yuxia
Hi all; FLIP-282: Introduce Delete & Update API [1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 1 non-bindings as follows: Samrat Deb (no-binding) Jingsong Li (binding) Lincoln Lee (binding) Jark (binding) There are no disapproving votes. :) btw,

[jira] [Created] (FLINK-30648) [Umbrella]FLIP-282 Introduce Delete/Update API

2023-01-12 Thread luoyuxia (Jira)
luoyuxia created FLINK-30648: Summary: [Umbrella]FLIP-282 Introduce Delete/Update API Key: FLINK-30648 URL: https://issues.apache.org/jira/browse/FLINK-30648 Project: Flink Issue Type: New

Re: [VOTE] FLIP-279 Unified the max display column width for SqlClient and Table APi in both Streaming and Batch execMode

2023-01-12 Thread Shengkai Fang
+1(binding) Best, Shengkai Jark Wu 于2023年1月12日周四 19:22写道: > +1 (binding) > Thank you for driving this effort. > > Best, > Jark > > > 2023年1月9日 15:46,Jing Ge 写道: > > > > Hi, > > > > I'd like to start a vote on FLIP-279 Unified the max display column width > > for SqlClient and Table APi in

[jira] [Created] (FLINK-30649) Run kubernetes session test (default input) failed with a timeout

2023-01-12 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30649: - Summary: Run kubernetes session test (default input) failed with a timeout Key: FLINK-30649 URL: https://issues.apache.org/jira/browse/FLINK-30649 Project: Flink