[DISCUSS] FLINK-32737: At-least-once sink connector for Snowflake

Hi all, I'm in the process of writing a Snowflake sink connector much like the one described in FLINK-32737 [1], and I was interested in contributing the code back to Flink. I'm hoping to eventually add exactly-once semantics as described by the Snowflake documentation [2], and I'm looking

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

Hi Matt Wang, Thanks for your discussion here. > it is recommended to unify the descriptions of AutoScalerHandler > and AutoScalerEventHandler in the FLIP Good catch, I have updated all AutoScalerHandler to AutoScalerEventHandler. > Can it support the use of zookeeper (zookeeper is a

Re: [Question] How to assign uid to existing stream

Hi, Dennis You should send this question to mailbox u...@flink.apache.org, dev is used to discuss development-related issues. Back to your question: - AFAIK, uid will be set up as a random value if not defined. How can I find the current uid? Regarding the function of uid, you can see [1] and

[jira] [Created] (FLINK-32815) Add HASHCODE support in SQL & Table API

Hanyu Zheng created FLINK-32815: --- Summary: Add HASHCODE support in SQL & Table API Key: FLINK-32815 URL: https://issues.apache.org/jira/browse/FLINK-32815 Project: Flink Issue Type:

[jira] [Created] (FLINK-32814) Support disabling failed JM shutdown in the operator

Yaroslav Tkachenko created FLINK-32814: -- Summary: Support disabling failed JM shutdown in the operator Key: FLINK-32814 URL: https://issues.apache.org/jira/browse/FLINK-32814 Project: Flink

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

This is definitely a useful feature especially for the flink batch execution workloads using flow orchestrators like Airflow, Azkaban, Oozie etc. Thanks for reviving this issue and starting a FLIP. Regards Venkata krishnan On Mon, Aug 7, 2023 at 4:09 PM Allison Chang wrote: > Hi all, > > I am

[RESULT][VOTE] FLIP-333: Redesign Apache Flink website

Hi, Thank you for the review and the votes. I’m glad to announce FLIP-333: Redesign Apache Flink website has now been accepted, voted through thread [1]. We received 6 binding votes and 2 non-binding votes: Jing Ge (binding) Rui Fan (binding) Danny Cranmer (binding) Hong Liang (binding)

[jira] [Created] (FLINK-32813) Split autoscaler ConfigMap

Maximilian Michels created FLINK-32813: -- Summary: Split autoscaler ConfigMap Key: FLINK-32813 URL: https://issues.apache.org/jira/browse/FLINK-32813 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

Hi Rui Thanks for driving the FLIP. I agree with the point fo this FLIP. This FLIP first provides a general function of Autoscaler in Flink repo, and there is no need to move kubernetes-autoscaler from kubernetes-operator to Flink repo in this FLIP(it is recommended to unify the descriptions of

[jira] [Created] (FLINK-32812) HBaseRowDataLookupFunction HTable instantiation of thread safety problems

王江洲 created FLINK-32812: --- Summary: HBaseRowDataLookupFunction HTable instantiation of thread safety problems Key: FLINK-32812 URL: https://issues.apache.org/jira/browse/FLINK-32812 Project: Flink

[jira] [Created] (FLINK-32811) Add port range support for taskmanager.data.bind-port

Ferenc Csaky created FLINK-32811: Summary: Add port range support for taskmanager.data.bind-port Key: FLINK-32811 URL: https://issues.apache.org/jira/browse/FLINK-32811 Project: Flink Issue

[jira] [Created] (FLINK-32810) Improve managed memory usage in ListStateWithCache

Fan Hong created FLINK-32810: Summary: Improve managed memory usage in ListStateWithCache Key: FLINK-32810 URL: https://issues.apache.org/jira/browse/FLINK-32810 Project: Flink Issue Type:

[jira] [Created] (FLINK-32809) YarnClusterDescriptor.isarchiveonlyincludedinShipArchiveFiles dose not work as expected

junzhong qin created FLINK-32809: Summary: YarnClusterDescriptor.isarchiveonlyincludedinShipArchiveFiles dose not work as expected Key: FLINK-32809 URL: https://issues.apache.org/jira/browse/FLINK-32809

Re: [DISCUSS] How about adding OLAP to Flink Roadmap?

Thanks for bringing this up, Shammon. In general, I'd be +1 to improve Flink's ability to serve as an OLAP engine. I see a great value in Flink becoming a unified Large-scale Data Processing / Analysis tool. Through my interactions with users (Alibaba internal users, external users on Alibaba

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

Congrats, well done, and welcome to the PMC Matthias! -Max On Tue, Aug 8, 2023 at 8:36 AM yh z wrote: > > Congratulations, Matthias! > > Best, > Yunhong Zheng (Swuferhong) > > Ryan Skraba 于2023年8月7日周一 21:39写道： > > > Congratulations Matthias -- very well-deserved, the community is lucky to > >

[jira] [Created] (FLINK-32808) eventTimeWindow follow ContinuousProcessingTimeTrigger sink Infinite number of data when eventTime < processTime

yong yang created FLINK-32808: - Summary: eventTimeWindow follow ContinuousProcessingTimeTrigger sink Infinite number of data when eventTime < processTime Key: FLINK-32808 URL:

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congrats, Hangxiang! Best regards, Jing On Tue, Aug 8, 2023 at 3:04 PM Yangze Guo wrote: > Congrats, Hangxiang! > > Best, > Yangze Guo > > On Tue, Aug 8, 2023 at 11:28 AM yh z wrote: > > > > Congratulations, Hangxiang ! > > > > > > Best, > > Yunhong Zheng (Swuferhong) > > > > yuxia

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congrats, YanFei! Best regards, Jing On Tue, Aug 8, 2023 at 3:04 PM Yangze Guo wrote: > Congrats, Yanfei! > > Best, > Yangze Guo > > On Tue, Aug 8, 2023 at 9:20 AM yuxia wrote: > > > > Congratulations, Yanfei! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "ron9 liu" > >

[jira] [Created] (FLINK-32807) when i use emitUpdateWithRetract of udtagg,bug error

yong yang created FLINK-32807: - Summary: when i use emitUpdateWithRetract of udtagg,bug error Key: FLINK-32807 URL: https://issues.apache.org/jira/browse/FLINK-32807 Project: Flink Issue Type:

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

Hi all, As part of Flink bylaws, binding votes for FLIP changes are active committer votes. Up to now, we have only 2 binding votes. Can one of the committers/PMC members vote on this FLIP ? Thanks Etienne Le 08/08/2023 à 10:19, Etienne Chauchot a écrit : Hi Joseph, Thanks for the

Re: [VOTE] FLIP-322 Cooldown period for adaptive scheduler. Second vote.

Hi Joseph, Thanks for the detailled review ! Best Etienne Le 14/07/2023 à 11:57, Prabhu Joseph a écrit : *+1 (non-binding)* Thanks for working on this. We have seen good improvement during the cool down period with this feature. Below are details on the test results from one of our

[jira] [Created] (FLINK-32806) EmbeddedJobResultStore keeps the non-dirty job entries forever

Matthias Pohl created FLINK-32806: - Summary: EmbeddedJobResultStore keeps the non-dirty job entries forever Key: FLINK-32806 URL: https://issues.apache.org/jira/browse/FLINK-32806 Project: Flink

[jira] [Created] (FLINK-32805) Release Testing: Verify Support Java 17 (LTS)

Qingsheng Ren created FLINK-32805: - Summary: Release Testing: Verify Support Java 17 (LTS) Key: FLINK-32805 URL: https://issues.apache.org/jira/browse/FLINK-32805 Project: Flink Issue Type:

[jira] [Created] (FLINK-32804) Release Testing: Verify FLIP-304: Pluggable failure handling for Apache Flink

Qingsheng Ren created FLINK-32804: - Summary: Release Testing: Verify FLIP-304: Pluggable failure handling for Apache Flink Key: FLINK-32804 URL: https://issues.apache.org/jira/browse/FLINK-32804

[jira] [Created] (FLINK-32802) Release Testing: Verify FLIP-291: Externalized Declarative Resource Management

Qingsheng Ren created FLINK-32802: - Summary: Release Testing: Verify FLIP-291: Externalized Declarative Resource Management Key: FLINK-32802 URL: https://issues.apache.org/jira/browse/FLINK-32802

[jira] [Created] (FLINK-32803) Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management

Qingsheng Ren created FLINK-32803: - Summary: Release Testing: Verify FLINK-32165 - Improve observability of fine-grained resource management Key: FLINK-32803 URL: https://issues.apache.org/jira/browse/FLINK-32803

[jira] [Created] (FLINK-32801) Release Testing: Verify FLINK-32524 - Improve the watermark aggregation performance when enabling the watermark alignment

Qingsheng Ren created FLINK-32801: - Summary: Release Testing: Verify FLINK-32524 - Improve the watermark aggregation performance when enabling the watermark alignment Key: FLINK-32801 URL:

[jira] [Created] (FLINK-32800) Release Testing: Verify FLINK-32548 - Make watermark alignment ready for production use

Qingsheng Ren created FLINK-32800: - Summary: Release Testing: Verify FLINK-32548 - Make watermark alignment ready for production use Key: FLINK-32800 URL: https://issues.apache.org/jira/browse/FLINK-32800

[jira] [Created] (FLINK-32799) Release Testing: Verify FLINK-26603 -Decouple Hive with Flink planner

Qingsheng Ren created FLINK-32799: - Summary: Release Testing: Verify FLINK-26603 -Decouple Hive with Flink planner Key: FLINK-32799 URL: https://issues.apache.org/jira/browse/FLINK-32799 Project:

[jira] [Created] (FLINK-32798) Release Testing: Verify FLIP-294: Support Customized Catalog Modification Listener

Qingsheng Ren created FLINK-32798: - Summary: Release Testing: Verify FLIP-294: Support Customized Catalog Modification Listener Key: FLINK-32798 URL: https://issues.apache.org/jira/browse/FLINK-32798

[jira] [Created] (FLINK-32797) Release Testing: Verify FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

Qingsheng Ren created FLINK-32797: - Summary: Release Testing: Verify FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source Key: FLINK-32797 URL: https://issues.apache.org/jira/browse/FLINK-32797

[jira] [Created] (FLINK-32796) Release Testing: Verify FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations

Qingsheng Ren created FLINK-32796: - Summary: Release Testing: Verify FLIP-295: Support lazy initialization of catalogs and persistence of catalog configurations Key: FLINK-32796 URL:

[jira] [Created] (FLINK-32795) Release Testing: Verify FLIP-279 Unified the max display column width for SqlClient and Table APi in both Streaming and Batch execMode

Qingsheng Ren created FLINK-32795: - Summary: Release Testing: Verify FLIP-279 Unified the max display column width for SqlClient and Table APi in both Streaming and Batch execMode Key: FLINK-32795 URL:

[jira] [Created] (FLINK-32794) Release Testing: Verify FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

Qingsheng Ren created FLINK-32794: - Summary: Release Testing: Verify FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway Key: FLINK-32794 URL: https://issues.apache.org/jira/browse/FLINK-32794

[jira] [Created] (FLINK-32793) Release Testing: Verify FLINK-31535 - Extend watermark-related features for SQL

Qingsheng Ren created FLINK-32793: - Summary: Release Testing: Verify FLINK-31535 - Extend watermark-related features for SQL Key: FLINK-32793 URL: https://issues.apache.org/jira/browse/FLINK-32793

[jira] [Created] (FLINK-32791) Release Testing: Verify FLIP-308: Support Time Travel

Qingsheng Ren created FLINK-32791: - Summary: Release Testing: Verify FLIP-308: Support Time Travel Key: FLINK-32791 URL: https://issues.apache.org/jira/browse/FLINK-32791 Project: Flink

[jira] [Created] (FLINK-32792) Release Testing: Verify FLINK-27237 - Partitioned table statement enhancement

Qingsheng Ren created FLINK-32792: - Summary: Release Testing: Verify FLINK-27237 - Partitioned table statement enhancement Key: FLINK-32792 URL: https://issues.apache.org/jira/browse/FLINK-32792

[jira] [Created] (FLINK-32790) Release Testing: Verify FLIP-311: Support Call Stored Procedure

Qingsheng Ren created FLINK-32790: - Summary: Release Testing: Verify FLIP-311: Support Call Stored Procedure Key: FLINK-32790 URL: https://issues.apache.org/jira/browse/FLINK-32790 Project: Flink

[jira] [Created] (FLINK-32789) Release Testing: Verify FLIP-303: Support REPLACE TABLE AS SELECT statement

Qingsheng Ren created FLINK-32789: - Summary: Release Testing: Verify FLIP-303: Support REPLACE TABLE AS SELECT statement Key: FLINK-32789 URL: https://issues.apache.org/jira/browse/FLINK-32789

[jira] [Created] (FLINK-32787) Release Testing: Verify FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

Qingsheng Ren created FLINK-32787: - Summary: Release Testing: Verify FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement Key: FLINK-32787 URL: https://issues.apache.org/jira/browse/FLINK-32787

[jira] [Created] (FLINK-32788) SpeculativeScheduler do not handle allocate task errors when schedule speculative tasks may causes resource leakage.

Junrui Li created FLINK-32788: - Summary: SpeculativeScheduler do not handle allocate task errors when schedule speculative tasks may causes resource leakage. Key: FLINK-32788 URL:

[jira] [Created] (FLINK-32786) Release Testing: Verify FLIP-302: Support TRUNCATE TABLE statement in batch mode

Qingsheng Ren created FLINK-32786: - Summary: Release Testing: Verify FLIP-302: Support TRUNCATE TABLE statement in batch mode Key: FLINK-32786 URL: https://issues.apache.org/jira/browse/FLINK-32786

[jira] [Created] (FLINK-32785) Release Testing: Verify FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

Qingsheng Ren created FLINK-32785: - Summary: Release Testing: Verify FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration Key: FLINK-32785 URL:

[jira] [Created] (FLINK-32784) Release Testing: Verify FLIP-300 Add targetColumns to DynamicTableSink#Context

Qingsheng Ren created FLINK-32784: - Summary: Release Testing: Verify FLIP-300 Add targetColumns to DynamicTableSink#Context Key: FLINK-32784 URL: https://issues.apache.org/jira/browse/FLINK-32784

[jira] [Created] (FLINK-32783) Release Testing: Improve parallel download of RocksDB incremental state

Qingsheng Ren created FLINK-32783: - Summary: Release Testing: Improve parallel download of RocksDB incremental state Key: FLINK-32783 URL: https://issues.apache.org/jira/browse/FLINK-32783 Project:

[jira] [Created] (FLINK-32781) Release Testing: Add a metric for back-pressure from the ChangelogStateBackend

Qingsheng Ren created FLINK-32781: - Summary: Release Testing: Add a metric for back-pressure from the ChangelogStateBackend Key: FLINK-32781 URL: https://issues.apache.org/jira/browse/FLINK-32781

[jira] [Created] (FLINK-32782) Release Testing: Disable WAL in RocksDBWriteBatchWrapper by default

Qingsheng Ren created FLINK-32782: - Summary: Release Testing: Disable WAL in RocksDBWriteBatchWrapper by default Key: FLINK-32782 URL: https://issues.apache.org/jira/browse/FLINK-32782 Project:

[jira] [Created] (FLINK-32780) Release Testing: Verify FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

Qingsheng Ren created FLINK-32780: - Summary: Release Testing: Verify FLIP-324: Introduce Runtime Filter for Flink Batch Jobs Key: FLINK-32780 URL: https://issues.apache.org/jira/browse/FLINK-32780

[jira] [Created] (FLINK-32779) Release Testing: Verify FLIP-301: Hybrid Shuffle supports Remote Storage

Qingsheng Ren created FLINK-32779: - Summary: Release Testing: Verify FLIP-301: Hybrid Shuffle supports Remote Storage Key: FLINK-32779 URL: https://issues.apache.org/jira/browse/FLINK-32779 Project:

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congrats, Hangxiang! Best, Yangze Guo On Tue, Aug 8, 2023 at 11:28 AM yh z wrote: > > Congratulations, Hangxiang ! > > > Best, > Yunhong Zheng (Swuferhong) > > yuxia 于2023年8月8日周二 09:20写道： > > > Congratulations, Hangxiang ! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人:

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congrats, Yanfei! Best, Yangze Guo On Tue, Aug 8, 2023 at 9:20 AM yuxia wrote: > > Congratulations, Yanfei! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "ron9 liu" > 收件人: "dev" > 发送时间: 星期一, 2023年 8 月 07日 下午 11:44:23 > 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

Congratulations, Matthias! Best, Yunhong Zheng (Swuferhong) Ryan Skraba 于2023年8月7日周一 21:39写道： > Congratulations Matthias -- very well-deserved, the community is lucky to > have you <3 > > All my best, Ryan > > On Mon, Aug 7, 2023 at 3:04 PM Lincoln Lee wrote: > > > Congratulations! > > > >