[jira] [Created] (FLINK-33592) The return type of the function is void,not convenient to use

2023-11-17 Thread ZhangTao (Jira)
ZhangTao created FLINK-33592: Summary: The return type of the function is void,not convenient to use Key: FLINK-33592 URL: https://issues.apache.org/jira/browse/FLINK-33592 Project: Flink Issue

[jira] [Created] (FLINK-33591) Cleanup ysage of deprecated TableTestBase#addFunction

2023-11-17 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33591: --- Summary: Cleanup ysage of deprecated TableTestBase#addFunction Key: FLINK-33591 URL: https://issues.apache.org/jira/browse/FLINK-33591 Project: Flink

Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-17 Thread Rui Fan
Thanks Mason for your feedback and update! The sources you listed look good to me, +1 for this proposal! Best, Rui On Sat, Nov 18, 2023 at 3:38 AM Mason Chen wrote: > Also, it looks like externalizing the Hive connector is unblocked based on > the past email thread.

Re: Request a release of flink-connector-kafka version 3.1.0 (to consume kafka 3.4.0 with Flink 1.18)

2023-11-17 Thread Mason Chen
Hi all, Sorry for the late reply. I will follow up with the reviewers on https://issues.apache.org/jira/browse/FLINK-32197. I think we can definitely release a new Kafka connector before Flink 1.19 but do note it is the holiday season, so I can't speak on when the exact date will work for the

Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-17 Thread Mason Chen
Also, it looks like externalizing the Hive connector is unblocked based on the past email thread. https://issues.apache.org/jira/browse/FLINK-30064 seems to have some progress and perhaps we shouldn't touch it for now. On Fri, Nov 17, 2023 at 11:00 AM Mason Chen wrote: > Hi Rui and Max, > >

Re: [DISCUSS] Change the default restart-strategy to exponential-delay

2023-11-17 Thread Mason Chen
Hi Rui, I suppose we could do some benchmarking on what works well for the resource providers that Flink relies on e.g. Kubernetes. Based on conferences and blogs, it seems most people are relying on Kubernetes to deploy Flink and the restart strategy has a large dependency on how well Kubernetes

[jira] [Created] (FLINK-33590) CheckpointStatsTracker.totalNumberOfSubTasks not updated

2023-11-17 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-33590: - Summary: CheckpointStatsTracker.totalNumberOfSubTasks not updated Key: FLINK-33590 URL: https://issues.apache.org/jira/browse/FLINK-33590 Project: Flink

Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-17 Thread Mason Chen
Hi Rui and Max, Thanks for the feedback! If yes, I suggest this FLIP includes registering metric part, otherwise > these metrics still cannot work. Yup, you understood it correctly. I'll add that to the required list of work. Note that I'll include only FLIP-27 sources in the Flink repo:

[jira] [Created] (FLINK-33589) Fix broken documentation page for Kinesis connector

2023-11-17 Thread Aleksandr Pilipenko (Jira)
Aleksandr Pilipenko created FLINK-33589: --- Summary: Fix broken documentation page for Kinesis connector Key: FLINK-33589 URL: https://issues.apache.org/jira/browse/FLINK-33589 Project: Flink

Re: [DISCUSS] Change the default restart-strategy to exponential-delay

2023-11-17 Thread David Anderson
Rui, I don't have any direct experience with this topic, but given the motivation you shared, the proposal makes sense to me. Given that the new default feels more complex than the current behavior, if we decide to do this I think it will be important to include the rationale you've shared in the

[jira] [Created] (FLINK-33588) Fix Flink Checkpointing Statistics Bug

2023-11-17 Thread Tongtong Zhu (Jira)
Tongtong Zhu created FLINK-33588: Summary: Fix Flink Checkpointing Statistics Bug Key: FLINK-33588 URL: https://issues.apache.org/jira/browse/FLINK-33588 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-33587) Tidy up docs around JDBC

2023-11-17 Thread Robin Moffatt (Jira)
Robin Moffatt created FLINK-33587: - Summary: Tidy up docs around JDBC Key: FLINK-33587 URL: https://issues.apache.org/jira/browse/FLINK-33587 Project: Flink Issue Type: Improvement

Re:[DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-17 Thread Wencong Liu
Hello Junrui, Thanks for the effort. I agree with the proposal to deprecate the getExecutionConfig() method in the RuntimeContext class. Exposing the complex ExecutionConfig to user-defined functions can lead to unnecessary complexity and risks. I also have a suggestion. We could consider

[jira] [Created] (FLINK-33586) Add GHA support in release-1.17 branch

2023-11-17 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33586: - Summary: Add GHA support in release-1.17 branch Key: FLINK-33586 URL: https://issues.apache.org/jira/browse/FLINK-33586 Project: Flink Issue Type:

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.7.0, release candidate #1

2023-11-17 Thread Rui Fan
+1(non-binding) - Downloaded artifacts from dist - Verified SHA512 checksums - Verified GPG signatures - Build the source with java-11 and java-17 - Verified the license header - Verified that chart and appVersion matches the target release - RC repo works as Helm rep(helm repo add

Re: [DISCUSS] FLIP-393: Make QueryOperations SQL serializable

2023-11-17 Thread xiangyu feng
>After this FLIP is done, FLINK-25015() can utilize this ability to set > job name for queries. +1 for this. Currently, when users submit sql jobs through table api, we can't see the complete SQL string on flink ui. It would be easy for us to finish this feature if we can get serialized sql from

Re: [DISCUSS] FLIP-393: Make QueryOperations SQL serializable

2023-11-17 Thread Benchao Li
That sounds good to me, I'm looking forward to it! After this FLIP is done, FLINK-25015 can utilize this ability to set job name for queries. Dawid Wysakowicz 于2023年11月16日周四 21:16写道: > > Yes, the idea is to convert the QueryOperation tree into a > proper/compilable query. To be honest I didn't

Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-17 Thread Maximilian Michels
Hi Mason, Thank you for the proposal. This is a highly requested feature to make the source scaling of Flink Autoscaling generic across all sources. The current implementation handles every source individually, and if we don't find any backlog metrics, we default to using busy time only. At this

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-17 Thread Becket Qin
Hi Hongshun, SplitFetcher.enqueueTask() returns void, right? SplitFetcherTask is already an interface, and we need to make that as a PublicEvolving API as well. So overall, a source developer can potentially do a few things in the SplitFetcherManager. 1. for customized logic including

[jira] [Created] (FLINK-33585) Upgrade Zookeeper to 3.7.1

2023-11-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33585: -- Summary: Upgrade Zookeeper to 3.7.1 Key: FLINK-33585 URL: https://issues.apache.org/jira/browse/FLINK-33585 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-33584) Update Hadoop Filesystems to 3.3.6

2023-11-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33584: -- Summary: Update Hadoop Filesystems to 3.3.6 Key: FLINK-33584 URL: https://issues.apache.org/jira/browse/FLINK-33584 Project: Flink Issue Type: Technical

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-17 Thread Hongshun Wang
Hi, Jiangjie(Becket) , Thank you for your advice. I have learned a lot. If SplitFetcherManager becomes PublicEvolving, that also means > SplitFetcher needs to be PublicEvolving, because it is returned by the > protected method SplitFetcherManager.createSplitFetcher(). I completely agree with

[jira] [Created] (FLINK-33583) Support state ttl hint for join

2023-11-17 Thread xuyang (Jira)
xuyang created FLINK-33583: -- Summary: Support state ttl hint for join Key: FLINK-33583 URL: https://issues.apache.org/jira/browse/FLINK-33583 Project: Flink Issue Type: Sub-task

[ANNOUNCE] Apache Flink-shaded 16.2 released

2023-11-17 Thread weijie guo
The Apache Flink community is very happy to announce the release of Apache Flink-shaded 16.2. The flink-shaded project contains a number of shaded dependencies for Apache Flink. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available,

[jira] [Created] (FLINK-33582) Update flink-shaded version

2023-11-17 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-33582: - Summary: Update flink-shaded version Key: FLINK-33582 URL: https://issues.apache.org/jira/browse/FLINK-33582 Project: Flink Issue Type: Bug Components: