[VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-12 Thread Rui Fan
Hi all, Thanks for all the feedback about the FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler[1]. This FLIP was discussed in [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until Sep 16th 11:00 UTC+8) unless there is an

Re: [Discuss] FLIP-355: Add parent dir of files to classpath using yarn.provided.lib.dirs

2023-09-12 Thread Biao Geng
+1 for the FLIP. Another side thought is that in my experience, when users want to make Flink TM use a specific hadoop/hive configuration, an easier way is to ship the corresponding conf dir and set the env variable via containerized.taskmanager.env.HADOOP_CONF_DIR. Best, Biao Geng Archit Goyal

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread liu ron
+1(non-binding) Best, Ron ConradJam 于2023年9月12日周二 20:43写道: > +1 (non-binding) > > Matt Wang 于2023年9月12日周二 19:29写道: > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | From | Samrat Deb | > > | Date | 09/12/2023 18:26 | > > | To | | >

Re: [Discuss] FLIP-355: Add parent dir of files to classpath using yarn.provided.lib.dirs

2023-09-12 Thread Archit Goyal
Hi All, If there are no further concerns about this FLIP, I will start a vote thread tomorrow. Thanks, Archit Goyal From: Venkatakrishnan Sowrirajan Date: Thursday, August 24, 2023 at 10:21 PM To: dev@flink.apache.org Subject: Re: [Discuss] FLIP-355: Add parent dir of files to classpath

[jira] [Created] (FLINK-33078) Enhance ParameterTool to support múltiple environments

2023-09-12 Thread Oscar Perez (Jira)
Oscar Perez created FLINK-33078: --- Summary: Enhance ParameterTool to support múltiple environments Key: FLINK-33078 URL: https://issues.apache.org/jira/browse/FLINK-33078 Project: Flink Issue

Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-12 Thread Jing Ge
Hi Zhanghao, Thanks for bringing this to our attention. It is a good proposal to improve data consistency. Speaking of naming conventions of choosing location over host, how about "endpoint" with the following thoughts: 1. endpoint is a more professional word than location in the network

Flink and Flink shaded dependency

2023-09-12 Thread Jing Ge
Hi Dev, Currently Flink 1.17 is using flink-shaded 16.1 and Flink 1.18 is using flink-shaded 17.0. Do we need to consider any compatibility rules between them? E.g. is there any concern to upgrade flink-shaded from 16.1 to 17.x for Flink 1.17? Or there are some implicit dependency rules between

Re: Future of classical remoting in Pekko

2023-09-12 Thread He Pin
Hi Ferenc: What's the ETA of the Flink 1.18? I think we should beable to collaborate on this,and at work we are using Flink too. On 2023/09/12 15:16:11 Ferenc Csaky wrote: > Hi Matthew, > > Thanks for bringing this up! Cca half a year ago I started to work on an Akka > Artery migration, there

Re: [DISCUSS] Drop python 3.7 support in 1.19

2023-09-12 Thread Gabor Somogyi
Thank you all for the questions/suggestions! After some questions/clarifications there are only +1 on the discussion. Unless there are further questions/objections I'm intended to merge the related PR in 24 hours: https://github.com/apache/flink/pull/23359 G On Wed, Sep 6, 2023 at 10:53 AM

Re: Future of classical remoting in Pekko

2023-09-12 Thread Ferenc Csaky
Hi Matthew, Thanks for bringing this up! Cca half a year ago I started to work on an Akka Artery migration, there is a draft PR for that [1]. It might be an option to revive that work and point it against Pekko instead. Although I would highlight FLINK-29281 [2] which will replace the whole

Re: Future of classical remoting in Pekko

2023-09-12 Thread He Pin
The netty maintenance asked akka team to migrate once back in 2012, but they never have a chance to do that, and the multi node testkit has been upgraded to Netty 4 ,only the classic transport is based on Netty 3. In later version of Akka 2.8, they removed the classic transport too. I think

[jira] [Created] (FLINK-33077) Minimize the risk of hard back-pressure with buffer debloating enabled

2023-09-12 Thread Stefan Richter (Jira)
Stefan Richter created FLINK-33077: -- Summary: Minimize the risk of hard back-pressure with buffer debloating enabled Key: FLINK-33077 URL: https://issues.apache.org/jira/browse/FLINK-33077 Project:

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread ConradJam
+1 (non-binding) Matt Wang 于2023年9月12日周二 19:29写道: > +1 (non-binding) > > > -- > > Best, > Matt Wang > > > Replied Message > | From | Samrat Deb | > | Date | 09/12/2023 18:26 | > | To | | > | Subject | Re: [VOTE] FLIP-323: Support Attached Execution on Flink > Application Completion

[jira] [Created] (FLINK-33076) broadcastEmit of ChannelSelectorRecordWriter should reuse the serialized record

2023-09-12 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-33076: -- Summary: broadcastEmit of ChannelSelectorRecordWriter should reuse the serialized record Key: FLINK-33076 URL: https://issues.apache.org/jira/browse/FLINK-33076 Project:

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread Matt Wang
+1 (non-binding) -- Best, Matt Wang Replied Message | From | Samrat Deb | | Date | 09/12/2023 18:26 | | To | | | Subject | Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs | Thank you for driving this FLIP, +1 (non-binding) Bests,

Re: [DISCUSS] Flink annotation strategy/consensus

2023-09-12 Thread Jing Ge
Hi Becket, Thanks for your reply with details. > 2. I agree it would be too verbose to annotate every internal method / > class / interface. Currently we already treat the methods / interfaces / > classes without annotations as effectively @Internal. > Does it make sense to clearly define that

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread Samrat Deb
Thank you for driving this FLIP, +1 (non-binding) Bests, Samrat On Tue, Sep 12, 2023 at 2:27 PM Ahmed Hamdy wrote: > Hi Allison > Thanks for the proposal. > + (non-binding) > Best Regards > Ahmed Hamdy > > > On Mon, 11 Sept 2023 at 03:48, Weihua Hu wrote: > > > +1 (binding) > > > > Best, > >

[VOTE] Apache Flink Stateful Functions Release 3.3.0, release candidate #2

2023-09-12 Thread Martijn Visser
Hi everyone, Please review [1] and vote on the release candidate #2 for the version 3.3.0 of Apache Flink Stateful Functions, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread Ahmed Hamdy
Hi Allison Thanks for the proposal. + (non-binding) Best Regards Ahmed Hamdy On Mon, 11 Sept 2023 at 03:48, Weihua Hu wrote: > +1 (binding) > > Best, > Weihua > > > On Mon, Sep 11, 2023 at 3:16 AM Jing Ge > wrote: > > > +1(binding) > > > > Best Regards, > > Jing > > > > On Sun, Sep 10, 2023

[RESULT][VOTE] Release flink-connector-hbase v3.0.0, release candidate #2

2023-09-12 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Ahmed (non-binding) * Sergey (non-binding) * Samrat (non-binding) * Ferenc (non-binding) * Danny (binding) * Leonard (binding) * Dong (binding) There are no disapproving

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate 2

2023-09-12 Thread Martijn Visser
Hi everyone, The vote is now closed, and I'll open a separate result thread. Best regards, Martijn On Tue, Sep 12, 2023 at 10:25 AM Dong Lin wrote: > +1 (binding) > > - Verified that the source release can be built successfully. > - Verified that the checksum and gpg files match the

Future of classical remoting in Pekko

2023-09-12 Thread Matthew de Detrich
It's come to my attention that Flink is using Pekko's classical remoting, if this is the case then I would recommend making a response at https://lists.apache.org/thread/19h2wrs2om91g5vhnftv583fo0ddfshm . Quick summary of what is being discussed is what to do with Pekko's classical remoting.

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate 2

2023-09-12 Thread Dong Lin
+1 (binding) - Verified that the source release can be built successfully. - Verified that the checksum and gpg files match the corresponding source release files and maven artifacts. - Verified that the source archives do not contain any binary file. - Checked that the source code tag looks

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

2023-09-12 Thread Dong Lin
Hi Jark, Please see my comments inline. On Mon, Sep 11, 2023 at 4:41 PM Jark Wu wrote: > Hi Dong, > > Please see my comments inline. > > > As a result, the proposed job-level > > config will be applied only in the changelog stage. So there is no > > difference between these two approaches in

[jira] [Created] (FLINK-33075) Notice files for Statefun are outdated

2023-09-12 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33075: -- Summary: Notice files for Statefun are outdated Key: FLINK-33075 URL: https://issues.apache.org/jira/browse/FLINK-33075 Project: Flink Issue Type: Bug

Re: [VOTE] Apache Flink Stateful Functions Release 3.3.0, release candidate #1

2023-09-12 Thread Martijn Visser
Hey Danny, Thanks for this. Cancelling the RC and fixing the issues. Best regards, Martijn On Mon, Sep 11, 2023 at 12:34 PM Danny Cranmer wrote: > Hey Martijn, thanks for driving this. > > -1 (binding) due to the concerns highlighted below > > - NOTICE files are present > - Note: The

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate 2

2023-09-12 Thread Leonard Xu
+1 (binding) - built from source code succeeded - verified signatures - verified hashsums - checked release notes - reviewed the web PR Best, Leonard > On Sep 11, 2023, at 7:01 PM, Danny Cranmer wrote: > > Hey Martijn, thanks for picking this up. > > +1 (binding) > > - Release notes look

[jira] [Created] (FLINK-33074) Flink-ci-mirror stopped running for commits after 3rd of Septemper

2023-09-12 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33074: --- Summary: Flink-ci-mirror stopped running for commits after 3rd of Septemper Key: FLINK-33074 URL: https://issues.apache.org/jira/browse/FLINK-33074 Project: