[jira] [Created] (FLINK-29308) NoResourceAvailableException fails the batch job

2022-09-14 Thread Aitozi (Jira)
Aitozi created FLINK-29308: -- Summary: NoResourceAvailableException fails the batch job Key: FLINK-29308 URL: https://issues.apache.org/jira/browse/FLINK-29308 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29307) Fix timeInQueue in CheckpointRequestDecider

2022-09-14 Thread chenzihao (Jira)
chenzihao created FLINK-29307: - Summary: Fix timeInQueue in CheckpointRequestDecider Key: FLINK-29307 URL: https://issues.apache.org/jira/browse/FLINK-29307 Project: Flink Issue Type:

Re: [DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Konstantin Knauf
Hi everyone, thanks for starting this discussion. I think, the flink-kubernetes and flink repository are too different (age, size) to draw conclusions from another. On a first thought, I am not a fan of having different processes for different repositories inside the project. The discussion

[jira] [Created] (FLINK-29306) fail to check multiple flink-dist*.jar for config.sh

2022-09-14 Thread LiuZeshan (Jira)
LiuZeshan created FLINK-29306: - Summary: fail to check multiple flink-dist*.jar for config.sh Key: FLINK-29306 URL: https://issues.apache.org/jira/browse/FLINK-29306 Project: Flink Issue Type:

[jira] [Created] (FLINK-29305) UpsertTestSinkWriter fails if parent of output file does not exist

2022-09-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29305: Summary: UpsertTestSinkWriter fails if parent of output file does not exist Key: FLINK-29305 URL: https://issues.apache.org/jira/browse/FLINK-29305 Project:

[jira] [Created] (FLINK-29304) Set timeout on CI

2022-09-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29304: Summary: Set timeout on CI Key: FLINK-29304 URL: https://issues.apache.org/jira/browse/FLINK-29304 Project: Flink Issue Type: Technical Debt

Re: [DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Márton Balassi
Hi gents, Thanks for the stats Martjin, that valuable insight into the situation. Having a large number of open, stale PRs can also result in a bad contributor experience down the line, as in my opinion it can reach a point where it discourages committers reviewing them as it starts to feel like

Re: [DISCUSS] FLIP-260: Expose Finish Method For UserDefinedFunction

2022-09-14 Thread Lincoln Lee
Thanks @Piort for your valuable inputs! I did a quick read of the previous discussion you mentioned, seems my flip title doesn't give a clear scope here and make some confusions, if my understanding is correct, the UDFs in your context is the user implemented

Re: [DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Chesnay Schepler
We've had discussions about closing stale PRs several times in the past and always rejected it. I see no reason to change this. If you want to close a PR, then do so while informing the contributor about the reason. On 14/09/2022 15:36, Martijn Visser wrote: Hi Gabor, I have my doubts: I

Re: [DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Martijn Visser
Hi Gabor, I have my doubts: I think the majority of the open PRs are not open because of inactivity from the contributor, but I think the majority (at least for the flink repository) are open because there are not enough reviews occurring. If we actively mark those as stale and close them, I

Re: Sink V2 interface replacement for GlobalCommitter

2022-09-14 Thread Steven Wu
Krzysztof, no worries. We are discussing the same topic (how to support storage with globally transactional commits). > In Delta Sink connector we actually use both Committer [1] and GlobalCommitter [2]. The former, since we are using Flink's Parquet file writers is doing a very simple job of "of

Re: [DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Őrhidi Mátyás
Hi Gabor, Thanks for bringing this to our attention. I'd be happy to see such automatism guarding our repos. We could start a trial period on the operator repo I guess until we have the confidence it's a good thing. Are you aware of this plugin being used at other ASF projects? Any pros/cons?

[jira] [Created] (FLINK-29303) Add DockerImageVersions

2022-09-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29303: Summary: Add DockerImageVersions Key: FLINK-29303 URL: https://issues.apache.org/jira/browse/FLINK-29303 Project: Flink Issue Type: Sub-task

[DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

2022-09-14 Thread Gabor Somogyi
Hi All, As I see there is no action for stale PRs for flink and flink-kubernetes-operator repos however almost 1k PRs are open. I would like to suggest to add new stale PR action based on the following github plugin: https://github.com/marketplace/actions/close-stale-issues I think the default

Re: Sink V2 interface replacement for GlobalCommitter

2022-09-14 Thread Krzysztof Chmielewski
Hi Yun, Thanks for your input. In Delta Sink connector we actually use both Committer [1] and GlobalCommitter [2]. The former, since we are using Flink's Parquet file writers is doing a very simple job of "of renaming the hidden file to make it visible and removing from the name some 'in-progress

Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng

2022-09-14 Thread Shuo Cheng
Congratulations Caizhi, well deserved! Best, Shuo On Fri, Sep 9, 2022 at 9:41 AM Jingsong Lee wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Caizhi Weng as a new > Flink committer. > > Caizhi has been contributing to the Flink project for more than 3 > years, and

[jira] [Created] (FLINK-29302) Support DNS policy and configuration in helm chart

2022-09-14 Thread Joao Coutinho (Jira)
Joao Coutinho created FLINK-29302: - Summary: Support DNS policy and configuration in helm chart Key: FLINK-29302 URL: https://issues.apache.org/jira/browse/FLINK-29302 Project: Flink Issue

[jira] [Created] (FLINK-29301) Publish java-ci-tools

2022-09-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29301: Summary: Publish java-ci-tools Key: FLINK-29301 URL: https://issues.apache.org/jira/browse/FLINK-29301 Project: Flink Issue Type: Technical Debt

Re: Recommended way to Enable SSL Flink Kubernetes Operator

2022-09-14 Thread Yang Wang
I think you have already found the solution. Pod template[1] is exactly what you want. [1]. https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/resource-providers/native_kubernetes/#pod-template Best, Yang Hao t Chang 于2022年9月13日周二 07:41写道: > Hi Biao > I think this

[jira] [Created] (FLINK-29300) Upgrade python version to 3.10.3

2022-09-14 Thread Bilna (Jira)
Bilna created FLINK-29300: - Summary: Upgrade python version to 3.10.3 Key: FLINK-29300 URL: https://issues.apache.org/jira/browse/FLINK-29300 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

2022-09-14 Thread Yun Gao
Congratulations, Martijn! Best, Yun -- From:weijie guo Send Time:2022 Sep. 14 (Wed.) 16:09 To:dev Subject:Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser Congratulations, Martijn! Best regards, Weijie Etienne Chauchot

Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng

2022-09-14 Thread Yun Gao
Congratulations Caizhi! Best, Yun -- From:Caizhi Weng Send Time:2022 Sep. 10 (Sat.) 19:19 To:dev Subject:Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng It's a great honor to be invited as a committer. Thank you all for the

Re: [VOTE] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

2022-09-14 Thread Qs Ou
+1 (non-binding) nice! Zheng Yu Chen 于2022年9月11日周日 20:02写道: > Since no one objected in the discuss thread, let's vote! FLIP-256 : > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-256+Support+Job+Dynamic+Parameter+With+Flink+Rest+Api > > > The vote will be open for at least 72h. > > >

Re: [DISCUSS] FLIP-260: Expose Finish Method For UserDefinedFunction

2022-09-14 Thread Piotr Nowojski
Hi Lincoln, Thanks for the proposal. Have you seen the old discussion about adding this `finish()` method? [1] We didn't add it to UDFs, as we didn't see a motivation (maybe we have missed something), and at the same time it wasn't that easy. Plain `finish()` wouldn't be enough. Users would need

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

2022-09-14 Thread weijie guo
Congratulations, Martijn! Best regards, Weijie Etienne Chauchot 于2022年9月14日周三 15:52写道: > Congrats, Martijn! > > Etienne > > Le 14/09/2022 à 08:23, Lincoln Lee a écrit : > > Congrats, Martijn! > > > > Best, > > Lincoln Lee > > > > > > Danny Cranmer 于2022年9月13日周二 16:50写道: > > > >> Congrats

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

2022-09-14 Thread Etienne Chauchot
Congrats, Martijn! Etienne Le 14/09/2022 à 08:23, Lincoln Lee a écrit : Congrats, Martijn! Best, Lincoln Lee Danny Cranmer 于2022年9月13日周二 16:50写道: Congrats Martijn, a well deserved placement. Thankyou for all your efforts in the Flink community! Danny On Tue, Sep 13, 2022 at 4:04 AM

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

2022-09-14 Thread Lincoln Lee
Congrats, Martijn! Best, Lincoln Lee Danny Cranmer 于2022年9月13日周二 16:50写道: > Congrats Martijn, a well deserved placement. Thankyou for all your efforts > in the Flink community! > > Danny > > On Tue, Sep 13, 2022 at 4:04 AM Qingsheng Ren wrote: > > > Congratulations Martijn! > > > > Best

[DISCUSS] FLIP-260: Expose Finish Method For UserDefinedFunction

2022-09-14 Thread Lincoln Lee
Hello everyone, I’d like to open a discussion on FLIP-260[1]: expose finish method for UserDefinedFunction, this makes a chance for users who rely on finish logic in the legacy close() method (< 1.14) to migrate to the new finish() method. The task lifecycle was changed in FLINK-22972[2]: a