Re: Proposal to improve the Apache Flink website

2023-02-20 Thread Shuo Cheng
Hey! +1 for the proposal, the first page of Flink is more like a tutorial document for developers compared to the other top apache projects. Looking forward to a more attractive Flink website. Best regards, Shuo On Tue, Feb 21, 2023 at 8:13 AM Mohan, Deepthi wrote: > Hi, > > I am a product

Re: Metrics or runtimeContext in global commit

2023-02-20 Thread Tobias Fröhlich
Dear Yuxia, thank you for your answer! This is also our conclusion and my colleague has already proposed this feature. Best regards, Tobias - Ursprüngliche Mail - Von: "yuxia" An: "Dr. Tobias Fröhlich" CC: "User" , "dev" Gesendet: Montag, 20. Februar 2023 03:31:22 Betreff: Re:

Connectin two jobs with socket over AWS EMR - How to define the ip?

2023-02-20 Thread Itay Sali
Hi, I build a streaming pipeline and there are two jobs that I wish to connect with socket(later we plan to have kafka instead). The jobs submitted in AWS EMR cluster with this configuration { "Classification": "flink-conf", "Properties": { "JAVA_HOME":

[jira] [Created] (FLINK-31164) Unexpected correlate variable $cor0 in the plan error in where clause

2023-02-20 Thread P Rohan Kumar (Jira)
P Rohan Kumar created FLINK-31164: - Summary: Unexpected correlate variable $cor0 in the plan error in where clause Key: FLINK-31164 URL: https://issues.apache.org/jira/browse/FLINK-31164 Project:

[jira] [Created] (FLINK-31163) Unexpected correlate variable $cor0 in the plan error in where clause

2023-02-20 Thread P Rohan Kumar (Jira)
P Rohan Kumar created FLINK-31163: - Summary: Unexpected correlate variable $cor0 in the plan error in where clause Key: FLINK-31163 URL: https://issues.apache.org/jira/browse/FLINK-31163 Project:

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Lincoln Lee
Congratulations, Anton! Best, Lincoln Lee Guowei Ma 于2023年2月21日周二 15:05写道: > Congratulations, Anton! > > Best, > Guowei > > > On Tue, Feb 21, 2023 at 1:52 PM Shammon FY wrote: > > > Congratulations, Anton! > > > > Best, > > Shammon > > > > On Tue, Feb 21, 2023 at 1:41 PM Sergey Nuyanzin > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Lincoln Lee
Congratulations, Rui! Best, Lincoln Lee Guowei Ma 于2023年2月21日周二 15:03写道: > Congratulations, Rui! > > Best, > Guowei > > > On Tue, Feb 21, 2023 at 2:57 PM Wei Zhong wrote: > > > Congratulations, Rui! > > > > Best, > > Wei > > > > > 2023年2月21日 下午1:52,Shammon FY 写道: > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Guowei Ma
Congratulations, Anton! Best, Guowei On Tue, Feb 21, 2023 at 1:52 PM Shammon FY wrote: > Congratulations, Anton! > > Best, > Shammon > > On Tue, Feb 21, 2023 at 1:41 PM Sergey Nuyanzin > wrote: > > > Congratulations, Anton! > > > > On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Guowei Ma
Congratulations, Rui! Best, Guowei On Tue, Feb 21, 2023 at 2:57 PM Wei Zhong wrote: > Congratulations, Rui! > > Best, > Wei > > > 2023年2月21日 下午1:52,Shammon FY 写道: > > > > Congratulations, Rui! > > > > > > Best, > > Shammon > > > > On Tue, Feb 21, 2023 at 1:40 PM Sergey Nuyanzin > wrote: > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Wei Zhong
Congratulations, Rui! Best, Wei > 2023年2月21日 下午1:52,Shammon FY 写道: > > Congratulations, Rui! > > > Best, > Shammon > > On Tue, Feb 21, 2023 at 1:40 PM Sergey Nuyanzin wrote: > >> Congratulations, Rui! >> >> On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu wrote: >> >>> Congratulations, Rui!

Re: Proposal to improve the Apache Flink website

2023-02-20 Thread Shammon FY
Hi +1 too for this proposal Compared with the beginning, Flink has good applications in many directions now. The new website can give users better guidance for streaming/batch/olap/ML and so on. Looking forward to the new website :) Best, Shammon On Tue, Feb 21, 2023 at 2:24 PM Gyula Fóra

Re: Proposal to improve the Apache Flink website

2023-02-20 Thread Gyula Fóra
Hey! +1 The Flink website could indeed use some love both design and content-wise. Thank you for starting this effort! I think a combination of approaches I) and II) could work well. Given that this is a highly subjective area we could have a small kickoff / brainstorming session with a few

[jira] [Created] (FLINK-31162) Avoid setting private tokens to AM container context when kerberos delegation token fetch is disabled

2023-02-20 Thread Venkata krishnan Sowrirajan (Jira)
Venkata krishnan Sowrirajan created FLINK-31162: --- Summary: Avoid setting private tokens to AM container context when kerberos delegation token fetch is disabled Key: FLINK-31162 URL:

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Shammon FY
Congratulations, Rui! Best, Shammon On Tue, Feb 21, 2023 at 1:40 PM Sergey Nuyanzin wrote: > Congratulations, Rui! > > On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu wrote: > > > Congratulations, Rui! > > > > Best, > > Weihua > > > > > > On Tue, Feb 21, 2023 at 11:28 AM Biao Geng wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Shammon FY
Congratulations, Anton! Best, Shammon On Tue, Feb 21, 2023 at 1:41 PM Sergey Nuyanzin wrote: > Congratulations, Anton! > > On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu wrote: > > > Congratulations, Anton! > > > > Best, > > Weihua > > > > > > On Tue, Feb 21, 2023 at 11:22 AM weijie guo > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Sergey Nuyanzin
Congratulations, Anton! On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu wrote: > Congratulations, Anton! > > Best, > Weihua > > > On Tue, Feb 21, 2023 at 11:22 AM weijie guo > wrote: > > > Congratulations, Anton! > > > > Best regards, > > > > Weijie > > > > > > Leonard Xu 于2023年2月21日周二 11:02写道: > >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Sergey Nuyanzin
Congratulations, Rui! On Tue, Feb 21, 2023 at 4:53 AM Weihua Hu wrote: > Congratulations, Rui! > > Best, > Weihua > > > On Tue, Feb 21, 2023 at 11:28 AM Biao Geng wrote: > > > Congrats, Rui! > > Best, > > Biao Geng > > > > weijie guo 于2023年2月21日周二 11:21写道: > > > > > Congrats, Rui! > > > > > >

[jira] [Created] (FLINK-31161) upgrade MojoHaus Versions Maven Plugin to 2.14.2

2023-02-20 Thread jackylau (Jira)
jackylau created FLINK-31161: Summary: upgrade MojoHaus Versions Maven Plugin to 2.14.2 Key: FLINK-31161 URL: https://issues.apache.org/jira/browse/FLINK-31161 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Weihua Hu
Congratulations, Anton! Best, Weihua On Tue, Feb 21, 2023 at 11:22 AM weijie guo wrote: > Congratulations, Anton! > > Best regards, > > Weijie > > > Leonard Xu 于2023年2月21日周二 11:02写道: > > > Congratulations, Anton! > > > > Best, > > Leonard > > > > > > > On Feb 21, 2023, at 10:02 AM, Rui Fan

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Weihua Hu
Congratulations, Rui! Best, Weihua On Tue, Feb 21, 2023 at 11:28 AM Biao Geng wrote: > Congrats, Rui! > Best, > Biao Geng > > weijie guo 于2023年2月21日周二 11:21写道: > > > Congrats, Rui! > > > > Best regards, > > > > Weijie > > > > > > Leonard Xu 于2023年2月21日周二 11:03写道: > > > > > Congratulations,

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Biao Geng
Congrats, Rui! Best, Biao Geng weijie guo 于2023年2月21日周二 11:21写道: > Congrats, Rui! > > Best regards, > > Weijie > > > Leonard Xu 于2023年2月21日周二 11:03写道: > > > Congratulations, Rui! > > > > Best, > > Leonard > > > > > On Feb 21, 2023, at 9:50 AM, Matt Wang wrote: > > > > > > Congrats Rui > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread weijie guo
Congratulations, Anton! Best regards, Weijie Leonard Xu 于2023年2月21日周二 11:02写道: > Congratulations, Anton! > > Best, > Leonard > > > > On Feb 21, 2023, at 10:02 AM, Rui Fan wrote: > > > > Congratulations, Anton! > > > > Best, > > Rui Fan > > > > On Tue, Feb 21, 2023 at 9:23 AM yuxia > wrote:

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread weijie guo
Congrats, Rui! Best regards, Weijie Leonard Xu 于2023年2月21日周二 11:03写道: > Congratulations, Rui! > > Best, > Leonard > > > On Feb 21, 2023, at 9:50 AM, Matt Wang wrote: > > > > Congrats Rui > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | From | yuxia | >

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Leonard Xu
Congratulations, Rui! Best, Leonard > On Feb 21, 2023, at 9:50 AM, Matt Wang wrote: > > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Junrui Lee
Congratulations, Rui Best, Junrui Matt Wang 于2023年2月21日周二 09:51写道: > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan | > Congrats Rui >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Leonard Xu
Congratulations, Anton! Best, Leonard > On Feb 21, 2023, at 10:02 AM, Rui Fan wrote: > > Congratulations, Anton! > > Best, > Rui Fan > > On Tue, Feb 21, 2023 at 9:23 AM yuxia wrote: > >> Congrats Anton! >> >> Best regards, >> Yuxia >> >> - 原始邮件 - >> 发件人: "Matthias Pohl" >>

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Paul Lam
Congrats, Rui! Best, Paul Lam > 2023年2月21日 09:50,Matt Wang 写道: > > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan | > Congrats Rui

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Junrui Lee
Congratulations, Anton! Best, Junrui Rui Fan 于2023年2月21日周二 10:02写道: > Congratulations, Anton! > > Best, > Rui Fan > > On Tue, Feb 21, 2023 at 9:23 AM yuxia wrote: > > > Congrats Anton! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Matthias Pohl" > > 收件人: "dev" > > 发送时间:

Re: Proposal to improve the Apache Flink website

2023-02-20 Thread Mohan, Deepthi
Hi Jing, I am proposing a redesign of the Apache Flink website (NOT a simpler way to use Flink with Zeppelin or other technical solution). In general, the feedback we're received from customers is that the content on the Flink website is useful but is just not presented in an approachable way.

Re: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread ConradJam
+1 Maximilian Michels 于2023年2月21日周二 00:21写道: > Great to see the interest here! I think the next step would be to > write a FLIP which explains how the autoscaler implementation would be > made agnostic to the resource management framework (k8s / yarn / etc). > There will have to be

Re: Proposal to improve the Apache Flink website

2023-02-20 Thread yuxia
Hi, Deepthi. Thanks for bring it up. I'm looking forward to seeing what a “modern” user design will look like for Flink. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期二, 2023年 2 月 21日 上午 8:33:37 主题: Re: Proposal to improve the Apache Flink website Hi Deepthi,

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Rui Fan
Congratulations, Anton! Best, Rui Fan On Tue, Feb 21, 2023 at 9:23 AM yuxia wrote: > Congrats Anton! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Matthias Pohl" > 收件人: "dev" > 发送时间: 星期二, 2023年 2 月 21日 上午 12:52:40 > 主题: Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov >

[jira] [Created] (FLINK-31160) Support join/cogroup in BroadcastUtils.withBroadcastStream

2023-02-20 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-31160: - Summary: Support join/cogroup in BroadcastUtils.withBroadcastStream Key: FLINK-31160 URL: https://issues.apache.org/jira/browse/FLINK-31160 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Matt Wang
Congrats Rui -- Best, Matt Wang Replied Message | From | yuxia | | Date | 02/21/2023 09:22 | | To | dev | | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan | Congrats Rui Best regards, Yuxia - 原始邮件 - 发件人: "Samrat Deb" 收件人: "dev" 发送时间: 星期二, 2023年 2 月 21日 上午

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread yuxia
Congrats Rui Best regards, Yuxia - 原始邮件 - 发件人: "Samrat Deb" 收件人: "dev" 发送时间: 星期二, 2023年 2 月 21日 上午 1:09:25 主题: Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan Congrats Rui On Mon, 20 Feb 2023 at 10:28 PM, Anton Kalashnikov wrote: > Congrats Rui! > > -- > Best regards, > Anton

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread yuxia
Congrats Anton! Best regards, Yuxia - 原始邮件 - 发件人: "Matthias Pohl" 收件人: "dev" 发送时间: 星期二, 2023年 2 月 21日 上午 12:52:40 主题: Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov Congratulations, Anton! :-) On Mon, Feb 20, 2023 at 5:09 PM Jing Ge wrote: > Congrats Anton! > > On

Re: Proposal to improve the Apache Flink website

2023-02-20 Thread Jing Ge
Hi Deepthi, Welcome to the Flink community. Thanks for the proposal. Commonly speaking, anything that could make Flink more attractive is welcome. I was wondering what your FLIP will look like. Are you going to propose a modern UX/UI design via e.g. Zeplin which could be turned into a technical

Proposal to improve the Apache Flink website

2023-02-20 Thread Mohan, Deepthi
Hi, I am a product manager for Kinesis Data Analytics, AWS’s managed service for Apache Flink. I’m creating this thread to gauge community interest in redesigning the Flink website: https://flink.apache.org/. A few of our customers have provided feedback that the Apache Flink website looks

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-20 Thread John Roesler
Thanks for the FLIP, David! I just had one small question. IIUC, the REST API PUT request will go through the new DispatcherGateway method to be handled. Then, after validation, the dispatcher would call the new JobMasterGateway method to actually update the job. Which component will write

[jira] [Created] (FLINK-31159) Release Testing: Verify FLINK-30583 Provide the flame graph to the subtask level

2023-02-20 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-31159: --- Summary: Release Testing: Verify FLINK-30583 Provide the flame graph to the subtask level Key: FLINK-31159 URL: https://issues.apache.org/jira/browse/FLINK-31159

[jira] [Created] (FLINK-31158) Vote on the release candidate

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31158: - Summary: Vote on the release candidate Key: FLINK-31158 URL: https://issues.apache.org/jira/browse/FLINK-31158 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31157) Propose a pull request for website updates

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31157: - Summary: Propose a pull request for website updates Key: FLINK-31157 URL: https://issues.apache.org/jira/browse/FLINK-31157 Project: Flink Issue Type:

[jira] [Created] (FLINK-31156) Stage source and binary releases on dist.apache.org

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31156: - Summary: Stage source and binary releases on dist.apache.org Key: FLINK-31156 URL: https://issues.apache.org/jira/browse/FLINK-31156 Project: Flink Issue

[jira] [Created] (FLINK-31155) Build and stage Java and Python artifacts

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31155: - Summary: Build and stage Java and Python artifacts Key: FLINK-31155 URL: https://issues.apache.org/jira/browse/FLINK-31155 Project: Flink Issue Type:

[jira] [Created] (FLINK-31154) Build Release Candidate: 1.17.0-rc1

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31154: - Summary: Build Release Candidate: 1.17.0-rc1 Key: FLINK-31154 URL: https://issues.apache.org/jira/browse/FLINK-31154 Project: Flink Issue Type: New

[jira] [Created] (FLINK-31153) Create a release branch

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31153: - Summary: Create a release branch Key: FLINK-31153 URL: https://issues.apache.org/jira/browse/FLINK-31153 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31152) Setup for the executing release manager

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31152: - Summary: Setup for the executing release manager Key: FLINK-31152 URL: https://issues.apache.org/jira/browse/FLINK-31152 Project: Flink Issue Type:

[jira] [Created] (FLINK-31151) Review Release Notes in JIRA

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31151: - Summary: Review Release Notes in JIRA Key: FLINK-31151 URL: https://issues.apache.org/jira/browse/FLINK-31151 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31150) Cross team testing

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31150: - Summary: Cross team testing Key: FLINK-31150 URL: https://issues.apache.org/jira/browse/FLINK-31150 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31149) Review and update documentation

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31149: - Summary: Review and update documentation Key: FLINK-31149 URL: https://issues.apache.org/jira/browse/FLINK-31149 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31148) Triage release-blocking issues in JIRA

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31148: - Summary: Triage release-blocking issues in JIRA Key: FLINK-31148 URL: https://issues.apache.org/jira/browse/FLINK-31148 Project: Flink Issue Type:

[jira] [Created] (FLINK-31147) Create a new version in JIRA

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31147: - Summary: Create a new version in JIRA Key: FLINK-31147 URL: https://issues.apache.org/jira/browse/FLINK-31147 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31146) Flink 1.17 Release

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31146: - Summary: Flink 1.17 Release Key: FLINK-31146 URL: https://issues.apache.org/jira/browse/FLINK-31146 Project: Flink Issue Type: New Feature Affects

[jira] [Created] (FLINK-31145) Stabilize Kafka-related tests

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31145: - Summary: Stabilize Kafka-related tests Key: FLINK-31145 URL: https://issues.apache.org/jira/browse/FLINK-31145 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Samrat Deb
Congrats Rui On Mon, 20 Feb 2023 at 10:28 PM, Anton Kalashnikov wrote: > Congrats Rui! > > -- > Best regards, > Anton Kalashnikov > > On 20.02.23 17:53, Matthias Pohl wrote: > > Congratulations, Rui :) > > > > On Mon, Feb 20, 2023 at 5:10 PM Jing Ge > wrote: > > > >> Congrats Rui! > >> > >> On

[jira] [Created] (FLINK-31144) Slow scheduling on large-scale batch jobs

2023-02-20 Thread Julien Tournay (Jira)
Julien Tournay created FLINK-31144: -- Summary: Slow scheduling on large-scale batch jobs Key: FLINK-31144 URL: https://issues.apache.org/jira/browse/FLINK-31144 Project: Flink Issue Type:

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Anton Kalashnikov
Congrats Rui! -- Best regards, Anton Kalashnikov On 20.02.23 17:53, Matthias Pohl wrote: Congratulations, Rui :) On Mon, Feb 20, 2023 at 5:10 PM Jing Ge wrote: Congrats Rui! On Mon, Feb 20, 2023 at 3:19 PM Piotr Nowojski wrote: Hi, everyone On behalf of the PMC, I'm very happy to

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Matthias Pohl
Congratulations, Rui :) On Mon, Feb 20, 2023 at 5:10 PM Jing Ge wrote: > Congrats Rui! > > On Mon, Feb 20, 2023 at 3:19 PM Piotr Nowojski > wrote: > > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Rui Fan as a new Flink > > Committer. > > > > Rui Fan has been active

Re: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread Samrat Deb
> If the autoscaler supports yarn, I propose to divide it into two stages: > > 1. It only collects and evaluates scaling related performance metrics > but does not trigger any job upgrades. > 2. Support for automatic upgrades of yarn jobs. > > Thank you @Rui to validate the thought and valuable

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Matthias Pohl
Congratulations, Anton! :-) On Mon, Feb 20, 2023 at 5:09 PM Jing Ge wrote: > Congrats Anton! > > On Mon, Feb 20, 2023 at 5:02 PM Samrat Deb wrote: > > > congratulations Anton! > > > > Bests, > > Samrat > > > > On Mon, 20 Feb 2023 at 9:29 PM, John Roesler > wrote: > > > > > Congratulations,

[jira] [Created] (FLINK-31143) Invalid request: offset doesn't match when restarting from a savepoint

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31143: - Summary: Invalid request: offset doesn't match when restarting from a savepoint Key: FLINK-31143 URL: https://issues.apache.org/jira/browse/FLINK-31143 Project:

Re: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread Maximilian Michels
Great to see the interest here! I think the next step would be to write a FLIP which explains how the autoscaler implementation would be made agnostic to the resource management framework (k8s / yarn / etc). There will have to be platform-agnostic abstractions and interfaces for the implementation

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Jing Ge
Congrats Rui! On Mon, Feb 20, 2023 at 3:19 PM Piotr Nowojski wrote: > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Rui Fan as a new Flink > Committer. > > Rui Fan has been active on a small scale since August 2019, and ramped up > his contributions in the 2nd half of 2021.

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Jing Ge
Congrats Anton! On Mon, Feb 20, 2023 at 5:02 PM Samrat Deb wrote: > congratulations Anton! > > Bests, > Samrat > > On Mon, 20 Feb 2023 at 9:29 PM, John Roesler wrote: > > > Congratulations, Anton! > > -John > > > > On Mon, Feb 20, 2023, at 08:18, Piotr Nowojski wrote: > > > Hi, everyone > > >

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Samrat Deb
congratulations Anton! Bests, Samrat On Mon, 20 Feb 2023 at 9:29 PM, John Roesler wrote: > Congratulations, Anton! > -John > > On Mon, Feb 20, 2023, at 08:18, Piotr Nowojski wrote: > > Hi, everyone > > > > On behalf of the PMC, I'm very happy to announce Anton Kalashnikov as a > new > > Flink

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread John Roesler
Congratulations, Anton! -John On Mon, Feb 20, 2023, at 08:18, Piotr Nowojski wrote: > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Anton Kalashnikov as a new > Flink Committer. > > Anton has been very active for almost two years already, authored and > reviewed many PRs over

Re: [DISCUSS] Flink minor version support policy for old releases

2023-02-20 Thread Piotr Nowojski
+1 for the proposal, it makes sense to me. Re Matthias, I think ideally it would be better for the minor release manager to do the final bug fix, so that we have a clear person that's responsible for that. Otherwise I have some fear that we would forget about doing that. But I'm fine trying it

[jira] [Created] (FLINK-31142) Some queries lead to abrupt sql client close

2023-02-20 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-31142: --- Summary: Some queries lead to abrupt sql client close Key: FLINK-31142 URL: https://issues.apache.org/jira/browse/FLINK-31142 Project: Flink Issue

[jira] [Created] (FLINK-31141) CreateTableAsITCase.testCreateTableAs fails

2023-02-20 Thread Rui Fan (Jira)
Rui Fan created FLINK-31141: --- Summary: CreateTableAsITCase.testCreateTableAs fails Key: FLINK-31141 URL: https://issues.apache.org/jira/browse/FLINK-31141 Project: Flink Issue Type: Bug

[ANNOUNCE] New Apache Flink Committer - Rui Fan

2023-02-20 Thread Piotr Nowojski
Hi, everyone On behalf of the PMC, I'm very happy to announce Rui Fan as a new Flink Committer. Rui Fan has been active on a small scale since August 2019, and ramped up his contributions in the 2nd half of 2021. He was mostly involved in quite demanding performance related work around the

[ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

2023-02-20 Thread Piotr Nowojski
Hi, everyone On behalf of the PMC, I'm very happy to announce Anton Kalashnikov as a new Flink Committer. Anton has been very active for almost two years already, authored and reviewed many PRs over this time. He is active in the Flink's runtime, being the main author of improvements like Buffer

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.4.0, release candidate #1

2023-02-20 Thread Gyula Fóra
+1 (binding) - Downloaded archives, validated binary content, checksum signatures, NOTICE files - Installed to local k8s cluster from Helm repo, verified docker image, logs - Ran some basic examples, ran autoscaler example Cheers Gyula On Sun, Feb 19, 2023 at 5:09 AM Peter Huang wrote: >

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-20 Thread Matthias Pohl
Thanks for your clarifications, David. I don't have any additional major points to add. One thing about the FLIP: The RPC layer API for updating the JRR returns a future with a JRR? I don't see value in returning a JRR here since it's an idempotent operation? Wouldn't it be enough to return

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-20 Thread Maximilian Michels
Thanks David! If we could get the pre-allocation working as part of the FLIP, that would be great. Concerning the downscale case, I agree this is a special case for the (single-job) application mode where we could re-allocate slots in a way that could leave entire task managers unoccupied which

[jira] [Created] (FLINK-31140) Load additional dependencies in Operator classpath

2023-02-20 Thread Tamir Sagi (Jira)
Tamir Sagi created FLINK-31140: -- Summary: Load additional dependencies in Operator classpath Key: FLINK-31140 URL: https://issues.apache.org/jira/browse/FLINK-31140 Project: Flink Issue Type:

[jira] [Created] (FLINK-31139) not upload empty state changelog file

2023-02-20 Thread Feifan Wang (Jira)
Feifan Wang created FLINK-31139: --- Summary: not upload empty state changelog file Key: FLINK-31139 URL: https://issues.apache.org/jira/browse/FLINK-31139 Project: Flink Issue Type: Bug

Re: [DISCUSS] Flink minor version support policy for old releases

2023-02-20 Thread Matthias Pohl
+1 Thanks for picking it up, Danny. Your change makes sense. One question, though: The phrase makes it sound like we're doing it mandatorily. With this in mind, I would see the responsibility on the minor-release release managers' side (in your example 1.17). I would prefer to have it decoupled to

[jira] [Created] (FLINK-31138) Either StreamCheckpointingITCase/StreamFaultToleranceTestBase or EventTimeWindowCheckpointingITCase are timinng out

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31138: - Summary: Either StreamCheckpointingITCase/StreamFaultToleranceTestBase or EventTimeWindowCheckpointingITCase are timinng out Key: FLINK-31138 URL:

RE: Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread zhangjiao
Hi, Glad to hear that, we’re very interested in that too. Currently, all of our jobs are running on yarn and our team have implemented autoscaler in our production. We prepare to upgrade it base on flip-271.It’ll be very nice that have a version compatible with yarn and k8s. Hope to see it

[jira] [Created] (FLINK-31137) SQL Client doesn't print results for SHOW CREATE TABLE/DESC in hive dialect

2023-02-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-31137: - Summary: SQL Client doesn't print results for SHOW CREATE TABLE/DESC in hive dialect Key: FLINK-31137 URL: https://issues.apache.org/jira/browse/FLINK-31137

[jira] [Created] (FLINK-31136) SQL Client Gateway mode should not read read execution config

2023-02-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-31136: - Summary: SQL Client Gateway mode should not read read execution config Key: FLINK-31136 URL: https://issues.apache.org/jira/browse/FLINK-31136 Project: Flink

[jira] [Created] (FLINK-31135) ConfigMap DataSize went > 1 MB and cluster stopped working

2023-02-20 Thread Sriram Ganesh (Jira)
Sriram Ganesh created FLINK-31135: - Summary: ConfigMap DataSize went > 1 MB and cluster stopped working Key: FLINK-31135 URL: https://issues.apache.org/jira/browse/FLINK-31135 Project: Flink

[jira] [Created] (FLINK-31134) Out of memory error in KafkaSourceE2ECase>SourceTestSuiteBase.testScaleDown

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31134: - Summary: Out of memory error in KafkaSourceE2ECase>SourceTestSuiteBase.testScaleDown Key: FLINK-31134 URL: https://issues.apache.org/jira/browse/FLINK-31134

[jira] [Created] (FLINK-31133) AdaptiveSchedulerITCase took extraordinary long to finish

2023-02-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31133: - Summary: AdaptiveSchedulerITCase took extraordinary long to finish Key: FLINK-31133 URL: https://issues.apache.org/jira/browse/FLINK-31133 Project: Flink

[jira] [Created] (FLINK-31132) Set sink.parallelism doesn't work for Hive table

2023-02-20 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-31132: - Summary: Set sink.parallelism doesn't work for Hive table Key: FLINK-31132 URL: https://issues.apache.org/jira/browse/FLINK-31132 Project: Flink Issue

[jira] [Created] (FLINK-31131) The INITIALIZING of ExecutionState is missed in the doc

2023-02-20 Thread Rui Fan (Jira)
Rui Fan created FLINK-31131: --- Summary: The INITIALIZING of ExecutionState is missed in the doc Key: FLINK-31131 URL: https://issues.apache.org/jira/browse/FLINK-31131 Project: Flink Issue Type:

Re: [DISCUSS] Release Flink 1.15.4

2023-02-20 Thread Danny Cranmer
Hi everyone, There are two critical bugs [1][2] that are close to completion. I will try to get these into the 1.15.4 release. I will follow up with the assignees. Thanks, [1] https://issues.apache.org/jira/browse/FLINK-31041 [2] https://issues.apache.org/jira/browse/FLINK-31077 On Fri, Feb

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-20 Thread Matt Wang
Hi, Thank you gays for bringing this up, we're very interested in that as well. We are currently migrating from yarn to kubernetes, but this will last for a long time, so the support of yarn is also more important. We have now started to promote Autoscaling in our internal business. The model

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-20 Thread David Morávek
Hi everyone, Thanks for the feedback! I've updated the FLIP to use idempotent PUT API instead of PATCH and to properly handle lower bound settings, to support the "pre-allocation" of the resources. @Max > How hard would it be to address this issue in the FLIP? I've included this in the FLIP.

Re: [DISCUSS] Flink minor version support policy for old releases

2023-02-20 Thread weijie guo
Thanks Danny for the proposal~ +1 for this. In particular, we still have some users using relatively early versions of flink. Best regards, Weijie yuxia 于2023年2月20日周一 14:51写道: > +1 > Thanks for the proposal. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Weihua Hu" > 收件人: "dev" >