Re: [VOTE] Apache Flink Kubernetes Operator Release 1.4.0, release candidate #1

Thanks Gyula for the release. +1 (non-binding) I tested the following: * Helm repo install from flink-kubernetes-operator-1.4.0-helm.tgz * Podman Dockerfile build from source, looked good. * Twistlock security scans of proposed image looks good. No currently known vulnerabilities

Re: Proposal to add support for Kafka Headers to KafkaRecordSerializationSchemaWrapper

Hi Alex, Just assigned the ticket to you. Kafka Header should be supported as we started implementing the KafkaSink. Thanks for driving this! Best regards, Jing On Fri, Feb 17, 2023 at 3:35 PM Alex Gout wrote: > Hey :) > I created a JIRA for

Re: [DISCUSS] Flink minor version support policy for old releases

+1 I would not be surprised to also see future requests to extend the window for older releases in general. Rollout of upgrades may not keep pace with our current release policy for a variety of reasons. Thanks, Thomas On Fri, Feb 17, 2023 at 12:38 PM Jing Ge wrote: > +1 > > Thanks Danny for

Re: [DISCUSS] Flink minor version support policy for old releases

+1 Thanks Danny for starting the discussion! This proposal makes a lot of sense. Given that the Flink development is so active, there should be always some bugs fix with the previous minor version waiting to be "flushed" during the time when a new minor version after the current minor version is

Re: [DISCUSS] Flink minor version support policy for old releases

Hi Danny, yes, this makes a lot of sense. We should probably by default just do one more patch release shortly after the official support window has ended to flush out all bug fixes. Cheers, Konstantin Am Fr., 17. Feb. 2023 um 17:52 Uhr schrieb Danny Cranmer < dannycran...@apache.org>: >

[DISCUSS] Flink minor version support policy for old releases

Hello all, As proposed by Matthias in a separate thread [1], I would like to start a discussion on changing the policy wording to include the release of bug fixes during their support window. Our current policy [2] is to only support the latest two minor versions: " If 1.17.x is the current

Re: Proposal to add support for Kafka Headers to KafkaRecordSerializationSchemaWrapper

Hey :) I created a JIRA for it. Can someone assign it to me? On Mon, Feb 13, 2023 at 3:17 PM Márton Balassi wrote: > Hi Alex, > > Please do share, this comes up somewhat frequently. > > Marton > > On Mon, Feb 13, 2023 at 7:44 PM Őrhidi Mátyás

[jira] [Created] (FLINK-31125) Flink ML benchmark result should not include data generation overhead

Dong Lin created FLINK-31125: Summary: Flink ML benchmark result should not include data generation overhead Key: FLINK-31125 URL: https://issues.apache.org/jira/browse/FLINK-31125 Project: Flink

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

@Gyula Thank you We will work on this and try to come up with an approach. On Fri, Feb 17, 2023 at 6:12 PM Gyula Fóra wrote: > In case you guys feel strongly about this I suggest you try to fork the > autoscaler implementation and make a version that works with both the > Kubernetes operator

[jira] [Created] (FLINK-31124) Add it case for HiveTableSink speculative execution

Biao Liu created FLINK-31124: Summary: Add it case for HiveTableSink speculative execution Key: FLINK-31124 URL: https://issues.apache.org/jira/browse/FLINK-31124 Project: Flink Issue Type:

[jira] [Created] (FLINK-31123) Add it case for FileSink speculative execution

Biao Liu created FLINK-31123: Summary: Add it case for FileSink speculative execution Key: FLINK-31123 URL: https://issues.apache.org/jira/browse/FLINK-31123 Project: Flink Issue Type:

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

In case you guys feel strongly about this I suggest you try to fork the autoscaler implementation and make a version that works with both the Kubernetes operator and YARN. If your solution is generic and works well, we can discuss the way forward. Unfortunately me or my team don't really have the

[jira] [Created] (FLINK-31122) Expose MetricGroup to Committer of new Unified Sink v2

Theo Diefenthal created FLINK-31122: --- Summary: Expose MetricGroup to Committer of new Unified Sink v2 Key: FLINK-31122 URL: https://issues.apache.org/jira/browse/FLINK-31122 Project: Flink

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

@Gyula >> It is easier to make the operator work with jobs running in different types of clusters than to take the autoscaler module itself and plug that in somewhere else. Our (part of Samrat's team) main problem is to leverage the AutoScaler Recommendation Engine part of

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

Thank you all! Looking forward to working with you even closer! Best regards, Jing On Fri, Feb 17, 2023 at 8:33 AM Qingsheng Ren wrote: > Congratulations and welcome, Jing! > > Best, > Qingsheng > > On Fri, Feb 17, 2023 at 3:02 PM Jane Chan wrote: > >> Congratulations, Jing! >> >> Best, >>

Should the sink writer and committer always be chained together

Hi all, I see that some users are finding the way to disable the chain of sink writer and committer [1]. This makes me think about the bug FLINK-29492 [2], which is caused by the operator chaining disabled. When operator chaining disabled, the kafka committer can not return the producers to the

Re: [DISCUSS] Release Flink 1.15.4

Thanks for the feedback. I will start the release preparation. Matthias I agree with your idea, I will start a separate discussion thread on this matter. Thanks, Danny On Fri, Feb 17, 2023 at 2:00 AM ConradJam wrote: > +1 > > Sergey Nuyanzin 于2023年2月16日周四 17:36写道： > > > +1 > > > > On Thu,

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Congrats and welcome to the team! On Fri, Feb 17, 2023 at 10:03 AM Benchao Li wrote: > Congratulations, Dong! > > Lincoln Lee 于2023年2月17日周五 17:42写道： > > > Congratulations, Dong! > > > > Best, > > Lincoln Lee > > > > > > Qingsheng Ren 于2023年2月17日周五 15:34写道： > > > > > Congratulations, Dong! >

[jira] [Created] (FLINK-31121) KafkaSink should be able to catch and ignore exp via config on/off

Jing Ge created FLINK-31121: --- Summary: KafkaSink should be able to catch and ignore exp via config on/off Key: FLINK-31121 URL: https://issues.apache.org/jira/browse/FLINK-31121 Project: Flink

[jira] [Created] (FLINK-31120) ConcurrentModificationException occurred in StringFunctionsITCase.test

Matthias Pohl created FLINK-31120: - Summary: ConcurrentModificationException occurred in StringFunctionsITCase.test Key: FLINK-31120 URL: https://issues.apache.org/jira/browse/FLINK-31120 Project:

[jira] [Created] (FLINK-31119) JobRecoveryITCase.testTaskFailureRecovery failed due to the job not finishing successfully

Matthias Pohl created FLINK-31119: - Summary: JobRecoveryITCase.testTaskFailureRecovery failed due to the job not finishing successfully Key: FLINK-31119 URL: https://issues.apache.org/jira/browse/FLINK-31119

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Congratulations, Dong! Lincoln Lee 于2023年2月17日周五 17:42写道： > Congratulations, Dong! > > Best, > Lincoln Lee > > > Qingsheng Ren 于2023年2月17日周五 15:34写道： > > > Congratulations, Dong! > > > > Best, > > Qingsheng > > > > On Fri, Feb 17, 2023 at 3:00 PM Jane Chan wrote: > > > > > Congratulations,

[jira] [Created] (FLINK-31118) Add ARRAY_UNION supported in SQL & Table API

jackylau created FLINK-31118: Summary: Add ARRAY_UNION supported in SQL & Table API Key: FLINK-31118 URL: https://issues.apache.org/jira/browse/FLINK-31118 Project: Flink Issue Type: Sub-task

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Congratulations, Dong! Best, Lincoln Lee Qingsheng Ren 于2023年2月17日周五 15:34写道： > Congratulations, Dong! > > Best, > Qingsheng > > On Fri, Feb 17, 2023 at 3:00 PM Jane Chan wrote: > > > Congratulations, Dong! > > > > Best, > > Jane > > > > On Fri, Feb 17, 2023 at 10:43 AM Zhipeng Zhang > >

[jira] [Created] (FLINK-31117) Split flink connector to each module of each version

Jingsong Lee created FLINK-31117: Summary: Split flink connector to each module of each version Key: FLINK-31117 URL: https://issues.apache.org/jira/browse/FLINK-31117 Project: Flink Issue