Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2022-11-28 Thread Martijn Visser
Hi, Is there any update to be expected on the benchmark? I see results of the benchmark being posted to Slack, but it appears that it's not being monitored and no follow-up actions are being taken. I think it's currently lacking a process on how to interpret the results and what action should be t

[jira] [Created] (FLINK-30236) UpsertKafkaTableITCase failed due to timeout when creating a topic

2022-11-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30236: - Summary: UpsertKafkaTableITCase failed due to timeout when creating a topic Key: FLINK-30236 URL: https://issues.apache.org/jira/browse/FLINK-30236 Project: Flink

[jira] [Created] (FLINK-30235) Comprehensive benchmarks on changelog checkpointing

2022-11-28 Thread Rui Xia (Jira)
Rui Xia created FLINK-30235: --- Summary: Comprehensive benchmarks on changelog checkpointing Key: FLINK-30235 URL: https://issues.apache.org/jira/browse/FLINK-30235 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-30234) SourceReaderBase should provide an option to disable numRecordsIn metric registration

2022-11-28 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-30234: - Summary: SourceReaderBase should provide an option to disable numRecordsIn metric registration Key: FLINK-30234 URL: https://issues.apache.org/jira/browse/FLINK-30234

Re: How's JobManager bring up TaskManager in Application Mode or Session Mode?

2022-11-28 Thread Matthias Pohl
Hi Mark, the JobManager is not necessarily in charge of spinning up TaskManager instances. It depends on the resource provider configuration you choose. Flink differentiates between active and passive Resource Management (see the two available implementations of ResourceManager [1]). Active Resour

Re: Kubernetes Operator 1.3.0 release

2022-11-28 Thread Őrhidi Mátyás
Thanks Gyula! Sounds good. On Mon, Nov 28, 2022 at 9:59 PM Gyula Fóra wrote: > Hi Matyas! > > +1 for the 1.3.0 release. > > Thank you for the proposal and for volunteering as a release manager. > > Given that it's already Nov 29 here, I suggest moving the feature freeze > to the end of this week

Re: Kubernetes Operator 1.3.0 release

2022-11-28 Thread Gyula Fóra
Hi Matyas! +1 for the 1.3.0 release. Thank you for the proposal and for volunteering as a release manager. Given that it's already Nov 29 here, I suggest moving the feature freeze to the end of this week (Dec 2) and release cut to mid next week (Dec 7) to give us some flexibility in merging the

Kubernetes Operator 1.3.0 release

2022-11-28 Thread Őrhidi Mátyás
Hi Devs, Our planned milestones for the upcoming operator 1.3.0 release are the following: Feature Freeze: Nov 28 Release Cut:Dec 5 Release Date: Dec 12 There are a few JIRAs that still need to be addressed, but most of them are work in progress, so it seems we can most probably me

Re: [VOTE] FLIP-271: Autoscaling

2022-11-28 Thread Chenya Zhang
+1 (non-binding) On Sun, Nov 27, 2022 at 5:49 PM Jiangang Liu wrote: > +1 (non-binding) > > Best, > Jiangang Liu > > Thomas Weise 于2022年11月28日周一 06:23写道: > > > +1 (binding) > > > > > > On Sat, Nov 26, 2022 at 8:11 AM Zheng Yu Chen > wrote: > > > > > +1(no-binding) > > > > > > Maximilian Michel

[jira] [Created] (FLINK-30233) Hybrid full result partition should also work with speculative execution

2022-11-28 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-30233: -- Summary: Hybrid full result partition should also work with speculative execution Key: FLINK-30233 URL: https://issues.apache.org/jira/browse/FLINK-30233 Project: Flink

How's JobManager bring up TaskManager in Application Mode or Session Mode?

2022-11-28 Thread
Hi, How's JobManager bring up TaskManager in Application Mode or Session Mode? I can’t get it even after reading source code of flink operator? Any help will be appreciate, Thank you. Mark

[jira] [Created] (FLINK-30232) shading of netty epoll shared library does not account for ARM64 platform

2022-11-28 Thread Chris Thomson (Jira)
Chris Thomson created FLINK-30232: - Summary: shading of netty epoll shared library does not account for ARM64 platform Key: FLINK-30232 URL: https://issues.apache.org/jira/browse/FLINK-30232 Project:

[jira] [Created] (FLINK-30231) Update to Fabric8 Kubernetes Client to a version that has automatic renewal of service account tokens

2022-11-28 Thread Chris Thomson (Jira)
Chris Thomson created FLINK-30231: - Summary: Update to Fabric8 Kubernetes Client to a version that has automatic renewal of service account tokens Key: FLINK-30231 URL: https://issues.apache.org/jira/browse/FLINK-

Re: [NOTICE] Connector release guide

2022-11-28 Thread Danny Cranmer
Thanks Chesnay, this was very helpful! On Mon, 28 Nov 2022, 16:07 Chesnay Schepler, wrote: > Just so spread some awareness: > > The wiki now contains a release guide for connectors: > > > https://cwiki.apache.org/confluence/display/FLINK/Creating+a+flink-connector+release > >

Re: SQL Gateway and SQL Client

2022-11-28 Thread Jim Hughes
Hi Shengkai, Yu, Thanks for the FLIP! I have had a chance to read it, and it looks good. I do have some questions: I do like the idea of unifying the approaches so that the code doesn't get out of step. 1. For the Client Parser, is it going to work with the extended syntax from the Flink

[jira] [Created] (FLINK-30230) Drop Support for Flink 1.15

2022-11-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30230: - Summary: Drop Support for Flink 1.15 Key: FLINK-30230 URL: https://issues.apache.org/jira/browse/FLINK-30230 Project: Flink Issue Type: Improvement

[VOTE] Release flink-connector-dynamodb v3.0.0, release candidate #0

2022-11-28 Thread Danny Cranmer
Hi everyone, Please review and vote on the release candidate #0 for the version 3.0.0 as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * t

[NOTICE] Connector release guide

2022-11-28 Thread Chesnay Schepler
Just so spread some awareness: The wiki now contains a release guide for connectors: https://cwiki.apache.org/confluence/display/FLINK/Creating+a+flink-connector+release

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-28 Thread Dawid Wysakowicz
Do we really need to have separate methods for triggering/waiting/cancelling. To me it sounds rather counterintuitive. Why can't users just execute whatever they want in the handler itself instead of additional back and forth with the system? Moreover it still have the downside that if you call

[jira] [Created] (FLINK-30229) SQL IT case for DynamoDB Sink

2022-11-28 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30229: - Summary: SQL IT case for DynamoDB Sink Key: FLINK-30229 URL: https://issues.apache.org/jira/browse/FLINK-30229 Project: Flink Issue Type: Improvement

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-28 Thread Galen Warren
Hi Gordon, just checking in. Is there anything I can do to help here? On Fri, Nov 4, 2022 at 12:59 PM Tzu-Li (Gordon) Tai wrote: > @Galen The next step is essentially for someone to be the release manager > and drive the release process for StateFun 3.3.0 [1]. The document for the > release proc

[jira] [Created] (FLINK-30228) RateLimitedSourceReaderITCase.testRateLimitingParallelExecution failed

2022-11-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30228: - Summary: RateLimitedSourceReaderITCase.testRateLimitingParallelExecution failed Key: FLINK-30228 URL: https://issues.apache.org/jira/browse/FLINK-30228 Project: Fli

Re: Table API thrift support

2022-11-28 Thread Martijn Visser
Hi Chen, Everything on connector externalization is documented at https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development, including the links to the relevant discussions on that topic in the community. Thanks, Martijn On Mon, Nov 28, 2022 at 11:59 AM Chen Qin wrot

Re: Table API thrift support

2022-11-28 Thread Chen Qin
Hi Martijn, I feel our proposal “shading libthrift in hive connector” seems pinching a new problem “how to externalization connectors”. I assume there might be some discussion in community already. If so please kindly pass some contexts. I would incline take back shading proposal at this point.

[jira] [Created] (FLINK-30227) Add LeafEmptyFunction for predicate without fields

2022-11-28 Thread Shammon (Jira)
Shammon created FLINK-30227: --- Summary: Add LeafEmptyFunction for predicate without fields Key: FLINK-30227 URL: https://issues.apache.org/jira/browse/FLINK-30227 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-30226) Offer a Identity(De)SerializationSchema

2022-11-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-30226: Summary: Offer a Identity(De)SerializationSchema Key: FLINK-30226 URL: https://issues.apache.org/jira/browse/FLINK-30226 Project: Flink Issue Type: Improveme

How to make flink operator as a cluster operator?

2022-11-28 Thread Mark Lee
Hi all, How to make flink operator as a cluster operator? And How to register it to CVO(Cluster Version Operator)? I didn't find any code or configure file in flink-operator's code. Thank you. Mark

[jira] [Created] (FLINK-30225) Convergence test failed once after reference version upgrade to 1.15.3

2022-11-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30225: - Summary: Convergence test failed once after reference version upgrade to 1.15.3 Key: FLINK-30225 URL: https://issues.apache.org/jira/browse/FLINK-30225 Project: Fli

[jira] [Created] (FLINK-30224) NullPointerException in FlinkKinesisConsumer's close() method during too early stop-with-savepoint

2022-11-28 Thread Astamur Kirillin (Jira)
Astamur Kirillin created FLINK-30224: Summary: NullPointerException in FlinkKinesisConsumer's close() method during too early stop-with-savepoint Key: FLINK-30224 URL: https://issues.apache.org/jira/browse/FLI

Re: Table API thrift support

2022-11-28 Thread Martijn Visser
Hi Chen, While I agree that Hive Metastore is a crucial component for a lot of companies, this isn't the case for all companies. Right now it sounds like Flink has to take on tech debt because users of Flink are running on older versions of the Hive Metastore. I don't think that's a good idea at a