[jira] [Created] (FLINK-32173) Flink Job Metrics returns stale values in the first request after an update in the values

2023-05-23 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-32173: - Summary: Flink Job Metrics returns stale values in the first request after an update in the values Key: FLINK-32173 URL: https://issues.apache.org/jira/browse/FLINK-32173

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-23 Thread Jing Ge
Hi Yunfeng, Hi Dong Thanks for the informative discussion! It is a rational requirement to set different checkpoint intervals for different sources in a hybridSource. The tiny downside of this proposal, at least for me, is that I have to understand the upper-bound definition of the interval and

[jira] [Created] (FLINK-32172) KafkaExample can not run with args

2023-05-23 Thread xulongfeng (Jira)
xulongfeng created FLINK-32172: -- Summary: KafkaExample can not run with args Key: FLINK-32172 URL: https://issues.apache.org/jira/browse/FLINK-32172 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-32171) Add PostStart hook to flink k8s operator helm

2023-05-23 Thread Xingcan Cui (Jira)
Xingcan Cui created FLINK-32171: --- Summary: Add PostStart hook to flink k8s operator helm Key: FLINK-32171 URL: https://issues.apache.org/jira/browse/FLINK-32171 Project: Flink Issue Type: New

[jira] [Created] (FLINK-32170) Continue metric collection on intermittant job restarts

2023-05-23 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-32170: -- Summary: Continue metric collection on intermittant job restarts Key: FLINK-32170 URL: https://issues.apache.org/jira/browse/FLINK-32170 Project: Flink

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-23 Thread Dong Lin
Hi Piotr, Thanks for the comments. Let me try to understand your concerns and hopefully address the concerns. >> What would happen if there are two (or more) operator coordinators with conflicting desired checkpoint trigger behaviour With the proposed change, there won't exist any

How to figure out what's the size of ListState?

2023-05-23 Thread Amir Hossein Sharifzadeh
Dear Flink Dev team, It's about a while since I am dealing with an issue that can't figure out myself. I spent quite a lot of time trying to solve the problem myself, but I feel stuck. I explained the problem statement and the issue here:

Re: Questions on checkpointing mechanism for FLIP-27 Source API

2023-05-23 Thread Piotr Nowojski
Hi, I vaguely remember someone implementing a mechanism to deal with it. I think at least at some point (it might have changed since I looked at it), it was solving the problem via canceling the checkpoint in the scenario that you described. However I can not remember from the top of my head

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-05-23 Thread Piotr Nowojski
Hi, Thanks for the proposal. However, are you sure that the OperatorCoordinator is the right place to place such logic? What would happen if there are two (or more) operator coordinators with conflicting desired checkpoint trigger behaviour? If one source is processing a backlog and the other is

[jira] [Created] (FLINK-32169) Show allocated slots on TM page

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32169: Summary: Show allocated slots on TM page Key: FLINK-32169 URL: https://issues.apache.org/jira/browse/FLINK-32169 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32168) Log required/available resources in RM

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32168: Summary: Log required/available resources in RM Key: FLINK-32168 URL: https://issues.apache.org/jira/browse/FLINK-32168 Project: Flink Issue Type:

[jira] [Created] (FLINK-32167) Log dynamic slot creation on task manager

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32167: Summary: Log dynamic slot creation on task manager Key: FLINK-32167 URL: https://issues.apache.org/jira/browse/FLINK-32167 Project: Flink Issue

[jira] [Created] (FLINK-32166) Show unassigned/total TM resources in web ui

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32166: Summary: Show unassigned/total TM resources in web ui Key: FLINK-32166 URL: https://issues.apache.org/jira/browse/FLINK-32166 Project: Flink Issue

[jira] [Created] (FLINK-32165) Improve observability ofd fine-grained resource management

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32165: Summary: Improve observability ofd fine-grained resource management Key: FLINK-32165 URL: https://issues.apache.org/jira/browse/FLINK-32165 Project: Flink

[jira] [Created] (FLINK-32164) LifecycleState count metrics are not reported correctly by namespace

2023-05-23 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-32164: -- Summary: LifecycleState count metrics are not reported correctly by namespace Key: FLINK-32164 URL: https://issues.apache.org/jira/browse/FLINK-32164 Project: Flink

[jira] [Created] (FLINK-32163) Support the same application run multiple jobs in HA mode

2023-05-23 Thread melin (Jira)
melin created FLINK-32163: - Summary: Support the same application run multiple jobs in HA mode Key: FLINK-32163 URL: https://issues.apache.org/jira/browse/FLINK-32163 Project: Flink Issue Type: New

[jira] [Created] (FLINK-32162) Misleading log message due to missing null check

2023-05-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32162: Summary: Misleading log message due to missing null check Key: FLINK-32162 URL: https://issues.apache.org/jira/browse/FLINK-32162 Project: Flink

Re: [DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-23 Thread Aitozi
Just catch an user case report from Giannis Polyzos for this usage: https://lists.apache.org/thread/qljwd40v5ntz6733cwcdr8s4z97b343b Aitozi 于2023年5月23日周二 17:45写道: > > Hi guys, > I want to bring up a discussion about adding support of User > Defined AsyncTableFunction in Flink. > Currently,

[jira] [Created] (FLINK-32161) Migrate and remove some legacy ExternalResource

2023-05-23 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-32161: -- Summary: Migrate and remove some legacy ExternalResource Key: FLINK-32161 URL: https://issues.apache.org/jira/browse/FLINK-32161 Project: Flink Issue Type:

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.5.0 released

2023-05-23 Thread Maximilian Michels
Niceee. Thanks for managing the release, Gyula! -Max On Wed, May 17, 2023 at 8:25 PM Márton Balassi wrote: > > Thanks, awesome! :-) > > On Wed, May 17, 2023 at 2:24 PM Gyula Fóra wrote: >> >> The Apache Flink community is very happy to announce the release of Apache >> Flink Kubernetes

[DISCUSS] FLIP-313 Add support of User Defined AsyncTableFunction

2023-05-23 Thread Aitozi
Hi guys, I want to bring up a discussion about adding support of User Defined AsyncTableFunction in Flink. Currently, async table function are special functions for table source to perform async lookup. However, it's worth to support the user defined async table function. Because, in this way,

Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-23 Thread Hang Ruan
+1(non-binding) - reviewed Jira release notes - built from source - verified signatures - verified hashes - verified that no binary exist in the source archive - run streaming job in sql-client successfully Best, Hang Samrat Deb 于2023年5月23日周二 16:23写道: > +1 (non-binding) > > - Verified

Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-23 Thread Samrat Deb
+1 (non-binding) - Verified signature - Verified hashes - Build form source with mac - Verify that the source archives do not contain any binaries - Run streaming and batch job in sql-client successfully. Thank you for driving this release candidate. On Tue, 23 May 2023 at 1:51 PM, Qingsheng

Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-23 Thread Qingsheng Ren
+1 (binding) - Verified checksums and signatures - Verified that no binary exist in the source archive - Build the source with Maven - Verified that README doesn't have unexpected contents - Verified that the commit ID on Flink UI matches with the tag - Run a job with SQL client that reads from a

[jira] [Created] (FLINK-32160) CompactOperator cannot continue from checkpoint because of java.util.NoSuchElementException

2023-05-23 Thread Jira
Michał Fijołek created FLINK-32160: -- Summary: CompactOperator cannot continue from checkpoint because of java.util.NoSuchElementException Key: FLINK-32160 URL: https://issues.apache.org/jira/browse/FLINK-32160

Re: [DISCUSS] FLIP-287: Extend Sink#InitContext to expose ExecutionConfig and JobID

2023-05-23 Thread Lijie Wang
Hi Joao, I noticed the FLIP currently contains the following 2 methods about type serializer: (1) TypeSerializer createInputSerializer(); (2) TypeSerializer createSerializer(TypeInformation inType); Is the method (2) still needed now? Best, Lijie João Boto 于2023年5月19日周五 16:53写道: > Updated

[jira] [Created] (FLINK-32159) Hudi Source throws NPE

2023-05-23 Thread Bo Cui (Jira)
Bo Cui created FLINK-32159: -- Summary: Hudi Source throws NPE Key: FLINK-32159 URL: https://issues.apache.org/jira/browse/FLINK-32159 Project: Flink Issue Type: Bug Affects Versions: 1.17.0,

Re: [VOTE] Release 1.17.1, release candidate #1

2023-05-23 Thread Benchao Li
+1 (non-binding) - Checked signature/checksum [OK] - Unpacked the src tar file, diffed with github tag [OK] - Compiled from source with jdk 1.8.0_301 [OK] - Started a local cluster, played with JDBC 3.1.0-1.17, mysql 8.0.28, for some simple batch queries [OK] - Gone through the release note [OK]