[VOTE] Release 1.15.0, release candidate #3

2022-04-14 Thread Yun Gao
Hi everyone, Please review and vote on the release candidate #3 for the version 1.15.0, as follows: [ ] +1, Approve the release[ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes

[jira] [Created] (FLINK-27259) Observer should not clear savepoint errors even though deployment is healthy

2022-04-14 Thread Yang Wang (Jira)
Yang Wang created FLINK-27259: - Summary: Observer should not clear savepoint errors even though deployment is healthy Key: FLINK-27259 URL: https://issues.apache.org/jira/browse/FLINK-27259 Project:

[jira] [Created] (FLINK-27258) Deployment Chinese document malformed text

2022-04-14 Thread FanJia (Jira)
FanJia created FLINK-27258: -- Summary: Deployment Chinese document malformed text Key: FLINK-27258 URL: https://issues.apache.org/jira/browse/FLINK-27258 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-27257) Flink kubernetes operator triggers savepoint failed because of not all tasks running

2022-04-14 Thread Yang Wang (Jira)
Yang Wang created FLINK-27257: - Summary: Flink kubernetes operator triggers savepoint failed because of not all tasks running Key: FLINK-27257 URL: https://issues.apache.org/jira/browse/FLINK-27257

Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

2022-04-14 Thread Qingsheng Ren
Hi Yuan, I’m fine to skip the OneToManyCache since it’s just a one-line implementation under the abstraction of cache. Thanks for the review and advice. Qingsheng > On Apr 14, 2022, at 19:23, zst...@163.com wrote: > > Hi Qingsheng, > > > > > Thanks very much for your detail advice. The

[jira] [Created] (FLINK-27256) Log the root exception in closing the task manager connection

2022-04-14 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-27256: -- Summary: Log the root exception in closing the task manager connection Key: FLINK-27256 URL: https://issues.apache.org/jira/browse/FLINK-27256 Project: Flink

[jira] [Created] (FLINK-27255) Flink-avro does not support serialization and deserialization of avro schema longer than 65535 characters

2022-04-14 Thread Haizhou Zhao (Jira)
Haizhou Zhao created FLINK-27255: Summary: Flink-avro does not support serialization and deserialization of avro schema longer than 65535 characters Key: FLINK-27255 URL:

Re: Supporting Collector API in Kinesis Connector

2022-04-14 Thread Blake Wilson
Thanks for offering to review, Danny. Thanks also for pointing out that KCL can de-aggregate records aggregated by KPL. Several applications I've worked on batch multiple records without using the KPL unfortunately. Is de-aggregation supported by the Kinesis Connector Source? I found mention of

[jira] [Created] (FLINK-27254) Add Volume and VolumeMount supports for FlinkSessionJob

2022-04-14 Thread Xin Hao (Jira)
Xin Hao created FLINK-27254: --- Summary: Add Volume and VolumeMount supports for FlinkSessionJob Key: FLINK-27254 URL: https://issues.apache.org/jira/browse/FLINK-27254 Project: Flink Issue Type:

[jira] [Created] (FLINK-27253) Remove custom surefire config from connector-cassandra

2022-04-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27253: Summary: Remove custom surefire config from connector-cassandra Key: FLINK-27253 URL: https://issues.apache.org/jira/browse/FLINK-27253 Project: Flink

[jira] [Created] (FLINK-27252) Remove surefire fork options from connector-hive

2022-04-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27252: Summary: Remove surefire fork options from connector-hive Key: FLINK-27252 URL: https://issues.apache.org/jira/browse/FLINK-27252 Project: Flink

[jira] [Created] (FLINK-27251) Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint

2022-04-14 Thread fanrui (Jira)
fanrui created FLINK-27251: -- Summary: Solve the problem that upstream Task cannot be switched to Unaligned Checkpoint Key: FLINK-27251 URL: https://issues.apache.org/jira/browse/FLINK-27251 Project: Flink

[jira] [Created] (FLINK-27250) Remove custom surefire config from sql-parser[-hive]

2022-04-14 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27250: Summary: Remove custom surefire config from sql-parser[-hive] Key: FLINK-27250 URL: https://issues.apache.org/jira/browse/FLINK-27250 Project: Flink

Re: [DISCUSS] FLIP-220: Temporal State

2022-04-14 Thread Yun Tang
Hi David Anderson, I feel doubted that no motivating use case for this generalization to SortedMapState. From our internal stats, SQL user would use much more cases of min/max with retract functions [1] compared with interval join. From my understanding, the TemporalListState is actually

Re:Re: [DISCUSS] The abstraction of cache lookupFunction and cache metric

2022-04-14 Thread zst...@163.com
Hi Qingsheng, Thanks very much for your detail advice. The first two points are very clear and make sense. I have only one question about the third point. >Another point to note is that if you check the usage of cache in JDBC and Hive >lookup table, the value type is List, since it’s

Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-14 Thread Jingsong Li
I agree with Martijn. At least, HDFS S3 OSS should be supported. Best, Jingsong On Thu, Apr 14, 2022 at 4:46 PM Martijn Visser wrote: > > Hi Ron, > > The FLIP mentions that the priority will be set to support HDFS as a > resource provider. I'm concerned that we end up with a partially >

[jira] [Created] (FLINK-27249) Change the state field in the FlinkSessionJob.Spec.Job into desiredState

2022-04-14 Thread Xin Hao (Jira)
Xin Hao created FLINK-27249: --- Summary: Change the state field in the FlinkSessionJob.Spec.Job into desiredState Key: FLINK-27249 URL: https://issues.apache.org/jira/browse/FLINK-27249 Project: Flink

Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-14 Thread Martijn Visser
Hi Ron, The FLIP mentions that the priority will be set to support HDFS as a resource provider. I'm concerned that we end up with a partially implemented FLIP which only supports local and HDFS and then we move on to other features, as we see happen with others. I would argue that we should not

[jira] [Created] (FLINK-27248) can not call function collect_set() in hive module

2022-04-14 Thread macdoor615 (Jira)
macdoor615 created FLINK-27248: -- Summary: can not call function collect_set() in hive module Key: FLINK-27248 URL: https://issues.apache.org/jira/browse/FLINK-27248 Project: Flink Issue Type:

[jira] [Created] (FLINK-27247) when add numeric casting rules, some logics are lost

2022-04-14 Thread xuyang (Jira)
xuyang created FLINK-27247: -- Summary: when add numeric casting rules, some logics are lost Key: FLINK-27247 URL: https://issues.apache.org/jira/browse/FLINK-27247 Project: Flink Issue Type: Bug

Re: Supporting Collector API in Kinesis Connector

2022-04-14 Thread Danny Cranmer
Just to clarify, the native KCL/KPL aggregation [1] handles the partition key rebalancing for you out of the box. [1] https://docs.aws.amazon.com/streams/latest/dev/kinesis -kpl-concepts.html#kinesis-kpl-concepts-aggretation On Thu, Apr 14, 2022 at 8:48 AM Danny Cranmer wrote: > Hey Blake, >

Re: Supporting Collector API in Kinesis Connector

2022-04-14 Thread Danny Cranmer
Hey Blake, I am happy to take a look, but I will not have capacity until next week. The current way to achieve multiple records per PUT is to use the native KCL/KPL aggregation [1], which is supported by the Flink connector. A downside of aggregation is that the sender has to manage the

Alertmanager Sink Connector

2022-04-14 Thread Dhruv Patel
Hi, We have a use case where we want to send alerts to Prometheus Alertmanager (https://prometheus.io/docs/alerting/latest/alertmanager/) from Flink. Each of these alerts have a startsAt, endsAt field along with alertMetadata. Alertmanager expects clients to send all the FIRING alerts every X

[jira] [Created] (FLINK-27246) Code of method "processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V" of class "HashAggregateWithKeys$9211" grows beyond 64 KB

2022-04-14 Thread Jira
Maciej Bryński created FLINK-27246: -- Summary: Code of method "processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V" of class "HashAggregateWithKeys$9211" grows beyond 64 KB Key: FLINK-27246

[jira] [Created] (FLINK-27245) Flink job on Yarn cannot revover when zookeeper in Exception

2022-04-14 Thread hjw (Jira)
hjw created FLINK-27245: --- Summary: Flink job on Yarn cannot revover when zookeeper in Exception Key: FLINK-27245 URL: https://issues.apache.org/jira/browse/FLINK-27245 Project: Flink Issue Type: Bug

Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-14 Thread 刘大龙
Hi, everyone First of all, thanks for the valuable suggestions received about this FLIP. After some discussion, it looks like all concerns have been addressed for now, so I will start a vote about this FLIP in two or three days later. Also, further feedback is very welcome. Best, Ron >