[DISCUSS] REST API to suspend & resume checkpointing

Hey everyone, I will create a FLIP, but wanted to gauge community opinion first. The motivation is that production Flink applications frequently need to go through node/image patching to update the software and AMI with latest security fixes. These patching related restarts do not involve

[jira] [Created] (FLINK-29698) Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link

Caizhi Weng created FLINK-29698: --- Summary: Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link Key: FLINK-29698 URL: https://issues.apache.org/jira/browse/FLINK-29698

[jira] [Created] (FLINK-29697) Flaky test failure KafkaShuffleExactlyOnceITCase.testAssignedToPartitionFailureRecoveryEventTime

Samrat Deb created FLINK-29697: -- Summary: Flaky test failure KafkaShuffleExactlyOnceITCase.testAssignedToPartitionFailureRecoveryEventTime Key: FLINK-29697 URL: https://issues.apache.org/jira/browse/FLINK-29697

[jira] [Created] (FLINK-29696) [Doc] Operator helm install command points to wrong repo

Yufei Zhang created FLINK-29696: --- Summary: [Doc] Operator helm install command points to wrong repo Key: FLINK-29696 URL: https://issues.apache.org/jira/browse/FLINK-29696 Project: Flink Issue

[VOTE] FLIP 267: Iceberg Connector

Hi all, Thanks for all the feedback for FLIP 267[1]: Iceberg Connector in the discussion thread [2]. I would like to start a vote thread for it. The vote will be open for atleast 72 hours. [1] https://lists.apache.org/thread/ycdll6wxj4npz5h7zvoh9khtfw8vy9nr

Re: [Discuss]- Donate Iceberg Flink Connector

Hi Martijn, I created a FLIP for this, its FLIP 267: Iceberg Connector  Please let me know if anything else is needed. My email on confluence is abmo.w...@icloud.com. As 1.0 was released today, from Iceberg

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

Hi Kevin, While it's still a non-binding vote I do want to ask you to reconsider given the following: In the discussion thread I outlined that Flinks Scala APIs can't be removed until Flink 2.0 while Java 17 support can either be added in a new Flink minor version or in a next major version as

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

Hi Abid, We should have a FLIP as this would be a code contribution. If you provide your Confluence user name, we can grant you access to create one. Is there also something from an Iceberg point of view needed to agree with the code contribution? Best regards, Martijn Op wo 19 okt. 2022 om

RE: Re: Re: [Discuss]- Donate Iceberg Flink Connector

Thanks Martijn! Thanks for all the support and positive responses. I will start a vote thread and send it out to the dev list. Also, we need help with creation of a new repo for the Iceberg Connector. Can someone help with the creation of a repo? Please let me know if I need to create an

[jira] [Created] (FLINK-29695) Create a utility to report the status of the last savepoint

Clara Xiong created FLINK-29695: --- Summary: Create a utility to report the status of the last savepoint Key: FLINK-29695 URL: https://issues.apache.org/jira/browse/FLINK-29695 Project: Flink

Re: [Cassandra] source connector

Hi Etienne, thanks for your contribution. In light of the current efforts to externalize connectors, do you think we could maybe combine the new implementation with moving it into an external repository instead of merging into Flink main? Best, Alexander Fedulov On Fri, Oct 14, 2022 at 4:18 PM

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

+1 On Wed, Oct 19, 2022 at 12:56 PM Jing Ge wrote: > +1 > > On Wed, Oct 19, 2022 at 10:31 AM David Anderson > wrote: > > > +1 > > > > > > > > On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser > > > wrote: > > > > > Hi everyone, > > > > > > I'm hereby opening a vote for FLIP-265 Deprecate and

[jira] [Created] (FLINK-29694) Support tolerations in helm template for flink operator deployment

Max Lim created FLINK-29694: --- Summary: Support tolerations in helm template for flink operator deployment Key: FLINK-29694 URL: https://issues.apache.org/jira/browse/FLINK-29694 Project: Flink

RE: [VOTE] FLIP-265 Deprecate and remove Scala API support

Non-binding -1. Aligned with the objections raised by Yaroslav in https://lists.apache.org/thread/d3borhdzj496nnggohq42fyb6zkwob3h and agree with his recommendation to support Java 17 as a prerequisite. We use the Scala APIs extensively and we would like to have an alternative to Scala so that

[jira] [Created] (FLINK-29693) MiniClusterExtension should respect DEFAULT_PARALLELISM if set

Chesnay Schepler created FLINK-29693: Summary: MiniClusterExtension should respect DEFAULT_PARALLELISM if set Key: FLINK-29693 URL: https://issues.apache.org/jira/browse/FLINK-29693 Project:

[jira] [Created] (FLINK-29692) Support early/late fires for Windowing TVFs

Canope Nerda created FLINK-29692: Summary: Support early/late fires for Windowing TVFs Key: FLINK-29692 URL: https://issues.apache.org/jira/browse/FLINK-29692 Project: Flink Issue Type:

[jira] [Created] (FLINK-29691) Adjust org.apache.flink.test.junit5.MiniClusterExtension#registerEnv to honor DEFAULT_PARALLELISM if set

Martijn Visser created FLINK-29691: -- Summary: Adjust org.apache.flink.test.junit5.MiniClusterExtension#registerEnv to honor DEFAULT_PARALLELISM if set Key: FLINK-29691 URL:

[DISCUSS] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

Hi devs, I would like to open a discussion to remove the long deprecated (@PublicEvolving) TypeSerializerConfigSnapshot class [1] and the related code. The motivation behind this move is two fold. One reason is that it complicates our code base unnecessarily and creates confusion on how to

[jira] [Created] (FLINK-29690) listTables in HiveCatalog should only return table store tables

Jingsong Lee created FLINK-29690: Summary: listTables in HiveCatalog should only return table store tables Key: FLINK-29690 URL: https://issues.apache.org/jira/browse/FLINK-29690 Project: Flink

[RESULT][VOTE] Reverting sink metric name changes made in 1.15

Hi everyone, I'm happy to announce that the vote about reverting sink metric name changes has passed [1]: +1 votes: - Hang Ruan (non-binding) - Jark Wu (binding) - Xintong Song (binding) - Xingbo Huang (binding) - Jing Ge (non-binding) - Yun Tang (binding) There are no disapproving votes.

[jira] [Created] (FLINK-29689) CLONE - Improve the CSV reading process

Vrinda Palod created FLINK-29689: Summary: CLONE - Improve the CSV reading process Key: FLINK-29689 URL: https://issues.apache.org/jira/browse/FLINK-29689 Project: Flink Issue Type:

[jira] [Created] (FLINK-29688) Build time compatibility check for DynamoDB SDK

Danny Cranmer created FLINK-29688: - Summary: Build time compatibility check for DynamoDB SDK Key: FLINK-29688 URL: https://issues.apache.org/jira/browse/FLINK-29688 Project: Flink Issue

Re: Re: Re: [DISCUSS] Aligning migration test data generation

Works for me. Feel free to ping me for a review. Best, Matthias On Wed, Oct 19, 2022 at 10:01 AM Yun Gao wrote: > Hi Matthias, > > Thanks a lot for the clarification! If it is not a blocker for 1.16, I > could also continue to > finish the whole work roughly in the next week so we could avoid

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

+1 On Wed, Oct 19, 2022 at 10:31 AM David Anderson wrote: > +1 > > > > On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser > wrote: > > > Hi everyone, > > > > I'm hereby opening a vote for FLIP-265 Deprecate and remove Scala API > > support. The related discussion can be found here [1]. > > > >

[jira] [Created] (FLINK-29687) Do not throw exception when Lookup table is empty

Jane Chan created FLINK-29687: - Summary: Do not throw exception when Lookup table is empty Key: FLINK-29687 URL: https://issues.apache.org/jira/browse/FLINK-29687 Project: Flink Issue Type: Bug

Re: [VOTE] Drop Gelly

Hi everyone, The vote has passed already, as you can see in the result thread [1] Regarding mentioning continued support of graph processing, feel free to comment on the open PR on flink-web [2] on this. Thanks, Martijn [1] https://lists.apache.org/thread/ng5t85t1lnmzrld4vvlk0mglq3fcgj50 [2]

Re: [VOTE] Drop Gelly

+1 and I second Yu Li and Yun Gao. It should be also pointed out that Flink will continue to support graph processing with a new plan in the upcoming 1.17 release notes which includes the change of dropping Gelly in order to let more developers and users be aware of it. Best regards, Jing On

Re: Re: [Discuss]- Donate Iceberg Flink Connector

Hi all, Thanks for the info and also thanks Peter and Steven for offering to volunteer. I think that's a great idea and a necessity. Overall +1 given the current ideas to make this contribution happen. BTW congrats on reaching Iceberg 1.0, a great accomplishment :) Thanks, Martijn On Tue,

Re: [VOTE] Drop Gelly

+1 On Wed, Oct 12, 2022 at 10:59 PM Martijn Visser wrote: > Hi everyone, > > I would like to open a vote for dropping Gelly, which was discussed a long > time ago but never put to a vote [1]. > > Voting will be open for at least 72 hours. > > Best regards, > > Martijn >

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

+1 On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser wrote: > Hi everyone, > > I'm hereby opening a vote for FLIP-265 Deprecate and remove Scala API > support. The related discussion can be found here [1]. > > Voting will be open for at least 72 hours. > > Best regards, > > Martijn >

Re: [DISCUSS] Changing the minimal supported version of Hadoop to 2.10.2

+1; anything below 2.10.x seems to be EOL Best, D. On Mon, Oct 17, 2022 at 10:48 AM Márton Balassi wrote: > Hi Martjin, > > +1 for 2.10.2. Do you expect to have bandwidth in the near term to > implement the bump? > > On Wed, Oct 5, 2022 at 5:00 PM Gabor Somogyi > wrote: > > > Hi Martin, > > >

Re: Re: Re: [DISCUSS] Aligning migration test data generation

Hi Matthias, Thanks a lot for the clarification! If it is not a blocker for 1.16, I could also continue to finish the whole work roughly in the next week so we could avoid redundant work. Do you think this would be also ok? Best, Yun Gao --Original Mail

[jira] [Created] (FLINK-29686) Flink-SQL使用Hive方言出现bug

Vincent Long created FLINK-29686: Summary: Flink-SQL使用Hive方言出现bug Key: FLINK-29686 URL: https://issues.apache.org/jira/browse/FLINK-29686 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-29685) Add JM info into ExecutionGraph

LI Mingkun created FLINK-29685: -- Summary: Add JM info into ExecutionGraph Key: FLINK-29685 URL: https://issues.apache.org/jira/browse/FLINK-29685 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29684) [UI] Upgrade runtime web Angular framework and associated deps to v14

Junhan Yang created FLINK-29684: --- Summary: [UI] Upgrade runtime web Angular framework and associated deps to v14 Key: FLINK-29684 URL: https://issues.apache.org/jira/browse/FLINK-29684 Project: Flink

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

+1 (binding) after reading through the discussion thread On Wed, Oct 19, 2022 at 3:29 AM Maximilian Michels wrote: > +1 (binding) > > On Mon, Oct 17, 2022 at 6:41 AM Márton Balassi > wrote: > > > +1 (binding) > > > > On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser > > > wrote: > > > > > Hi

Re: Re: [DISCUSS] Aligning migration test data generation

I don't think that it's actually a blocker for the current release. It's more like a nice-to-have. The release managers for 1.16 could still do the test data generation manually like you did it for 1.15. So, in this sense, we're not under pressure to finalize it before 1.16. But ok, I will go