[jira] [Created] (FLINK-29825) Improve benchmark stablility

Yanfei Lei created FLINK-29825: -- Summary: Improve benchmark stablility Key: FLINK-29825 URL: https://issues.apache.org/jira/browse/FLINK-29825 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29824) AgglomerativeClustering fails when the distanceThreshold is very large

Zhipeng Zhang created FLINK-29824: - Summary: AgglomerativeClustering fails when the distanceThreshold is very large Key: FLINK-29824 URL: https://issues.apache.org/jira/browse/FLINK-29824 Project:

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

+1 (binding) Thanks Hangxiang for driving this topic. Best Yun Tang From: Tzu-Li (Gordon) Tai Sent: Tuesday, November 1, 2022 5:21 To: dev@flink.apache.org Subject: Re: [VOTE] FLIP-263: Improve resolving schema compatibility +1. Thanks Hangxiang, the proposed

Re: [DISCUSS] Delete useless branches from Flink repository

Hi Leonard, Thanks for driving this topic, I think the release candidate branch after flink-1.10 could be deleted. I believe those branches are created by mistake as the release manager should use tags instead of branch to hold the release candidate. Those branches are: release-1.12.3-rc1

[jira] [Created] (FLINK-29823) Support create schema for table snapshot

Shammon created FLINK-29823: --- Summary: Support create schema for table snapshot Key: FLINK-29823 URL: https://issues.apache.org/jira/browse/FLINK-29823 Project: Flink Issue Type: Sub-task

Re: [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

Hi, 15725139602 Please send email to dev-unsubscr...@flink.apache.org if you want to unsubscribe the mail from dev , and you can refer[1] for more details. Best, Leonard [1]https://flink.apache.org/community.html#mailing-lists > 2022年10月31日 下午6:02，m15725139602 <15725139...@163.com> 写道： > >

[jira] [Created] (FLINK-29822) Fix wrong description in comments of StreamExecutionEnvironment#setMaxParallelism()

Feifan Wang created FLINK-29822: --- Summary: Fix wrong description in comments of StreamExecutionEnvironment#setMaxParallelism() Key: FLINK-29822 URL: https://issues.apache.org/jira/browse/FLINK-29822

[jira] [Created] (FLINK-29821) Schema.Builder how to set not null column?

Alvin Ge created FLINK-29821: Summary: Schema.Builder how to set not null column? Key: FLINK-29821 URL: https://issues.apache.org/jira/browse/FLINK-29821 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29820) Support to read data from table store with specify snapshot id

Shammon created FLINK-29820: --- Summary: Support to read data from table store with specify snapshot id Key: FLINK-29820 URL: https://issues.apache.org/jira/browse/FLINK-29820 Project: Flink Issue

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congratulations! Best, Liudalong Sergey Nuyanzin 于2022年10月31日周一 23:25写道： > Congratulations! > Thanks everyone involved! > > On Mon, Oct 31, 2022 at 3:15 PM Matthias Pohl > wrote: > > > Thanks everyone for making this release happen. > > > > Best, > > Matthias > > > > On Mon, Oct 31, 2022 at

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Hey all, Since we are planning to externalize the connectors by Flink 1.17, we will not need to wait until Flink 1.18 for Step 2. We can fast follow with a new connector version implementing Step 2 post externalization (assuming we have met the bake time discussed in FLIP-197 [1]). I noted there

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

+1. Thanks Hangxiang, the proposed plan looks good! On Sun, Oct 30, 2022 at 3:38 AM Yu Li wrote: > +1 (binding) > > Thanks Hangxiang for driving this and thanks all for the thorough > discussion. > > Best Regards, > Yu > > > On Fri, 28 Oct 2022 at 16:01, Dawid Wysakowicz > wrote: > > > +1, > >

Re: Stateful Functions with Flink 1.15 and onwards

Yes, that makes sense. PR is here: [FLINK-29814][statefun] Change supported Flink version to 1.15.2 by galenwarren · Pull Request #319 · apache/flink-statefun (github.com) . On Mon, Oct 31, 2022 at 11:35 AM Till Rohrmann wrote: > I think there

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Hi, Maybe a stupid question, but how one can migrate from the FlinkKafkaConsumer/FlinkKafkaProducer to KafkaSource/KafkaSink, while preserving exactly-once guarantees etc? Is it possible? I've tried a quick search and couldn't find it, but maybe I was looking in wrong places. Best, Piotrek

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

+1, thanks for driving this! On a side note, can we also ensure that a performance summary report for Flink major version upgrades is in release notes, once this infrastructure becomes mature? From the user perspective, it would be nice to know what the expected (or unexpected) regressions in a

[jira] [Created] (FLINK-29819) Record an error event when savepoint fails within grace period

Clara Xiong created FLINK-29819: --- Summary: Record an error event when savepoint fails within grace period Key: FLINK-29819 URL: https://issues.apache.org/jira/browse/FLINK-29819 Project: Flink

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Thanks Martijn. What you said makes a lot of sense. I figure we should do it in 2 steps. Step 1 (with 1.17): - Remove FlinkKafkaConsumer. - Graduate Kafka Source from @PublicEvolving to @Public. - Update doc and leave hints for customers as the reference. According to [1], the Kafka Sink should

Re: Stateful Functions with Flink 1.15 and onwards

I think there might still be value in supporting 1.15 since not everyone upgrades Flink very fast. Hopefully, for Statefun the diff between Flink 1.15 and 1.16 boils down to changing the Flink dependencies. Cheers, Till On Mon, Oct 31, 2022 at 2:06 PM Galen Warren wrote: > Sure thing. One

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congratulations! Thanks everyone involved! On Mon, Oct 31, 2022 at 3:15 PM Matthias Pohl wrote: > Thanks everyone for making this release happen. > > Best, > Matthias > > On Mon, Oct 31, 2022 at 10:47 AM Yuan Mei wrote: > > > Congrats! Thanks everyone who is making this release happen! > > > >

[DISCUSS] Flink release retro

Hi everyone, I want to bring up the idea of having a retrospective on the release from the release manager's perspective. The idea would be to collect feedback on what went well and what could be improved for a specific minor release. So far, I didn't find anything on that topic. Does the

[jira] [Created] (FLINK-29818) HsResultPartitionTest.testAvailability fails

Sergey Nuyanzin created FLINK-29818: --- Summary: HsResultPartitionTest.testAvailability fails Key: FLINK-29818 URL: https://issues.apache.org/jira/browse/FLINK-29818 Project: Flink Issue

[jira] [Created] (FLINK-29817) Published metadata for apache-flink in pypi are inconsistent and causes poetry to fail

André Casimiro created FLINK-29817: -- Summary: Published metadata for apache-flink in pypi are inconsistent and causes poetry to fail Key: FLINK-29817 URL: https://issues.apache.org/jira/browse/FLINK-29817

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Thanks everyone for making this release happen. Best, Matthias On Mon, Oct 31, 2022 at 10:47 AM Yuan Mei wrote: > Congrats! Thanks everyone who is making this release happen! > > Best > Yuan > > On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer > wrote: > > > Nice work everyone! > > > >

[ANNOUNCE] Starting with Flink 1.17 release sync

Hi everyone, We want to let you know that with Flink 1.16 now available, we'll focus on the Flink 1.17 release. [1] As part of that release, we'll continue with our release sync meetings. At first, they will be every 2 weeks and when the feature freeze gets closer, we'll move to weekly meetings.

Re: Stateful Functions with Flink 1.15 and onwards

Sure thing. One question -- Flink 1.16 was just released a few days ago. Should I support 1.15, or just go straight to 1.16? On Mon, Oct 31, 2022 at 8:49 AM Till Rohrmann wrote: > Hi folks, > > if you can open a PR for supporting Flink 1.15 Galen, then this would be > awesome. I've assigned you

[GitHub] [flink-connector-shared-utils] zentol commented on pull request #1: [FLINK-29472] Add first version of release scripts

zentol commented on PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#issuecomment-1297059496 Note that we could just do a review round, and then try them out for the ES connector release before merging them. -- This is an automated message from the Apache Git

[GitHub] [flink-connector-shared-utils] zentol opened a new pull request, #1: Add first version of release scripts

zentol opened a new pull request, #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1 This PR adds the first version of shared release utilities for connectors. The expectation is that the `release_utils` branch will be mounted as a git submodule into each

[jira] [Created] (FLINK-29816) Userfunction exception in ProcessWindowFunction was called before invoke during restore state(subtask was in INITIALIZING state), but SteamTask skip handle Exception

Xie Yi created FLINK-29816: -- Summary: Userfunction exception in ProcessWindowFunction was called before invoke during restore state(subtask was in INITIALIZING state), but SteamTask skip handle Exception Key: FLINK-29816

Re: Stateful Functions with Flink 1.15 and onwards

Hi folks, if you can open a PR for supporting Flink 1.15 Galen, then this would be awesome. I've assigned you to this ticket. The next thing after merging this PR would be creating a new StateFun release. Once we have merged the PR, let's check who can help with it the fastest. Cheers, Till On

support Kryo.setRegistrationRequired(false)

Hi all, I'd be interested to pick up this existing JIRA ticket, to add support to configure whether Kryo requires registrations for all serialized objects. [FLINK-25993] Option to disable Kryo.setRegistrationRequired(false) - ASF JIRA (apache.org)

[jira] [Created] (FLINK-29815) image apache/flink:1.16.0-scala_2.12 does not exist

Harkin created FLINK-29815: -- Summary: image apache/flink:1.16.0-scala_2.12 does not exist Key: FLINK-29815 URL: https://issues.apache.org/jira/browse/FLINK-29815 Project: Flink Issue Type: Bug

Re: [DISCUSS] Delete useless branches from Flink repository

> Actually I double checked it and the default branch on jenkins is `master`. Great, I’ve deleted benchmark-request branch. Now, our repo looks better. Best, Leonard

Re: Stateful Functions with Flink 1.15 and onwards

Yes, I could do that. On Mon, Oct 31, 2022 at 7:48 AM Filip Karnicki wrote: > Hi All > > So what's the play here? > > Galen, what do you think about taking this on? Perhaps ++Till would assign > this jira to you (with your permission) given he's helped me out > with statefun work before >

Re: Stateful Functions with Flink 1.15 and onwards

Hi All So what's the play here? Galen, what do you think about taking this on? Perhaps ++Till would assign this jira to you (with your permission) given he's helped me out with statefun work before https://issues.apache.org/jira/browse/FLINK-29814 I can try to move to move statefun to flink

[jira] [Created] (FLINK-29814) Upgrade Stateful Functions to use Flink 1.15

Fil Karnicki created FLINK-29814: Summary: Upgrade Stateful Functions to use Flink 1.15 Key: FLINK-29814 URL: https://issues.apache.org/jira/browse/FLINK-29814 Project: Flink Issue Type:

[jira] [Created] (FLINK-29812) Remove deprecated Netty API usages

Chesnay Schepler created FLINK-29812: Summary: Remove deprecated Netty API usages Key: FLINK-29812 URL: https://issues.apache.org/jira/browse/FLINK-29812 Project: Flink Issue Type:

[jira] [Created] (FLINK-29813) Remove deprecated Curator API usages

Chesnay Schepler created FLINK-29813: Summary: Remove deprecated Curator API usages Key: FLINK-29813 URL: https://issues.apache.org/jira/browse/FLINK-29813 Project: Flink Issue Type:

[jira] [Created] (FLINK-29811) HadoopOSSFileSystemBehaviorITCase is not executed on AzureCI

Matthias Pohl created FLINK-29811: - Summary: HadoopOSSFileSystemBehaviorITCase is not executed on AzureCI Key: FLINK-29811 URL: https://issues.apache.org/jira/browse/FLINK-29811 Project: Flink

[jira] [Created] (FLINK-29810) AzureFileSystemBehaviorITCase is not executed on AzureCI

Matthias Pohl created FLINK-29810: - Summary: AzureFileSystemBehaviorITCase is not executed on AzureCI Key: FLINK-29810 URL: https://issues.apache.org/jira/browse/FLINK-29810 Project: Flink

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 On 28/10/2022 16:57, Piotr Nowojski wrote: Hi, As discussed on the dev mailing list [0] I would like to start a vote to drop support of older savepoint formats (for Flink versions older than 1.8). You can find the original explanation from the aforementioned dev mailing list thread at the

[jira] [Created] (FLINK-29809) REST API for running a Flink job

Nguyễn Minh Phú created FLINK-29809: --- Summary: REST API for running a Flink job Key: FLINK-29809 URL: https://issues.apache.org/jira/browse/FLINK-29809 Project: Flink Issue Type:

Re: [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

unsubscribe | | 15725139...@163.com | | 邮箱：15725139...@163.com | Replied Message | From | Piotr Nowojski (Jira) | | Date | 10/31/2022 17:55 | | To | dev@flink.apache.org | | Cc | | | Subject | [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support

[jira] [Created] (FLINK-29808) Grant leadership to leaderContender while it is closing may lead to deadlock

Weijie Guo created FLINK-29808: -- Summary: Grant leadership to leaderContender while it is closing may lead to deadlock Key: FLINK-29808 URL: https://issues.apache.org/jira/browse/FLINK-29808 Project:

[jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

Piotr Nowojski created FLINK-29807: -- Summary: Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0 Key: FLINK-29807 URL: https://issues.apache.org/jira/browse/FLINK-29807

Re: [DISCUSS] Delete useless branches from Flink repository

Hi, Actually I double checked it and the default branch on jenkins is `master`. So `benchmark-request` branch can be safely removed without any further changes. Best, Piotrek pon., 31 paź 2022 o 10:34 Leonard Xu napisał(a): > > So the > > benchmark_request could be deleted, but only if

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 Best Yuan On Mon, Oct 31, 2022 at 5:01 PM Dawid Wysakowicz wrote: > +1 > > On 28/10/2022 16:57, Piotr Nowojski wrote: > > Hi, > > > > As discussed on the dev mailing list [0] I would like to start a vote to > > drop support of older savepoint formats (for Flink versions older than > > 1.8).

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congrats! Thanks everyone who is making this release happen! Best Yuan On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer wrote: > Nice work everyone! > > Congratulations to all involved :D > > Danny, > > On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > > > Congrats! Finally! > > > > Best, > >

[jira] [Created] (FLINK-29806) Move related class StateChangeOperation into package org.apache.flink.state.changelog.restore

senbork created FLINK-29806: --- Summary: Move related class StateChangeOperation into package org.apache.flink.state.changelog.restore Key: FLINK-29806 URL: https://issues.apache.org/jira/browse/FLINK-29806

Re: [DISCUSS] Delete useless branches from Flink repository

> So the > benchmark_request could be deleted, but only if someone would also clean > up/adjust the Jenkins's job default parameters. Thanks @Piotr for suppling this background. As an upstream repository, I tend to keep it as clean as possible. These users(I think they’re experienced developers)

Re: [VOTE] Dedicated AWS externalized connector repo

The vote has passed unanimously. +1 Votes: - Martijn (binding) - Hong (non-binding) - Ahmed (non-binding) - Samrat (non-binding) - Jing (non-binding) - Jark (binding) - Jiangjie (binding) Thanks all. On Mon, Oct 31, 2022 at 2:37 AM Becket Qin wrote: > +1 (binding) > > Thanks, > > Jiangjie

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Nice work everyone! Congratulations to all involved :D Danny, On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > Congrats! Finally! > > Best, > Paul Lam > > > 2022年10月31日 11:58，Yuxin Tan 写道： > > > > Congrats! Glad to hear that. > > > > Best, > > Yuxin > > > > > > weijie guo 于2022年10月31日周一

[jira] [Created] (FLINK-29805) Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow

Caizhi Weng created FLINK-29805: --- Summary: Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow Key: FLINK-29805 URL:

Re: [DISCUSS] Delete useless branches from Flink repository

Hi, benchmark_request is used by default by the jenkins benchmark request job. However I think no-one is using this anymore, and everybody starts benchmark requests from his own repository forks/clones. So the benchmark_request could be deleted, but only if someone would also clean up/adjust the

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 On 28/10/2022 16:57, Piotr Nowojski wrote: Hi, As discussed on the dev mailing list [0] I would like to start a vote to drop support of older savepoint formats (for Flink versions older than 1.8). You can find the original explanation from the aforementioned dev mailing list thread at the

[jira] [Created] (FLINK-29804) Support convertion of Correlate to Join if correlation variable is unused introduced in Calcite 1.28

Sergey Nuyanzin created FLINK-29804: --- Summary: Support convertion of Correlate to Join if correlation variable is unused introduced in Calcite 1.28 Key: FLINK-29804 URL:

Re: Want to help upgrading Flink ElasticSearch connector

Hi Elkhan, Thanks for reaching out. However, this upgrade path isn't possible because the Elastic license for version 7.17 is not compatible with the Apache License. The only way that support for Elasticsearch 8 can be created is by moving away from the High Level REST Client (which has also been

[jira] [Created] (FLINK-29803) Table API Scala APIs lack proper source jars

Chesnay Schepler created FLINK-29803: Summary: Table API Scala APIs lack proper source jars Key: FLINK-29803 URL: https://issues.apache.org/jira/browse/FLINK-29803 Project: Flink Issue

[jira] [Created] (FLINK-29802) ChangelogStateBackend supports native savepoint

Hangxiang Yu created FLINK-29802: Summary: ChangelogStateBackend supports native savepoint Key: FLINK-29802 URL: https://issues.apache.org/jira/browse/FLINK-29802 Project: Flink Issue Type:

[jira] [Created] (FLINK-29801) OperatorCoordinator need open the way to operate metricGroup interface

yuemeng created FLINK-29801: --- Summary: OperatorCoordinator need open the way to operate metricGroup interface Key: FLINK-29801 URL: https://issues.apache.org/jira/browse/FLINK-29801 Project: Flink