[ANNOUNCE] Release 1.16.0, release candidate #0

Hi everyone, The RC0 for Apache Flink 1.16.0 has been created. This is still a preview-only release candidate to facilitate the integrated testing since there are still some ongoing efforts, thus no official votes will take place. It has all the artifacts that we would typically have for a

Re: Sink V2 interface replacement for GlobalCommitter

> setting the committer parallelism to 1. Yun, setting the parallelism to 1 is essentially a global committer. That would work. not sure about the implications to other parts of the v2 sink interface. On Tue, Sep 13, 2022 at 2:17 PM Krzysztof Chmielewski < krzysiek.chmielew...@gmail.com> wrote:

[jira] [Created] (FLINK-29299) Fix the network memory size calculation issue in fine-grained resource mode

Yingjie Cao created FLINK-29299: --- Summary: Fix the network memory size calculation issue in fine-grained resource mode Key: FLINK-29299 URL: https://issues.apache.org/jira/browse/FLINK-29299 Project:

[jira] [Created] (FLINK-29298) LocalBufferPool request buffer from NetworkBufferPool hanging

Weijie Guo created FLINK-29298: -- Summary: LocalBufferPool request buffer from NetworkBufferPool hanging Key: FLINK-29298 URL: https://issues.apache.org/jira/browse/FLINK-29298 Project: Flink

[jira] [Created] (FLINK-29297) Group Table Store file writers into SingleFileWriter and RollingFileWriter

Caizhi Weng created FLINK-29297: --- Summary: Group Table Store file writers into SingleFileWriter and RollingFileWriter Key: FLINK-29297 URL: https://issues.apache.org/jira/browse/FLINK-29297 Project:

[jira] [Created] (FLINK-29296) OperatorCoordinatorHolder.create throws NPE

Xingbo Huang created FLINK-29296: Summary: OperatorCoordinatorHolder.create throws NPE Key: FLINK-29296 URL: https://issues.apache.org/jira/browse/FLINK-29296 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29295) Clear RecordWriter slower to avoid causing frequent compaction conflicts

Jingsong Lee created FLINK-29295: Summary: Clear RecordWriter slower to avoid causing frequent compaction conflicts Key: FLINK-29295 URL: https://issues.apache.org/jira/browse/FLINK-29295 Project:

Re: [DISCUSS] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

+1 On Sun, Sep 11, 2022 at 8:04 PM Zheng Yu Chen wrote: > Now FLIP-256 is start vote in this thread url: > >

[jira] [Created] (FLINK-29294) Introduce a CompactTask for full compaction

Caizhi Weng created FLINK-29294: --- Summary: Introduce a CompactTask for full compaction Key: FLINK-29294 URL: https://issues.apache.org/jira/browse/FLINK-29294 Project: Flink Issue Type:

[jira] [Created] (FLINK-29293) Introduce a MergeFunction for full compaction

Caizhi Weng created FLINK-29293: --- Summary: Introduce a MergeFunction for full compaction Key: FLINK-29293 URL: https://issues.apache.org/jira/browse/FLINK-29293 Project: Flink Issue Type:

[jira] [Created] (FLINK-29292) Change MergeFunction to produce not only KeyValues

Caizhi Weng created FLINK-29292: --- Summary: Change MergeFunction to produce not only KeyValues Key: FLINK-29292 URL: https://issues.apache.org/jira/browse/FLINK-29292 Project: Flink Issue Type:

[jira] [Created] (FLINK-29291) Change DataFileWriter into a factory to create writers

Caizhi Weng created FLINK-29291: --- Summary: Change DataFileWriter into a factory to create writers Key: FLINK-29291 URL: https://issues.apache.org/jira/browse/FLINK-29291 Project: Flink Issue

[jira] [Created] (FLINK-29290) Produce changelog during full compaction in Table Store

Caizhi Weng created FLINK-29290: --- Summary: Produce changelog during full compaction in Table Store Key: FLINK-29290 URL: https://issues.apache.org/jira/browse/FLINK-29290 Project: Flink Issue

[jira] [Created] (FLINK-29289) SequencefileInputFormat based on the new Source API

Jing Ge created FLINK-29289: --- Summary: SequencefileInputFormat based on the new Source API Key: FLINK-29289 URL: https://issues.apache.org/jira/browse/FLINK-29289 Project: Flink Issue Type: New

[jira] [Created] (FLINK-29288) Can't start a job with a jar in the system classpath

Yaroslav Tkachenko created FLINK-29288: -- Summary: Can't start a job with a jar in the system classpath Key: FLINK-29288 URL: https://issues.apache.org/jira/browse/FLINK-29288 Project: Flink

Re: Sink V2 interface replacement for GlobalCommitter

Hi Martijn Could you clarify a little bit what do you mean by: "The important part to remember is that this topology is lagging one checkpoint behind in terms of fault-tolerance: it only receives data once the committer committed" What are the implications? Thanks, Krzysztof Chmielewski wt.,

[jira] [Created] (FLINK-29287) Add PackagingTestUtils

Chesnay Schepler created FLINK-29287: Summary: Add PackagingTestUtils Key: FLINK-29287 URL: https://issues.apache.org/jira/browse/FLINK-29287 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-29286) Potential compatibility risk between snapshot binary and jars

Chesnay Schepler created FLINK-29286: Summary: Potential compatibility risk between snapshot binary and jars Key: FLINK-29286 URL: https://issues.apache.org/jira/browse/FLINK-29286 Project: Flink

[jira] [Created] (FLINK-29285) Public ParameterProperty and TestUtils

Chesnay Schepler created FLINK-29285: Summary: Public ParameterProperty and TestUtils Key: FLINK-29285 URL: https://issues.apache.org/jira/browse/FLINK-29285 Project: Flink Issue Type:

[jira] [Created] (FLINK-29284) Bump derby in flink-connector-hive to v10.14.2.0

Martijn Visser created FLINK-29284: -- Summary: Bump derby in flink-connector-hive to v10.14.2.0 Key: FLINK-29284 URL: https://issues.apache.org/jira/browse/FLINK-29284 Project: Flink Issue

[jira] [Created] (FLINK-29283) Remove hardcoded apiVersion from operator unit test

Tony Garrard created FLINK-29283: Summary: Remove hardcoded apiVersion from operator unit test Key: FLINK-29283 URL: https://issues.apache.org/jira/browse/FLINK-29283 Project: Flink Issue

[jira] [Created] (FLINK-29282) Decouple Quickstart E2E test from Elasticsearch

Chesnay Schepler created FLINK-29282: Summary: Decouple Quickstart E2E test from Elasticsearch Key: FLINK-29282 URL: https://issues.apache.org/jira/browse/FLINK-29282 Project: Flink

[jira] [Created] (FLINK-29281) Replace Akka

Chesnay Schepler created FLINK-29281: Summary: Replace Akka Key: FLINK-29281 URL: https://issues.apache.org/jira/browse/FLINK-29281 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-29280) Hint will not be propagated in subquery

xuyang created FLINK-29280: -- Summary: Hint will not be propagated in subquery Key: FLINK-29280 URL: https://issues.apache.org/jira/browse/FLINK-29280 Project: Flink Issue Type: Bug

[SUMMARY] Flink 1.16 release sync of 2022-09-13

I would like to give you a brief update of the Flink 1.16 release sync meating of 2022-09-13. *We have finished x-team testing and all blocker issues have been fixed, so we will start to prepare rc0* *We still have some critical test stabilities[1] need to be resolved* For more information

[jira] [Created] (FLINK-29279) ElasticsearchWriterITCase fails without logging enabled

Chesnay Schepler created FLINK-29279: Summary: ElasticsearchWriterITCase fails without logging enabled Key: FLINK-29279 URL: https://issues.apache.org/jira/browse/FLINK-29279 Project: Flink

Re: [ANNOUNCE] New Apache Flink PMC Member - Martijn Visser

Congrats Martijn, a well deserved placement. Thankyou for all your efforts in the Flink community! Danny On Tue, Sep 13, 2022 at 4:04 AM Qingsheng Ren wrote: > Congratulations Martijn! > > Best regards, > Qingsheng > > > On Sep 9, 2022, at 23:08, Timo Walther wrote: > > > > Hi everyone, > > >

Re: [VOTE] FLIP-256 Support Job Dynamic Parameter With Flink Rest Api

+1 (non-binding) Thanks for driving this! Regards, Hong On 11/09/2022, 19:23, "Gyula Fóra" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. +1 (binding)

Re: Sink V2 interface replacement for GlobalCommitter

Hi, Very sorry for the late reply for being in the holiday. And also very thanks for the discussion, it also reminds me one more background on the change of the GlobalCommitter: When we are refactoring the job finish process in FLIP-147 to ensures all the records could be committed at the end of

[jira] [Created] (FLINK-29278) BINARY type is not supported in table store

Jingsong Lee created FLINK-29278: Summary: BINARY type is not supported in table store Key: FLINK-29278 URL: https://issues.apache.org/jira/browse/FLINK-29278 Project: Flink Issue Type: New

[jira] [Created] (FLINK-29277) Flink submits tasks to yarn Federation and throws an exception 'org.apache.commons.lang3.NotImplementedException: Code is not implemented'

Jiankun Feng created FLINK-29277: Summary: Flink submits tasks to yarn Federation and throws an exception 'org.apache.commons.lang3.NotImplementedException: Code is not implemented' Key: FLINK-29277 URL: