Re: [DISCUSS] Release new version of Flink's Kafka connector

2024-01-25 Thread Mason Chen
Hi Martijn, +1 no objections, thanks for volunteering. I'll definitely help verify the rc when it becomes available. I think FLIP-288 (I assume you meant this) doesn't introduce incompatible changes since the implementation should be state compatible as well as the default changes should be

Re: [DISCUSS] Release new version of Flink's Kafka connector

2024-01-25 Thread Hongshun Wang
Hi Martin, Thank you for your invitation. The idea of adding new improvements to either version V3.1 or V4.0 sounds appealing to me. > if the functionality was added in a > backwards compatible matter (meaning a new minor version would be > sufficient). It seems there is no backwards compatible

Re: Re: [DISCUSS] FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment

2024-01-25 Thread Dong Lin
Thanks Xuannan for the update! +1 (binding) On Wed, Jan 10, 2024 at 5:54 PM Xuannan Su wrote: > Hi all, > > After several rounds of offline discussions with Xingtong and Jinhao, > we have decided to narrow the scope of the FLIP. It will now focus on > introducing OperatorAttributes that

Re: [DISCUSS] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-01-25 Thread Yunfeng Zhou
Hi Weijie, Thanks for introducing this FLIP! I have a few questions about the designs proposed. 1. Would it be better to have all XXXPartitionStream classes implement ProcessConfigurable, instead of defining both XXXPartitionStream and ProcessConfigurableAndXXXPartitionStream? I wonder whether

Re: [DISCUSS] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-01-25 Thread Yunfeng Zhou
Hi Weijie, Thanks for raising discussions about the new DataStream API. I have a few questions about the content of the FLIP. 1. Will we provide any API to support choosing which input to consume between the two inputs of TwoInputStreamProcessFunction? It would be helpful in online machine

[jira] [Created] (FLINK-34240) The example of sliding windows with offset in documentation is not correct

2024-01-25 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-34240: -- Summary: The example of sliding windows with offset in documentation is not correct Key: FLINK-34240 URL: https://issues.apache.org/jira/browse/FLINK-34240 Project:

Re: Re: [VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-01-25 Thread Rui Fan
+1(binding) Best, Rui On Fri, Jan 26, 2024 at 11:55 AM Xuyang wrote: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-01-26 10:12:34,"Hang Ruan" 写道: > >Thanks for the FLIP. > > > >+1 (non-binding) > > > >Best, > >Hang > > > >Mason Chen 于2024年1月26日周五 04:51写道: > > > >>

Re:Re: [VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-01-25 Thread Xuyang
+1 (non-binding) -- Best! Xuyang 在 2024-01-26 10:12:34,"Hang Ruan" 写道: >Thanks for the FLIP. > >+1 (non-binding) > >Best, >Hang > >Mason Chen 于2024年1月26日周五 04:51写道: > >> Hi Devs, >> >> I would like to start a vote on FLIP-417: Expose JobManagerOperatorMetrics >> via REST API [1]

[NOTICE] master branch cannot compile for now

2024-01-25 Thread Benchao Li
Hi devs, I merged FLINK-33263[1] this morning (10:16 +8:00), and it based on an old commit which uses older guava version, so currently the master branch cannot compile. Zhanghao has discovered this in FLINK-33264[2], and the hotfix commit has been proposed in the same PR, hopefully we can merge

[jira] [Created] (FLINK-34239) Introduce a deep copy method of SerializerConfig for merging with Table configs in org.apache.flink.table.catalog.DataTypeFactoryImpl

2024-01-25 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34239: - Summary: Introduce a deep copy method of SerializerConfig for merging with Table configs in org.apache.flink.table.catalog.DataTypeFactoryImpl Key: FLINK-34239 URL:

Re: [VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-01-25 Thread Hang Ruan
Thanks for the FLIP. +1 (non-binding) Best, Hang Mason Chen 于2024年1月26日周五 04:51写道: > Hi Devs, > > I would like to start a vote on FLIP-417: Expose JobManagerOperatorMetrics > via REST API [1] which has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless

[jira] [Created] (FLINK-34238) In streaming mode, redundant exchange nodes can be optimally deleted in some cases

2024-01-25 Thread xuyang (Jira)
xuyang created FLINK-34238: -- Summary: In streaming mode, redundant exchange nodes can be optimally deleted in some cases Key: FLINK-34238 URL: https://issues.apache.org/jira/browse/FLINK-34238 Project:

Re: [ANNOUNCE] Apache Flink 1.18.1 released

2024-01-25 Thread Jing Ge
Hi folks, The bug has been fixed and PR at docker-library/official-images has been merged. The official images are available now. Best regards, Jing On Mon, Jan 22, 2024 at 11:39 AM Jing Ge wrote: > Hi folks, > > I am still working on the official images because of the issue >

[DISCUSS] Release new version of Flink's Kafka connector

2024-01-25 Thread Martijn Visser
Hi everyone, The latest version of the Flink Kafka connector that's available is currently v3.0.2, which is compatible with both Flink 1.17 and Flink 1.18. I would like to propose to create a release which is either v3.1, or v4.0 (see below), with compatibility for Flink 1.17 and Flink 1.18.

[VOTE] FLIP-417: Expose JobManagerOperatorMetrics via REST API

2024-01-25 Thread Mason Chen
Hi Devs, I would like to start a vote on FLIP-417: Expose JobManagerOperatorMetrics via REST API [1] which has been discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1]

[jira] [Created] (FLINK-34237) MongoDB connector compile failed with Flink 1.19-SNAPSHOT

2024-01-25 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-34237: -- Summary: MongoDB connector compile failed with Flink 1.19-SNAPSHOT Key: FLINK-34237 URL: https://issues.apache.org/jira/browse/FLINK-34237 Project: Flink Issue

Re: [SUMMARY] Flink 1.19 Release Sync 01/23/2024

2024-01-25 Thread Jing Ge
Hi Feng, Thanks for letting us know, it is a great feature. +1 to extend the code freeze deadline. Best regards, Jing On Thu, Jan 25, 2024 at 8:08 AM Feng Jin wrote: > Hi everyone, > > Xuyang and I are currently working on FLIP-387[1], which aims to support > named parameters for functions

[jira] [Created] (FLINK-34236) Evaluate strange unstable build after cleaning up CI machines

2024-01-25 Thread Jing Ge (Jira)
Jing Ge created FLINK-34236: --- Summary: Evaluate strange unstable build after cleaning up CI machines Key: FLINK-34236 URL: https://issues.apache.org/jira/browse/FLINK-34236 Project: Flink Issue

Re: [SUMMARY] Flink 1.19 Release Sync 01/23/2024

2024-01-25 Thread shuai xu
Hi everyone, I am currently working on FLIP-415[1], which aims to support minibatch join. This will bring higher performance for regular joins. There is still a task to be merged which has undergone multiple rounds of review. I expect it could be merged on Jan 26th. Therefore, I am +1 with Feng

[jira] [Created] (FLINK-34235) Not using Optional as input arguments in QueryHintsResolver

2024-01-25 Thread xuyang (Jira)
xuyang created FLINK-34235: -- Summary: Not using Optional as input arguments in QueryHintsResolver Key: FLINK-34235 URL: https://issues.apache.org/jira/browse/FLINK-34235 Project: Flink Issue Type:

[jira] [Created] (FLINK-34234) Apply ShadeOptionalChecker for flink-shaded

2024-01-25 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-34234: --- Summary: Apply ShadeOptionalChecker for flink-shaded Key: FLINK-34234 URL: https://issues.apache.org/jira/browse/FLINK-34234 Project: Flink Issue

[jira] [Created] (FLINK-34233) HybridShuffleITCase.testHybridSelectiveExchangesRestart failed due to a IllegalStateException

2024-01-25 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34233: - Summary: HybridShuffleITCase.testHybridSelectiveExchangesRestart failed due to a IllegalStateException Key: FLINK-34233 URL: https://issues.apache.org/jira/browse/FLINK-34233

[jira] [Created] (FLINK-34232) Config file unexpectedly lacks support for env.java.home

2024-01-25 Thread Junrui Li (Jira)
Junrui Li created FLINK-34232: - Summary: Config file unexpectedly lacks support for env.java.home Key: FLINK-34232 URL: https://issues.apache.org/jira/browse/FLINK-34232 Project: Flink Issue

[RESULT][VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-25 Thread shuai xu
Hi devs, I'm glad to announce that the FLIP-415[1] has been accepted. The voting thread is here[2]. The proposal received five approving votes, four of which are binding: - Lincoln Lee (binding) - Jane Chan (binding) - Ron liu (binding) - Benchao Li (binding) - Xuyang (non-binding) And there

[RESULT][VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-25 Thread shuai xu
Hi devs, I'm glad to announce that the FLIP-415[1] has been accepted. The voting thread is here[2]. The proposal received 5 approving votes, all of which are as follow: - Lincoln Lee (binding) - liu ron (binding) - Jane Chan (binding) - Benchao Li (binding) - Xuyang (non-binding) And there is