Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-13 Thread Jingsong Li
Congratulations Jing! Best, Jingsong On Tue, Feb 14, 2023 at 3:50 PM godfrey he wrote: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Jing Ge as a new Flink > committer. > > Jing has been consistently contributing to the project for over 1 year. > He authored more than 50

[ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-13 Thread godfrey he
Hi everyone, On behalf of the PMC, I'm very happy to announce Jing Ge as a new Flink committer. Jing has been consistently contributing to the project for over 1 year. He authored more than 50 PRs and reviewed more than 40 PRs with mainly focus on connector, test, and document modules. He was

[jira] [Created] (FLINK-31055) The dynamic flag of stream graph does not take effect when translating the transformations

2023-02-13 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-31055: -- Summary: The dynamic flag of stream graph does not take effect when translating the transformations Key: FLINK-31055 URL: https://issues.apache.org/jira/browse/FLINK-31055

[jira] [Created] (FLINK-31054) Flink free to common codegen core shade

2023-02-13 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31054: Summary: Flink free to common codegen core shade Key: FLINK-31054 URL: https://issues.apache.org/jira/browse/FLINK-31054 Project: Flink Issue Type: Sub-task

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Feng Jin
Congratulations! Weijie Best, Feng On Tue, Feb 14, 2023 at 2:19 PM Leonard Xu wrote: > > Congratulations! Weijie > > Best, > Leonard

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Leonard Xu
Congratulations! Weijie Best, Leonard

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Guowei Ma
Congratulations!!! Weijie Best, Guowei On Tue, Feb 14, 2023 at 1:49 PM Dian Fu wrote: > Congratulations, Weijie! > > Regards, > Dian > > On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl > wrote: > > > Congrats, Weijie! :-) > > > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > > wrote: >

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Dian Fu
Congratulations, Weijie! Regards, Dian On Mon, Feb 13, 2023 at 10:55 PM Matthias Pohl wrote: > Congrats, Weijie! :-) > > On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin > wrote: > > > Congratulations, Weijie! > > > > On Mon, Feb 13, 2023 at 10:32 AM Yun Tang wrote: > > > > >

[jira] [Created] (FLINK-31053) Example Repair the log output format of the CheckpointCoordinator

2023-02-13 Thread xzw0223 (Jira)
xzw0223 created FLINK-31053: --- Summary: Example Repair the log output format of the CheckpointCoordinator Key: FLINK-31053 URL: https://issues.apache.org/jira/browse/FLINK-31053 Project: Flink

[jira] [Created] (FLINK-31052) Release Testing: Verify FLINK-30707 Improve slow task detection

2023-02-13 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-31052: --- Summary: Release Testing: Verify FLINK-30707 Improve slow task detection Key: FLINK-31052 URL: https://issues.apache.org/jira/browse/FLINK-31052 Project: Flink Issue

[jira] [Created] (FLINK-31051) Introduce `delete` action to support deleting from table

2023-02-13 Thread yuzelin (Jira)
yuzelin created FLINK-31051: --- Summary: Introduce `delete` action to support deleting from table Key: FLINK-31051 URL: https://issues.apache.org/jira/browse/FLINK-31051 Project: Flink Issue Type:

[jira] [Created] (FLINK-31050) Supports IN predicate in ORC format of table store

2023-02-13 Thread Nicholas Jiang (Jira)
Nicholas Jiang created FLINK-31050: -- Summary: Supports IN predicate in ORC format of table store Key: FLINK-31050 URL: https://issues.apache.org/jira/browse/FLINK-31050 Project: Flink Issue

[jira] [Created] (FLINK-31049) Add support for Kafka record headers to KafkaSink

2023-02-13 Thread Alex Gout (Jira)
Alex Gout created FLINK-31049: - Summary: Add support for Kafka record headers to KafkaSink Key: FLINK-31049 URL: https://issues.apache.org/jira/browse/FLINK-31049 Project: Flink Issue Type:

Re: Proposal to add support for Kafka Headers to KafkaRecordSerializationSchemaWrapper

2023-02-13 Thread Márton Balassi
Hi Alex, Please do share, this comes up somewhat frequently. Marton On Mon, Feb 13, 2023 at 7:44 PM Őrhidi Mátyás wrote: > Hi Alex, > > This is a reasonable request IMO. I've recently bumped into this topic > myself. This could be handy for supporting schema registries in Kafka to > Kafka

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-13 Thread Maximilian Michels
Based on further discussion I had with Chesnay on this PR [1], I think jobs would currently go into a restarting state after the resource requirements have changed. This wouldn't achieve what we had in mind, i.e. sticking to the old resource requirements until enough slots are available to fulfil

Re: Proposal to add support for Kafka Headers to KafkaRecordSerializationSchemaWrapper

2023-02-13 Thread Őrhidi Mátyás
Hi Alex, This is a reasonable request IMO. I've recently bumped into this topic myself. This could be handy for supporting schema registries in Kafka to Kafka scenarios for example. Looking forward to your proposal. Cheers, Matyas On Mon, Feb 13, 2023 at 7:08 AM Alex Gout wrote: > Hi all, > >

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-13 Thread Maximilian Michels
Hi David, This is awesome! Great writeup and demo. This is pretty much what we need for the autoscaler as part of the Flink Kubernetes operator [1]. Scaling Flink jobs effectively is hard but fortunately we have solved the issue as part of the Flink Kubernetes operator. The only critical piece we

[jira] [Created] (FLINK-31048) Java doc of PulsarSourceBuilder was not updated in time

2023-02-13 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31048: -- Summary: Java doc of PulsarSourceBuilder was not updated in time Key: FLINK-31048 URL: https://issues.apache.org/jira/browse/FLINK-31048 Project: Flink Issue

[jira] [Created] (FLINK-31047) Support Topology spread constrains when HA is enabled.

2023-02-13 Thread Tamir Sagi (Jira)
Tamir Sagi created FLINK-31047: -- Summary: Support Topology spread constrains when HA is enabled. Key: FLINK-31047 URL: https://issues.apache.org/jira/browse/FLINK-31047 Project: Flink Issue

[jira] [Created] (FLINK-31046) Support Extra environment variables from field ref

2023-02-13 Thread Tamir Sagi (Jira)
Tamir Sagi created FLINK-31046: -- Summary: Support Extra environment variables from field ref Key: FLINK-31046 URL: https://issues.apache.org/jira/browse/FLINK-31046 Project: Flink Issue Type:

[jira] [Created] (FLINK-31045) In IntelliJ: flink-clients cannot find symbol symbol: class TestUserClassLoaderJobLib

2023-02-13 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-31045: -- Summary: In IntelliJ: flink-clients cannot find symbol symbol: class TestUserClassLoaderJobLib Key: FLINK-31045 URL: https://issues.apache.org/jira/browse/FLINK-31045

Proposal to add support for Kafka Headers to KafkaRecordSerializationSchemaWrapper

2023-02-13 Thread Alex Gout
Hi all, I'm currently working on a few pipelines sinking to Kafka. The downstream consumers of the sink topics expect some Kafka headers to be set. However the default org.apache.flink.connector.kafka.sink.KafkaSink does not support adding Kafka record headers. I tracked the code path down to

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Matthias Pohl
Congrats, Weijie! :-) On Mon, Feb 13, 2023 at 10:50 AM Sergey Nuyanzin wrote: > Congratulations, Weijie! > > On Mon, Feb 13, 2023 at 10:32 AM Yun Tang wrote: > > > Congratulations, Weijie! > > > > Best > > Yun Tang > > > > On 2023/02/13 09:23:16 ramkrishna vasudevan wrote: > > >

[jira] [Created] (FLINK-31044) Unexpected behavior using greedy on looping pattern with notFollowedBy at end

2023-02-13 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-31044: - Summary: Unexpected behavior using greedy on looping pattern with notFollowedBy at end Key: FLINK-31044 URL: https://issues.apache.org/jira/browse/FLINK-31044 Project:

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-13 Thread Dian Fu
+1 (binding) Regards, Dian On Mon, Feb 13, 2023 at 11:04 AM Dong Lin wrote: > Hi all, > > We would like to start the vote for FLIP-289: Support online inference > (Flink ML) [1]. This FLIP was discussed in this thread [2]. > > The goal of this FLIP is to enable users to use the model trained

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-13 Thread feng xiangyu
Hi David, Thanks for your reply. I think your response totally make sense. This flip targets on declaring required resource to ResourceManager instead of using ResourceManager to add/remove TMs directly. Best, Xiangyu David Morávek 于2023年2月13日周一 15:46写道: > Hi everyone, > > @Shammon > >

[jira] [Created] (FLINK-31043) KeyError exception is thrown in CachedMapState

2023-02-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-31043: --- Summary: KeyError exception is thrown in CachedMapState Key: FLINK-31043 URL: https://issues.apache.org/jira/browse/FLINK-31043 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31042) AfterMatchSkipStrategy not working on notFollowedBy ended pattern

2023-02-13 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-31042: - Summary: AfterMatchSkipStrategy not working on notFollowedBy ended pattern Key: FLINK-31042 URL: https://issues.apache.org/jira/browse/FLINK-31042 Project: Flink

[jira] [Created] (FLINK-31041) Race condition in DefaultScheduler results in memory leak and busy loop

2023-02-13 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-31041: - Summary: Race condition in DefaultScheduler results in memory leak and busy loop Key: FLINK-31041 URL: https://issues.apache.org/jira/browse/FLINK-31041 Project:

[jira] [Created] (FLINK-31040) Looping pattern notFollowedBy at end missing an element

2023-02-13 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-31040: - Summary: Looping pattern notFollowedBy at end missing an element Key: FLINK-31040 URL: https://issues.apache.org/jira/browse/FLINK-31040 Project: Flink Issue

[jira] [Created] (FLINK-31039) ChangelogWithKeyFileStoreTableITCase in table store is not stable

2023-02-13 Thread Shammon (Jira)
Shammon created FLINK-31039: --- Summary: ChangelogWithKeyFileStoreTableITCase in table store is not stable Key: FLINK-31039 URL: https://issues.apache.org/jira/browse/FLINK-31039 Project: Flink

Re: [DISCUSS] Promote SinkV2 to @Public and deprecate SinkFunction

2023-02-13 Thread Jing Ge
@Martijn What I shared previously is the fact of the current KafkaSink. Following your suggestion, the KafkaSink should still be marked as @Experimental for now which will need even longer time to graduate. BTW, KafkaSink does not depend on any @Internal interfaces. The @Internal is used for

[jira] [Created] (FLINK-31038) Avoid accessing non-TableStore tables in HiveCatalog.listTables

2023-02-13 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31038: Summary: Avoid accessing non-TableStore tables in HiveCatalog.listTables Key: FLINK-31038 URL: https://issues.apache.org/jira/browse/FLINK-31038 Project: Flink

[jira] [Created] (FLINK-31037) Table Store supports streaming reading a whole snapshot in one checkpoint

2023-02-13 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31037: Summary: Table Store supports streaming reading a whole snapshot in one checkpoint Key: FLINK-31037 URL: https://issues.apache.org/jira/browse/FLINK-31037 Project:

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Sergey Nuyanzin
Congratulations, Weijie! On Mon, Feb 13, 2023 at 10:32 AM Yun Tang wrote: > Congratulations, Weijie! > > Best > Yun Tang > > On 2023/02/13 09:23:16 ramkrishna vasudevan wrote: > > Congratulations!!! Weijie > > > > Regards > > Ram > > > > On Mon, Feb 13, 2023 at 2:17 PM Yuepeng Pan wrote: > > >

Re: Looking for a jira to get started with contributing

2023-02-13 Thread Joern Kottmann
Hello, I looked through the tickets Yuxia suggested and would like to work on FLINK-26948 (Add SORT_ARRAY supported in SQL & Table API). Do you think that's a good pick? If yes, please assign it to me. Best regards, Jörn On Wed, Feb 8, 2023 at 11:38 AM Matthias Pohl wrote: > Just as a

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Yun Tang
Congratulations, Weijie! Best Yun Tang On 2023/02/13 09:23:16 ramkrishna vasudevan wrote: > Congratulations!!! Weijie > > Regards > Ram > > On Mon, Feb 13, 2023 at 2:17 PM Yuepeng Pan wrote: > > > Congratulations, Weijie! > > > > Best, > > > > Best, Yuepeng Pan. > > > > 在 2023-02-13

Re: Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread ramkrishna vasudevan
Congratulations!!! Weijie Regards Ram On Mon, Feb 13, 2023 at 2:17 PM Yuepeng Pan wrote: > Congratulations, Weijie! > > Best, > > Best, Yuepeng Pan. > > 在 2023-02-13 16:26:32,"Lincoln Lee" 写道: > >Congratulations, Weijie! > > > >Best, > >Lincoln Lee > > > > > >Martijn Visser 于2023年2月13日周一

[jira] [Created] (FLINK-31036) StateCheckpointedITCase timed out due to deadlock

2023-02-13 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31036: - Summary: StateCheckpointedITCase timed out due to deadlock Key: FLINK-31036 URL: https://issues.apache.org/jira/browse/FLINK-31036 Project: Flink Issue

[jira] [Created] (FLINK-31035) add warn info to user when NoNodeException happend

2023-02-13 Thread xy (Jira)
xy created FLINK-31035: -- Summary: add warn info to user when NoNodeException happend Key: FLINK-31035 URL: https://issues.apache.org/jira/browse/FLINK-31035 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31034) Deploy Maven Snapshot failed

2023-02-13 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31034: - Summary: Deploy Maven Snapshot failed Key: FLINK-31034 URL: https://issues.apache.org/jira/browse/FLINK-31034 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31033) UsingRemoteJarITCase.testUdfInRemoteJar failed with assertion

2023-02-13 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31033: - Summary: UsingRemoteJarITCase.testUdfInRemoteJar failed with assertion Key: FLINK-31033 URL: https://issues.apache.org/jira/browse/FLINK-31033 Project: Flink

[jira] [Created] (FLINK-31032) Supports AND predicate in orc format for table store

2023-02-13 Thread Shammon (Jira)
Shammon created FLINK-31032: --- Summary: Supports AND predicate in orc format for table store Key: FLINK-31032 URL: https://issues.apache.org/jira/browse/FLINK-31032 Project: Flink Issue Type:

Re:Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Yuepeng Pan
Congratulations, Weijie! Best, Best, Yuepeng Pan. 在 2023-02-13 16:26:32,"Lincoln Lee" 写道: >Congratulations, Weijie! > >Best, >Lincoln Lee > > >Martijn Visser 于2023年2月13日周一 16:17写道: > >> Congrats Weijie! >> >> On Mon, Feb 13, 2023 at 7:19 AM Weihua Hu wrote: >> >> > Congratulations, Weijie!

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Jing Ge
Congrats Weijie! Best regards, Jing On Mon, Feb 13, 2023 at 9:27 AM Lincoln Lee wrote: > Congratulations, Weijie! > > Best, > Lincoln Lee > > > Martijn Visser 于2023年2月13日周一 16:17写道: > > > Congrats Weijie! > > > > On Mon, Feb 13, 2023 at 7:19 AM Weihua Hu > wrote: > > > > > Congratulations,

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Lincoln Lee
Congratulations, Weijie! Best, Lincoln Lee Martijn Visser 于2023年2月13日周一 16:17写道: > Congrats Weijie! > > On Mon, Feb 13, 2023 at 7:19 AM Weihua Hu wrote: > > > Congratulations, Weijie! > > > > Best, > > Weihua > > > > > On Feb 13, 2023, at 11:55, Lijie Wang > wrote: > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-13 Thread Martijn Visser
Congrats Weijie! On Mon, Feb 13, 2023 at 7:19 AM Weihua Hu wrote: > Congratulations, Weijie! > > Best, > Weihua > > > On Feb 13, 2023, at 11:55, Lijie Wang wrote: > > > > Congratulations, Weijie! > >