Re: [DISCUSS] Graduate the FileSink to @PublicEvolving

2023-06-22 Thread Jing Ge
Hi Galen, Thanks for the hint which is helpful for us to have a clear big picture. Afaiac, this will not be a blocking issue for the graduation. There will always be some (potential) bugs in the implementation. The API is very stable from 2020. The timing is good to graduate. WDYT? Furthermore,

[jira] [Created] (FLINK-32418) ClassNotFoundException when using flink-protobuf with sql-client

2023-06-22 Thread Michael Kreis (Jira)
Michael Kreis created FLINK-32418: - Summary: ClassNotFoundException when using flink-protobuf with sql-client Key: FLINK-32418 URL: https://issues.apache.org/jira/browse/FLINK-32418 Project: Flink

When does backpressure matter

2023-06-22 Thread Lu Niu
For example, if a flink job reads from kafka do something and writes to kafka. Do we need to take any actions when the job kafka consumer lag is low or 0 but some tasks have constant backpressure? Do we need to increase the parallelism or do some network tuning so that backpressure is constant 0?

[jira] [Created] (FLINK-32417) DynamicKafkaSource User Documentation

2023-06-22 Thread Mason Chen (Jira)
Mason Chen created FLINK-32417: -- Summary: DynamicKafkaSource User Documentation Key: FLINK-32417 URL: https://issues.apache.org/jira/browse/FLINK-32417 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32416) Initial DynamicKafkaSource Implementation

2023-06-22 Thread Mason Chen (Jira)
Mason Chen created FLINK-32416: -- Summary: Initial DynamicKafkaSource Implementation Key: FLINK-32416 URL: https://issues.apache.org/jira/browse/FLINK-32416 Project: Flink Issue Type: Sub-task

[RESULT][VOTE] FLIP-246: Dynamic Kafka Source (originally Multi Cluster Kafka Source)

2023-06-22 Thread Mason Chen
Hi everyone, I'm happy to announce that FLIP-246: DynamicKafkaSource [1] has been approved! According to the voting thread [2], there are 6 approving votes, 5 of which are binding: - Jing Ge (binding) - Tzu-Li (Gordon) Tai (binding) - Martijn Visser (binding) - Ryan van Huuksloot (non-binding) -

[DISCUSS] Persistent SQL Gateway

2023-06-22 Thread Ferenc Csaky
Hello devs, I would like to open a discussion about persistence possibilitis for the SQL Gateway. At Cloudera, we are happy to see the work already done on this project and looking for ways to utilize it on our platform as well, but currently it lacks some features that would be essential in

[jira] [Created] (FLINK-32415) Add maven wrapper to benchmark to avoid maven version issues

2023-06-22 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-32415: - Summary: Add maven wrapper to benchmark to avoid maven version issues Key: FLINK-32415 URL: https://issues.apache.org/jira/browse/FLINK-32415 Project: Flink

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-22 Thread Lijie Wang
Hi all, Thanks for all the feedback about this FLIP. If there are no other questions or concerns, I will start voting tomorrow(Friday, June 23rd). Best, Lijie Jing Ge 于2023年6月21日周三 17:14写道: > Hi Ron, > > Thanks for sharing your thoughts! It makes sense. It would be helpful if > these

[RESULT][VOTE]FLIP-308: Support Time Travel

2023-06-22 Thread Feng Jin
Hi everyone, Happy to announce that FLIP-308[1] has been approved! According to the vote thread[2], there are 7 approving votes, out of which 6 are binding: - yuxia (binding) - Lincoln Lee (binding) - Benchao Li (binding) - Jing Ge (binding) - Leonard Xu (binding) - John Roesler (non-binding) -

[jira] [Created] (FLINK-32414) Watermark alignment will cause flink jobs to hang forever when any source subtask has no SourceSplit

2023-06-22 Thread Rui Fan (Jira)
Rui Fan created FLINK-32414: --- Summary: Watermark alignment will cause flink jobs to hang forever when any source subtask has no SourceSplit Key: FLINK-32414 URL: https://issues.apache.org/jira/browse/FLINK-32414

Re: [VOTE] FLIP-246: Dynamic Kafka Source (originally Multi Cluster Kafka Source)

2023-06-22 Thread Rui Fan
+1 (binding) +1 for DynamicKafkaSource Best, Rui Fan On Wed, Jun 21, 2023 at 6:57 PM Thomas Weise wrote: > +1 (binding) > > > On Mon, Jun 19, 2023 at 8:09 AM Ryan van Huuksloot > wrote: > > > +1 (non-binding) > > > > +1 for DynamicKafkaSource > > > > Ryan van Huuksloot > > Sr. Production

[jira] [Created] (FLINK-32413) Add fallback error handler to DefaultLeaderElectionService

2023-06-22 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-32413: - Summary: Add fallback error handler to DefaultLeaderElectionService Key: FLINK-32413 URL: https://issues.apache.org/jira/browse/FLINK-32413 Project: Flink

[jira] [Created] (FLINK-32412) JobID collisions in FlinkSessionJob

2023-06-22 Thread Fabio Wanner (Jira)
Fabio Wanner created FLINK-32412: Summary: JobID collisions in FlinkSessionJob Key: FLINK-32412 URL: https://issues.apache.org/jira/browse/FLINK-32412 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-321: Introduce an API deprecation process

2023-06-22 Thread Becket Qin
Thanks much for the input, John, Stefan and Jing. I think Xingtong has well summarized the pros and cons of the two options. Let's collect a few more opinions here and we can move forward with the one more people prefer. Thanks, Jiangjie (Becket) Qin On Wed, Jun 21, 2023 at 3:20 AM Jing Ge