Re: [DISCUSS] Release flink-shaded 16.2

2023-11-09 Thread Yuxin Tan
Hi, Weijie, Thank you for volunteering to be a release manager. Currently, no objections are received. If there are no objections, we will release flink-shaded 16.2 next week. Best, Yuxin weijie guo 于2023年11月8日周三 11:11写道: > Thanks Yuxin for driving this! > > I am willing to help release

[VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-09 Thread Junrui Lee
Hi everyone, Thank you to everyone for the feedback on FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends)

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-09 Thread Hongshun Wang
@Martijn, I agree with you. I also have two questions at the beginning: - Why is an Internal class exposed as a constructor param of a Public class? - Should these classes be exposed as public? For the first question, I noticed that before the original Jira[1] , all these classes

[jira] [Created] (FLINK-33510) Update plugin for SBOM generation to 2.7.10

2023-11-09 Thread Vinod Anandan (Jira)
Vinod Anandan created FLINK-33510: - Summary: Update plugin for SBOM generation to 2.7.10 Key: FLINK-33510 URL: https://issues.apache.org/jira/browse/FLINK-33510 Project: Flink Issue Type:

[jira] [Created] (FLINK-33507) JsonToRowDataConverters can't parse zero timestamp '0000-00-00 00:00:00'

2023-11-09 Thread jinzhuguang (Jira)
jinzhuguang created FLINK-33507: --- Summary: JsonToRowDataConverters can't parse zero timestamp '-00-00 00:00:00' Key: FLINK-33507 URL: https://issues.apache.org/jira/browse/FLINK-33507 Project:

[jira] [Created] (FLINK-33508) Support for wildcard paths in Flink History Server for multi cluster environment

2023-11-09 Thread Jayadeep Jayaraman (Jira)
Jayadeep Jayaraman created FLINK-33508: -- Summary: Support for wildcard paths in Flink History Server for multi cluster environment Key: FLINK-33508 URL: https://issues.apache.org/jira/browse/FLINK-33508

[jira] [Created] (FLINK-33509) flaky test testNodeAffinity() in InitTaskManagerDecoratorTest.java

2023-11-09 Thread Ruby (Jira)
Ruby created FLINK-33509: Summary: flaky test testNodeAffinity() in InitTaskManagerDecoratorTest.java Key: FLINK-33509 URL: https://issues.apache.org/jira/browse/FLINK-33509 Project: Flink Issue

[jira] [Created] (FLINK-33511) flink SqlGateway select bigint type column get cast exception

2023-11-09 Thread xiaodao (Jira)
xiaodao created FLINK-33511: --- Summary: flink SqlGateway select bigint type column get cast exception Key: FLINK-33511 URL: https://issues.apache.org/jira/browse/FLINK-33511 Project: Flink Issue

[jira] [Created] (FLINK-33512) Update download link in doc of Kafka connector

2023-11-09 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-33512: - Summary: Update download link in doc of Kafka connector Key: FLINK-33512 URL: https://issues.apache.org/jira/browse/FLINK-33512 Project: Flink Issue Type:

Re: Adding a new channel to Apache Flink slack workspace

2023-11-09 Thread Yun Tang
+1 and glad to see more guys are using PyFlink. Best Yun Tang From: Jing Ge Sent: Wednesday, November 8, 2023 3:18 To: ro...@decodable.co.invalid Cc: dev@flink.apache.org Subject: Re: Adding a new channel to Apache Flink slack workspace +1 since there are so

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-09 Thread Xia Sun
Thanks Leonard for the feedback and sorry for my late response. > `How user disable the parallelism inference if they want to use fixed source parallelism?` > `Could you explain the priority the static parallelism set from table layer and the proposed dynamic source parallelism?` >From the

[jira] [Created] (FLINK-33492) Fix unavailable links in connector download page

2023-11-09 Thread Yubin Li (Jira)
Yubin Li created FLINK-33492: Summary: Fix unavailable links in connector download page Key: FLINK-33492 URL: https://issues.apache.org/jira/browse/FLINK-33492 Project: Flink Issue Type: Bug

Re: [DISCUSS] Release flink-connector-pulsar 4.1.0

2023-11-09 Thread Martijn Visser
Hi Tison, I would be +1 for releasing it, but does it include support for Flink 1.18? I think that the tests still failed for it, and I think that support should be in place before releasing a new version of the connector. What do you think? Best regards, Martijn On Thu, Nov 9, 2023 at 7:09 AM

[jira] [Created] (FLINK-33491) Support json column validated

2023-11-09 Thread ouyangwulin (Jira)
ouyangwulin created FLINK-33491: --- Summary: Support json column validated Key: FLINK-33491 URL: https://issues.apache.org/jira/browse/FLINK-33491 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-33495) Add catalog and connector ability API and validation

2023-11-09 Thread Timo Walther (Jira)
Timo Walther created FLINK-33495: Summary: Add catalog and connector ability API and validation Key: FLINK-33495 URL: https://issues.apache.org/jira/browse/FLINK-33495 Project: Flink Issue

[jira] [Created] (FLINK-33497) Update the Kafka connector to support DISTRIBUTED BY clause

2023-11-09 Thread Timo Walther (Jira)
Timo Walther created FLINK-33497: Summary: Update the Kafka connector to support DISTRIBUTED BY clause Key: FLINK-33497 URL: https://issues.apache.org/jira/browse/FLINK-33497 Project: Flink

[DISCUSSION] flink-connector-shared-utils release process

2023-11-09 Thread Etienne Chauchot
Hi all, flink-connector-shared-utils contains utilities for connectors (parent pom, ci scripts, template test connector project etc...). It is divided into 2 main branches: - parent_pom (1) containing just a pom.xml - ci_utils (2) containing the test project using the parent pom and the ci

[jira] [Created] (FLINK-33494) FLIP-376: Add DISTRIBUTED BY clause

2023-11-09 Thread Timo Walther (Jira)
Timo Walther created FLINK-33494: Summary: FLIP-376: Add DISTRIBUTED BY clause Key: FLINK-33494 URL: https://issues.apache.org/jira/browse/FLINK-33494 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-33493) Elasticsearch connector ElasticsearchWriterITCase test failed

2023-11-09 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-33493: - Summary: Elasticsearch connector ElasticsearchWriterITCase test failed Key: FLINK-33493 URL: https://issues.apache.org/jira/browse/FLINK-33493 Project: Flink

[jira] [Created] (FLINK-33496) Expose DISTRIBUTED BY clause via parser

2023-11-09 Thread Timo Walther (Jira)
Timo Walther created FLINK-33496: Summary: Expose DISTRIBUTED BY clause via parser Key: FLINK-33496 URL: https://issues.apache.org/jira/browse/FLINK-33496 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33498) Do not allow manually triggering incremental checkpoints with full checkpoint configured

2023-11-09 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33498: --- Summary: Do not allow manually triggering incremental checkpoints with full checkpoint configured Key: FLINK-33498 URL: https://issues.apache.org/jira/browse/FLINK-33498

[RESULT][VOTE] FLIP-376: Add DISTRIBUTED BY clause

2023-11-09 Thread Timo Walther
Hi everyone, The voting time for [VOTE] FLIP-376: Add DISTRIBUTED BY clause[1] has passed. I'm closing the vote now. There were 10 +1 votes, of which 8 were binding: - Jing Ge (binding) - Martijn Visser (binding) - Lincoln Lee (binding) - Benchao Li (binding) - Dawid Wysakowicz (binding) -

[jira] [Created] (FLINK-33500) Run storing the JobGraph an asynchronous operation

2023-11-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33500: - Summary: Run storing the JobGraph an asynchronous operation Key: FLINK-33500 URL: https://issues.apache.org/jira/browse/FLINK-33500 Project: Flink Issue

[jira] [Created] (FLINK-33501) Rely on Maven wrapper instead of having custom Maven installation logic

2023-11-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33501: - Summary: Rely on Maven wrapper instead of having custom Maven installation logic Key: FLINK-33501 URL: https://issues.apache.org/jira/browse/FLINK-33501 Project:

[jira] [Created] (FLINK-33499) Addressing the stability of org.apache.flink.cep.operator.CEPOperatorTest.testCEPOperatorCleanupEventTime

2023-11-09 Thread Krishna Anandan Ganesan (Jira)
Krishna Anandan Ganesan created FLINK-33499: --- Summary: Addressing the stability of org.apache.flink.cep.operator.CEPOperatorTest.testCEPOperatorCleanupEventTime Key: FLINK-33499 URL:

Re: Request a release of flink-connector-kafka version 3.1.0 (to consume kafka 3.4.0 with Flink 1.18)

2023-11-09 Thread Martijn Visser
Hi, The CVE is related to the Kafka Connect API and I think of that as a false-positive for the Flink Kafka connector. I would be inclined to preferably get https://issues.apache.org/jira/browse/FLINK-32197 in, and then do a release afterwards. But I would like to understand from Mason if he

Re: [DISCUSS] FLIP-390: Support System out and err to be redirected to LOG or discarded

2023-11-09 Thread Piotr Nowojski
Hi Rui, > I see java8 doesn't have `Arrays.equals(int[] a, int aFromIndex, int > aToIndex, int[] b, int bFromIndex, int bToIndex)`, > and java11 has it. Do you have any other suggestions for java8? Maybe use `ByteBuffer.wrap`? ByteBuffer.wrap(array, ..., ...).equals(ByteBuffer.wrap(array2, ...,

[jira] [Created] (FLINK-33506) Make AWS connectors compilable with jdk17

2023-11-09 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33506: --- Summary: Make AWS connectors compilable with jdk17 Key: FLINK-33506 URL: https://issues.apache.org/jira/browse/FLINK-33506 Project: Flink Issue Type:

[jira] [Created] (FLINK-33505) switch away from using netty 3 based Pekko Classic Remoting

2023-11-09 Thread PJ Fanning (Jira)
PJ Fanning created FLINK-33505: -- Summary: switch away from using netty 3 based Pekko Classic Remoting Key: FLINK-33505 URL: https://issues.apache.org/jira/browse/FLINK-33505 Project: Flink

Re: [DISCUSS] FLIP-390: Support System out and err to be redirected to LOG or discarded

2023-11-09 Thread Rui Fan
Hi Piotr, Thanks for your feedback! > Or implement your own loop? It shouldn't be more than a couple of lines. Implementing it directly is fine, I have updated the FLIP. And this logic can be found in the `isLineEnded` method. Best, Rui On Thu, Nov 9, 2023 at 11:00 PM Piotr Nowojski wrote:

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.2, release candidate #1

2023-11-09 Thread Martijn Visser
I agree with Leonard. We should also not update 1.16.0 to 1.18.0, but to the lowest supported Flink version of this release (in this case, 1.17.0) On Thu, Nov 9, 2023 at 3:08 AM Leonard Xu wrote: > > Thanks Danny for the reply. > > -1 (binding) > > Let’s fix the outdated version in the source

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-09 Thread Martijn Visser
Hi all, I'm looking at the original Jira that introduced these stability designations [1] and I'm just curious if it was intended that these Internal classes would be used directly, or if we just haven't created the right abstractions? The reason for asking is because moving something from

[jira] [Created] (FLINK-33502) HybridShuffleITCase caused a fatal error

2023-11-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33502: - Summary: HybridShuffleITCase caused a fatal error Key: FLINK-33502 URL: https://issues.apache.org/jira/browse/FLINK-33502 Project: Flink Issue Type:

[jira] [Created] (FLINK-33503) Upgrade Maven wrapper to 3.2.0

2023-11-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33503: - Summary: Upgrade Maven wrapper to 3.2.0 Key: FLINK-33503 URL: https://issues.apache.org/jira/browse/FLINK-33503 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-33504) Supported parallel jobs

2023-11-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33504: - Summary: Supported parallel jobs Key: FLINK-33504 URL: https://issues.apache.org/jira/browse/FLINK-33504 Project: Flink Issue Type: Sub-task