Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi, Thanks for joining the discussion and giving the ideas. @ron > can the Hybrid Shuffle replace the RSS in the future? The hybrid shuffle and RSS offer distinct solutions to address the shuffle operation challenge. To optimize performance, we store shuffle data in different tiers of memory and

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Thanks for your start this discuss Here I am a bit confused about the memory layer definition. This refers to local memory. Should we define a data acceleration layer like Alluxio [1] in remote storage? Let me cite a scenario: If I use Fluid [2] to mount an AlluxioRuntime [3] on K8S, it looks

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi, Yuxin, Thanks for creating this FLIP. Adding remote storage capability to Flink's Hybrid Shuffle is a significant improvement that addresses the issue of local disk storage limitations, this also can improve the stability of Flink Batch Job. I just have one question: can the Hybrid Shuffle

[jira] [Created] (FLINK-31493) helm upgrade does not work, because repo path does not follow helm standards

Emmanuel Leroy created FLINK-31493: -- Summary: helm upgrade does not work, because repo path does not follow helm standards Key: FLINK-31493 URL: https://issues.apache.org/jira/browse/FLINK-31493

Re: [VOTE] Release flink-connector-parent10.0, release candidate #1

+1 (binding) - Verified hashes and signature - Read web PR - Staging Maven artifacts looks good Thanks, Gordon On Thu, Mar 16, 2023 at 1:24 PM Martijn Visser wrote: > +1 (binding) > > - Validated hashes > - Verified signature > - Verified that no binaries exist in the source archive > -

Re: [VOTE] Release flink-connector-mongodb, release candidate #1

+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Thu, Mar 16, 2023 at 11:21 AM Danny Cranmer wrote: > Hi everyone, > Please review and vote on the release

Re: [VOTE] Release flink-connector-parent10.0, release candidate #1

+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Verified web PR On Thu, Mar 16, 2023 at 2:51 PM Danny Cranmer wrote: > Thanks for driving this release, Chesnay. > > +1 (binding) > > - Verified signatures and hashes of source

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

Hi Daniel, > I don't know how to get to this point, it sounds like more of an organizational constraint than a technical one though- who is responsible for the same role for the standard Pub/Sub connector? I'm working with the Pub/Sub team right now on prioritization of supporting the flink

[jira] [Created] (FLINK-31492) AWS Firehose Connector misclassifies IAM permission exceptions as retryable

Samuel Siebenmann created FLINK-31492: - Summary: AWS Firehose Connector misclassifies IAM permission exceptions as retryable Key: FLINK-31492 URL: https://issues.apache.org/jira/browse/FLINK-31492

[jira] [Created] (FLINK-31491) table planner NestedLoopJoinTest.testLeftOuterJoinWithFilter failed in branch release1.16

Ran Tao created FLINK-31491: --- Summary: table planner NestedLoopJoinTest.testLeftOuterJoinWithFilter failed in branch release1.16 Key: FLINK-31491 URL: https://issues.apache.org/jira/browse/FLINK-31491

[jira] [Created] (FLINK-31490) ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten times out

Matthias Pohl created FLINK-31490: - Summary: ZooKeeperLeaderElectionTest.testLeaderShouldBeCorrectedWhenOverwritten times out Key: FLINK-31490 URL: https://issues.apache.org/jira/browse/FLINK-31490

[jira] [Created] (FLINK-31489) OperationManagerTest.testCloseOperation failed because it couldn't find a submitted operation

Matthias Pohl created FLINK-31489: - Summary: OperationManagerTest.testCloseOperation failed because it couldn't find a submitted operation Key: FLINK-31489 URL: https://issues.apache.org/jira/browse/FLINK-31489

[jira] [Created] (FLINK-31488) Dependency convergence failed due to dependency not being available

Matthias Pohl created FLINK-31488: - Summary: Dependency convergence failed due to dependency not being available Key: FLINK-31488 URL: https://issues.apache.org/jira/browse/FLINK-31488 Project: Flink

Re: [VOTE] Release 1.17.0, release candidate #2

Hi Martijn, Leonard. Thanks for your explanation. Best Regards, Ran Tao Leonard Xu 于2023年3月16日周四 22:32写道： > Thanks everyone for validating the RC2! > > As the new blocker issue FLINK-31485[1] we found , the RC2 of 1.17.0 is > officially canceled. > We'll build a new RC once FLINK-31485 is

Re: [VOTE] Release 1.17.0, release candidate #2

Thanks everyone for validating the RC2! As the new blocker issue FLINK-31485[1] we found , the RC2 of 1.17.0 is officially canceled. We'll build a new RC once FLINK-31485 is fixed. Hi, Ran Tao As Martijn’s explanation, FLINK-31319[2] is not a blocker for 1.17. But I’ve reviewed you patch and

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

Hi everyone I'm closing this vote now. I will follow up with the result in another email. Thanks Best, Shammon FY On Thu, Mar 16, 2023 at 10:37 AM ConradJam wrote: > Hang Ruan ruanhang1...@gmail.com 通过 > “flink.apache.org > ” > 3月15日周三

Re: [VOTE] Release flink-connector-parent10.0, release candidate #1

Thanks for driving this release, Chesnay. +1 (binding) - Verified signatures and hashes of source archive - Maven repo looks good - Passes maven "build" - Tag present in github - Reviewed web PR Thanks, Danny On Thu, Mar 16, 2023 at 8:55 AM Etienne Chauchot wrote: > Hi all, > > - checked

Re: [VOTE] Release 1.17.0, release candidate #2

Hi Ran Tao, This normally would not be considered a blocker, since this is already occurring in Flink 1.16 (so it's not a regression). It might be that we can include it, given that we will need to prepare another RC given the blocker that I've encountered. Best regards, Martijn On Thu, Mar

[jira] [Created] (FLINK-31487) Add targetColumns to DynamicTableSink#Context

lincoln lee created FLINK-31487: --- Summary: Add targetColumns to DynamicTableSink#Context Key: FLINK-31487 URL: https://issues.apache.org/jira/browse/FLINK-31487 Project: Flink Issue Type:

[RESULT][VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

Hi everyone, FLIP-300[1] has been accepted. There are 12 approving votes, 7 of which are binding: * yuxia (binding) * Hang Ruan * Jing Ge (binding) * Aitozi * Jark Wu (binding) * Samrat Deb * Jingsong Li (binding) * Jacky Lau * Dong Lin (binding) * Benchao Li (binding) * Jane Chan * Martijn

[jira] [Created] (FLINK-31486) Using KeySelector in IterationBody causes ClassNotFoundException

Jiang Xin created FLINK-31486: - Summary: Using KeySelector in IterationBody causes ClassNotFoundException Key: FLINK-31486 URL: https://issues.apache.org/jira/browse/FLINK-31486 Project: Flink

[VOTE] Release flink-connector-aws 4.1.0, release candidate #1

Hi everyone, Please review and vote on the flink-connector-aws release candidate #1 for the version 4.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA

Re: [VOTE] Release 1.17.0, release candidate #2

Hi, Martijn, QingSheng. I have a issue[1], QingSheng has reviewed and approved it. We need to backport it to release-1.17[2]. please help to do final checking. thanks. [1] https://issues.apache.org/jira/browse/FLINK-31319 [2] https://github.com/apache/flink/pull/22193 Best Regards, Ran Tao

Re: [VOTE] Release 1.17.0, release candidate #2

Hi all, I've spoken to Qingsheng via Slack as I've encountered a ClassNotFoundException when testing Avro Schema Registry. I've filed https://issues.apache.org/jira/browse/FLINK-31485 and created https://github.com/apache/flink/pull/22191 as a fix. Best regards, Martijn On Wed, Mar 15, 2023 at

[VOTE] Release flink-connector-mongodb, release candidate #1

Hi everyone, Please review and vote on the release candidate # for the version , as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * the

[jira] [Created] (FLINK-31485) Connecting to Kafka and Avro Schema Registry fails with ClassNotFoundException

Martijn Visser created FLINK-31485: -- Summary: Connecting to Kafka and Avro Schema Registry fails with ClassNotFoundException Key: FLINK-31485 URL: https://issues.apache.org/jira/browse/FLINK-31485

Re: [VOTE] Release flink-connector-parent10.0, release candidate #1

Hi all, - checked the release notes - tested the connector-parent with under development Cassandra connector. +1 (non-biding) Best Etienne Le 15/03/2023 à 16:40, Chesnay Schepler a écrit : Hi everyone, Please review and vote on the release candidate, as follows: [ ] +1, Approve the release

Re: [DISCUSS] Release of AWS Connectors v4.1.0

Given there are no objections, I will start the release process. On Tue, Mar 14, 2023 at 1:17 PM Danny Cranmer wrote: > Hello all, > > I would like to discuss the release of AWS Connectors v4.1.0. As well as > bug fixes the 4.1.0 changelog [1] includes externalized GSR formats [2] > which need

Re: [DISCUSS] Release of MongoDB Connector v1.0.0

Thanks for the feedback, I will start the release process On Wed, Mar 15, 2023 at 3:42 AM Leonard Xu wrote: > +1 to prepare the initial release. > > Thanks Danny and Jiabao for driving this great work, it's a pretty nice > addition to the Flink ecosystem. > > Best, > Leonard > > On Wed, Mar 15,

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

+1 (binding) On Thu, Mar 16, 2023 at 4:16 AM Jane Chan wrote: > +1 (non-binding) > > Best, > Jane > > On Thu, Mar 16, 2023 at 7:48 AM Benchao Li wrote: > > > +1 (binding) > > > > Dong Lin 于2023年3月15日周三 23:24写道： > > > > > +1 (binding) > > > > > > On Mon, Mar 13, 2023 at 8:18 PM Lincoln Lee >

Re: [ANNOUNCE] Apache Flink 1.15.4 released

Hi Danny, Thanks a lot for driving this release! Best regards, Martijn On Wed, Mar 15, 2023 at 5:38 PM Danny Cranmer wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.15.4, which is the fourth bugfix release for the Apache Flink 1.15 > series. > >

[jira] [Created] (FLINK-31484) flink-web compile failed due to local node tar corrupted

Leonard Xu created FLINK-31484: -- Summary: flink-web compile failed due to local node tar corrupted Key: FLINK-31484 URL: https://issues.apache.org/jira/browse/FLINK-31484 Project: Flink Issue

[Discussion] - Release major Flink version to support JDK 17 (LTS)

Read this recent thread regarding upgrading Kryo in Flink: https://lists.apache.org/thread/gv49jfkhmbshxdvzzozh017ntkst3sgq One option to consider is a Flink bridge release version that includes both Kryo v2 + v5 libraries, that supports reading saved state in either v2/v5 format, writes new

[jira] [Created] (FLINK-31483) Implement Split Deletion Support in Flink Kafka Connector

Ruibin Xing created FLINK-31483: --- Summary: Implement Split Deletion Support in Flink Kafka Connector Key: FLINK-31483 URL: https://issues.apache.org/jira/browse/FLINK-31483 Project: Flink