Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Hi Hang, Thank you for your feedback. Regarding your suggestion to delete the private field 'storage', I want to clarify that in this FLIP, we are only deprecating the getter and setter methods for CheckpointConfig#storage. Therefore, we cannot directly remove the 'storage' field at this moment.

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Thanks Junrui for driving the proposal. +1 from my side. This FLIP will help to make the configuration clearer for users. ps: We should also delete the private field `storage` as its getter and setter are deleted and it is marked as `@Deprecated`. This is not written in the FLIP. Best, Hang

[jira] [Created] (FLINK-33446) SubQueryAntiJoinTest#testMultiNotExistsWithCorrelatedOnWhere_NestedCorrelation doesn't produce the correct plan

Shengkai Fang created FLINK-33446: - Summary: SubQueryAntiJoinTest#testMultiNotExistsWithCorrelatedOnWhere_NestedCorrelation doesn't produce the correct plan Key: FLINK-33446 URL:

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Thanks Junrui for driving the proposal. +1 for this proposal. I believe this change will enhance the usability of Flink configuration for both users and developers, while also ensuring consistency across various types of configurations. Best, Yuxin Lijie Wang 于2023年11月3日周五 10:59写道： > Thanks

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Thanks Junrui for driving this. Making configurations simple and consistent has great benefits for both users and devs. +1 for the proposal. Best, Lijie weijie guo 于2023年11月2日周四 16:49写道： > Thanks Junrui for driving this proposal! > > I believe this is helpful for the new Process Function API.

[jira] [Created] (FLINK-33445) Translate DataSet migration guideline to Chinese

Wencong Liu created FLINK-33445: --- Summary: Translate DataSet migration guideline to Chinese Key: FLINK-33445 URL: https://issues.apache.org/jira/browse/FLINK-33445 Project: Flink Issue Type:

[jira] [Created] (FLINK-33444) Fixing the stability of "org.apache.flink.connectors.hive.TableEnvHiveConnectorITCase.testUDTF"

Krishna Anandan Ganesan created FLINK-33444: --- Summary: Fixing the stability of "org.apache.flink.connectors.hive.TableEnvHiveConnectorITCase.testUDTF" Key: FLINK-33444 URL:

Re: Heartbeat of TaskManager with id container

Hi Xiangyu, I have one issue, I am using *Flink** 1.16* version, How can i specify log4j.properties for the flink run command line along with my job. every job i need to pass different log file. looks like below one is not working: -Dlog4j.configurationFile= Please help me with correct config

[jira] [Created] (FLINK-33443) Make the test "testWriteComplexType" stable

Krishna Anandan Ganesan created FLINK-33443: --- Summary: Make the test "testWriteComplexType" stable Key: FLINK-33443 URL: https://issues.apache.org/jira/browse/FLINK-33443 Project: Flink

[jira] [Created] (FLINK-33442) UnsupportedOperationException thrown from RocksDBIncrementalRestoreOperation

Roman Khachatryan created FLINK-33442: - Summary: UnsupportedOperationException thrown from RocksDBIncrementalRestoreOperation Key: FLINK-33442 URL: https://issues.apache.org/jira/browse/FLINK-33442

[DISCUSS] Connector releases for Flink 1.18

Hey all. Now Flink 1.18 is released we need to do some connector releases for integration parity. We can use this thread to start the discussions for each connector release and spawn separate vote threads. Kafka is done [1] (thanks Gordon) and AWS connectors are in process [2], I appreciate help

Re: How do I source debug the scala in the flink table planner?

Hi David thanks on working on it May be I don't fully understand your issue however if you are using IntellijIdea and scala plugin (at least in readme it is mentioned that it is recommended) then you should be able to download corresponding sources(at least for table-planner) set breakpoints

[jira] [Created] (FLINK-33441) Implement union restore tests for ExecUnion node

Bonnie Varghese created FLINK-33441: --- Summary: Implement union restore tests for ExecUnion node Key: FLINK-33441 URL: https://issues.apache.org/jira/browse/FLINK-33441 Project: Flink Issue

[jira] [Created] (FLINK-33439) Implement type inference for IN function

Dawid Wysakowicz created FLINK-33439: Summary: Implement type inference for IN function Key: FLINK-33439 URL: https://issues.apache.org/jira/browse/FLINK-33439 Project: Flink Issue Type:

How do I source debug the scala in the flink table planner?

Hi, I am working on issue https://issues.apache.org/jira/browse/FLINK-33365 which has been marked as critical and a blocker for the next release of the jdbc connector. I can recreate an issue locally using code I built from source, so I can add in println’s which are coming out – but this is

Re: [RESULT][VOTE] Release flink-connector-hbase v3.0.0, release candidate #2

Hi Martijn! Is this work in progress? Thanks, Ferenc --- Original Message --- On Tuesday, September 12th, 2023 at 10:47, Martijn Visser wrote: > > > I'm happy to announce that we have unanimously approved this release. > > There are 7 approving votes, 3 of which are binding: >

[jira] [Created] (FLINK-33440) Bump flink version on flink-connectors-hbase

Ferenc Csaky created FLINK-33440: Summary: Bump flink version on flink-connectors-hbase Key: FLINK-33440 URL: https://issues.apache.org/jira/browse/FLINK-33440 Project: Flink Issue Type:

[jira] [Created] (FLINK-33438) HiveITCase.testHiveDialect and HiveITCase.testReadWriteHive are failing

Matthias Pohl created FLINK-33438: - Summary: HiveITCase.testHiveDialect and HiveITCase.testReadWriteHive are failing Key: FLINK-33438 URL: https://issues.apache.org/jira/browse/FLINK-33438 Project:

Re: [DISCUSS] FLIP-378: Support Avro timestamp with local timezone

+1 On Thu, Nov 2, 2023 at 12:44 PM Leonard Xu wrote: > > > > Thanks @Leonard Xu . Two minor versions are > > definitely needed for flip the configs. > > Sorry, Peter. I thought the next minor versions are 1.19、2.0， but actually it > should be 1.19、1.20、2.0 from

Re: [DISCUSS] Confluent Avro support without Schema Registry access

Hi Dale, > Aren’t we already fairly dependent on the schema remaining consistent, > because otherwise we’d need to update the table schema as well? No, because the schema can be updated with optional fields and depending on the compatibility mode, Flink will just consume or produce nulls in

Re: [DISCUSS] FLIP-376: Add DISTRIBUTED BY clause

Hi all, >From a user point of view, I think it makes sense to go for DISTRIBUTED BY with how Timo explained it. +1 for his proposal Best regards, Martijn On Thu, Nov 2, 2023 at 11:00 AM Timo Walther wrote: > > Hi Jing, > > I agree this is confusing. THe Spark API calls it bucketBy in the >

Apply to become a Flink contributor

Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is dyccode.

[jira] [Created] (FLINK-33437) Flink 1.17 sink commited legacy Committable state, but it was not removed from state backend

Yuchi Duan created FLINK-33437: -- Summary: Flink 1.17 sink commited legacy Committable state, but it was not removed from state backend Key: FLINK-33437 URL: https://issues.apache.org/jira/browse/FLINK-33437

Re: [DISCUSS] FLIP-378: Support Avro timestamp with local timezone

> Thanks @Leonard Xu . Two minor versions are > definitely needed for flip the configs. Sorry, Peter. I thought the next minor versions are 1.19、2.0， but actually it should be 1.19、1.20、2.0 from current community version plan IIUC, so remove the config in 2.0 should

[DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

Hi devs, Zhu Zhu and I would like to start a discussion about FLIP-383: Support Job Recovery for Batch Jobs[1] Currently, when Flink’s job manager crashes or gets killed, possibly due to unexpected errors or planned nodes decommission, it will cause the following two situations: 1. Failed, if

Re: [DISCUSS] FLIP-376: Add DISTRIBUTED BY clause

Hi Jing, I agree this is confusing. THe Spark API calls it bucketBy in the programmatic API. But anyway, we should discuss the SQL semantics here. It's like a "WHERE" is called "filter" in the programmatic world. Or a "SELECT" is called "projection" in code. And looking at all the Hive

[jira] [Created] (FLINK-33436) Documentation on the built-in Profiler

Yu Chen created FLINK-33436: --- Summary: Documentation on the built-in Profiler Key: FLINK-33436 URL: https://issues.apache.org/jira/browse/FLINK-33436 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33435) The visualization and download capabilities of profiling history

Yu Chen created FLINK-33435: --- Summary: The visualization and download capabilities of profiling history Key: FLINK-33435 URL: https://issues.apache.org/jira/browse/FLINK-33435 Project: Flink

[jira] [Created] (FLINK-33434) Support invoke async-profiler on Taskmanager through REST API

Yu Chen created FLINK-33434: --- Summary: Support invoke async-profiler on Taskmanager through REST API Key: FLINK-33434 URL: https://issues.apache.org/jira/browse/FLINK-33434 Project: Flink Issue

[jira] [Created] (FLINK-33433) Support invoke async-profiler on Jobmanager through REST API

Yu Chen created FLINK-33433: --- Summary: Support invoke async-profiler on Jobmanager through REST API Key: FLINK-33433 URL: https://issues.apache.org/jira/browse/FLINK-33433 Project: Flink Issue

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Thanks Junrui for driving this proposal! I believe this is helpful for the new Process Function API. Because we don't need to move some related class/components from flink-core to a pure API module (maybe, called flink-core-api) after this. Even though the FLIP related to new API is in

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Thanks Junrui for creating the FLIP and kicking off this discussion. The community has been constantly striving to unify and simplify the configuration layer of Flink. Some progress has already been made, such as FLINK-29379. However, the compatibility of public interfaces poses an obstacle to

[jira] [Created] (FLINK-33432) Build artifacts cannot be extracted smoothly

Matthias Pohl created FLINK-33432: - Summary: Build artifacts cannot be extracted smoothly Key: FLINK-33432 URL: https://issues.apache.org/jira/browse/FLINK-33432 Project: Flink Issue Type:

[jira] [Created] (FLINK-33431) Create restore tests for ExecNodes

Dawid Wysakowicz created FLINK-33431: Summary: Create restore tests for ExecNodes Key: FLINK-33431 URL: https://issues.apache.org/jira/browse/FLINK-33431 Project: Flink Issue Type:

[jira] [Created] (FLINK-33430) Fix Test Failures

Yang Chen created FLINK-33430: - Summary: Fix Test Failures Key: FLINK-33430 URL: https://issues.apache.org/jira/browse/FLINK-33430 Project: Flink Issue Type: Bug Reporter: Yang Chen