[jira] [Created] (FLINK-25492) Changelog with InMemoryStateChangelogStorage cannot work well

Hangxiang Yu created FLINK-25492: Summary: Changelog with InMemoryStateChangelogStorage cannot work well Key: FLINK-25492 URL: https://issues.apache.org/jira/browse/FLINK-25492 Project: Flink

[jira] [Created] (FLINK-25491) Code generation: init method exceeds 64 KB when there is a large IN filter with Table API

Daniel Cheng created FLINK-25491: Summary: Code generation: init method exceeds 64 KB when there is a large IN filter with Table API Key: FLINK-25491 URL: https://issues.apache.org/jira/browse/FLINK-25491

Re: [DISCUSS] FLIP-206: Support PyFlink Runtime Execution in Thread Mode

Hi Xingbo, Thanks for creating this FLIP. Big +1 for it! I have some question about the Thread Mode: 1. It seems that we dynamically load an embedded Python and user dependencies in the TM process. Can they be uninstalled cleanly after the task finished? i.e. Can we use the Thread Mode in

[jira] [Created] (FLINK-25493) 日期类型数据为空导致SQL校验失败原因为null

kunghsu created FLINK-25493: --- Summary: 日期类型数据为空导致SQL校验失败原因为null Key: FLINK-25493 URL: https://issues.apache.org/jira/browse/FLINK-25493 Project: Flink Issue Type: Improvement Components:

Re: [VOTE] Apache Flink ML Release 2.0.0, release candidate #3

+1 (non-binding) - Verified that the checksums and GPG files match the corresponding release files - Verified that the source distributions do not contain any binaries - Built the source distribution with Maven to ensure all source files have Apache headers - Verified that all POM files point to

[jira] [Created] (FLINK-25495) Client support attach mode when using the deployment of application mode

Junfan Zhang created FLINK-25495: Summary: Client support attach mode when using the deployment of application mode Key: FLINK-25495 URL: https://issues.apache.org/jira/browse/FLINK-25495 Project:

[jira] [Created] (FLINK-25494) Duplicate element serializer during DefaultOperatorStateBackendSnapshotStrategy#syncPrepareResources

Yun Tang created FLINK-25494: Summary: Duplicate element serializer during DefaultOperatorStateBackendSnapshotStrategy#syncPrepareResources Key: FLINK-25494 URL: https://issues.apache.org/jira/browse/FLINK-25494

Re: [VOTE] Apache Flink ML Release 2.0.0, release candidate #3

+1 (non-binding) - Verified that the checksums and GPG files match the corresponding release files - Verified that the source distributions do not contain any binaries - Built the source distribution with Maven to ensure all source files have Apache headers - Verified that all POM files point to

[jira] [Created] (FLINK-25496) ThreadDumpInfoTest.testComparedWithDefaultJDKImplemetation failed on azure

Yun Gao created FLINK-25496: --- Summary: ThreadDumpInfoTest.testComparedWithDefaultJDKImplemetation failed on azure Key: FLINK-25496 URL: https://issues.apache.org/jira/browse/FLINK-25496 Project: Flink

[jira] [Created] (FLINK-25485) JDBC connector implicitly add options when use mysql

Ada Wong created FLINK-25485: Summary: JDBC connector implicitly add options when use mysql Key: FLINK-25485 URL: https://issues.apache.org/jira/browse/FLINK-25485 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-200: Support Multiple Rule and Dynamic Rule Changing (Flink CEP)

Hi all, I can understand the need for a control plane mechanism. I'm not the technical go-to person for questions on the OperatorCoordinator, but I would expect that we could offer those interfaces from Flink but shouldn't recommend running user-code in the JobManager itself. I think the user

[jira] [Created] (FLINK-25486) Perjob can not recover from checkpoint when zookeeper leader changes

Liu created FLINK-25486: --- Summary: Perjob can not recover from checkpoint when zookeeper leader changes Key: FLINK-25486 URL: https://issues.apache.org/jira/browse/FLINK-25486 Project: Flink Issue

Re: [DISCUSS] FLIP-200: Support Multiple Rule and Dynamic Rule Changing (Flink CEP)

Hi all, sorry for the late reply, vacation season ;) I'm still not 100% sold on choosing the OC for this use-case, but on the other hand I don't have strong arguments against it. Few more questions / thoughts: We're still talking about the "web server based" pattern_processor_discoverer, but

Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

Hi Xuannan, Thanks for starting the discussion. This would certainly help a lot on both efficiency and reproducibility in machine learning cases :) I have a few questions as follows: 1. Can we support caching both the output and sideoutputs of a SingleOutputStreamOperator (which I believe is a

Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

Hi Xuannan, I found FLIP-188[1] that is aiming to introduce a built-in dynamic table storage, which provides a unified changelog & table representation. Tables stored there can be used in further ad-hoc queries. To my understanding, it's quite like an implementation of caching in Table API, and

Re: [DISCUSS] FLIP-200: Support Multiple Rule and Dynamic Rule Changing (Flink CEP)

Hi Konstantin, Becket, Martijn, Thanks for sharing your feedback. What other concerns do you have about OperatorCoodinator? If an agreement is reached on OperatorCoodinator, I will start the voting thread. Best, Nicholas Jiang On 2021/12/22 03:19:58 Becket Qin wrote: > Hi Konstantin, > >

[jira] [Created] (FLINK-25488) Using a pipe symbol as pair delimiter in STR_TO_MAP in combination with concatenation results in broken output

Martijn Visser created FLINK-25488: -- Summary: Using a pipe symbol as pair delimiter in STR_TO_MAP in combination with concatenation results in broken output Key: FLINK-25488 URL:

[NOTICE] Table API is now Scala-free by introducing a flink-table-planner-loader

Hi everyone, The new module flink-table-planner-loader replaces flink-table-planner_2.12 and avoids the need for a specific Scala version in downstream projects. It is included in the Flink distribution under /lib. For backwards compatibility, users can still swap it with

Re: [DISCUSS] FLIP-201: Persist local state in working directory

Hi Till, thanks for drafting the FLIP, it looks really good. I did a quick pass over the PR and it seems to be heading in a right direction. It might be required to introduce a graceful shutdown of the TaskExecutor > in order to support proper cleanup of resources. > This is actively being

Re: [NOTICE] Table API is now Scala-free by introducing a flink-table-planner-loader

This is really great news. Thanks a lot for all the effort Timo, Francesco and everyone else who was involved! I believe that this will make it a lot easier for our users to use any Scala version they want with Flink's vanilla distribution :-) Cheers, Till On Thu, Dec 30, 2021 at 4:03 PM David

Re: Unable to update logback configuration in Flink Native Kubernetes

I've faced the same issue before. I figured out that there is an internal configuration `$internal.deployment.config-dir` (code )

Re: [NOTICE] Table API is now Scala-free by introducing a flink-table-planner-loader

Great job! This brings the scala-free effort close to the finish line! D. On Thu, Dec 30, 2021 at 3:08 PM Timo Walther wrote: > Hi everyone, > > The new module flink-table-planner-loader replaces > flink-table-planner_2.12 and avoids the need for a specific Scala > version in downstream

[jira] [Created] (FLINK-25489) failed at task: node and npm install when building flink from source in mac m1

jie han created FLINK-25489: --- Summary: failed at task: node and npm install when building flink from source in mac m1 Key: FLINK-25489 URL: https://issues.apache.org/jira/browse/FLINK-25489 Project: Flink

[jira] [Created] (FLINK-25487) Improve exception when flink-table-runtime is not in classpath

Timo Walther created FLINK-25487: Summary: Improve exception when flink-table-runtime is not in classpath Key: FLINK-25487 URL: https://issues.apache.org/jira/browse/FLINK-25487 Project: Flink

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

+1 for a separate repository. And also +1 for finding a good name. `flink-warehouse` would be definitely a good marketing name but I agree that we should not start marketing for code bases. Are we planning to make this storage also available to DataStream API users? If not, I would also vote

Re: [DISCUSS] FLIP-201: Persist local state in working directory

Hi David, Thanks for your feedback. With the graceful shutdown I mean a way to stop the TaskManager and to clean up the working directory. At the moment, I think we always kill the process via SIGTERM or SIGKILL. This won't clean up the working directory because it could also originate from a

[VOTE] Apache Flink ML Release 2.0.0, release candidate #3

Hi everyone, Please review and vote on the release candidate #3 for the version 2.0.0 of Apache Flink ML, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Testing Guideline** You can find here [1] a page in the project wiki on

[jira] [Created] (FLINK-25490) Update the Chinese document related to final checkpoint

Yun Gao created FLINK-25490: --- Summary: Update the Chinese document related to final checkpoint Key: FLINK-25490 URL: https://issues.apache.org/jira/browse/FLINK-25490 Project: Flink Issue Type: