Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

Ron and Lincoln, Great proposal and interesting discussion for adding support for dynamic tables within Flink. At LinkedIn, we are also trying to solve compute/storage convergence for similar problems discussed as part of this FLIP, specifically periodic backfill, bootstrap + nearline update use

[DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

Hi Flink devs, I would like to start a discussion on FLIP-XXX: Make Flink's Hadoop and YARN configuration probing consistent . This stems from an earlier discussion thread here

[VOTE] FLIP-437: Support ML Models in Flink SQL

Hi devs, I'd like to start a vote on the FLIP-437: Support ML Models in Flink SQL [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] FLIP-427: Disaggregated State Store

Hi Feifan, I just replied in the discussion of FLIP-428. I agree that we could leave the clean-up optimization in the future FLIP, however, I think we should mention this topic explicitly in the current FLIP to make the overall design complete and more sophisticated. Best Yun Tang

Re: [DISCUSS] FLIP-424: Asynchronous State APIs

Hi Zakelly, I just have one minor question, why the interface of StateIterator#isEmpty is not asynchronous? Moreover, it lacks docs. Best Yun Tang From: Jane Chan Sent: Tuesday, March 19, 2024 21:54 To: dev@flink.apache.org Subject: Re: [DISCUSS] FLIP-424:

[jira] [Created] (FLINK-34966) Support to read snapshot by table partitions in MySQL CDC Source

He Wang created FLINK-34966: --- Summary: Support to read snapshot by table partitions in MySQL CDC Source Key: FLINK-34966 URL: https://issues.apache.org/jira/browse/FLINK-34966 Project: Flink

Re: [DISCUSS] FLIP-424: Asynchronous State APIs

Hi Yun, We can easily obtain whether it is empty or not when creating an iterator by the way, so this is synchronous. Docs added. Thanks & Best, Zakelly On Sat, Mar 30, 2024 at 11:01 AM Yun Tang wrote: > Hi Zakelly, > > I just have one minor question, why the interface of

Re: [DISCUSS] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

Hi Jinzhong, Yes, I know the cleanup mechanism for the remote working directory is the same as the current Rocksdb state-backend. However, the impact of the residual files in the remote working directory is different compared with residual files in the local directory, especially Flink just

Re: [VOTE] FLIP-424: Asynchronous State APIs

+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 12:51 PM Yuepeng Pan wrote: > +1(non-binding) > > Best, > Yuepeng Pan > > > On 2024/03/29 03:03:53 Yunfeng Zhou wrote: > > +1 (non-binding) > > > > Best, > > Yunfeng > > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan > wrote: > > > > > >

Re: [VOTE] FLIP-425: Asynchronous Execution Model

+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 11:04 AM Yunfeng Zhou wrote: > +1 (non-bindling) > > Best, > Yunfeng > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > > Model [1].

Re: Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 10:28 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Thu, Mar 28, 2024 at 10:13 PM Jing Ge > wrote: > > > +1(binding) > > > > Best Regards, > > Jing > > > > On Thu, Mar 28, 2024 at 1:28 PM Feifan Wang wrote:

[jira] [Created] (FLINK-34965) optimize code of ServiceType

bai sui created FLINK-34965: --- Summary: optimize code of ServiceType Key: FLINK-34965 URL: https://issues.apache.org/jira/browse/FLINK-34965 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-34964) ScheduledTask leak in registering the processing timer

zoucao created FLINK-34964: -- Summary: ScheduledTask leak in registering the processing timer Key: FLINK-34964 URL: https://issues.apache.org/jira/browse/FLINK-34964 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

+1 (non-binding) Best, Yue

Re: [VOTE] FLIP-426: Grouping Remote State Access

+1 (non-binding) Jinzhong Li 于2024年3月27日周三 18:57写道： > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficient votes. > > > [1]

Re: [VOTE] FLIP-427: Disaggregated state Store

+1(non-binding) Hangxiang Yu 于2024年3月27日周三 18:37写道： > Hi devs, > > Thanks all for your valuable feedback about FLIP-427: Disaggregated state > Store [1]. > I'd like to start a vote on it. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an

Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

+1(non-binding) Jinzhong Li 于2024年3月27日周三 19:31写道： > Hi devs, > > > I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale > Integration for Disaggregated State [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless there is an objection or >

Re: [VOTE] FLIP-425: Asynchronous Execution Model

+1 (non-binding) Yanfei Lei 于2024年3月27日周三 18:28写道： > Hi everyone, > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > Model [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an > objection or insufficient votes. > >

Re: [VOTE] FLIP-433: State Access on DataStream API V2

+1 (non-binding) weijie guo 于2024年3月20日周三 20:35写道： > Hi everyone, > > > Thanks for all the feedback about the FLIP-433: State Access on > DataStream API V2 [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless there is an > objection or insufficient

[jira] [Created] (FLINK-34963) Compilation error in ProcessFunctionTestHarnesses

Ryan Skraba created FLINK-34963: --- Summary: Compilation error in ProcessFunctionTestHarnesses Key: FLINK-34963 URL: https://issues.apache.org/jira/browse/FLINK-34963 Project: Flink Issue Type: