Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-19 Thread Ron Liu
Hi, Lincoln > 2. Regarding the options in HashAggCodeGenerator, since this new feature has gone through a couple of release cycles and could be considered for PublicEvolving now, cc @Ron Liu WDYT? Thanks for cc'ing me, +1 for public these options now. Best, Ron Benchao Li 于2024年5月20日周一

[RESULT][VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-13 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table[1] has been accepted with 8 approving votes (4 binding) [2]. - Xuyang - Feng Jin - Lincoln Lee(binding) - Jark Wu(binding) - Ron Liu(binding) - Shengkai Fang(binding) - Keith Lee

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Ron Liu
+1(binding) Best, Ron Jark Wu 于2024年5月10日周五 09:51写道: > +1 (binding) > > Best, > Jark > > On Thu, 9 May 2024 at 21:27, Lincoln Lee wrote: > > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > Feng Jin 于2024年5月9日周四 19:45写道

Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
there is an objection or not enough votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table [2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1 Best, Ron Ron Liu 于2024年5月9日周四 13:52写道: > Hi Dev, Thank

[VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table [2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1 Best, Ron

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
Hi, Dev Thank you all for joining this thread and giving your comments and suggestions, they have helped improve this proposal and I look forward to further feedback. If there are no further comments, I'd like to close the discussion and start the voting one day later. Best, Ron Ron Liu 于2024年

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-07 Thread Ron Liu
/blob/29736b8c01924b7da03d4bcbfd9c812a8e5a08b4/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/Operation.java Best, Ron Ron Liu 于2024年5月7日周二 14:30写道: > > 4. It appears that in the section on `public interfaces`, within > `Workflow

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-07 Thread Ron Liu
ter and the caller. Best, Ron Ron Liu 于2024年5月6日周一 20:48写道: > Hi, Xuyang > > Thanks for joining this discussion > > > 1. In the sequence diagram, it appears that there is a missing step for > obtaining the refresh handler from the catalog during the suspend operation. > >

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-06 Thread Ron Liu
oint. Can you give more description? Best, Ron Xuyang 于2024年5月6日周一 20:26写道: > Hi, Ron. > > Thanks for driving this. After reading the entire flip, I have the > following questions: > > > > > 1. In the sequence diagram, it appears that there is a missing step for > obt

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-04 Thread Ron Liu
provide the necessary information without the need to provide a new interface. I've updated the public interface section of FLIP. Best, Ron Lincoln Lee 于2024年4月30日周二 21:27写道: > Thanks Ron for starting this flip! It will complete the user story for > flip-435[1]. > > Regarding the Workflow

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
ache/flink/blob/b1544e4e513d2b75b350c20dbb1c17a8232c22fd/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/listener/CatalogModificationListener.java#L31 Best, Ron Ron Liu 于2024年4月28日周日 23:53写道: > Hi, Shengkai > > Thanks for your feedback and suggestion, it looks very useful for this > proposal

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
lated needs of materialized table. Based on your feedback, I have optimized and updated the FLIP related section. Best, Ron Shengkai Fang 于2024年4月28日周日 15:47写道: > Hi, Liu. > > Thanks for your proposal. I have some questions about the FLIP: > > *WorkflowScheduler* > > 1. How to g

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Ron Liu
+1(binding) Best, Ron Rui Fan <1996fan...@gmail.com> 于2024年4月26日周五 12:55写道: > +1(binding) > > Best, > Rui > > On Fri, Apr 26, 2024 at 10:26 AM Muhammet Orazov > wrote: > > > Hey Xia, > > > > +1 (non-binding) > > > > Thanks and b

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-25 Thread Ron Liu
e background? So I don't think it is necessary. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines Best, Ron Feng Jin 于2024年4月25日周四 00:46写道: > Hi Ron > > Thank you for initiating this FLIP. > > My

[DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-22 Thread Ron Liu
LINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table Best, Ron

[RESULT][VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-22 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines[1] has been accepted with 13 approving votes (8 binding) [2] - Ron Liu(binding) - Feng Jin - Rui Fan(binding) - Yuepeng Pan - Ahmed Hamdy - Ferenc Csaky - Lincoln Lee(binding) - Leonard

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
Hi, Xia Thanks for updating, looks good to me. Best, Ron Xia Sun 于2024年4月18日周四 19:11写道: > Hi Ron, > Yes, presenting it in a table might be more intuitive. I have already added > the table in the "Public Interfaces | New Config Option" chapter of FLIP. > PTAL~ > > R

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
think you should list the various behaviors of these two options that coexist in FLIP by a table, only then users can know how the dynamic and static parallelism inference work. Best, Ron Xia Sun 于2024年4月18日周四 16:33写道: > Hi Ron and Lijie, > Thanks for joining the discussion and sharing y

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-17 Thread Ron liu
or will the manually set parallelism take effect, and who has the higher priority? Best, Ron Xia Sun 于2024年4月17日周三 12:08写道: > Hi Jeyhun, Muhammet, > Thanks for all the feedback! > > > Could you please mention the default values for the new configurations > > (e.g., table.e

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-17 Thread Ron liu
+1(binding) Best, Ron Ron liu 于2024年4月17日周三 14:27写道: > Hi Dev, > > Thank you to everyone for the feedback on FLIP-435: Introduce a New > Materialized Table for Simplifying Data Pipelines[1][2]. > > I'd like to start a vote for it. The vote will be open for at least

[VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-17 Thread Ron liu
/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines [2] https://lists.apache.org/thread/c1gnn3bvbfs8v1trlf975t327s4rsffs Best, Ron

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Ron liu
Congratulations! Best, Ron Yuan Mei 于2024年4月15日周一 10:51写道: > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become > a new Flink Committer! > > Zakelly has been continuously contributing to the Flink project since 2020, &

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
FLIP-282 [1] has also introduced Update & Delete API for modifying table. 1. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=235838061 Best, Ron Ron liu 于2024年4月12日周五 19:49写道: > Hi, jgrier > > Thanks for your insightful input. > > First of all, very

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Ron liu
Congratulations, Lincoln! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Lincoln! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:29写道: > > > Congratulations, Lincoln! > > > > Best Regards > > Aleksandr > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Ron liu
Congratulations, Jing! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Jing! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:28写道: > > > Congratulations, Jing! > > > > Best Regards, > > Aleksandr > > >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
us statement may not be that accurate, this is not a new concept, it is just a new type of table, similar to the capabilities of materialized view, but simplifies the data processing pipeline, which is also aligned with the long term vision of Flink SQL. Best, Ron Jamie Grier 于2024年4月11日周四 05:59

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev My rankings are: 1. Derived Table 2. Materialized Table 3. Live Table 4. Materialized View Best, Ron Ron liu 于2024年4月9日周二 20:07写道: > Hi, Dev > > After several rounds of discussion, there is currently no consensus on the > name of the new concept. Timo has proposed th

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Friday. I look forward to everyone voting on the name in this thread. Of course, we also welcome new input regarding the name. Best, Ron Ron liu 于2024年4月9日周二 19:49写道: > Hi, Dev > > Sorry for my previous statement was not quite accurate. We will hold a > vote for the name within t

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev Sorry for my previous statement was not quite accurate. We will hold a vote for the name within this thread. Best, Ron Ron liu 于2024年4月9日周二 19:29写道: > Hi, Timo > > Thanks for your reply. > > I agree with you that sometimes naming is more difficult. When no on

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
, in your ranking there is an option for Materialized View, does it stand for the UPDATING Materialized View that you mentioned earlier in the discussion? If using Materialized View I think it is needed to extend it. Best, Ron Timo Walther 于2024年4月9日周二 17:20写道: > Hi Ron, > > yes namin

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
-materialized-query [3] https://community.denodo.com/docs/html/browse/6.0/vdp/vql/materialized_tables/creating_materialized_tables/creating_materialized_tables Best, Ron Ron liu 于2024年4月7日周日 15:55写道: > Hi, Lorenzo > > Thank you for your insightful input. > > >>> I think the 2 above

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/create/#as-select_statement Best, Ron 于2024年4月3日周三 22:25写道: > Hello everybody! > Thanks for the FLIP as it looks amazing (and I think the prove is this > deep discussion it is provoking :)) > > I have a

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-02 Thread Ron liu
that the Refresh command and the background refresh job can be executed in parallel, with no restrictions at the framework level. 5. Convert RefreshHandler into a plug-in interface to support various workflow schedulers. Best, Ron Ron liu 于2024年4月2日周二 10:28写道: > Hi, Venkata krishnan > > Thank you

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-01 Thread Ron liu
processing+backlog+data Best, Ron Venkatakrishnan Sowrirajan 于2024年3月30日周六 07:06写道: > Ron and Lincoln, > > Great proposal and interesting discussion for adding support for dynamic > tables within Flink. > > At LinkedIn, we are also trying to solve compute/storage converge

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-04-01 Thread Ron liu
Congratulations! Best, Ron Jeyhun Karimov 于2024年4月1日周一 18:12写道: > Congratulations! > > Regards, > Jeyhun > > On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > > > Congratulations! > > Best, > > Guowei > > > > > > On Mon, Apr 1, 20

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-25 Thread Ron liu
? Of course, look forward to your better suggestions. Best, Ron Timo Walther 于2024年3月25日周一 18:49写道: > After thinking about this more, this discussion boils down to whether > this is a special table or a special materialized view. In both cases, > we would need to add a specia

Re: Support minibatch for TopNFunction

2024-03-25 Thread Ron liu
/table/tuning/#minibatch-regular-joins [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals Best, Ron Roman Boyko 于2024年3月24日周日 01:14写道: > Hi Flink Community, > > I tried to describe my idea about minibatch for TopNFunction in this doc - > > https://

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-25 Thread Ron liu
c Table in FLIP user story section, Dynamic Table can be referenced by downstream Dynamic Table and can also support OLAP queries. Best, Ron Ron liu 于2024年3月23日周六 10:35写道: > Hi, Feng > > Thanks for your feedback. > > > Although currently we restrict users from modifying the qu

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-22 Thread Ron liu
costly. Also I think data consistency itself is the responsibility of the user, similar to how Regular Table is now also the responsibility of the user, so it's consistent with its behavior and no additional guarantees are made at the engine level. Best, Ron Ahmed Hamdy 于2024年3月22日周五 23:50写

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Ron liu
Congratulations! Best, Ron Jark Wu 于2024年3月21日周四 10:46写道: > Congratulations and welcome! > > Best, > Jark > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations! > > > > Best, > > Rui > >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Ron liu
Congratulations Best, Ron Yanfei Lei 于2024年3月18日周一 20:01写道: > Congrats, thanks for the great work! > > Sergey Nuyanzin 于2024年3月18日周一 19:30写道: > > > > Congratulations, thanks release managers and everyone involved for the > great work! > > > > On Mon,

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-14 Thread Ron liu
me for this, > however, it would require careful discussions. What do you think? The query part indeed requires a separate FLIP for discussion, as it involves changes to the default behavior. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/concepts/dynamic_tab

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Ron liu
+1 (non binding) quickly verified: - verified that source distribution does not contain binaries - verified checksums - built source code successfully Best, Ron Jeyhun Karimov 于2024年3月12日周二 01:00写道: > +1 (non binding) > > - verified that source distribution does not contain

[DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-11 Thread Ron liu
+Dynamic+Table+for+Simplifying+Data+Pipelines Best, Lincoln & Ron

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-25 Thread Ron liu
Congratulations, Jiabao! Best, Ron Yun Tang 于2024年2月23日周五 19:59写道: > Congratulations, Jiabao! > > Best > Yun Tang > > From: Weihua Hu > Sent: Thursday, February 22, 2024 17:29 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE]

Re: Temporal join on rolling aggregate

2024-02-25 Thread Ron liu
-syntax-qry-select-watermark.html Best, Ron

Re: Re: [VOTE] FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving

2024-01-19 Thread Ron liu
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 14:00写道: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-01-19 10:16:23,"Qingsheng Ren" 写道: > >+1 (binding) > > > >Thanks for the work, Hongshun! > >

Re: Re: [VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-18 Thread liu ron
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 13:58写道: > +1 (non-binding)-- > > Best! > Xuyang > > > > > > 在 2024-01-19 13:28:52,"Lincoln Lee" 写道: > >+1 (binding) > > > >Best, > >Lincoln Lee > > > > > >Ben

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread liu ron
+1 non-binding Best Ron Matthias Pohl 于2024年1月10日周三 23:05写道: > +1 (binding) > > On Wed, Jan 10, 2024 at 3:35 PM ConradJam wrote: > > > +1 non-binding > > > > Dawid Wysakowicz 于2024年1月10日周三 21:06写道: > > > > > +1 (binding) > > > Best, >

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-10 Thread liu ron
+1 Best, Ron Yunqing Mo 于2023年12月11日周一 12:01写道: > So cool, Big +1 for this exciting work. > > On 2023/12/07 03:24:59 Leonard Xu wrote: > > Dear Flink devs, > > > > As you may have heard, we at Alibaba (Ververica) are planning to donate > CDC Connectors

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-04 Thread liu ron
-FIRE. This FLIP is a continuation of FLIP-145, and also supports legacy group window aggregation to flat-migrate to the new window tvf agregation, which is very useful, especially for the support of CDC streams, a pain point that users often feedback. Big +1 for this FLIP. Best, Ron Xuyang 于

Re: [DISCUSS] Release 1.17.2

2023-11-06 Thread liu ron
+1 Best, Ron Jing Ge 于2023年11月6日周一 22:07写道: > +1 > Thanks for your effort! > > Best regards, > Jing > > On Mon, Nov 6, 2023 at 1:15 AM Konstantin Knauf wrote: > > > Thank you for picking it up! +1 > > > > Cheers, > > > > Konstantin >

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread liu ron
Great work, thanks everyone! Best, Ron Alexander Fedulov 于2023年10月27日周五 04:00写道: > Great work, thanks everyone! > > Best, > Alexander > > On Thu, 26 Oct 2023 at 21:15, Martijn Visser > wrote: > > > Thank you all who have contributed! > > > > O

Re: [VOTE] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-25 Thread liu ron
+1(binding) Best, Ron Jark Wu 于2023年10月25日周三 19:52写道: > +1 (binding) > > Best, > Jark > > On Wed, 25 Oct 2023 at 16:27, Jiabao Sun > wrote: > > > Thanks Jane for driving this. > > > > +1 (non-binding) > > > > Best, > > Jiabao >

Re: [DISCUSS] Implementing SQL remote functions

2023-09-18 Thread liu ron
Harder to do multiple remote calls per input row I think one solution is to support Mini-Batch Lookup Join by the framework layer, do a RPC call by a batch input row, which can improve throughput. Best, Ron Alan Sheinberg 于2023年9月19日周二 07:34写道: > Hello all, > > We want to implement a

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread liu ron
+1(non-binding) Best, Ron Dong Lin 于2023年9月14日周四 09:01写道: > Thank you Rui for the proposal. > > +1 (binding) > > On Wed, Sep 13, 2023 at 10:52 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi all, > > > > Thanks for all the feedback about the FLIP-334

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread liu ron
+1(non-binding) Best, Ron ConradJam 于2023年9月12日周二 20:43写道: > +1 (non-binding) > > Matt Wang 于2023年9月12日周二 19:29写道: > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Repl

Re: 退订

2023-09-07 Thread liu ron
#mailing-lists Best, Ron 喻凯 于2023年9月7日周四 19:38写道: > 退订

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-09-06 Thread liu ron
Hi Tawfik, Fast and slow streaming in distributed scenarios leads to watermark advancing too fast, which leads to lost data and is a headache in Flink. Can't wait to read your research paper! Best, Ron Yun Tang 于2023年9月6日周三 14:46写道: > Hi Tawfik, > > Thanks for offering such a

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-06 Thread liu ron
in users not being able to use it. Best, Ron Bonnie Arogyam Varghese 于2023年9月6日周三 23:52写道: > Hi Liu Ron, > To answer your question, >Security might not be the main reason for disabling this option but > other arguments brought forward by Timo. Let me know if you have a

Re: [DISCUSS] FLIP-361: Improve GC Metrics

2023-09-06 Thread liu ron
Hi, Gyula Thanks for driving this proposal, GC-related metrics are beneficial for us to profile the root cause, +1 for this proposal. Best, Ron Matt Wang 于2023年9月6日周三 15:24写道: > Hi Gyula, > > +1 for this proposal. > > Do we need to add a metric to record the count of differe

Re: 退订

2023-08-30 Thread liu ron
-lists Best, Ron 喻凯 于2023年8月30日周三 14:17写道: > >

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread liu ron
Hi, Bonnie > Options hints could be a security concern since users can override settings. I think this still doesn't answer my question Best, Ron Jark Wu 于2023年8月17日周四 19:51写道: > Sorry, I still don't understand why we need to disable the query hint. > It doesn't have the security

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
Hi, Jiangjie Thanks for your detailed explanation, I got your point. If the execution.attached is only used for client currently, removing it also make sense to me. Best, Ron Becket Qin 于2023年8月17日周四 07:37写道: > Hi Ron, > > Isn't the cluster (session or per job) o

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread liu ron
Hi, Thanks for driving this proposal. Can you explain why you would need to disable query hints because of security issues? I don't really understand why query hints affects security. Best, Ron Bonnie Arogyam Varghese 于2023年8月16日周三 23:59写道: > Platform providers may want to disable hi

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
section of the FLIP. Since execution.attached is used in session mode, there is a compatibility issue here if we change it directly to client.attached.after.submission, and I think we should make this clear in the FLIP. Best, Ron Becket Qin 于2023年8月14日周一 20:33写道: > Hi Ron and Weihua, > &g

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread liu ron
Hi, Ashish As Timo said, the community currently doesn't have plan to support schema evolution in Table API, Best, Ron Timo Walther 于2023年8月15日周二 23:29写道: > Hi Ashish, > > sorry for the late reply. There are currently no concrete plans to > support schema evolution in Tabl

Re: request for jira

2023-08-14 Thread liu ron
Hi, Lambda If you're interested in a ticket that doesn't currently have an owner, you can comment directly in the ticket and the committer will assign it to you without assigning special permissions. Best, Ron lambda ch 于2023年8月14日周一 22:42写道: > Hi, > I want to contribute to Apache

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-13 Thread liu ron
Hi, Venkata krishnan Thanks for driving this work, look forward to your FLIP. Best, Ron Venkatakrishnan Sowrirajan 于2023年8月13日周日 14:34写道: > Thanks Yunhong. That's correct. I am able to make it work locally. > Currently, in the process of writing a FLIP for the necessary c

Re: [DISCUSS] Connectors, Formats, and even User Code should also be pluggable.

2023-08-10 Thread liu ron
to turn it into a FLIP. In that case, the whole design will be very complete. Best, Ron Thor God 于2023年8月10日周四 14:47写道: > I'm interested in this, we often have linker dependency conflicts and it > takes a lot of work to resolve dependency conflicts. > > Benchao Li 于2023年7月25日周二 20:5

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-09 Thread liu ron
://issues.apache.org/jira/browse/FLINK-25495 Best, Ron Venkatakrishnan Sowrirajan 于2023年8月9日周三 02:07写道: > This is definitely a useful feature especially for the flink batch > execution workloads using flow orchestrators like Airflow, Azkaban, Oozie > etc. Thanks for reviving t

Re: [Question] How to assign uid to existing stream

2023-08-08 Thread liu ron
/dfb9cb851dc1f0908ea6c3ce1230dd8ca2b48733/flink-core/src/main/java/org/apache/flink/configuration/PipelineOptions.java#L70 [2] https://github.com/apache/flink/blob/dfb9cb851dc1f0908ea6c3ce1230dd8ca2b48733/flink-core/src/main/java/org/apache/flink/api/dag/Transformation.java#L168 Best, Ron Dennis Jung

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread liu ron
Congratulations Yanfei! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Yanfei! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:04 PM Lincoln Lee wrote: > > > > Congratulations, Yanfei! > > > > Best, > > Lincoln

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread liu ron
Congratulations, Hangxiang! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Hangxiang! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:03 PM Lincoln Lee wrote: > > > > Congratulations Hangxiang! > > > > Best, > > Lincoln

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-08-06 Thread liu ron
that can support other resource management frameworks such as Yarn, I think it will be very meaningful. +1 for this proposal. Best, Ron Gyula Fóra 于2023年8月5日周六 15:03写道: > Hi Rui! > > Thanks for the proposal. > > I agree with Max on that the state store abstractions could be improve

Re: Projection pushdown for Avro files seems to be buggy

2023-08-06 Thread liu ron
Hi, Xingcan After deep dive into the source code, I also think it is a bug. Best, Ron Xingcan Cui 于2023年8月5日周六 23:27写道: > Hi all, > > We tried to read some Avro files with the Flink SQL (1.16.1) and noticed > that the projection pushdown seems to be buggy. > > The Avro sc

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread liu ron
Congratulations Weihua! Best, Ron Shammon FY 于2023年8月4日周五 13:25写道: > Congratulations, Weihua! > > Best, > Shammon FY > > On Fri, Aug 4, 2023 at 12:33 PM Jing Ge > wrote: > > > congrats! Weihua! > > > > Best regards, > > Jing > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread liu ron
Congrats, Matthias! Best, Ron Shammon FY 于2023年8月4日周五 13:24写道: > Congratulations, Matthias! > > On Fri, Aug 4, 2023 at 1:13 PM Samrat Deb wrote: > > > Congrats, Matthias! > > > > > > On Fri, 4 Aug 2023 at 10:13 AM, Benchao Li wrote: > > > > >

Re: [VOTE] FLIP-333: Redesign Apache Flink website

2023-08-03 Thread liu ron
+1 Best, Ron Xintong Song 于2023年8月4日周五 09:35写道: > +1 (binding) > > Best, > > Xintong > > > > On Fri, Aug 4, 2023 at 3:05 AM Hong Liang wrote: > > > +1 (binding) > > > > Thanks Deepthi! > > > > > > > > On Thu

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread liu ron
Congratulations, Hong! Best, Ron Samrat Deb 于2023年8月4日周五 10:49写道: > Congratulations, Hong Teoh > > On Fri, 4 Aug 2023 at 7:52 AM, Benchao Li wrote: > > > Congratulations, Hong! > > > > yuxia 于2023年8月4日周五 09:23写道: > > > > > Congratulations, Hon

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-01 Thread liu ron
to extend it. You can also look further into reasonable solutions, which we'll discuss further later on. Best, Ron Venkatakrishnan Sowrirajan 于2023年7月29日周六 03:31写道: > Hi all, > > Currently, I am working on adding support for nested fields filter push > down. In our use case r

Re: [DISCUSSION] Revival of FLIP-154 (SQL Implicit Type Coercion)

2023-07-31 Thread liu ron
to start this work. Best, Ron Benchao Li 于2023年7月25日周二 21:06写道: > Hi Sergey, > > There is a discussion[1] for this FLIP before. > > I like this feature, thanks for driving this. I hope it does not need to > much customization (if there is any improvement which would benefit both &

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2023-07-31 Thread liu ron
+1, Best, Ron Yun Tang 于2023年7月26日周三 14:19写道: > +1 (binding) > > Best > Yun Tang > > From: Yu Li > Sent: Wednesday, July 26, 2023 14:10 > To: dev@flink.apache.org > Subject: Re: [DISCUSS][2.0] FLIP-349: Move R

Re: [VOTE][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-31 Thread liu ron
+1(no-binding) Best, Ron Jing Ge 于2023年7月26日周三 21:47写道: > +1 (binding) > > On Wed, Jul 26, 2023 at 4:21 PM weijie guo > wrote: > > > +1 (binding) > > > > Best regards, > > > > Weijie > > > > > > Yuxin Tan 于2023年7月26日周三 16

Re: [DISCUSS] Add missing visibility annotation for Table APIs

2023-07-30 Thread liu ron
Hi, Jane Thanks for driving this discussion, I think this would be very useful for developer, +1. Best, Ron Jane Chan 于2023年7月31日周一 10:57写道: > Hi Jing, > > According to your proposal, does it mean that there will be no public class > > that has no annotation? > > >

Re: Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-30 Thread liu ron
+1, make sense. Best, Ron Wencong Liu 于2023年7月27日周四 09:47写道: > Hi Matthias, > > Thanks for your reply. Due to my busy work reasons, I would like to focus > only on > the `Path` class in FLIP-347 for now. As for the implementation of other > modules, > I will review them

Re: [VOTE][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-30 Thread liu ron
+1 Best, Ron Xintong Song 于2023年7月27日周四 09:59写道: > I think we should add the release version when the FLIP is actually > released, in case of inconsistency. > > > Best, > > Xintong > > > > On Wed, Jul 26, 2023 at 9:48 PM Jing Ge > wrote: > >

Re: [VOTE][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-27 Thread liu ron
+1 Best, Ron Jing Ge 于2023年7月26日周三 23:39写道: > +1(binding). > > Theoretically, I agree with Matthias. But in the practices, afaic, those > touched classes are low level APIs. We'd better have enough time to > evaluate them with care. More time might be needed than we coul

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread liu ron
Congratulations, Best, Ron Qingsheng Ren 于2023年7月24日周一 11:18写道: > Congratulations and welcome aboard, Yong! > > Best, > Qingsheng > > On Mon, Jul 24, 2023 at 11:14 AM Chen Zhanghao > wrote: > > > Congrats, Shammon! > > > > Best, > > Zhanghao C

Re: [DISCUSS] FLIP 333 - Redesign Apache Flink website

2023-07-23 Thread liu ron
+1, The dark mode looks very cool. Best, Ron Matthias Pohl 于2023年7月20日周四 15:45写道: > I think Martijn and Markos brought up a few good points: > > - We shouldn't degrade the accessibility but ideally improve it as part of > the redesign. The current proposal doesn't look like

Re: [VOTE] FLIP-346: Deprecate ManagedTable related APIs

2023-07-23 Thread liu ron
+1 Best, Ron Lincoln Lee 于2023年7月21日周五 16:09写道: > +1 > > Best, > Lincoln Lee > > > Leonard Xu 于2023年7月21日周五 16:07写道: > > > +1 > > > > Best, > > Leonard > > > > > On Jul 21, 2023, at 4:02 PM, yuxia > wrote: > > > >

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-23 Thread liu ron
+1 Best, Ron Yuxin Tan 于2023年7月21日周五 16:21写道: > +1 > > Best, > Yuxin > > > Jing Ge 于2023年7月21日周五 15:41写道: > > > +1 > > > > NIT: the release in the FLIP is still empty, it should be 2.0 > > > > Best regards, > > Jing > > > &g

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-03 Thread liu ron
Congrats everyone Best, Ron Jark Wu 于2023年7月3日周一 22:48写道: > Congrats everyone! > > Best, > Jark > > > 2023年7月3日 22:37,Yuval Itzchakov 写道: > > > > Congrats team! > > > > On Mon, Jul 3, 2023, 17:28 Jing Ge via user <mailto:u...@flink.apache.o

Re: [RESULT][VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-29 Thread liu ron
Thanks all for participating! Best, Ron Lijie Wang 于2023年6月29日周四 21:38写道: > Hi, all > Happy to announce that FLIP-324 [1] has been approved unanimously. > According to the vote thread[2], there are 10 approving votes, out of > which 7 are binding: > > - Jing Ge (binding) &g

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread liu ron
+1(no-binding) Best, Ron Feng Jin 于2023年6月29日周四 00:22写道: > +1 (no-binding) > > > Best > Feng > > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge > wrote: > > > +1(binding) > > > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > >

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-20 Thread liu ron
should first follow the simple way, the subsequent gradual optimization. The first step may be that we can verify the reasonableness of current formula by TPC-DS case. Best, Ron Jing Ge 于2023年6月20日周二 19:46写道: > Hi Ron, > > Thanks for the clarification. That answered my questions. >

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread liu ron
ter/docs/deployment/elastic_scaling/#adaptive-batch-scheduler Best, Ron Jing Ge 于2023年6月20日周二 07:11写道: > Hi Lijie, > > Thanks for your proposal. It is a really nice feature. I'd like to ask a > few questions to understand your thoughts. > > Afaiu, the runtime Filter will only be Inje

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-15 Thread liu ron
+1(no-binding) Best, Ron yuxia 于2023年6月15日周四 20:15写道: > +1 (binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Leonard Xu" > 收件人: "dev" > 发送时间: 星期四, 2023年 6 月 15日 下午 8:09:00 > 主题: Re: [VOTE] FLIP-294: Support Customized Catalog

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-14 Thread liu ron
. Runtime filter is a general performance optimization technique that can improve the performance of Flink batch jobs, so we are introducing it on batch as well. Looking forward to all feedback. Best, Ron Lijie Wang 于2023年6月14日周三 17:17写道: > Hi devs > > Ron Liu, Gen Luo and I would like

Re: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-12 Thread liu ron
+1 (no-binding) Best, Ron Jing Ge 于2023年6月12日周一 19:33写道: > +1(binding) Thanks! > > Best regards, > Jing > > On Mon, Jun 12, 2023 at 12:01 PM yuxia > wrote: > > > +1 (binding) > > Thanks Mang driving it. > > > > Best regards, > > Yuxia &

  1   2   >