+1(binding)
Best,
Ron
Xuyang 于2024年1月19日周五 14:00写道:
> +1 (non-binding)
>
>
> --
>
> Best!
> Xuyang
>
>
>
>
>
> 在 2024-01-19 10:16:23,"Qingsheng Ren" 写道:
> >+1 (binding)
> >
> >Thanks for the work, Hongshun!
> >
> >Best,
> >Qingsheng
> >
> >On Tue, Jan 16, 2024 at 11:21 AM Leonard Xu
FLIP-282 [1] has also introduced Update & Delete API for modifying table.
1.
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=235838061
Best,
Ron
Ron liu 于2024年4月12日周五 19:49写道:
> Hi, jgrier
>
> Thanks for your insightful input.
>
> First of all, very
Congratulations, Jing!
Best,
Ron
Junrui Lee 于2024年4月12日周五 18:54写道:
> Congratulations, Jing!
>
> Best,
> Junrui
>
> Aleksandr Pilipenko 于2024年4月12日周五 18:28写道:
>
> > Congratulations, Jing!
> >
> > Best Regards,
> > Aleksandr
> >
>
Congratulations, Lincoln!
Best,
Ron
Junrui Lee 于2024年4月12日周五 18:54写道:
> Congratulations, Lincoln!
>
> Best,
> Junrui
>
> Aleksandr Pilipenko 于2024年4月12日周五 18:29写道:
>
> > Congratulations, Lincoln!
> >
> > Best Regards
> > Aleksandr
> >
>
; > > > >standard, with a strong association with query, and has industry
> > > > > precedents
> > > > >such as Google Looker.
> > > > >
> > > > > 2. Live Table -> an alternative for 'dynamic table'
> > > > >
>
Hi Dev,
Thank you to everyone for the feedback on FLIP-435: Introduce a New
Materialized Table for Simplifying Data Pipelines[1][2].
I'd like to start a vote for it. The vote will be open for at least 72
hours unless there is an objection or not enough votes.
[1]
+1(binding)
Best,
Ron
Ron liu 于2024年4月17日周三 14:27写道:
> Hi Dev,
>
> Thank you to everyone for the feedback on FLIP-435: Introduce a New
> Materialized Table for Simplifying Data Pipelines[1][2].
>
> I'd like to start a vote for it. The vote will be open for at least
Hi, Xia
Thanks for updating, looks good to me.
Best,
Ron
Xia Sun 于2024年4月18日周四 19:11写道:
> Hi Ron,
> Yes, presenting it in a table might be more intuitive. I have already added
> the table in the "Public Interfaces | New Config Option" chapter of FLIP.
> PTAL~
>
> R
the Enum options in InferMode class.
>
> Best,
> Xia
>
> Lijie Wang 于2024年4月18日周四 13:50写道:
>
> > Thanks for driving the discussion.
> >
> > +1 for the proposal and +1 for the `InferMode.NONE` option.
> >
> > Best,
> > Lijie
> >
> >
Hi, Dev
I'm happy to announce that FLIP-435: Introduce a New Materialized Table for
Simplifying Data Pipelines[1] has been accepted with 13 approving votes (8
binding) [2]
- Ron Liu(binding)
- Feng Jin
- Rui Fan(binding)
- Yuepeng Pan
- Ahmed Hamdy
- Ferenc Csaky
- Lincoln Lee(binding)
- Leonard
Hi, Dev
I would like to start a discussion about FLIP-448: Introduce Pluggable
Workflow Scheduler Interface for Materialized Table.
In FLIP-435[1], we proposed Materialized Table, which has two types of data
refresh modes: Full Refresh & Continuous Refresh Mode. In Full Refresh
mode, the
Congratulations!
Best,
Ron
Yuan Mei 于2024年4月15日周一 10:51写道:
> Hi everyone,
>
> On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become
> a new Flink Committer!
>
> Zakelly has been continuously contributing to the Flink project since 2020,
> with a focus area on
+1(binding)
Best,
Ron
Rui Fan <1996fan...@gmail.com> 于2024年4月26日周五 12:55写道:
> +1(binding)
>
> Best,
> Rui
>
> On Fri, Apr 26, 2024 at 10:26 AM Muhammet Orazov
> wrote:
>
> > Hey Xia,
> >
> > +1 (non-binding)
> >
> > Thanks and best,
> > Muhammet
> >
> > On 2024-04-26 02:21, Xia Sun wrote:
> >
2. Regarding the status information of the workflow, I am wondering if it
> is necessary to provide an interface to display the backend scheduling
> information? This would make it more convenient to view the execution
> status of backend jobs.
>
>
> Best,
> Feng
>
>
&g
Hi, Xia
Thanks for driving this FLIP.
This proposal looks good to me overall. However, I have the following minor
questions:
1. FLIP introduced `table.exec.hive.infer-source-parallelism.mode` as a new
parameter, and the value is the enum class `InferMode`, I think the
InferMode class should
Hi, Shengkai
Thanks for your feedback and suggestion, it looks very useful for this
proposal, regarding your question I made the following optimization:
> *WorkflowScheduler*
> 1. How to get the exception details if `modifyRefreshWorkflow` fails?
> 2. Could you give us an example about how to
ache/flink/blob/b1544e4e513d2b75b350c20dbb1c17a8232c22fd/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/listener/CatalogModificationListener.java#L31
Best,
Ron
Ron Liu 于2024年4月28日周日 23:53写道:
> Hi, Shengkai
>
> Thanks for your feedback and suggestion, it looks very useful for this
> proposal
Hi Dev, Thank you to everyone for the feedback on FLIP-448: Introduce
Pluggable Workflow Scheduler Interface for Materialized Table[1][2]. I'd
like to start a vote for it. The vote will be open for at least 72 hours
unless there is an objection or not enough votes. [1]
there is an objection or not enough votes.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table
[2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1
Best,
Ron
Ron Liu 于2024年5月9日周四 13:52写道:
> Hi Dev, Thank
that in the section on `public interfaces`, within
> `WorkflowOperation`, `CreatePeriodicWorkflowOperation` should be changed to
>
> `CreateWorkflowOperation`, right?
>
>
>
>
> --
>
> Best!
> Xuyang
>
>
>
>
>
> At 2024-04-22 14:41:39, "Ron L
:
> >
> > > +1 (non-binding)
> > >
> > >
> > > Best,
> > > Feng
> > >
> > >
> > > On Thu, May 9, 2024 at 7:37 PM Xuyang wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > &
Hi, Dev
Thank you all for joining this thread and giving your comments and
suggestions, they have helped improve this proposal and I look forward to
further feedback.
If there are no further comments, I'd like to close the discussion and
start the voting one day later.
Best,
Ron
Ron Liu 于2024年
ter and
the caller.
Best,
Ron
Ron Liu 于2024年5月6日周一 20:48写道:
> Hi, Xuyang
>
> Thanks for joining this discussion
>
> > 1. In the sequence diagram, it appears that there is a missing step for
> obtaining the refresh handler from the catalog during the suspend operation.
>
>
Hi, Dev
I'm happy to announce that FLIP-448: Introduce Pluggable Workflow Scheduler
Interface for Materialized Table[1] has been accepted with 8 approving
votes (4 binding) [2].
- Xuyang
- Feng Jin
- Lincoln Lee(binding)
- Jark Wu(binding)
- Ron Liu(binding)
- Shengkai Fang(binding)
- Keith Lee
simply wait for the PRs to come.
> >
> > > After discussing with Shengkai offline, there is no need for this REST
> > API
> > to support multiple tables to be refreshed at the same time, so it would
> be
> > more appropriate to put the materialized table identifier in
/blob/29736b8c01924b7da03d4bcbfd9c812a8e5a08b4/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/Operation.java
Best,
Ron
Ron Liu 于2024年5月7日周二 14:30写道:
> > 4. It appears that in the section on `public interfaces`, within
> `Workflow
+1 (non binding)
quickly verified:
- verified that source distribution does not contain binaries
- verified checksums
- built source code successfully
Best,
Ron
Jeyhun Karimov 于2024年3月12日周二 01:00写道:
> +1 (non binding)
>
> - verified that source distribution does not contain binaries
> -
Hi, Dev
Lincoln Lee and I would like to start a discussion about FLIP-435:
Introduce a New Dynamic Table for Simplifying Data Pipelines.
This FLIP is designed to simplify the development of data processing
pipelines. With Dynamic Tables with uniform SQL statements and
freshness, users can
Congratulations
Best,
Ron
Yanfei Lei 于2024年3月18日周一 20:01写道:
> Congrats, thanks for the great work!
>
> Sergey Nuyanzin 于2024年3月18日周一 19:30写道:
> >
> > Congratulations, thanks release managers and everyone involved for the
> great work!
> >
> > On Mon, Mar 18, 2024 at 12:15 PM Benchao Li
>
Congratulations!
Best,
Ron
Jark Wu 于2024年3月21日周四 10:46写道:
> Congratulations and welcome!
>
> Best,
> Jark
>
> On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote:
>
> > Congratulations!
> >
> > Best,
> > Rui
> >
> > On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan
> wrote:
> >
> > >
ES`. Your proposal seems to rephrase STREAM and EMIT,
> > into other keywords DYNAMIC TABLE and FRESHNESS. But the core
> > functionality is still there. I'm wondering if we should widen the scope
> > (maybe not part of this FLIP but a new FLIP) to follow the standard more
>
c Table in FLIP user
story section, Dynamic Table can be referenced by downstream Dynamic Table
and can also support OLAP queries.
Best,
Ron
Ron liu 于2024年3月23日周六 10:35写道:
> Hi, Feng
>
> Thanks for your feedback.
>
> > Although currently we restrict users from modifying the qu
Hi, Roman
Thanks for your proposal, I intuitively feel that this optimization would
be very useful to reduce the amount of message amplification for TopN
operators. After briefly looking at your google docs, I have the following
questions:
1. Whether you can describe in detail the principle of
gt;>> the catalog or somewhere else.
> > > >>>
> > > >>>
> > > >>> [1]
> > > >>>
> > > >>
> > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-134%3A+Batch+execution+for+the+Da
he given query, the content cannot be changed by using DML.
> > > You don’t insert, update, or delete the rows in a dynamic table.
> >
> > So a new term makes a lot of sense.
> >
> > How about using `UPDATING`?
> >
> > CREATE UPDATING TABLE
> >
ontext of a bootstrap (batch) + nearline update
> (streaming) case that are stateful applications? What I mean by that is,
> will the state from the batch application be transferred to the nearline
> application after the bootstrap execution is complete?
>
> Regards
> Venkata krish
Congratulations!
Best,
Ron
Jeyhun Karimov 于2024年4月1日周一 18:12写道:
> Congratulations!
>
> Regards,
> Jeyhun
>
> On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote:
>
> > Congratulations!
> > Best,
> > Guowei
> >
> >
> > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote:
> >
> > > Congratulations!
> >
-materialized-query
[3]
https://community.denodo.com/docs/html/browse/6.0/vdp/vql/materialized_tables/creating_materialized_tables/creating_materialized_tables
Best,
Ron
Ron liu 于2024年4月7日周日 15:55写道:
> Hi, Lorenzo
>
> Thank you for your insightful input.
>
> >>> I think the 2 above
ly
> > prefer something like CREATE CONTINUOUS TABLE, CREATE REFRESH TABLE or
> > CREATE LIVE TABLE.
> >
> > Best regards,
> >
> > Martijn
> >
> > [1]
> >
> https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-ddl-create-streaming-
Hi, Dev
My rankings are:
1. Derived Table
2. Materialized Table
3. Live Table
4. Materialized View
Best,
Ron
Ron liu 于2024年4月9日周二 20:07写道:
> Hi, Dev
>
> After several rounds of discussion, there is currently no consensus on the
> name of the new concept. Timo has proposed th
gt; 2. Materialized Table -> similar to SQL materialized view but a table
> 3. Live Table -> nice buzzword, but maybe still too close to dynamic
> tables?
> 4. Materialized View -> a bit broader than standard but still very similar
> 5. Derived table -> taken by standard
>
>
Hi, Dev
Sorry for my previous statement was not quite accurate. We will hold a vote
for the name within this thread.
Best,
Ron
Ron liu 于2024年4月9日周二 19:29写道:
> Hi, Timo
>
> Thanks for your reply.
>
> I agree with you that sometimes naming is more difficult. When no on
Friday. I
look forward to everyone voting on the name in this thread. Of course, we
also welcome new input regarding the name.
Best,
Ron
Ron liu 于2024年4月9日周二 19:49写道:
> Hi, Dev
>
> Sorry for my previous statement was not quite accurate. We will hold a
> vote for the name within t
that the Refresh command and the
background refresh job can be executed in parallel, with no restrictions at
the framework level.
5. Convert RefreshHandler into a plug-in interface to support various
workflow schedulers.
Best,
Ron
Ron liu 于2024年4月2日周二 10:28写道:
> Hi, Venkata krishnan
>
> Thank you
Congratulations, Jiabao!
Best,
Ron
Yun Tang 于2024年2月23日周五 19:59写道:
> Congratulations, Jiabao!
>
> Best
> Yun Tang
>
> From: Weihua Hu
> Sent: Thursday, February 22, 2024 17:29
> To: dev@flink.apache.org
> Subject: Re: [ANNOUNCE] New Apache Flink Committer -
+1,
But I think this should be a more general requirement, that is, support for
declaring watermarks in query, which can be declared for any type of
source, such as table, view. Similar to databricks provided [1], this needs
a FLIP.
[1]
Hi, Lincoln
> 2. Regarding the options in HashAggCodeGenerator, since this new feature
has gone
through a couple of release cycles and could be considered for
PublicEvolving now,
cc @Ron Liu WDYT?
Thanks for cc'ing me, +1 for public these options now.
Best,
Ron
Benchao Li 于2024年5月20日周一
47 matches
Mail list logo