Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Thank you Timo! I started voting thread [1] [1] https://lists.apache.org/thread/40xyjjvklt65tw21o2pmk8r3srprxs5q On Thu, Aug 28, 2025 at 11:56 AM Timo Walther wrote: > > Hi Sergey, > > thanks for updating the FLIP. I think this is a very small and > non-controversal change that aligns well with previous FLIPs. Feel free > to start a voting earlier. > > Thanks, > Timo > > On 28.08.25 08:29, Sergey Nuyanzin wrote: > > Hi Ron > > > > thank you, updated. > > > > Thanks everyone > > if there is no objections I'm going to start voting next week > > > > On Wed, Aug 20, 2025 at 3:43 AM Ron Liu wrote: > >> > >> Hi, Sergey. > >> > >> Thanks for the FLIP to improve the materialized table ddl. The proposal > >> looks good to me overall. > >> > >> Just one minor comment, about the Catalog#listMaterializedTables method > >> signature, it should be a default method. > >> > >> Best, > >> Ron > >> > >> Gustavo de Morais 于2025年8月19日周二 16:18写道： > >> > >>> Hey Sergey, > >>> > >>> The FLIP looks good. +1 as well. Thanks for driving it. > >>> > >>> Gustavo > >>> > >>> On Mon, 18 Aug 2025 at 23:08, Sergey Nuyanzin wrote: > >>> > Hi Hao > > sure, added > > On Mon, Aug 18, 2025 at 10:48 PM Hao Li > >>> wrote: > > > > Hi Sergey, > > > > Thanks for the FLIP. Can you add the modify distribution sql syntax to > the > > FLIP as well? Looks like you have `ModifyDistribution` but it's not in > sql > > syntax. > > > > Thanks, > > Hao > > > > On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib > wrote: > > > >> Hi Sergey, > >> > >> Thanks for driving this! +1 from my side! > >> > >> Cheers, > >> > >> Ramin > >> > >> On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > >> wrote: > >> > >>> Hi everyone, > >>> I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > >>> Materialized tables [1]. > >>> > >>> In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality > >>> to > >>> support bucketing concept in Flink, then in FLIP-435 there were > >>> introduced Materialized tables. However so far there is no support > for > >>> DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > >>> address this issue > >>> > >>> [1] > >>> > >> > > >>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > >>> [2] > >>> > >> > > >>> https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > >>> [3] > >>> > >> > > >>> https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > >>> > >>> > >>> > >>> -- > >>> Best regards, > >>> Sergey > >>> > >> > > > > -- > Best regards, > Sergey > > >>> > > > > > > > -- Best regards, Sergey
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Sergey, thanks for updating the FLIP. I think this is a very small and non-controversal change that aligns well with previous FLIPs. Feel free to start a voting earlier. Thanks, Timo On 28.08.25 08:29, Sergey Nuyanzin wrote: Hi Ron thank you, updated. Thanks everyone if there is no objections I'm going to start voting next week On Wed, Aug 20, 2025 at 3:43 AM Ron Liu wrote: Hi, Sergey. Thanks for the FLIP to improve the materialized table ddl. The proposal looks good to me overall. Just one minor comment, about the Catalog#listMaterializedTables method signature, it should be a default method. Best, Ron Gustavo de Morais 于2025年8月19日周二 16:18写道： Hey Sergey, The FLIP looks good. +1 as well. Thanks for driving it. Gustavo On Mon, 18 Aug 2025 at 23:08, Sergey Nuyanzin wrote: Hi Hao sure, added On Mon, Aug 18, 2025 at 10:48 PM Hao Li wrote: Hi Sergey, Thanks for the FLIP. Can you add the modify distribution sql syntax to the FLIP as well? Looks like you have `ModifyDistribution` but it's not in sql syntax. Thanks, Hao On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib wrote: Hi Sergey, Thanks for driving this! +1 from my side! Cheers, Ramin On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin wrote: Hi everyone, I'd like to start a discussion of Support DISTRIBUTED BY/INTO for Materialized tables [1]. In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to support bucketing concept in Flink, then in FLIP-435 there were introduced Materialized tables. However so far there is no support for DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to address this issue [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause [3] https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines -- Best regards, Sergey -- Best regards, Sergey
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Ron thank you, updated. Thanks everyone if there is no objections I'm going to start voting next week On Wed, Aug 20, 2025 at 3:43 AM Ron Liu wrote: > > Hi, Sergey. > > Thanks for the FLIP to improve the materialized table ddl. The proposal > looks good to me overall. > > Just one minor comment, about the Catalog#listMaterializedTables method > signature, it should be a default method. > > Best, > Ron > > Gustavo de Morais 于2025年8月19日周二 16:18写道： > > > Hey Sergey, > > > > The FLIP looks good. +1 as well. Thanks for driving it. > > > > Gustavo > > > > On Mon, 18 Aug 2025 at 23:08, Sergey Nuyanzin wrote: > > > > > Hi Hao > > > > > > sure, added > > > > > > On Mon, Aug 18, 2025 at 10:48 PM Hao Li > > wrote: > > > > > > > > Hi Sergey, > > > > > > > > Thanks for the FLIP. Can you add the modify distribution sql syntax to > > > the > > > > FLIP as well? Looks like you have `ModifyDistribution` but it's not in > > > sql > > > > syntax. > > > > > > > > Thanks, > > > > Hao > > > > > > > > On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib > > > wrote: > > > > > > > > > Hi Sergey, > > > > > > > > > > Thanks for driving this! +1 from my side! > > > > > > > > > > Cheers, > > > > > > > > > > Ramin > > > > > > > > > > On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > > > > > > > wrote: > > > > > > > > > > > Hi everyone, > > > > > > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > > > > > > Materialized tables [1]. > > > > > > > > > > > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality > > to > > > > > > support bucketing concept in Flink, then in FLIP-435 there were > > > > > > introduced Materialized tables. However so far there is no support > > > for > > > > > > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > > > > > > address this issue > > > > > > > > > > > > [1] > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > > > > > > [2] > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > > > > > > [3] > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Best regards, > > > > > > Sergey > > > > > > > > > > > > > > > > > > > > > > > -- > > > Best regards, > > > Sergey > > > > > -- Best regards, Sergey
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi, Sergey. Thanks for the FLIP to improve the materialized table ddl. The proposal looks good to me overall. Just one minor comment, about the Catalog#listMaterializedTables method signature, it should be a default method. Best, Ron Gustavo de Morais 于2025年8月19日周二 16:18写道： > Hey Sergey, > > The FLIP looks good. +1 as well. Thanks for driving it. > > Gustavo > > On Mon, 18 Aug 2025 at 23:08, Sergey Nuyanzin wrote: > > > Hi Hao > > > > sure, added > > > > On Mon, Aug 18, 2025 at 10:48 PM Hao Li > wrote: > > > > > > Hi Sergey, > > > > > > Thanks for the FLIP. Can you add the modify distribution sql syntax to > > the > > > FLIP as well? Looks like you have `ModifyDistribution` but it's not in > > sql > > > syntax. > > > > > > Thanks, > > > Hao > > > > > > On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib > > wrote: > > > > > > > Hi Sergey, > > > > > > > > Thanks for driving this! +1 from my side! > > > > > > > > Cheers, > > > > > > > > Ramin > > > > > > > > On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > > > > > wrote: > > > > > > > > > Hi everyone, > > > > > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > > > > > Materialized tables [1]. > > > > > > > > > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality > to > > > > > support bucketing concept in Flink, then in FLIP-435 there were > > > > > introduced Materialized tables. However so far there is no support > > for > > > > > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > > > > > address this issue > > > > > > > > > > [1] > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > > > > > [2] > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > > > > > [3] > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > > > > > > > > > > > > > > > > > -- > > > > > Best regards, > > > > > Sergey > > > > > > > > > > > > > > > > > -- > > Best regards, > > Sergey > > >
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hey Sergey, The FLIP looks good. +1 as well. Thanks for driving it. Gustavo On Mon, 18 Aug 2025 at 23:08, Sergey Nuyanzin wrote: > Hi Hao > > sure, added > > On Mon, Aug 18, 2025 at 10:48 PM Hao Li wrote: > > > > Hi Sergey, > > > > Thanks for the FLIP. Can you add the modify distribution sql syntax to > the > > FLIP as well? Looks like you have `ModifyDistribution` but it's not in > sql > > syntax. > > > > Thanks, > > Hao > > > > On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib > wrote: > > > > > Hi Sergey, > > > > > > Thanks for driving this! +1 from my side! > > > > > > Cheers, > > > > > > Ramin > > > > > > On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > > > wrote: > > > > > > > Hi everyone, > > > > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > > > > Materialized tables [1]. > > > > > > > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to > > > > support bucketing concept in Flink, then in FLIP-435 there were > > > > introduced Materialized tables. However so far there is no support > for > > > > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > > > > address this issue > > > > > > > > [1] > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > > > > [2] > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > > > > [3] > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > > > > > > > > > > > > > -- > > > > Best regards, > > > > Sergey > > > > > > > > > > > -- > Best regards, > Sergey >
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Hao sure, added On Mon, Aug 18, 2025 at 10:48 PM Hao Li wrote: > > Hi Sergey, > > Thanks for the FLIP. Can you add the modify distribution sql syntax to the > FLIP as well? Looks like you have `ModifyDistribution` but it's not in sql > syntax. > > Thanks, > Hao > > On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib wrote: > > > Hi Sergey, > > > > Thanks for driving this! +1 from my side! > > > > Cheers, > > > > Ramin > > > > On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > > wrote: > > > > > Hi everyone, > > > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > > > Materialized tables [1]. > > > > > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to > > > support bucketing concept in Flink, then in FLIP-435 there were > > > introduced Materialized tables. However so far there is no support for > > > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > > > address this issue > > > > > > [1] > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > > > [2] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > > > [3] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > > > > > > > > > -- > > > Best regards, > > > Sergey > > > > > -- Best regards, Sergey
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Sergey, Thanks for the FLIP. Can you add the modify distribution sql syntax to the FLIP as well? Looks like you have `ModifyDistribution` but it's not in sql syntax. Thanks, Hao On Mon, Aug 18, 2025 at 6:23 AM Ramin Gharib wrote: > Hi Sergey, > > Thanks for driving this! +1 from my side! > > Cheers, > > Ramin > > On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin > wrote: > > > Hi everyone, > > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > > Materialized tables [1]. > > > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to > > support bucketing concept in Flink, then in FLIP-435 there were > > introduced Materialized tables. However so far there is no support for > > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > > address this issue > > > > [1] > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > > [2] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > > [3] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > > > > > -- > > Best regards, > > Sergey > > >
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Sergey, Thanks for driving this! +1 from my side! Cheers, Ramin On Fri, Aug 15, 2025 at 3:42 PM Sergey Nuyanzin wrote: > Hi everyone, > I'd like to start a discussion of Support DISTRIBUTED BY/INTO for > Materialized tables [1]. > > In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to > support bucketing concept in Flink, then in FLIP-435 there were > introduced Materialized tables. However so far there is no support for > DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to > address this issue > > [1] > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 > [2] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause > [3] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines > > > > -- > Best regards, > Sergey >
Re: [DISCUSS] FLIP-542: Support DISTRIBUTED BY/INTO for Materialized tables
Hi Sergey, thanks for proposing this FLIP. No concerns from my side. +1 for synchonizing all tables for vertical/horizontal sharding along PARTITIONS and BUCKETS. Cheers, Timo On 15.08.25 15:42, Sergey Nuyanzin wrote: Hi everyone, I'd like to start a discussion of Support DISTRIBUTED BY/INTO for Materialized tables [1]. In FLIP-376 there was introduced DISTRIBUTED BY/INTO functionality to support bucketing concept in Flink, then in FLIP-435 there were introduced Materialized tables. However so far there is no support for DISTRIBUTED BY/INTO for Materialized tables. This FLIP is going to address this issue [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=378473269 [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-376%3A+Add+DISTRIBUTED+BY+clause [3] https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines
