Re: [Discuss]- Donate Iceberg Flink Connector

2022-11-08 Thread OpenInx
; >> > > > > >> >> > > > > Op wo 19 okt. 2022 om 19:11 schreef >> >> >> > > > > >> >> > > > >> Thanks Martijn! >> >> > > > >> >> >> > > > >> Thanks for all the suppo

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-25 Thread Jark Wu
ainer of Hive > Flink > >> > > > connector, I'm really glad to take part in Iceberg community for > the > >> > > > maintenance and future development of Icberg Flink connector. I > think I > >> > > can > >> > > > provide some v

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-24 Thread Ryan Blue
connector from Icberg >> > repository >> > > > to a separate connector under Flink umbrella: >> > > > >> > > > 1: If Iceberg develops new features, for icberg flink connector, it >> > have >> > > > to wait the Iceberg t

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-24 Thread Martijn Visser
wait a much longer time before enjoying the new features of Icberg by > > > using > > > > Flink. > > > > > > > > 2: If we move it to a sepreate repositoy, I'm afrad of it'll loss > > > > attention from both Flink and Iceberg sides which is d

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-20 Thread Jark Wu
gt; >>>>> We wanted to join the Flink connector externalization effort so > > that > > > >> we > > > >>>>> can bring the Iceberg connector closer to the Flink community. We > > are > > > >>>>> hoping any is

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-20 Thread Jing Ge
ferent voice in this dicussion, but I think > it > > deserves a further dicussion in dev mail list, at least it will help to > get > > Flink developer's attention to Iceberg. > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > &g

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-20 Thread Steven Wu
to the next > >>>> steps. > >>>>> > >>>>> Thanks > >>>>> Abid > >>>>> > >>>>> On 2022/10/14 03:37:09 Jark Wu wrote: > >>>>>> Thank Abid for the discussion, > >>>&

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-20 Thread yuxia
星期四, 2022年 10 月 20日 上午 6:33:40 主题: Re: [Discuss]- Donate Iceberg Flink Connector Hi Martijn, I created a FLIP for this, its FLIP 267: Iceberg Connector  <https://cwiki.apache.org/confluence/display/FLINK/FLIP+267:+Iceberg+Connector> Please let me know if anything else is needed. My emai

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread abmo . work
t; I'm also fine with maintaining it under the Flink project. >>>>>> But I'm also interested in the response to Martijn's question. >>>>>> >>>>>> Besides, once the code is moved to the Flink project, are there any >>>&g

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread Martijn Visser
> Besides, once the code is moved to the Flink project, are there any > > > > initial > > > > > maintainers for the connector we can find? > > > > > In addition, do we still maintain documentation under Iceberg > > > > > https://iceberg.

RE: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread abmo . work
; > > > > > > Best, > > > > Jark > > > > > > > > > > > > On Thu, 13 Oct 2022 at 17:52, yuxia wrote: > > > > > > > > > +1. Thanks for driving it. Hope I can find some chances to take part > > in >

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread Martijn Visser
gt; > > +1. Thanks for driving it. Hope I can find some chances to take part > in > > > > the future development of Iceberg Flink Connector. > > > > > > > > Best regards, > > > > Yuxia > > > > > > > > - 原始

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread Steven Wu
13 Oct 2022 at 17:52, yuxia wrote: > > > > > +1. Thanks for driving it. Hope I can find some chances to take part in > > > the future development of Iceberg Flink Connector. > > > > > > Best regards, > > > Yuxia > > > > > >

RE: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread abmo . work
; > +1. Thanks for driving it. Hope I can find some chances to take part in > > the future development of Iceberg Flink Connector. > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Zheng Yu Chen" > > 收件人: "dev" &

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread Péter Váry
"Zheng Yu Chen" > > 收件人: "dev" > > 发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29 > > 主题: Re: [Discuss]- Donate Iceberg Flink Connector > > > > +1, thanks to drive it > > > > Abid Mohammed 于2022年10月10日周一 09:22写道: > > > > > Hi

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-13 Thread Jark Wu
rds, > Yuxia > > - 原始邮件 - > 发件人: "Zheng Yu Chen" > 收件人: "dev" > 发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29 > 主题: Re: [Discuss]- Donate Iceberg Flink Connector > > +1, thanks to drive it > > Abid Mohammed 于2022年10月10日周一 09:22写道: > > >

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-13 Thread yuxia
+1. Thanks for driving it. Hope I can find some chances to take part in the future development of Iceberg Flink Connector. Best regards, Yuxia - 原始邮件 - 发件人: "Zheng Yu Chen" 收件人: "dev" 发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29 主题: Re: [Discuss]- Donate Iceberg Flink C

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Zheng Yu Chen
+1, thanks to drive it Abid Mohammed 于2022年10月10日周一 09:22写道: > Hi, > > I would like to start a discussion about contributing Iceberg Flink > Connector to Flink. > > I created a doc < > https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing> > with all

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Martijn Visser
Hi, Just to double check: while I believe most Iceberg content refers to Iceberg as a format, it's considered as a connector in Flink terms, right? So there is no 'format' option to specify. And one more question: is there a specific goal or reason why you would want to contribute this to Flink

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Danny Cranmer
+1 from me, let's open a VOTE thread to make this official. On Wed, Oct 12, 2022 at 1:37 PM Hang Ruan wrote: > +1, I have used the iceberg connector and catalog before. It is easy to > use. > > Márton Balassi 于2022年10月12日周三 16:38写道: > > > +1 from me, thanks for the clarification. > > > > On

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Hang Ruan
+1, I have used the iceberg connector and catalog before. It is easy to use. Márton Balassi 于2022年10月12日周三 16:38写道: > +1 from me, thanks for the clarification. > > On Wed, Oct 12, 2022 at 7:57 AM Péter Váry > wrote: > > > Thanks Abid, > > > > Count me in, and drop a note, if I can help in any

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Márton Balassi
+1 from me, thanks for the clarification. On Wed, Oct 12, 2022 at 7:57 AM Péter Váry wrote: > Thanks Abid, > > Count me in, and drop a note, if I can help in any way. > > Thanks, > Peter > > On Tue, Oct 11, 2022, 20:13 wrote: > > > Hi Martijn, > > > > Yes catalog integration exists and

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread Péter Váry
Thanks Abid, Count me in, and drop a note, if I can help in any way. Thanks, Peter On Tue, Oct 11, 2022, 20:13 wrote: > Hi Martijn, > > Yes catalog integration exists and catalogs can be created using Flink > SQL. > >

RE: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread abmo . work
Hi Martijn, Yes catalog integration exists and catalogs can be created using Flink SQL. https://iceberg.apache.org/docs/latest/flink/#creating-catalogs-and-using-catalogs has more details. We may need some discussion within Iceberg community but based on the current iceberg-flink code

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread Martijn Visser
Hi Abid, Thanks for the FLIP. I have a question about Iceberg's Catalog: has that integration between Flink and Iceberg been created already and are you looking to externalize that as well? Thanks, Martijn On Tue, Oct 11, 2022 at 12:14 AM wrote: > Hi Marton, > > Yes, we are initiating this

RE: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-10 Thread abmo . work
Hi Marton, Yes, we are initiating this as part of the Externalize Flink Connectors effort. Plan is to externalize the existing Flink connector from Iceberg repo into a separate repo under the Flink umbrella. Sorry about the doc permissions! I was able to create a FLIP-267:

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-10 Thread Márton Balassi
Hi Abid, Just to clarify does your suggestion mean that the Iceberg community would like to remove the iceberg-flink connector from the Iceberg codebase and maintain it under Flink instead? A new separate repo under the Flink project umbrella given the current existing effort to extract

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-09 Thread Jingsong Li
Thanks Abid for driving. +1 for this. Can you open the permissions for https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing ? Best, Jingsong On Mon, Oct 10, 2022 at 9:22 AM Abid Mohammed wrote: > > Hi, > > I would like to start a discussion about