Re: [DISCUSS] SQL Support using Apache Calcite

2020-12-14 Thread Nishith
Thanks for starting this thread Vinoth. In general, definitely see the need for SQL style semantics on Hudi tables. Apache Calcite is a great option to considering given DatasourceV2 has the limitations that you described. Additionally, even if Spark DatasourceV2 allowed for the flexibility,

Re: [DISCUSS] SQL Support using Apache Calcite

2020-12-14 Thread Vinoth Chandar
Hello all, Just bumping this thread again thanks vinoth On Thu, Dec 10, 2020 at 11:58 PM Vinoth Chandar wrote: > Hello all, > > One feature that keeps coming up is the ability to use UPDATE, MERGE sql > syntax to support writing into Hudi tables. We have looked into the Spark 3 > DataSource

Re: Accomplishments and Roadmap.

2020-12-14 Thread Mani Jindal
Hi Vinoth , Just thinking we should do that either way is fine online session or meetup. Yea we can plan a online session or in biweekly meeting. Thanks and Regards , Mani Jindal On Tue, 15 Dec 2020 at 11:07 AM, Vinoth Chandar wrote: > Mani, what did you have in mind? If we are thinking about

Re: Accomplishments and Roadmap.

2020-12-14 Thread nishith agarwal
+1 I like the idea of putting a "2020 journey" blog and sharing it in an online Apache Hudi Tech Talk session with the community. Additionally, if anyone is interested in showcasing a production use-case they've been running, I'm going to host a meetup soon, please reach out to me. Thanks,

Re: Accomplishments and Roadmap.

2020-12-14 Thread Vinoth Chandar
Mani, what did you have in mind? If we are thinking about a meetup, then we probably need more time. And Nishith is also thinking about something like that I think? we can put out a blog, go over it in an online session with the rest of the community? On Mon, Dec 14, 2020 at 9:26 PM Pratyaksh

Re: Accomplishments and Roadmap.

2020-12-14 Thread Pratyaksh Sharma
We can have this as part of our bi weekly meeting. :) On Tue, Dec 15, 2020 at 10:24 AM Gary Li wrote: > +1 > > Gary Li > > From: Sivabalan > Sent: Tuesday, December 15, 2020 3:34:00 AM > To: dev@hudi.apache.org > Subject: Re: Accomplishments and Roadmap. > >

Re: Accomplishments and Roadmap.

2020-12-14 Thread Gary Li
+1 Gary Li From: Sivabalan Sent: Tuesday, December 15, 2020 3:34:00 AM To: dev@hudi.apache.org Subject: Re: Accomplishments and Roadmap. +1 good idea. On Mon, Dec 14, 2020 at 10:58 AM Vinoth Chandar wrote: > +1 great idea. > > what do others think? > > On

Re: Accomplishments and Roadmap.

2020-12-14 Thread Sivabalan
+1 good idea. On Mon, Dec 14, 2020 at 10:58 AM Vinoth Chandar wrote: > +1 great idea. > > what do others think? > > On Sat, Dec 12, 2020 at 5:50 AM Mani Jindal wrote: > > > Hi All, > > > > As this year is ending , can we organise one event to list all our > > accomplishments during 2020 and a

Re: Accomplishments and Roadmap.

2020-12-14 Thread Vinoth Chandar
+1 great idea. what do others think? On Sat, Dec 12, 2020 at 5:50 AM Mani Jindal wrote: > Hi All, > > As this year is ending , can we organise one event to list all our > accomplishments during 2020 and a future roadmap for 2021. Wats ur > thoughts? > > Thanks and Regards, > Mani Jindal >