Re: Discussion about the metadata design

2018-08-03 Thread Paul Rogers
Hi All, Catching up on this old topic. One of Drill's main differentiators is the ability to extend Drill with UDFs, custom storage and format plugins, custom security plugins, etc. I wonder if the team has considered taking a modular approach to metadata. Perhaps define a "metadata plugin"

Re: Discussion about the metadata design

2018-06-28 Thread weijie tong
Hi Vitalii: Glad to hear that you are also looking at this part. Let's keep discussion under that Jira. On Fri, Jun 29, 2018 at 1:27 AM Vitalii Diravka wrote: > Hi Weijie, > > Thanks for bringing this topic up! > > Basically you are right, Hive Metastore is one the best candidates for >

Re: Discussion about the metadata design

2018-06-28 Thread Vitalii Diravka
Hi Weijie, Thanks for bringing this topic up! Basically you are right, Hive Metastore is one the best candidates for storing Driil's metadata. Also it will be good to make an abstraction, which will allow to implement and use other kind of tools for Metastore. The question of Metastore

Re: Discussion about the metadata design

2018-06-28 Thread Arina Yelchiyeva
Hi, Vitalii and Vova is also looking at this part, you might want to sync up with them. Or even better, we can create Jira for this and held all discussions there. Vitalii, what do you think? Kind regards, Arina On Thu, Jun 28, 2018 at 6:46 PM weijie tong wrote: > HI all: > > As @aman