Make sense, griffin should only depends on metadata service, and upon our users' use cases, griffin should provide several metadata service implementations as options. It is not correct to hardcode one solution as the only supported solution.
Thanks, William On Wed, Jun 19, 2019 at 1:46 PM Qian Wang <[email protected]> wrote: > MetaStoreService has some RESTful methods which return MetaStore Table > object, which is org.apache.hadoop.hive.metastore.api.Table. Need think > about how to use SQL to query Hive to get those information, such as > location, column name, column type, column comments, etc. > > Eric > On Jun 13, 2019, 4:33 AM -0700, Lionel, Liu <[email protected]>, wrote: > > Good point, I agree with that. > > Hive metastore service is not accessible in some specific environments, > so we need another way to fetch the data schemas. > > On the other hand, hive metastore only works for Hive tables, for the > other data source types, like avro files, RDB tables, even Kafka topics, > how to fetch the data schemas? > > Maybe something like schema management is what we need. > > > > Thanks > > Lionel, Liu > > > > From: Johnnie ZHANG > > Sent: 2019年6月12日 14:56 > > To: [email protected] > > Subject: Re: [DISCUSS]Alternatives way to access hive metadata? > > > > Hi All, > > I think this is reasonable and it would be great to provide the choice > to the users. > > > > Thanks > > Johnnie > > On Jun 11, 2019, 21:43 -0700, Kevin Yao <[email protected]>, wrote: > > > I agree. Griffin should provide a solution to solve hive permission > issue. > > > > > > Thanks, > > > Kevin > > > > > > On Wed, Jun 12, 2019 at 9:02 AM Eugene Liu <[email protected]> wrote: > > > > > > > I agree. Considering security/permission limit in a wide of variety > of > > > > deployments, Griffin should provide a common way to get hive > metadata like > > > > using jdbc. > > > > > > > > Thx > > > > Eugene > > > > ________________________________ > > > > From: William Guo <[email protected]> > > > > Sent: Wednesday, June 12, 2019 7:28 AM > > > > To: [email protected] > > > > Subject: Re: [DISCUSS]Alternatives way to access hive metadata? > > > > > > > > hi all, > > > > > > > > As I commented in ticket. > > > > > > > > I was told about this several times, > > > > some company has its own security policy for metadata tables. > > > > It might a general requirement for community. > > > > > > > > What do you think? > > > > > > > > Thanks, > > > > William > > > > > > > > On Tue, Jun 11, 2019 at 11:32 AM Qian Wang <[email protected]> > wrote: > > > > > > > > > Hi, > > > > > > > > > > Griffin needs to read Hive metadata from Hive metastore, however, > reading > > > > > metadata from Hive metastore directly may have some security issue > and > > > > may > > > > > be restricted by company security team. > > > > > > > > > > We should provide another solution to get Hive metadata > information such > > > > > as using JDBC implementation. > > > > > > > > > > Here is the ticket: > > > > > https://issues.apache.org/jira/browse/GRIFFIN-256 > > > > > > > > > > Best, > > > > > Eric > > > > > > > > > > > > > >
