MetaStoreService has some RESTful methods which return MetaStore Table object, which is org.apache.hadoop.hive.metastore.api.Table. Need think about how to use SQL to query Hive to get those information, such as location, column name, column type, column comments, etc.
Eric On Jun 13, 2019, 4:33 AM -0700, Lionel, Liu <[email protected]>, wrote: > Good point, I agree with that. > Hive metastore service is not accessible in some specific environments, so we > need another way to fetch the data schemas. > On the other hand, hive metastore only works for Hive tables, for the other > data source types, like avro files, RDB tables, even Kafka topics, how to > fetch the data schemas? > Maybe something like schema management is what we need. > > Thanks > Lionel, Liu > > From: Johnnie ZHANG > Sent: 2019年6月12日 14:56 > To: [email protected] > Subject: Re: [DISCUSS]Alternatives way to access hive metadata? > > Hi All, > I think this is reasonable and it would be great to provide the choice to the > users. > > Thanks > Johnnie > On Jun 11, 2019, 21:43 -0700, Kevin Yao <[email protected]>, wrote: > > I agree. Griffin should provide a solution to solve hive permission issue. > > > > Thanks, > > Kevin > > > > On Wed, Jun 12, 2019 at 9:02 AM Eugene Liu <[email protected]> wrote: > > > > > I agree. Considering security/permission limit in a wide of variety of > > > deployments, Griffin should provide a common way to get hive metadata like > > > using jdbc. > > > > > > Thx > > > Eugene > > > ________________________________ > > > From: William Guo <[email protected]> > > > Sent: Wednesday, June 12, 2019 7:28 AM > > > To: [email protected] > > > Subject: Re: [DISCUSS]Alternatives way to access hive metadata? > > > > > > hi all, > > > > > > As I commented in ticket. > > > > > > I was told about this several times, > > > some company has its own security policy for metadata tables. > > > It might a general requirement for community. > > > > > > What do you think? > > > > > > Thanks, > > > William > > > > > > On Tue, Jun 11, 2019 at 11:32 AM Qian Wang <[email protected]> wrote: > > > > > > > Hi, > > > > > > > > Griffin needs to read Hive metadata from Hive metastore, however, > > > > reading > > > > metadata from Hive metastore directly may have some security issue and > > > may > > > > be restricted by company security team. > > > > > > > > We should provide another solution to get Hive metadata information such > > > > as using JDBC implementation. > > > > > > > > Here is the ticket: > > > > https://issues.apache.org/jira/browse/GRIFFIN-256 > > > > > > > > Best, > > > > Eric > > > > > > > > >
