[
https://issues.apache.org/jira/browse/TAJO-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
JaeHwa Jung updated TAJO-433:
-----------------------------
Description:
Hi, guys~
I wish to discuss about HCatalogStore.
HiveMetaStore types consists of three types: embedded, local, remote.
This type will set up at hive configuration file which named 'hive-site.xml'
and HiveMetaStoreClient can use MetaStore by configuration file. So, if Tajo
have only to add hive configuration file to classpath, Tajo can use
HiveMetaStore with HiveMetaStoreClient.
But current HCatalogStore set up configurations about HiveMetaStore as follows:
- hive.metastore.uris
- hive.metastore.kerberos.principal
- hive.metastore.local
- hive.metastore.sasl.enabled
And Tajo doesn't need 'tajo.catalog.uri' property because 'hive-site.xml'
already includes metastore host and port. So, it looks like unnecessary
settings.
What do you think about this suggestion? :)
was:
Hi, guys~
I wish to discuss about HCatalogStore
=======
I wish to discuss about HCatalogStore. current Tajo uses HCatalog to integrate
catalog with hive. So, users must run HiveMetaStoreServer because HCatalog
connect HiveMetaStoreServer.
But at this point, it needs to make improvements.
- First is HiveMetaStoreServer. if it can fall down or it performance
bottlenecks, it will be a fatal problem for Tajo.
- Second is HCatalog API. It doesn't provide API for DDL. So, Tajo use HCatalog
API and HiveMetaStoreClient API.
So, I wish to remove HiveMetaStoreServer dependency and integrate catalog with
Hive using HiveMetaStoreClient. And I wish to use HiveMetaStoreClient API
instead of HCatalog API. I already checked HiveMetaStoreClient to connect
HiveMetaStore without HiveMetaStoreServer.
if HiveMetaStoreClient can't connect HiveMetaStore, Tajo try to connect
HiveMetaStoreServer as backup policy.
What do you think about this suggestion? :)
> Improve integration with Hive
> -----------------------------
>
> Key: TAJO-433
> URL: https://issues.apache.org/jira/browse/TAJO-433
> Project: Tajo
> Issue Type: Improvement
> Components: catalog
> Affects Versions: 0.8-incubating
> Reporter: JaeHwa Jung
> Assignee: JaeHwa Jung
> Fix For: 0.8-incubating
>
>
> Hi, guys~
> I wish to discuss about HCatalogStore.
> HiveMetaStore types consists of three types: embedded, local, remote.
> This type will set up at hive configuration file which named 'hive-site.xml'
> and HiveMetaStoreClient can use MetaStore by configuration file. So, if Tajo
> have only to add hive configuration file to classpath, Tajo can use
> HiveMetaStore with HiveMetaStoreClient.
> But current HCatalogStore set up configurations about HiveMetaStore as
> follows:
> - hive.metastore.uris
> - hive.metastore.kerberos.principal
> - hive.metastore.local
> - hive.metastore.sasl.enabled
> And Tajo doesn't need 'tajo.catalog.uri' property because 'hive-site.xml'
> already includes metastore host and port. So, it looks like unnecessary
> settings.
> What do you think about this suggestion? :)
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
