Re: Discussion about HIVE-12679 to make IMetaStoreClient pluggable

2023-10-19 Thread Attila Turoczy
Hi All, In my mind, the proxy option is to encapsulate the implementation and more likely force the IMetaStoreClient to have understanding about the RetryingMetaStoreClient or HiveMetaStoreClientWithLocalCache. Which should not be necessary all the time. IMetaStoreClient should be just an abstrac

Re: Discussion about HIVE-12679 to make IMetaStoreClient pluggable

2023-10-19 Thread Stamatis Zampetakis
Hey Okumin, Thanks for picking up this ticket and driving it forward. I don't have a strong opinion between the two options. On the surface the factory option seems simpler and possibly more efficient but I am not sure if the changes under the PR are sufficient to cover all usages in Hive. On t

Re: Discussion about HIVE-12679 to make IMetaStoreClient pluggable

2023-10-16 Thread Attila Turoczy
Hi Okumin, I love this initiative. Especially every good platform should be pluggable. In my mind the HMS should be just one option that the user can choose from. Yes, that will be the default, but the world is way more open now, and we need to provide the choice of freedom. If you or others want

Discussion about HIVE-12679 to make IMetaStoreClient pluggable

2023-10-13 Thread Okumin
Hi, I'm working on introducing a feature to make IMetaStoreClient pluggable. I'm sending this e-mail to gather opinions in a visible manner because it has controversial points. Some Hive users need the feature in order to integrate Hive with a data catalog other than HMS. Although the original pa