Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

2024-02-29 Thread Takanobu Asanuma
Yes, for now, we believe that HIVE-14187 has caused performance degradation in Hive3 MetaStore. We also use HiveServer2, but our HiveServer2 directly accesses the backend DB without going through the Hive MetaStore, because it enhances performance to directly access the DB in a heavily loaded

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

2024-02-29 Thread Sungwoo Park
Thank you for sharing the result. (Does your result imply that HIVE-14187 is introducing an intended bug?) Another issue that could be of your interest is the connection leak problem reported in HIVE-20600. Do you see the connection leak problem, or is it not relevant to your environment (e.g.,

Re: CachedStore for hive.metastore.rawstore.impl in Hive 3.0

2024-02-29 Thread Takanobu Asanuma
Hi Pau and Sungwoo, Thanks for sharing the information. We tested a set of simple queries which just referenced the Hive table and didn't execute any Hive jobs. The result is below. No. Version rawstore.impl connectionPoolingType HIVE-14187 QueryTime