Re: Caching metastore objects

2015-05-27 Thread Scott C Gray
@hive.apache.org Date: 05/27/2015 01:25 AM Subject:Re: Caching metastore objects Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147

Re: Caching metastore objects

2015-05-26 Thread Scott C Gray
To: dev@hive.apache.org Date: 05/26/2015 01:57 PM Subject:Re: Caching metastore objects Sivaramakrishnan Narayanan May 25, 2015 at 20:19 Apologies if this has been discussed in the past - my searches did not pull up any relevant threads

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Are you running pre-0.12 or with hive.metastore.try.direct.sql = false; Work done on https://issues.apache.org/jira/browse/HIVE-4051 should alleviate some of your problems. On Mon, May 25, 2015 at 8:19 PM, Sivaramakrishnan Narayanan tarb...@gmail.com wrote: Apologies if this has been

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Thanks for the replies. @Ashutosh - thanks for the pointer! Yes I was running 0.11 metastore. Let me try with 0.13 metastore! Maybe my woes will be gone. If they don't then I'll continue working along these lines. @Alan - agreed. Caching MTables seems like a better approach if 0.13 metastore

Re: Caching metastore objects

2015-05-26 Thread Ashutosh Chauhan
Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147 But there was a resistance from a community for it. May be now community is ready for it : )

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
Awesome!! On Wed, May 27, 2015 at 10:55 AM, Ashutosh Chauhan hashut...@apache.org wrote: Siva / Scott, Such a framework exists in some form : https://issues.apache.org/jira/browse/HIVE-2038 To make it even more generic there was a proposal https://issues.apache.org/jira/browse/HIVE-2147

Re: Caching metastore objects

2015-05-26 Thread Alan Gates
Sivaramakrishnan Narayanan mailto:tarb...@gmail.com May 25, 2015 at 20:19 Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there are better solutions available out of the box, please let me know! Problem statement