[
https://issues.apache.org/jira/browse/HIVE-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632048#comment-14632048
]
ASF GitHub Bot commented on HIVE-11294:
---------------------------------------
GitHub user alanfgates opened a pull request:
https://github.com/apache/hive/pull/46
Hbase metastore
HIVE-11294 Cache aggregated stats in hbase
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/alanfgates/hive hbase-metastore
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/46.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #46
----
commit 58ca965ca58925e4846e14cf37d64638edb3e353
Author: Alan Gates <[email protected]>
Date: 2015-01-23T19:05:19Z
Creating branch for hbase metastore development.
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1654331
13f79535-47bb-0310-9956-ffa450edef68
commit e81704eeaf061e7152c63379b828debdfdfe9a8e
Author: Alan Gates <[email protected]>
Date: 2015-02-04T20:00:49Z
HIVE-9453 Initial patch [hbase-metastore branch] (Alan Gates, reviewed by
Thejas Nair)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1657394
13f79535-47bb-0310-9956-ffa450edef68
commit 120047c308a011f17f94258779e4c47fcff191a5
Author: Alan Gates <[email protected]>
Date: 2015-02-10T21:41:19Z
HIVE-9578 Add support for getDatabases and alterDatabase calls
[hbase-metastore branch]
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658821
13f79535-47bb-0310-9956-ffa450edef68
commit c7dcf4a85d5cef4151d7b72115b4a1027af488ac
Author: Alan Gates <[email protected]>
Date: 2015-02-10T22:47:53Z
HIVE-9579 Support all get tables [hbase-metastore branch]
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1658829
13f79535-47bb-0310-9956-ffa450edef68
commit cd82601f6e5c4aea5db72b74629b6aada23cf7c2
Author: Alan Gates <[email protected]>
Date: 2015-02-19T18:51:39Z
HIVE-9606 Need a tool to export metadata from RDBMS based metastore into
HBase [hbase-metastore branch] (Alan Gates, reviewed by Thejas Nair)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1660974
13f79535-47bb-0310-9956-ffa450edef68
commit 21ba0a93dcadcf8726ae7a18e81f758921552697
Author: Alan Gates <[email protected]>
Date: 2015-03-02T18:17:01Z
HIVE-9641 Fill out remaining partition functions in HBaseStore (Alan Gates
reviewed by Vaibhav Gumashta)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1663386
13f79535-47bb-0310-9956-ffa450edef68
commit bb0010caa8734af34ecac7b5b054afd95b49b0e0
Author: Alan Gates <[email protected]>
Date: 2015-03-05T03:46:28Z
HIVE-9677 Implement privileges call in HBaseStore (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664220
13f79535-47bb-0310-9956-ffa450edef68
commit 408d467bffa0923714b8262427f1d1d72ba9932d
Author: Alan Gates <[email protected]>
Date: 2015-03-05T04:09:31Z
HIVE-9763 Remove M* classes from RawStore interface (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664226
13f79535-47bb-0310-9956-ffa450edef68
commit be575b84a8d5b4764550499c60bdccb7b0d1f82f
Author: Alan Gates <[email protected]>
Date: 2015-03-05T04:35:53Z
HIVE-9802 Refactor HBaseReadWrite to allow different implementations
underneath, also includes code from HIVE-9783 Move serialization of objects in
HBase to protocol buffers (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1664227
13f79535-47bb-0310-9956-ffa450edef68
commit 646468fcdfd612524961751ba3575a26a1fb3fcb
Author: Alan Gates <[email protected]>
Date: 2015-03-12T19:41:56Z
HIVE-9885 HBase metastore protobufs need to check hasX() functions for
values that are not auto set in serialization [hbase-metastore branch] (Alan
Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666280
13f79535-47bb-0310-9956-ffa450edef68
commit d268b81bcd2fbaae6fdbfe2f980f644ce5e3d92d
Author: Alan Gates <[email protected]>
Date: 2015-03-12T20:01:30Z
HIVE-9874 Partition storage descriptors being set from table sd without
copying [hbase-metastore branch] (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1666285
13f79535-47bb-0310-9956-ffa450edef68
commit 24f224867b70bacc91a877242aee1b0b84efd127
Author: Alan Gates <[email protected]>
Date: 2015-03-17T15:50:31Z
HIVE-9942 Implement functions methods in HBaseStore (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667338
13f79535-47bb-0310-9956-ffa450edef68
commit 35ac8b0257614523064c1b3647a91e123b78e999
Author: Alan Gates <[email protected]>
Date: 2015-03-18T17:41:50Z
HIVE-10008 Need to refactor itests for hbase metastore (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1667596
13f79535-47bb-0310-9956-ffa450edef68
commit 10cfdd96b69084bf0da7b864113d073006147e77
Author: Alan Gates <[email protected]>
Date: 2015-03-20T16:14:46Z
HIVE-10010 Alter table results in NPE [hbase-metastore branch] (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668071
13f79535-47bb-0310-9956-ffa450edef68
commit 63080f82c02c2b7756be09209bf07f03280e4f9b
Author: Alan Gates <[email protected]>
Date: 2015-03-23T21:34:11Z
HIVE-10018 Activating SQLStandardAuth results in NPE [hbase-metastore
branch] (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1668746
13f79535-47bb-0310-9956-ffa450edef68
commit 72004b826b71ced04f8bce4e3eb42c0264e0c9a6
Author: Thejas Nair <[email protected]>
Date: 2015-03-27T05:28:11Z
HIVE-10091 : Generate Hbase execution plan for partition filter conditions
in HbaseStore api calls - initial changes (Thejas Nair, reviewed by Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1669514
13f79535-47bb-0310-9956-ffa450edef68
commit 913dba22627cf2d555bb0b22105e4bde0c6a7aa5
Author: Vaibhav Gumashta <[email protected]>
Date: 2015-04-02T20:59:42Z
HIVE-9693: Introduce a stats cache for aggregate stats in HBase metastore
(Vaibhav Gumashta reviewed by Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670966
13f79535-47bb-0310-9956-ffa450edef68
commit e9a7173a52a7a2bd91a6edddf54c1b354a7b101d
Author: Alan Gates <[email protected]>
Date: 2015-04-02T23:46:04Z
HIVE-10205 A few lines accidentally removed from HBaseReadWrite (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670993
13f79535-47bb-0310-9956-ffa450edef68
commit ea1fc22f6b5ee4eed728598d554348bbb77d21b1
Author: Vaibhav Gumashta <[email protected]>
Date: 2015-04-03T00:27:00Z
HIVE-10207: Fix test failure in TestAggregateStatsCache
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1670994
13f79535-47bb-0310-9956-ffa450edef68
commit 185908979d4e701ff0ee4988f07750dce777460c
Author: Alan Gates <[email protected]>
Date: 2015-04-07T22:41:01Z
HIVE-10090 Add connection manager for Tephra (Alan Gates)
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671966
13f79535-47bb-0310-9956-ffa450edef68
commit f752b4ab6941d8f6907a97133a77aefb7303b4d7
Author: Alan Gates <[email protected]>
Date: 2015-04-08T02:29:25Z
Merge from trunk to hbase-metastore branch.
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1671993
13f79535-47bb-0310-9956-ffa450edef68
commit f95254d35ddeaa0712966f22dbbdb2fa1c49d0a9
Author: Alan Gates <[email protected]>
Date: 2015-04-14T14:47:30Z
hbase-metastore merge trunk to branch.
git-svn-id:
https://svn.apache.org/repos/asf/hive/branches/hbase-metastore@1673437
13f79535-47bb-0310-9956-ffa450edef68
commit afe1b5e3ad59474ddbcddf91865ec6b43171ee1d
Author: Vaibhav Gumashta <[email protected]>
Date: 2015-04-23T21:33:24Z
HIVE-10383: Add tests for partition level statistics + refactor stats tests
of TestHBaseStore [hbase-metastore branch] (Vaibhav Gumashta reviewed by Alan
Gates)
commit 1a64664aedbf0b36544380005b19db79e5c4364c
Author: Alan Gates <[email protected]>
Date: 2015-06-05T23:07:58Z
Merge branch 'master' into hbase-metastore
commit 15012469afb8e0c0354b82c972f058ed3cd0d221
Author: Alan Gates <[email protected]>
Date: 2015-06-18T00:20:19Z
HIVE-10954 AggregateStatsCache duplicated in HBaseMetastore (gates)
commit 4cc8c7ff674553f214324b41c93610822280507d
Author: Alan Gates <[email protected]>
Date: 2015-06-29T18:11:40Z
HIVE-11057 HBase metastore chokes on partition with ':' in name (gates)
commit 6ea5c0956972eb4582d9318d9866b441a92f7aab
Author: Alan Gates <[email protected]>
Date: 2015-06-29T18:32:19Z
HIVE-10952 Describe a non-partitioned table fail (gates)
commit 1a1c0d817da036025f1c3b953af7b52403c048ba
Author: Alan Gates <[email protected]>
Date: 2015-07-01T22:47:03Z
HIVE-11061 Table renames not propagated to partition table in HBase
metastore (gates)
commit 738e901a5c9a69342f29fffbfc53cb53ff192694
Author: Alan Gates <[email protected]>
Date: 2015-07-17T22:34:32Z
HIVE-11294 Add new stats cache to hbase
----
> Use HBase to cache aggregated stats
> -----------------------------------
>
> Key: HIVE-11294
> URL: https://issues.apache.org/jira/browse/HIVE-11294
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Affects Versions: hbase-metastore-branch
> Reporter: Alan Gates
> Assignee: Alan Gates
> Fix For: hbase-metastore-branch
>
> Attachments: HIVE-11294.patch
>
>
> Currently stats are cached only in the memory of the client. Given that
> HBase can easily manage the scale of caching aggregated stats we should be
> using it to do so.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
