[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21787: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) Close this one. Will tract unit tests on another ticket. > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.13.patch, HIVE-21787.14.patch, > HIVE-21787.15.patch, HIVE-21787.2.patch, HIVE-21787.3.patch, > HIVE-21787.4.patch, HIVE-21787.5.patch, HIVE-21787.6.patch, > HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21787: -- Attachment: HIVE-21787.15.patch > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.13.patch, HIVE-21787.14.patch, > HIVE-21787.15.patch, HIVE-21787.2.patch, HIVE-21787.3.patch, > HIVE-21787.4.patch, HIVE-21787.5.patch, HIVE-21787.6.patch, > HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-21787: -- Attachment: HIVE-21787.14.patch > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.13.patch, HIVE-21787.14.patch, > HIVE-21787.2.patch, HIVE-21787.3.patch, HIVE-21787.4.patch, > HIVE-21787.5.patch, HIVE-21787.6.patch, HIVE-21787.7.patch, > HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-21787: -- Attachment: HIVE-21787.13.patch > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.13.patch, HIVE-21787.2.patch, > HIVE-21787.3.patch, HIVE-21787.4.patch, HIVE-21787.5.patch, > HIVE-21787.6.patch, HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-21787: -- Attachment: (was: HIVE-21787.12.patch) > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.2.patch, HIVE-21787.3.patch, > HIVE-21787.4.patch, HIVE-21787.5.patch, HIVE-21787.6.patch, > HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-21787: -- Attachment: HIVE-21787.12.patch > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.12.patch, HIVE-21787.2.patch, > HIVE-21787.3.patch, HIVE-21787.4.patch, HIVE-21787.5.patch, > HIVE-21787.6.patch, HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam An updated HIVE-21787: -- Attachment: HIVE-21787.11.patch > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.11.patch, HIVE-21787.2.patch, HIVE-21787.3.patch, > HIVE-21787.4.patch, HIVE-21787.5.patch, HIVE-21787.6.patch, > HIVE-21787.7.patch, HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21787) Metastore table cache LRU eviction
[ https://issues.apache.org/jira/browse/HIVE-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-21787: - Summary: Metastore table cache LRU eviction (was: Metastore table cache enhancement) > Metastore table cache LRU eviction > -- > > Key: HIVE-21787 > URL: https://issues.apache.org/jira/browse/HIVE-21787 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sam An >Assignee: Sam An >Priority: Major > Attachments: HIVE-21787.1.patch, HIVE-21787.10.patch, > HIVE-21787.2.patch, HIVE-21787.3.patch, HIVE-21787.4.patch, > HIVE-21787.5.patch, HIVE-21787.6.patch, HIVE-21787.7.patch, > HIVE-21787.8.patch, HIVE-21787.9.patch > > > Metastore currently uses black/white list to specify patterns of tables to > load into the cache. Cache is loaded in one shot "prewarm", and updated by a > background thread. This is not a very efficient design. > In this feature, we try to enhance the cache for Tables with LRU to improve > cache utilization. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
