Maxwell Guo created IMPALA-12402:
------------------------------------

             Summary: Add some configurations for CatalogMetaProvider's cache_
                 Key: IMPALA-12402
                 URL: https://issues.apache.org/jira/browse/IMPALA-12402
             Project: IMPALA
          Issue Type: Improvement
          Components: fe
            Reporter: Maxwell Guo


when the cluster contains many db and tables such as if there are more than 
100000 tables, and if we restart the impalad , the local cache_ 
CatalogMetaProvider's need to doing some loading process. 
As we know that the goole's guava cache 's concurrencyLevel os set to 4 by 
default. 
but if there is many tables the loading process will need more time and 
increase the probability of lock contention, see 
[here|https://github.com/google/guava/blob/master/guava/src/com/google/common/cache/CacheBuilder.java#L437].
 
So we propose to add some configurations here, the first is the concurrency of 
cache.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to