[
https://issues.apache.org/jira/browse/IMPALA-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778933#comment-17778933
]
ASF subversion and git services commented on IMPALA-12402:
----------------------------------------------------------
Commit c244aadcf367360e52807a84e7fba8b6237651fd in impala's branch
refs/heads/master from maxwellguo
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c244aadcf ]
IMPALA-12402: Make CatalogdMetaProvider's cache concurrency level configurable
The local CatalogMetaProvider's cache_ need to doing some loading
process with the default cache concurrency level of 4, when the
table number is very big, the loading process will cost much time,
in that case the restart process will cost much time too, so we make
cache concurrency level parameter configurable.
Change-Id: I8e3c10660e371498c2edc1eb8d235b7b8ca170c9
Reviewed-on: http://gerrit.cloudera.org:8080/20443
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Quanlong Huang <[email protected]>
> Make CatalogdMetaProvider's cache concurrency level configurable
> ----------------------------------------------------------------
>
> Key: IMPALA-12402
> URL: https://issues.apache.org/jira/browse/IMPALA-12402
> Project: IMPALA
> Issue Type: Improvement
> Components: fe
> Reporter: Maxwell Guo
> Assignee: Maxwell Guo
> Priority: Minor
> Labels: pull-request-available
>
> when the cluster contains many db and tables such as if there are more than
> 100000 tables, and if we restart the impalad , the local cache_
> CatalogMetaProvider's need to doing some loading process.
> As we know that the goole's guava cache 's concurrencyLevel os set to 4 by
> default.
> but if there is many tables the loading process will need more time and
> increase the probability of lock contention, see
> [here|https://github.com/google/guava/blob/master/guava/src/com/google/common/cache/CacheBuilder.java#L437].
>
> So we propose to add some configurations here, the first is the concurrency
> of cache.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
