[
https://issues.apache.org/jira/browse/SENTRY-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15291618#comment-15291618
]
Joey Krabacher commented on SENTRY-990:
---------------------------------------
Just a thought, maybe something similar to the "load_catalog_in_background"
setting in Impala can be implemented.
If the setting is false the metadata is loaded lazily.
Also, being able to increase/decrease the threads would be a great improvement.
> Improve load time for HMS paths + HDFS sync
> -------------------------------------------
>
> Key: SENTRY-990
> URL: https://issues.apache.org/jira/browse/SENTRY-990
> Project: Sentry
> Issue Type: Improvement
> Components: Hdfs Plugin
> Affects Versions: 1.7.0
> Reporter: Hao Hao
> Assignee: Hao Hao
> Attachments: Improve load time for HMS paths HDFS sync.docx
>
>
> For large metastores, hdfs path sync can take up to 10m to start up, which
> delays the start of the HMS dramatically. Need to improve the load
> performance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
