[
https://issues.apache.org/jira/browse/SENTRY-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401422#comment-16401422
]
Arjun Mishra commented on SENTRY-2183:
--------------------------------------
That is true. It is purely empirical. Cases with million partitions took about
10 mins. Sometimes they take much longer. We can't factor in all cases. It is
significantly larger than 3.3mins which is very conservative. I can run some
tests to get numbers on the threshold time to number of hive objects
> Increase default sentry-hdfs rpc timeout to 20 mins
> ---------------------------------------------------
>
> Key: SENTRY-2183
> URL: https://issues.apache.org/jira/browse/SENTRY-2183
> Project: Sentry
> Issue Type: Improvement
> Components: Sentry
> Affects Versions: 2.1.0
> Reporter: Arjun Mishra
> Assignee: Arjun Mishra
> Priority: Major
> Attachments: SENTRY-2183.001.patch, SENTRY-2183.002.patch,
> SENTRY-2183.01.patch
>
>
> Full HMS Snapshots for large amounts of data (millions of databases, or
> tables or partitions etc) take a lot more time than the current default of
> 3.3mins. Also ideally since a full HMS snapshot should only occur once it is
> best to increase the default to 20mins. This highly reduce the chance of
> failure while sending a full snapshot which could be critical
> Set sentry.hdfs.service.client.server.rpc-connection-timeout = 1200000
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
