Rajkumar Singh created HIVE-19469:
-------------------------------------
Summary: HiveServer2: SqlStdAuth take too much time while doing
checkFileAccessWithImpersonation if the table location has too many files/dirs
Key: HIVE-19469
URL: https://issues.apache.org/jira/browse/HIVE-19469
Project: Hive
Issue Type: Task
Components: HiveServer2
Affects Versions: 2.1.0
Reporter: Rajkumar Singh
HiveServer2 doAuthorization call takes too much time while doing
checkFileAccessWithImpersonation if the table location has too many files/dirs
which increases the query compilation time.
{code}
at
org.apache.hadoop.hive.shims.Hadoop23Shims.checkFileAccess(Hadoop23Shims.java:1006)
at
org.apache.hadoop.hive.common.FileUtils.checkFileAccessWithImpersonation(FileUtils.java:378)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:417)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at
org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at
org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.isURIAccessAllowed(RangerHiveAuthorizer.java:752)
{code}
the improvement we can make here is to parallelize
checkFileAccessWithImpersonation call.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
