[
https://issues.apache.org/jira/browse/HIVE-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HIVE-16346:
--------------------------------
Description:
Right now, a lot of the logic in {{Hive.java}} attempts to set permissions of
different files that have been moved / copied. This is only triggered if
{{hive.warehouse.subdir.inherit.perms}} is set to true.
However, on blobstores such as S3, there is no concept of file permissions so
these calls are unnecessary, which can hurt performance.
One solution would be to set {{hive.warehouse.subdir.inherit.perms}} to false,
but this would be a global change that affects an entire HS2 instance. So HDFS
tables will no longer have permissions inheritance.
A better solution would be to make the inheritance of permissions conditional
on the target filesystem.
was:
Right now, a lot of the logic in {{Hive.java}} attempts to set permissions of
different files that have been moved / copied. This is only triggered if
{{hive.warehouse.subdir.inherit.perms}} is set to true.
However, on blobstores such as S3, there is no concept of file permissions so
these calls are unnecessary and can could a performance impact.
One solution would be to set {{hive.warehouse.subdir.inherit.perms}} to false,
but this would be a global change that affects an entire HS2 instance. So HDFS
tables will no longer have permissions inheritance.
A better solution would be to make the inheritance of permissions conditional
on the target filesystem.
> inheritPerms should be conditional based on the target filesystem
> -----------------------------------------------------------------
>
> Key: HIVE-16346
> URL: https://issues.apache.org/jira/browse/HIVE-16346
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Attachments: HIVE-16346.1-branch-2.patch
>
>
> Right now, a lot of the logic in {{Hive.java}} attempts to set permissions of
> different files that have been moved / copied. This is only triggered if
> {{hive.warehouse.subdir.inherit.perms}} is set to true.
> However, on blobstores such as S3, there is no concept of file permissions so
> these calls are unnecessary, which can hurt performance.
> One solution would be to set {{hive.warehouse.subdir.inherit.perms}} to
> false, but this would be a global change that affects an entire HS2 instance.
> So HDFS tables will no longer have permissions inheritance.
> A better solution would be to make the inheritance of permissions conditional
> on the target filesystem.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
