[ 
https://issues.apache.org/jira/browse/HIVE-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123052#comment-16123052
 ] 

ASF GitHub Bot commented on HIVE-17289:
---------------------------------------

GitHub user sankarh opened a pull request:

    https://github.com/apache/hive/pull/227

    HIVE-17289: EXPORT and IMPORT shouldn't perform distcp with doAs privileged 
user.

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sankarh/hive HIVE-17289

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hive/pull/227.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #227
    
----
commit 29072b2905c1ffa83141a5d29f6095869e68a4e7
Author: Sankar Hariappan <[email protected]>
Date:   2017-08-11T08:15:02Z

    HIVE-17289: EXPORT and IMPORT shouldn't perform distcp with doAs privileged 
user.

----


> EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
> ---------------------------------------------------------------------
>
>                 Key: HIVE-17289
>                 URL: https://issues.apache.org/jira/browse/HIVE-17289
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DR, Import, replication
>             Fix For: 3.0.0
>
>         Attachments: HIVE-17289.01.patch
>
>
> Currently, EXPORT uses distcp to dump data files to dump directory and IMPORT 
> uses distcp to copy the larger files/large number of files from dump 
> directory to table staging directory. But, this copy fails as distcp is 
> always done with doAs user specified in hive.distcp.privileged.doAs, which is 
> "hdfs' by default.
> Need to remove usage of doAs user when try to distcp from EXPORT/IMPORT flow.
> Privileged user based distcp should be done only for REPL DUMP/LOAD commands.
> Also, need to set the default config for hive.distcp.privileged.doAs to 
> "hive" as "hdfs" super-user is never allowed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to