[
https://issues.apache.org/jira/browse/HIVE-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sankar Hariappan updated HIVE-17757:
------------------------------------
Description:
As REPL LOAD command needs to read repl dump directory and data files from
source cluster, it needs to use some of the configurations to read data
securely through distcp.
Some of the HDFS configurations cannot be added to whitelist as they pose
security threat. So, it is necessary for REPL LOAD command to take such configs
as input and use it when trigger distcp.
*Proposed syntax:*
REPL LOAD [<dbname>[.<tablename>]] FROM <dirname> [WITH ('key1'='value1',
'key2'='value2')];
was:
As REPL LOAD command needs to read repl dump directory and data files from
source cluster, it needs to use some of the configurations to read data
securely through distcp.
Some of the HDFS configurations cannot be added to whitelist as they pose
security threat. So, it is necessary for REPL LOAD command to take such configs
as input and use it when trigger distcp.
*Proposed syntax:*
REPL LOAD [<dbname>][.<tablename>] FROM <dirname> [WITH ('key1'='value1',
'key2'='value2')];
> REPL LOAD need to use customised configurations to execute distcp/remote copy.
> ------------------------------------------------------------------------------
>
> Key: HIVE-17757
> URL: https://issues.apache.org/jira/browse/HIVE-17757
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
> Affects Versions: 3.0.0
> Reporter: Sankar Hariappan
> Assignee: Sankar Hariappan
> Labels: DR, pull-request-available, replication
> Fix For: 3.0.0
>
> Attachments: HIVE-17757.01.patch, HIVE-17757.02.patch
>
>
> As REPL LOAD command needs to read repl dump directory and data files from
> source cluster, it needs to use some of the configurations to read data
> securely through distcp.
> Some of the HDFS configurations cannot be added to whitelist as they pose
> security threat. So, it is necessary for REPL LOAD command to take such
> configs as input and use it when trigger distcp.
> *Proposed syntax:*
> REPL LOAD [<dbname>[.<tablename>]] FROM <dirname> [WITH ('key1'='value1',
> 'key2'='value2')];
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
