[
https://issues.apache.org/jira/browse/HADOOP-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jian He updated HADOOP-10519:
-----------------------------
Description:
Opening on [~arpitgupta]'s behalf.
We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will fail
on YARN. In non-HA mode, it'll pass.
The reason is in HA mode, only webhdfs delegation token is generated for the
job, but YARN also requires the regular hdfs token to do localization,
log-aggregation etc.
In non-HA mode, both tokens are generated for the job.
was:
Opening on [~arpitgupta]'s behalf.
We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will fail
on YARN. In non-HA mode, it'll pass.
The reason is in HA mode, only webhdfs delegation token is generated for the
job, but YARN also requires the regular hdfs to do localization,
log-aggregation etc.
In non-HA mode, both tokens are generated for the job.
> In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with
> Client cannot authenticate via:[TOKEN, KERBEROS] error
> ------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-10519
> URL: https://issues.apache.org/jira/browse/HADOOP-10519
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Jian He
>
> Opening on [~arpitgupta]'s behalf.
> We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will
> fail on YARN. In non-HA mode, it'll pass.
> The reason is in HA mode, only webhdfs delegation token is generated for the
> job, but YARN also requires the regular hdfs token to do localization,
> log-aggregation etc.
> In non-HA mode, both tokens are generated for the job.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
