[
https://issues.apache.org/jira/browse/HDFS-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13819741#comment-13819741
]
Haohui Mai commented on HDFS-5440:
----------------------------------
I've tested the patch by running distcp to pull data from hftp, and to write
data using webhdfs. DistCp copied the data successfully.
There are several benign warnings when running distcp.
{noformat}
13/11/12 01:51:56 WARN token.Token: Cannot find class for token kind HFTP
delegation
13/11/12 01:51:56 INFO security.TokenCache: Got dt for hftp://foo:50070; Kind:
HFTP delegation, Service: foo:50070, Ident: <masked>
{noformat}
I've looked into the code. The server does not look into the field kind at all.
Distcp obtained the corresponding tokens correctly, thus the job succeeds. The
message is due to the fact that distcp tries to print the token for debugging,
in which case the reflection utilities cannot find the corresponding class.
These warning messages are benign.
[~daryn], does it make sense to you?
> Extract the logic of handling delegation tokens in HftpFileSystem to the
> TokenAspect class
> ------------------------------------------------------------------------------------------
>
> Key: HDFS-5440
> URL: https://issues.apache.org/jira/browse/HDFS-5440
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Haohui Mai
> Assignee: Haohui Mai
> Attachments: HDFS-5440.000.patch, HDFS-5440.001.patch
>
>
> The logic of handling delegation token in HftpFileSystem and
> WebHdfsFileSystem are mostly identical. To simplify the code, this jira
> proposes to extract the common code into a new class named TokenAspect.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
