[
https://issues.apache.org/jira/browse/HDFS-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13703431#comment-13703431
]
Robert Kanter commented on HDFS-4951:
-------------------------------------
Test failure is unreleated; TestHttpFSFWithWebhdfsFileSystem fails even without
the patch due to a NPE. I've created HDFS-4969 for that.
> FsShell commands using secure httpfs throw exceptions due to missing
> TokenRenewer
> ---------------------------------------------------------------------------------
>
> Key: HDFS-4951
> URL: https://issues.apache.org/jira/browse/HDFS-4951
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: security
> Affects Versions: 3.0.0
> Reporter: Robert Kanter
> Assignee: Robert Kanter
> Attachments: HDFS-4951.patch
>
>
> It looks like there isn't a {{TokenRenewer}} for HttpFS delegation tokens
> ({{HTTPFS_DELEGATION_TOKENS}} tokens, so when it goes to cancel the token, it
> throws an exception:
> {noformat}
> $ hadoop fs -ls webhdfs://host:14000
> // File listing omitted
> 13/06/21 13:09:04 WARN token.Token: No TokenRenewer defined for token kind
> HTTPFS_DELEGATION_TOKEN
> 13/06/21 13:09:04 WARN util.ShutdownHookManager: ShutdownHook
> 'ClientFinalizer' failed, java.lang.UnsupportedOperationException: Token
> cancel is not supported for HTTPFS_DELEGATION_TOKEN tokens
> java.lang.UnsupportedOperationException: Token cancel is not supported for
> HTTPFS_DELEGATION_TOKEN tokens
> at
> org.apache.hadoop.security.token.Token$TrivialRenewer.cancel(Token.java:417)
> at org.apache.hadoop.security.token.Token.cancel(Token.java:382)
> at
> org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.cancel(DelegationTokenRenewer.java:146)
> at
> org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.access$200(DelegationTokenRenewer.java:58)
> at
> org.apache.hadoop.fs.DelegationTokenRenewer.removeRenewAction(DelegationTokenRenewer.java:233)
> at
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem.close(WebHdfsFileSystem.java:790)
> at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2398)
> at
> org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2414)
> at
> org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> {noformat}
> WebHDFS doesn't have this problem because it has a {{TokenRenewer}} for its
> delegation tokens ({{"WEBHDFS delegation"}} tokens).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
