[
https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Issac Buenrostro updated HDFS-15545:
------------------------------------
Description:
WebHdfsFileSystem can select a delegation token to use from the current user
UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it every
time without searching the UGI again.
If the previous token expires, WebHdfsFileSystem will catch the exception and
attempt to get a new token. However, the mechanism to get a new token bypasses
searching for one on the UGI, so even if there is external logic that has
retrieved a new token, it is not possible to make the FileSystem use the new,
valid token, rendering the FileSystem object unusable.
A simple fix would allow WebHdfsFileSystem to re-search the UGI, and if it
finds a different token than the cached one try to use it.
was:
WebHdfsFileSystem can select a delegation token to use from the current user
UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it every
time without searching the UGI again.
If the previous token expires, WebHdfsFileSystem will catch the exception and
attempt to get a new token. However, the mechanism to get a new token bypasses
searching for one on the UGI, so even if there is external logic that has
retrieved a new token, it is not possible to make the FileSystem use the new,
valid token, rendering the FileSystem object unusable.
> (S)Webhdfs will not use updated delegation tokens available in the ugi after
> the old ones expire
> ------------------------------------------------------------------------------------------------
>
> Key: HDFS-15545
> URL: https://issues.apache.org/jira/browse/HDFS-15545
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Issac Buenrostro
> Priority: Major
>
> WebHdfsFileSystem can select a delegation token to use from the current user
> UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it
> every time without searching the UGI again.
> If the previous token expires, WebHdfsFileSystem will catch the exception and
> attempt to get a new token. However, the mechanism to get a new token
> bypasses searching for one on the UGI, so even if there is external logic
> that has retrieved a new token, it is not possible to make the FileSystem use
> the new, valid token, rendering the FileSystem object unusable.
> A simple fix would allow WebHdfsFileSystem to re-search the UGI, and if it
> finds a different token than the cached one try to use it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
