Robert Levas created HADOOP-16340:
-------------------------------------
Summary: ABFS driver continues to retry on access denied responses
from REST operations
Key: HADOOP-16340
URL: https://issues.apache.org/jira/browse/HADOOP-16340
Project: Hadoop Common
Issue Type: Bug
Components: fs/azure
Affects Versions: 3.3.0
Reporter: Robert Levas
ABFS driver continues to retry (until retry count is exhausted) upon access
denied responses from REST operations.
In the exception hander for IOExceptions at
[https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
there is no way exit out of the retry loop by re-throwing an exception unless
one of the following conditions have been met:
* The retry limit was hit
* An HttpException was encountered
>From an
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
>implementation, there is no way to create an
>{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
>since the constructor is package private.
Either the exception handler needs to generic handle exceptions like
{{java.nio.file.AccessDeniedException}} and {{java.io.FileNotFoundException}},
or the access to
{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
needs to be set to that custom implementations can use it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
