[
https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Levas updated HADOOP-16340:
----------------------------------
Description:
ABFS driver continues to retry (until retry count is exhausted) upon
IOException responses from REST operations.
In the exception hander for IOExceptions at
[https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
there is no way exit out of the retry loop by re-throwing an exception unless
one of the following conditions have been met:
* The retry limit was hit
* An HttpException was encountered
>From an
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
>implementation, there is no way to create an
>{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
>since the constructor is package private.
Either the exception handler needs to generic handle exceptions like
{{java.nio.file.AccessDeniedException}} and {{java.io.FileNotFoundException}},
or the access to
{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
needs to be set to that custom implementations can use it.
was:
ABFS driver continues to retry (until retry count is exhausted) upon access
denied responses from REST operations.
In the exception hander for IOExceptions at
[https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
there is no way exit out of the retry loop by re-throwing an exception unless
one of the following conditions have been met:
* The retry limit was hit
* An HttpException was encountered
>From an
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
>{{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
>implementation, there is no way to create an
>{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
>since the constructor is package private.
Either the exception handler needs to generic handle exceptions like
{{java.nio.file.AccessDeniedException}} and {{java.io.FileNotFoundException}},
or the access to
{{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
needs to be set to that custom implementations can use it.
> ABFS driver continues to retry on IOException responses from REST operations
> ----------------------------------------------------------------------------
>
> Key: HADOOP-16340
> URL: https://issues.apache.org/jira/browse/HADOOP-16340
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 3.3.0
> Reporter: Robert Levas
> Priority: Major
>
> ABFS driver continues to retry (until retry count is exhausted) upon
> IOException responses from REST operations.
> In the exception hander for IOExceptions at
> [https://github.com/apache/hadoop/blob/65f60e56b082faf92e1cd3daee2569d8fc669c67/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRestOperation.java#L174-L197],
> there is no way exit out of the retry loop by re-throwing an exception
> unless one of the following conditions have been met:
> * The retry limit was hit
> * An HttpException was encountered
> From an
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomTokenProviderAdaptee}} or
> {{org.apache.hadoop.fs.azurebfs.extensions.CustomDelegationTokenManager}}
> implementation, there is no way to create an
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> since the constructor is package private.
> Either the exception handler needs to generic handle exceptions like
> {{java.nio.file.AccessDeniedException}} and
> {{java.io.FileNotFoundException}}, or the access to
> {{org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator.HttpException}}
> needs to be set to that custom implementations can use it.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
