[
https://issues.apache.org/jira/browse/HADOOP-18075?focusedWorklogId=733928&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-733928
]
ASF GitHub Bot logged work on HADOOP-18075:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 28/Feb/22 15:24
Start Date: 28/Feb/22 15:24
Worklog Time Spent: 10m
Work Description: steveloughran commented on a change in pull request
#3876:
URL: https://github.com/apache/hadoop/pull/3876#discussion_r815933855
##########
File path:
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsListStatusRemoteIterator.java
##########
@@ -141,13 +143,21 @@ private void asyncOp() {
}
private synchronized void addNextBatchIteratorToQueue()
- throws IOException, InterruptedException {
+ throws IOException {
List<FileStatus> fileStatuses = new ArrayList<>();
- continuation = listingSupport
- .listStatus(fileStatus.getPath(), null, fileStatuses, FETCH_ALL_FALSE,
- continuation, tracingContext);
- if (!fileStatuses.isEmpty()) {
- listResultQueue.put(new AbfsListResult(fileStatuses.iterator()));
+ try {
+ try {
+ continuation = listingSupport.listStatus(path, null, fileStatuses,
+ FETCH_ALL_FALSE, continuation, tracingContext);
+ } catch (AbfsRestOperationException ex) {
+ AzureBlobFileSystem.checkException(path, ex);
Review comment:
add a comment to say this always raises an IOE
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 733928)
Time Spent: 1h (was: 50m)
> ABFS: Fix failure caused by listFiles() in ITestAbfsRestOperationException
> --------------------------------------------------------------------------
>
> Key: HADOOP-18075
> URL: https://issues.apache.org/jira/browse/HADOOP-18075
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.3.2
> Reporter: Sumangala Patki
> Assignee: Sumangala Patki
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> testAbfsRestOperationExceptionFormat in ITestAbfsRestOperationException fails
> due to the wrong exception format of the FileNotFound exception. The test
> invokes the Filesystem method listFiles(), and the exception thrown is found
> to be of the GetPathStatus format instead of ListStatus (difference in number
> of error fields in response).
> The Filesystem implementation of listFiles() calls listLocatedStatus(), which
> then makes a listStatus call. A recent check-in that added implementation for
> listLocatedStatus() in ABFS driver led to a GetFileStatus request before
> ListStatus api are invoked, leading to the aberrant FNF exception format. The
> fix eliminates the GetPathStatus request before ListStatus is called.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
