[
https://issues.apache.org/jira/browse/HADOOP-17682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sumangala Patki updated HADOOP-17682:
-------------------------------------
Description:
ABFS open methods require certain information (contentLength, eTag, etc) to to
create an InputStream for the file at the given path. This information is
retrieved via a GetFileStatus request to backend.
However, client applications may often have access to the FileStatus prior to
invoking the open API. Providing this FileStatus to the driver through the
OpenFileParameters argument of openFileWithOptions() can help avoid the call to
Store for FileStatus.
This PR adds handling for the FileStatus instance (if any) provided via the
OpenFileParameters argument.
was:
ABFS open methods require certain information (contentLength, eTag, etc) to be
sent to Store to open the file at the given path. This information is retrieved
via a GetFileStatus request to backend, resulting in a total of two Store calls
to carry out the open function.
However, client applications may often have access to the FileStatus prior to
invoking the open API. Providing this FileStatus to the driver through the
OpenFileParameters argument of openFileWithOptions() can avoid the additional
call to Store for FileStatus.
This PR adds handling for the FileStatus instance (if any) provided via the
OpenFileParameters argument.
> ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters
> ------------------------------------------------------------------------------
>
> Key: HADOOP-17682
> URL: https://issues.apache.org/jira/browse/HADOOP-17682
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Sumangala Patki
> Assignee: Sumangala Patki
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> ABFS open methods require certain information (contentLength, eTag, etc) to
> to create an InputStream for the file at the given path. This information is
> retrieved via a GetFileStatus request to backend.
> However, client applications may often have access to the FileStatus prior to
> invoking the open API. Providing this FileStatus to the driver through the
> OpenFileParameters argument of openFileWithOptions() can help avoid the call
> to Store for FileStatus.
> This PR adds handling for the FileStatus instance (if any) provided via the
> OpenFileParameters argument.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
