[
https://issues.apache.org/jira/browse/HADOOP-19323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17896281#comment-17896281
]
Sneha Vijayarajan commented on HADOOP-19323:
--------------------------------------------
Hi [~csun] , The logic in the inner class is not reliable and hence should not
be made public. Thanks for bringing this up, from Azure Storage we will look
into this ask for a reliable solution.
Had a query though. As HDFS FileSystem base class does not have a
listStatus(final Path f, final String startFrom) API, how can this API be
called ? Can the AzureBlobFileSystem public API be directly called ?
> ABFS: Add a new API in AzureBlobFileSystem to allow listing with startFrom
> --------------------------------------------------------------------------
>
> Key: HADOOP-19323
> URL: https://issues.apache.org/jira/browse/HADOOP-19323
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Chao Sun
> Priority: Major
> Labels: pull-request-available
>
> Currently the API to list from a certain starting point is hidden inside
> {{{}AzureBlobFileSystemStore{}}}, and is hard to access. It'd be better to
> surface this up to places like {{AzureBlobFileSystem}} to make it easier to
> use.
>
> The API is useful in scenarios such as Delta Lake where transaction logs are
> always indexed sequentially. With this API, the listing in Delta no longer
> needs to listing the whole {{_delta_log}} directory but only a small subset.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
