[
https://issues.apache.org/jira/browse/HUDI-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247575#comment-17247575
]
Udit Mehrotra commented on HUDI-1401:
-------------------------------------
[~bhavanisudha] I haven't explored this piece of code you pointed out. What I
am implementing is another DirectoryLister like
[https://github.com/prestodb/presto/blob/master/presto-hive/src/main/java/com/facebook/presto/hive/HadoopDirectoryLister.java]
for Hudi. We will get rid of path filter. Our directory lister implementation
will use Hudi's FileSystemView to directly fetch the file listings as well
filtering of latest commit files. The FileSystemView will also take care of
whether to fetch the listing from Hudi's managed metadata table or from S3
directly. Do you see any concerns here ?
> Presto use of Metadata Table for file listings
> ----------------------------------------------
>
> Key: HUDI-1401
> URL: https://issues.apache.org/jira/browse/HUDI-1401
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Presto Integration
> Reporter: Vinoth Chandar
> Assignee: Udit Mehrotra
> Priority: Blocker
> Fix For: 0.7.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
