[
https://issues.apache.org/jira/browse/HUDI-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17246955#comment-17246955
]
Bhavani Sudha commented on HUDI-1401:
-------------------------------------
[~uditme] [~vinoth] I am not sure if we can explore this path as well. I came
across a ManifestPartitionLoader that requires partitions to have a manifest of
this form -
[https://github.com/prestodb/presto/blob/b7d1a76eb2d443f65ada17357e169e7bdda6c8be/presto-hive/src/main/java/com/facebook/presto/hive/HiveManifestUtils.java#L45]
and is used by the
[ManifestPartitionLoader|https://github.com/prestodb/presto/blob/b7d1a76eb2d443f65ada17357e169e7bdda6c8be/presto-hive/src/main/java/com/facebook/presto/hive/ManifestPartitionLoader.java#L60]
The idea seems like every partition will have this manifest file with file
names and file sizes. I haven't looked into how this is being used, but just
went through at high level. Does this look like its possible to integrate with
our metadata listing?
> Presto use of Metadata Table for file listings
> ----------------------------------------------
>
> Key: HUDI-1401
> URL: https://issues.apache.org/jira/browse/HUDI-1401
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Presto Integration
> Reporter: Vinoth Chandar
> Assignee: Udit Mehrotra
> Priority: Blocker
> Fix For: 0.7.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
