[
https://issues.apache.org/jira/browse/HUDI-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-1296:
----------------------------------
Status: Open (was: In Progress)
> Implement Spark DataSource using range metadata for file/partition pruning
> --------------------------------------------------------------------------
>
> Key: HUDI-1296
> URL: https://issues.apache.org/jira/browse/HUDI-1296
> Project: Apache Hudi
> Issue Type: Task
> Components: spark
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Alexey Kudinkin
> Priority: Blocker
> Fix For: 0.11.0
>
>
> MT exposed as Spark DataSource should provide for following interface:
> {code:java}
> Columnar interface to MT:
> - Filename
> - Already available in the payload
> - Partition Path (?)
> - We can decode on the fly (we have list of partitions, so we
> can match it with the key)
> - Col A stats
> - Col B stats
> - ... {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
