Jonathan Vexler created HUDI-8098:
-------------------------------------
Summary: For custom keygen, only require reading of timestamp
partition columns
Key: HUDI-8098
URL: https://issues.apache.org/jira/browse/HUDI-8098
Project: Apache Hudi
Issue Type: Improvement
Components: reader-core, spark
Reporter: Jonathan Vexler
Assignee: Jonathan Vexler
Fix For: 1.0.0
HUDI-5807 allows fg reader to read partition column values from the file
instead of just using the directory path structure. HUDI-8036 stores the
partition column keygen types.
In HoodieHadoopFsRelationFactory, partitionColumnsToRead is set to the list of
all partition columns if the keygen type is timestamp or custom keygen. In the
case of custom keygen, filter that list to only the timestamp keygen columns.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
