[
https://issues.apache.org/jira/browse/HUDI-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuo Cheng updated HUDI-9382:
-----------------------------
Component/s: spark
spark-sql
> Implement HoodieRecord#updateMetaField for HoodieSparkRecord
> -------------------------------------------------------------
>
> Key: HUDI-9382
> URL: https://issues.apache.org/jira/browse/HUDI-9382
> Project: Apache Hudi
> Issue Type: Improvement
> Components: spark, spark-sql
> Reporter: Shuo Cheng
> Priority: Major
>
> Currently, spark compactor uses HoodieSparkRecord#prependMetaFields to update
> FILENAME_META_FIELD for compaction, where all meda fields are extracted from
> InternalRow firstly for every record, which is unnecessary.
> HoodieRecord#updateMetaField can be implemented to just update the target
> meta field without additional costs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
