[
https://issues.apache.org/jira/browse/HUDI-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-9176:
------------------------------
Description:
The core logic of metadata table write path sits in these classes:
{code:java}
org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter
org.apache.hudi.client.utils.SparkMetadataWriterUtils
org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
org.apache.hudi.metadata.SecondaryIndexRecordGenerationUtils {code}
The readability and maintainability need to be improved by providing better
abstractions. The goal is to get it to a point where a new index type can be
added easily.
was:
The core logic of metadata table write path sits in these classes:
{code:java}
org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter
org.apache.hudi.client.utils.SparkMetadataWriterUtils
org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
org.apache.hudi.metadata.SecondaryIndexRecordGenerationUtils {code}
The
> Improve readability and maintainability of metadata table (MT/MDT) write path
> -----------------------------------------------------------------------------
>
> Key: HUDI-9176
> URL: https://issues.apache.org/jira/browse/HUDI-9176
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Y Ethan Guo
> Assignee: Y Ethan Guo
> Priority: Blocker
> Fix For: 1.1.0
>
>
> The core logic of metadata table write path sits in these classes:
> {code:java}
> org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
> org.apache.hudi.metadata.SparkHoodieBackedTableMetadataWriter
> org.apache.hudi.client.utils.SparkMetadataWriterUtils
> org.apache.hudi.metadata.HoodieBackedTableMetadataWriter
> org.apache.hudi.metadata.SecondaryIndexRecordGenerationUtils {code}
> The readability and maintainability need to be improved by providing better
> abstractions. The goal is to get it to a point where a new index type can be
> added easily.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
