sivabalan narayanan created HUDI-8473:
-----------------------------------------
Summary: Design and Impl MDT IndexRecordGenerator
Key: HUDI-8473
URL: https://issues.apache.org/jira/browse/HUDI-8473
Project: Apache Hudi
Issue Type: Sub-task
Components: metadata, writer-core
Reporter: sivabalan narayanan
Assignee: sivabalan narayanan
Fix For: 1.0.0
With the re-designed dag, we need to define and impl a new MDT Index Record
generator which takes in HoodieData<WriteStatus> and outputs
HoodieData<HoodieRecord> which are the records required to be ingested to MDT.
This should be a flatMapFunction, since a single WriteStatus could return more
than 1 record to ingest into MDT for various partitions in MDT
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
