Danny Chen created HUDI-9659:
--------------------------------

             Summary: Revisit the design of HoodieRecord metadata
                 Key: HUDI-9659
                 URL: https://issues.apache.org/jira/browse/HUDI-9659
             Project: Apache Hudi
          Issue Type: Improvement
          Components: core
            Reporter: Danny Chen
             Fix For: 1.2.0


Currently, each HoodieRecord takes an optional Map as a metadata, which is used 
for function like event_time metadata tracing, but it is not as efficient.

Before write a record in each write handle, we initialize a new map to keep the 
metadata if the HoodieRecord is empty(now it is always empty), and pass it to 
the WriteStatus.markSuccess, the write status then fetchs the meta from the 
map, this happens for every record.

Suggestion, remove the metadata from HoodieRecord, and add API on WriteStauts 
to collect the whatever metadata we like directly, for e.g, 

{code:java}
WriteStatus.collectEventTimeMetadata(Object eventTime).
{code}




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to