Jonathan Vexler created HUDI-8322:
-------------------------------------

             Summary: Operation metadata field is not implemented for spark 
records
                 Key: HUDI-8322
                 URL: https://issues.apache.org/jira/browse/HUDI-8322
             Project: Apache Hudi
          Issue Type: Bug
          Components: spark, writer-core
            Reporter: Jonathan Vexler


If you enable the operation field using the config 
HoodieWriteConfig.ALLOW_OPERATION_METADATA_FIELD and you write with spark 
records, it will lead to data corruption (or maybe write failure, can't 
remember) because HoodieInternalRow does not support the field, so the indexes 
are incorrect when it writes the record.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to