Udit Mehrotra created HUDI-2303:
-----------------------------------

             Summary: TestMereIntoLogOnlyTable with metadata enabled surfaces 
likely bug
                 Key: HUDI-2303
                 URL: https://issues.apache.org/jira/browse/HUDI-2303
             Project: Apache Hudi
          Issue Type: Bug
          Components: Common Core
            Reporter: Udit Mehrotra


While enabling Metadata as part of [https://github.com/apache/hudi/pull/3411/] 
one of the test that fails is *TestMereIntoLogOnlyTable*.

Upon looking a bit, what I found is after the final *Merge* command there is an 
inline compaction that is triggered. The parquet file formed as part of the 
compaction misses out on the data from the latest log file right before 
compaction.

I think it might be because of metadata returning an incorrect list for 
compaction, missing out on the latest log file.

cc [~pwason] [~vinoth]

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to