Lin Liu created HUDI-9455:
-----------------------------

             Summary: Create a compatibility test
                 Key: HUDI-9455
                 URL: https://issues.apache.org/jira/browse/HUDI-9455
             Project: Apache Hudi
          Issue Type: Sub-task
            Reporter: Lin Liu
            Assignee: Lin Liu
             Fix For: 1.1.0


Let's use this native HFile writer and HBase HFile writer to write the same 
key-value pairs and compare the HFile content so that they should be the same, 
as the final validation.

For this, we can generate a HFile using HBase-based HFile writer, add it as a 
test artifact ({{{}test/resources/hfile/from_hbase_writer.hfile{}}}) and add a 
unit/functional tests that generates a HFile using the new native HFile writer 
and compare the generated HFile with {{from_hbase_writer.hfile}} to make sure 
any change to the HFile writer that lead to storage byte change should be 
caught (we should also add the HFile generated by the native writer too so that 
byte-by-byte there is no change unless intended).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to