Lin Liu created HUDI-9455:
-----------------------------
Summary: Create a compatibility test
Key: HUDI-9455
URL: https://issues.apache.org/jira/browse/HUDI-9455
Project: Apache Hudi
Issue Type: Sub-task
Reporter: Lin Liu
Assignee: Lin Liu
Fix For: 1.1.0
Let's use this native HFile writer and HBase HFile writer to write the same
key-value pairs and compare the HFile content so that they should be the same,
as the final validation.
For this, we can generate a HFile using HBase-based HFile writer, add it as a
test artifact ({{{}test/resources/hfile/from_hbase_writer.hfile{}}}) and add a
unit/functional tests that generates a HFile using the new native HFile writer
and compare the generated HFile with {{from_hbase_writer.hfile}} to make sure
any change to the HFile writer that lead to storage byte change should be
caught (we should also add the HFile generated by the native writer too so that
byte-by-byte there is no change unless intended).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)