Ethan Guo created HUDI-3974:
-------------------------------
Summary: Fix upgrade step wrt precombine field
Key: HUDI-3974
URL: https://issues.apache.org/jira/browse/HUDI-3974
Project: Apache Hudi
Issue Type: Bug
Reporter: Ethan Guo
Assignee: Ethan Guo
Fix For: 0.11.0
This is related to HUDI-3972
Details about the bug: if someone is not explicitly setting preCombine field,
hudi still falls backs to the default value of "ts" and this goes into
hoodie.properties as well. So, when reading MOR table, since we are projecting
just the required columns, we also add preCombine field to it and if the
original table does not have "ts", basic read fails (even if there are no log
files, but just base files in MOR).
For the upgrade step, we need to update the preCombine field in the
hoodie.properties. If the user does not set the preCombine field, it should be
removed from the hoodie.properties; if the users sets the field, it should be
updated in the hoodie.properties.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
