Raymond Xu created HUDI-1932:
--------------------------------

             Summary: Hive Sync should not always update last_commit_time_sync
                 Key: HUDI-1932
                 URL: https://issues.apache.org/jira/browse/HUDI-1932
             Project: Apache Hudi
          Issue Type: Bug
          Components: Hive Integration
            Reporter: Raymond Xu
             Fix For: 0.9.0


In Hive Sync 

{{org.apache.hudi.hive.HiveSyncTool#syncHoodieTable()}}

it includes schema update and partition update.

Regardless of having update or not, the logic is to always update the table 
with a new timestamp for the last_commit_time_sync property.

This will result in having new versions in AWS Glue tables for example, which 
will eventually lead to exceeding table version limit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to