Timothy Brown created HUDI-9365:
-----------------------------------

             Summary: Reduce overhead of AWS and Hive Sync Tools
                 Key: HUDI-9365
                 URL: https://issues.apache.org/jira/browse/HUDI-9365
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Timothy Brown


The sync tools will create `ro` and `rt` tables for MoR but in these cases we 
recompute a few details for the table like the schema. In addition to this, the 
table definition in the remote system is fetched multiple times when inspecting 
the state. We can cache this to avoid the excessive calls to the remote system. 
And finally, we can avoid all of these calls if the table is already up to date.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to