[
https://issues.apache.org/jira/browse/HUDI-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-9365.
----------------------------
Reviewers: Danny Chen
Resolution: Fixed
Fixed via master branch: 9dd5358c4193c3480d7b95f6e4961566a0706238
> Reduce overhead of AWS and Hive Sync Tools
> ------------------------------------------
>
> Key: HUDI-9365
> URL: https://issues.apache.org/jira/browse/HUDI-9365
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Timothy Brown
> Assignee: Timothy Brown
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.1.0
>
>
> The sync tools will create `ro` and `rt` tables for MoR but in these cases we
> recompute a few details for the table like the schema. In addition to this,
> the table definition in the remote system is fetched multiple times when
> inspecting the state. We can cache this to avoid the excessive calls to the
> remote system. And finally, we can avoid all of these calls if the table is
> already up to date.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
