[
https://issues.apache.org/jira/browse/IMPALA-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-9937:
----------------------------------
Component/s: Catalog
> Catalogd should send incremental metadata updates in DDL responses to legacy
> coordinators
> -----------------------------------------------------------------------------------------
>
> Key: IMPALA-9937
> URL: https://issues.apache.org/jira/browse/IMPALA-9937
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Priority: Major
>
> After IMPALA-3127, catalogd is able to send incremental metadata updates in
> partition level. Ideally, legacy coordinators should receive incremental
> updates in DDL responses. E.g. when adding one partition, only get back the
> metadata of this partition and some table level updates, not including
> metadata of other unchanged partitions.
> However, catalogd still sends full table objects in DDL responses because
> catalogd is not aware of the table metadata cached in coordinator's cache.
> Catalogd can't compare them to send incremental updates. To support this, the
> Catalogd RPC requests should include the partition id list of the target
> table, catalogd uses it to generate incremental metadata updates in responses.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
