[ 
https://issues.apache.org/jira/browse/IMPALA-9937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tim Armstrong updated IMPALA-9937:
----------------------------------
    Component/s: Catalog

> Catalogd should send incremental metadata updates in DDL responses to legacy 
> coordinators
> -----------------------------------------------------------------------------------------
>
>                 Key: IMPALA-9937
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9937
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Quanlong Huang
>            Priority: Major
>
> After IMPALA-3127, catalogd is able to send incremental metadata updates in 
> partition level. Ideally, legacy coordinators should receive incremental 
> updates in DDL responses. E.g. when adding one partition, only get back the 
> metadata of this partition and some table level updates, not including 
> metadata of other unchanged partitions.
> However, catalogd still sends full table objects in DDL responses because 
> catalogd is not aware of the table metadata cached in coordinator's cache. 
> Catalogd can't compare them to send incremental updates. To support this, the 
> Catalogd RPC requests should include the partition id list of the target 
> table, catalogd uses it to generate incremental metadata updates in responses.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

Reply via email to