Quanlong Huang created IMPALA-9937:
--------------------------------------
Summary: Catalogd should send incremental metadata updates in DDL
responses to legacy coordinators
Key: IMPALA-9937
URL: https://issues.apache.org/jira/browse/IMPALA-9937
Project: IMPALA
Issue Type: Improvement
Reporter: Quanlong Huang
After IMPALA-3127, catalogd is able to send incremental metadata updates in
partition level. Ideally, legacy coordinators should receive incremental
updates in DDL responses. E.g. when adding one partition, only get back the
metadata of this partition and some table level updates, not including metadata
of other unchanged partitions.
However, catalogd still sends full table objects in DDL responses because
catalogd is not aware of the table metadata cached in coordinator's cache.
Catalogd can't compare them to send incremental updates. To support this, the
Catalogd RPC requests should include the partition id list of the target table,
catalogd uses it to generate incremental metadata updates in responses.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
