Quanlong Huang created IMPALA-13685:
---------------------------------------
Summary: Consider throttling WaitForHmsEvent requests in catalogd
Key: IMPALA-13685
URL: https://issues.apache.org/jira/browse/IMPALA-13685
Project: IMPALA
Issue Type: Task
Reporter: Quanlong Huang
Assignee: Quanlong Huang
The WaitForHmsEvent RPC is added by IMPALA-12152 so coordinators can use it
before query planning to wait until catalogd is in sync with HMS events. Each
query with SYNC_HMS_EVENTS_WAIT_TIME_S > 0 triggers such a RPC to catalogd,
which launches a sleeping thread in catalogd checking the event processing
progress periodically. If these overload catalogd, we should throttle
WaitForHmsEvent requests like what we have done on GetPartialCatalogObject
requests. The time between coordinator sends the request and catalogd starts
processing the request might be significant after that so it should also be
accounted in the waiting timeout.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
