Vihang Karajgaonkar created IMPALA-10219:
--------------------------------------------
Summary: Add a query option to simulate catalogd HDFS listing
delays
Key: IMPALA-10219
URL: https://issues.apache.org/jira/browse/IMPALA-10219
Project: IMPALA
Issue Type: Sub-task
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
This parent issue (IMPALA-6671) caused serious query backlog on large setups
where namenode response times are slower for whatever reasons. While you can
tune the namenode to some extent it is still problematic that Impala HDFS
operations which happen while holding the table lock block other unrelated
queries.
In order to simulate such problems in the product it would be nice to introduce
a query option which adds a artificial delay in the RPCs to namenode when the
table is being loaded. A query option is preferred over service level
configuration since, that way it is easier to model a slow blocking query and a
unrelated fast query in the test suite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
