Kurt Deschler created IMPALA-10355:
--------------------------------------
Summary: DROP FUNCTION IF EXISTS taking 4-5 sec to execute when
function does not exist
Key: IMPALA-10355
URL: https://issues.apache.org/jira/browse/IMPALA-10355
Project: IMPALA
Issue Type: Bug
Reporter: Kurt Deschler
DROP FUNCTION IF EXISTS is excessively slow when the function does not exist.
Preliminary analysis shows this line is taking 4+ sec for the drop function if
exists call:
impala-server.cc:1778 WaitForCatalogUpdate(catalog_update_result.version,
catalog_service_id);
The 4+ sec wait here is due to statestore updates being done every 2 sec by
default.
Setting statestore_update_frequency_ms to 100 significantly improves
performance of drop function if exists.
Query: create FUNCTION test_udf(DECIMAL(38,36)) RETURNS STRING LOCATION
'/tmp/test_udf.so' SYMBOL='test_udf'
real 0m0.104s
user 0m0.062s
sys 0m0.016s
Query: drop FUNCTION test_udf(DECIMAL(38,36))
real 0m0.097s
user 0m0.049s
sys 0m0.032s
Query: drop FUNCTION IF EXISTS test_udf(DECIMAL(38,36)) --function exists
real 0m0.098s
user 0m0.059s
sys 0m0.020s
Query: drop FUNCTION IF EXISTS test_udf(DECIMAL(38,36)) --function does not
exists
real 0m4.542s
user 0m0.068s
sys 0m0.022s
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
