[
https://issues.apache.org/jira/browse/IMPALA-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-10355:
-----------------------------------
Component/s: Catalog
> DROP FUNCTION IF EXISTS taking 4-5 sec to execute when function does not exist
> ------------------------------------------------------------------------------
>
> Key: IMPALA-10355
> URL: https://issues.apache.org/jira/browse/IMPALA-10355
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Kurt Deschler
> Priority: Major
>
> DROP FUNCTION IF EXISTS is excessively slow when the function does not exist.
> Preliminary analysis shows this line is taking 4+ sec for the drop function
> if exists call:
> impala-server.cc:1778 WaitForCatalogUpdate(catalog_update_result.version,
> catalog_service_id);
> The 4+ sec wait here is due to statestore updates being done every 2 sec by
> default.
> Setting statestore_update_frequency_ms to 100 significantly improves
> performance of drop function if exists.
> Query: create FUNCTION test_udf(DECIMAL(38,36)) RETURNS STRING LOCATION
> '/tmp/test_udf.so' SYMBOL='test_udf'
> real 0m0.104s
> user 0m0.062s
> sys 0m0.016s
> Query: drop FUNCTION test_udf(DECIMAL(38,36))
> real 0m0.097s
> user 0m0.049s
> sys 0m0.032s
> Query: drop FUNCTION IF EXISTS test_udf(DECIMAL(38,36)) --function exists
> real 0m0.098s
> user 0m0.059s
> sys 0m0.020s
> Query: drop FUNCTION IF EXISTS test_udf(DECIMAL(38,36)) --function does not
> exists
> real 0m4.542s
> user 0m0.068s
> sys 0m0.022s
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
