Csaba Ringhofer created IMPALA-13292:
----------------------------------------
Summary: Decrease statestore_update_frequency_ms in development
environment
Key: IMPALA-13292
URL: https://issues.apache.org/jira/browse/IMPALA-13292
Project: IMPALA
Issue Type: Improvement
Components: Infrastructure
Reporter: Csaba Ringhofer
The current default 2s for statestore_update_frequency_ms adds significant
delay to lot of operations. While decreasing it in production environment
sounds risky, doing this in the development environment could make it faster.
Decreasing statestore_update_frequency_ms from 2s to 0.5s reduced cluster
startup time by 1-2 seconds, which could make custom cluster tests faster. It
also significantly speeds up tests that create / drop metastore objects:
impala-py.test -x tests/metadata/test_ddl.py -ktest_create_table_as_select
with default settings:
first run: 32s -> 16s
other runs: 16s -> 8s
The effect less drastic on the first run with catalog_topic_mode=minimal:
first run: 18s-> 12s
other runs: 16s -> 8s
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
