Riza Suminto created IMPALA-12358:
-------------------------------------
Summary: Skip scheduling runtime filter that unlikely to meet
RUNTIME_FILTER_WAIT_TIME_MS constraint
Key: IMPALA-12358
URL: https://issues.apache.org/jira/browse/IMPALA-12358
Project: IMPALA
Issue Type: Improvement
Components: Frontend
Reporter: Riza Suminto
A scan node will wait for a runtime filter arrival for
[RUNTIME_FILTER_WAIT_TIME_MS|https://impala.apache.org/docs/build/html/topics/impala_runtime_filter_wait_time_ms.html].
If the runtime filter is not arrived within this period, the scan node will
stop waiting and start scanning. Late runtime filter can still be applied if
the scanning has not finished yet upon filter arrival. However, planner should
predict to some degree if a certain runtime filter is likely to be late. If it
does, then skip scheduling such a filter.
The prediction can be based on either of:
* total volume of all scans from the build side of join.
* the distance between the join node and the furthest fragment in the build
side direction.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
