Amogh Margoor created IMPALA-10938:
--------------------------------------
Summary: Adaptive Broadcast Joins in the Impala
Key: IMPALA-10938
URL: https://issues.apache.org/jira/browse/IMPALA-10938
Project: IMPALA
Issue Type: New Feature
Components: Backend
Reporter: Amogh Margoor
Assignee: Amogh Margoor
Broadcast joins when build side is small can be much faster than the
partitioned joins. Whenever cost model figures it out, it would try to enable
broadcast join. However due to lack of statistics or due to incorrect estimates
it is not always possible to detect small build side. Therefore, we need an
adaptive way to figure it out during the runtime and enable the broadcast.
There are other systems like Apache Spark and modern dataware houses which do
rely on this technique, so it would be good addition to Impala too.
As a part of this, we mayfield end up defining Adaptive framework which can be
extended to other problems like Skew joins etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)