Zoltán Borók-Nagy created IMPALA-13088:
------------------------------------------

             Summary: Speedup IcebergDeleteBuilder
                 Key: IMPALA-13088
                 URL: https://issues.apache.org/jira/browse/IMPALA-13088
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Zoltán Borók-Nagy


When there are lots of delete records IcebergDeleteBuilder can become a 
bottleneck. Since the left side of the JOIN is blocked on the build side any 
improvement we make here significantly improves Iceberg V2 table scanning.
* std vector growths need lots of re-allocations and memory copies
* inserting into the position vectors one-by-one is inefficient
* sorting the position vectors could be parallelized (especially in case of 
MT_DOP when there are MT_DOP threads blocked on the build)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to