Bikramjeet Vig created IMPALA-6621:

             Summary: Improve In-predicate performance by using an alternative 
data structure for checking set membership
                 Key: IMPALA-6621
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 2.13.0
            Reporter: Bikramjeet Vig
            Assignee: Bikramjeet Vig
         Attachments: release_build_BoostFlatset.txt.txt, 
release_build_BoostUnorderedset.txt.txt, release_build_StdSet.txt.txt

Currently when using a SET_LOOKUP strategy for in-predicates in impala we use 
an std:set object for checking membership.
Using other data structures like 
boost::unordere[^release_build_BoostFlatset.txt.txt]d_set and boost::flat_set 
we can get a significant performance improvement. Please see attached results 
of micro benchmarks using std::set, flat_Set, unordered_set.

This message was sent by Atlassian JIRA

Reply via email to