marchpure opened a new pull request #3816:
URL: https://github.com/apache/carbondata/pull/3816


    ### Why is this PR needed?
    During filter segments flow, there are a lot of LIST.CONTAINS, which has 
heavy time overhead when there are tens of thousands segments.
    For example, if there are 50000 segments. it will trigger LIST.CONTAINS  
for each segment, the LIST also has about 50000 elements. so the time 
complexity will be O(50000 * 50000 )
    
    ### What changes were proposed in this PR?
   Change List.CONTAINS to MAP.containsKEY
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to