Xingjun Hao created CARBONDATA-3879:

             Summary: Filtering Segmets Optimazation
                 Key: CARBONDATA-3879
             Project: CarbonData
          Issue Type: Improvement
          Components: data-query
    Affects Versions: 2.0.0
            Reporter: Xingjun Hao
             Fix For: 2.0.2

During filter segments flow, there are a lot of LIST.CONTAINS, which has heavy 
time overhead when there are tens of thousands segments.

For example, if there are 50000 segments. it will trigger LIST.CONTAINS  for 
each segment, the LIST also has about 50000 elements. so the time complexity 
will be O(50000 * 50000 )

This message was sent by Atlassian Jira

Reply via email to