Ajantha Bhat created CARBONDATA-3994:

             Summary: Skip Order by for map task if it is sort column and use 
limit pushdown for array_contains filter
                 Key: CARBONDATA-3994
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3994
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat

When the order by column is in sort column, every map task output will be 
already sorted. No need to sort the data again.
Hence skipping the order at map task by changing plan node from 
{{TakeOrderedAndProject}} --> {{CarbonTakeOrderedAndProjectExec}}
Also in this scenario collecting the limit at map task and Array_contains() 
will use this limit value for row scan filtering to break scan once limit value 
is reached.
Also added a carbon property to control this .

Note: later we can improve this for other filters also to use the limit value.

This message was sent by Atlassian Jira

Reply via email to