Manish Gupta created CARBONDATA-2051:
----------------------------------------
Summary: Added like query ends with and contains with filter push
down suport to carbondata
Key: CARBONDATA-2051
URL: https://issues.apache.org/jira/browse/CARBONDATA-2051
Project: CarbonData
Issue Type: Bug
Reporter: Manish Gupta
Assignee: Manish Gupta
Problem
Current like filter with start with expression is only pushed down to
carbondata. In case of ends with and contains like filter all the data is given
back to spark and then spark applies the filter on it.
This behavior is fine for the queries which has lesser number of queried
columns. But as the number of columns and data increases there is performance
impact because the data being sent to spark becomes more thereby increasing the
IO.
If like filter is push down then first filter column is read and blocks are
pruned. In this cases the data returned to the spark is after applying the
filter and only blocklets matching the data are fully read. This reduces IO and
increases the query performance.
Solution
Modify code to push down like query with ends and contains with filter
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
