[
https://issues.apache.org/jira/browse/KUDU-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bankim Bhavsar updated KUDU-2981:
---------------------------------
Description:
Commit c0f3727 added an optimization to push predicate evaluation into the
CFile decoders without fully materializing the contents of each cblock. It did
this with dictionary-encoded blocks, but the optimization can be applied to any
other encoding types too.
KUDU-736 also notes that we may be able to apply some predicates on bitshuffled
data.
was:
Commit c0f3727 added an optimization to push predicate evaluation into the
CFile decoders without fully materializing the contents of each cblock. It did
this with dictionary-encoded blocks, but the optimization can be applied to any
other encoding types too.
A low hanging fruit is RLE decoders, which should be able to evaluate the
predicate for each run instead of materializing each cell and then applying the
predicate.
KUDU-736 also notes that we may be able to apply some predicates on bitshuffled
data.
> Push predicate evaluation into more CFile decoders
> --------------------------------------------------
>
> Key: KUDU-2981
> URL: https://issues.apache.org/jira/browse/KUDU-2981
> Project: Kudu
> Issue Type: Improvement
> Components: cfile, perf
> Reporter: Bankim Bhavsar
> Assignee: Bankim Bhavsar
> Priority: Major
> Labels: newbie
>
> Commit c0f3727 added an optimization to push predicate evaluation into the
> CFile decoders without fully materializing the contents of each cblock. It
> did this with dictionary-encoded blocks, but the optimization can be applied
> to any other encoding types too.
> KUDU-736 also notes that we may be able to apply some predicates on
> bitshuffled data.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
