[
https://issues.apache.org/jira/browse/IMPALA-8381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815439#comment-16815439
]
Daniel Becker commented on IMPALA-8381:
---------------------------------------
https://gerrit.cloudera.org/#/c/12985/
> Remove branch from ParquetPlainEncoder::Decode()
> ------------------------------------------------
>
> Key: IMPALA-8381
> URL: https://issues.apache.org/jira/browse/IMPALA-8381
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Reporter: Csaba Ringhofer
> Assignee: Daniel Becker
> Priority: Minor
> Labels: newbie, parquet, performance, ramp-up
>
> Removing the "if" at
> https://github.com/apache/impala/blob/5670f96b828d57f9e36510bb9af02bcc31de775c/be/src/exec/parquet/parquet-common.h#L203
> can lead to 1.5x speed up in plain decoding (type=int32, stride=16). For
> primitive types, the same check can be done for a whole batch, so the speedup
> can be gained for large batches without loosing safety. The only Parquet type
> where this check is needed per element is BYTE_ARRAY (typically used for
> STRING columns), which already has a template specialization for
> ParquetPlainEncoder::Decode().
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
