[
https://issues.apache.org/jira/browse/ARROW-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xiangxiang Shen updated ARROW-17735:
------------------------------------
Description:
Improve parquet reading performance for String/Binary type based on Buffer
operations instead of BinaryArrayBuilder.
Currently, parquet String/Binary type reading performance is not good enough.
For fixedwidth types, the Reader has adopted Buffer operations instead of
ArrayBuilder interfaces.
So it‘s better to use Buffer operations in String/Binary type reading.
was:
Improve parquet reading performance for String/Binary type based on Buffer
operations instead of BinaryArrayBuilder.
Currently, parquet String/Binary type reading is not good enough. For
fixedwidth types， the Reader has adopted Buffer operations instead of
ArrayBuilder interfaces.
So it‘s better to use Buffer operations in String/Binary type reading.
> Improve parquet reading performance for String/Binary type based on Buffer
> operations instead of BinaryArrayBuilder
> -------------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-17735
> URL: https://issues.apache.org/jira/browse/ARROW-17735
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Parquet
> Affects Versions: 8.0.1
> Reporter: xiangxiang Shen
> Priority: Major
>
> Improve parquet reading performance for String/Binary type based on Buffer
> operations instead of BinaryArrayBuilder.
>
> Currently, parquet String/Binary type reading performance is not good enough.
> For fixedwidth types, the Reader has adopted Buffer operations instead of
> ArrayBuilder interfaces.
>
> So it‘s better to use Buffer operations in String/Binary type reading.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
