[
https://issues.apache.org/jira/browse/ARROW-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney updated ARROW-6076:
--------------------------------
Fix Version/s: (was: 0.16.0)
> [C++][Parquet] RecordReader::Reset logic is inefficient for small reads
> -----------------------------------------------------------------------
>
> Key: ARROW-6076
> URL: https://issues.apache.org/jira/browse/ARROW-6076
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Wes McKinney
> Priority: Major
>
> We have a unit test
> https://github.com/apache/arrow/blob/master/cpp/src/parquet/arrow/arrow-reader-writer-test.cc#L933
> that reads 1 record at a time from a Parquet-Arrow column reader. There is
> logic on RecordReader that advances the definition/repetition levels based on
> consumed data from previous records, but this is inefficient for this case:
> https://github.com/apache/arrow/blob/master/cpp/src/parquet/column_reader.cc#L1011
> This should be refactored to not require this copying, or at least to only
> "shift" the levels occasionally
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
