Wes McKinney created ARROW-5428:
-----------------------------------
Summary: [C++] Add option to set "read extent" in
arrow::io::BufferedInputStream
Key: ARROW-5428
URL: https://issues.apache.org/jira/browse/ARROW-5428
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Wes McKinney
Fix For: 0.14.0
I'm looking at simplifying libparquet to use common IO interfaces rather than
its own custom ones
The {{parquet::BufferedInputStream}} interface has an option to not read beyond
a particular number of bytes. For example, if we were reading a 32MB block with
1MB buffering, then we will not consume more than 32MB from the raw
InputStream.
This seems like a fairly trivial addition to {{arrow::io::BufferedInputStream}}
to track total read bytes and do not read beyond the configured extent. We'll
have to add a method like {{set_read_extent}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
