Paddy Horan created ARROW-6971:
----------------------------------
Summary: [Rust] Replace "RecordBatchReader" with "BatchIterator"
Key: ARROW-6971
URL: https://issues.apache.org/jira/browse/ARROW-6971
Project: Apache Arrow
Issue Type: Improvement
Components: Rust, Rust - DataFusion
Affects Versions: 0.15.0
Reporter: Paddy Horan
Assignee: Paddy Horan
Fix For: 1.0.0
As part of the recent reader work we introduced
{code:java}
// arrow::record_batch::RecordBatchReader{code}
but in datafusion we have
{code:java}
// datafusion::physical_plan::BatchIterator
{code}
These two trait are almost identical (BatchIterator implements Send + Sync
whereas RecordBatchReader does not). I propose we replace RecordBatchReader
with BatchIterator (i.e. move it to arrow as it's generally useful outside of
datafusion) and update parquet and data fusion accordingly.
[~andygrove] [~liurenjie1024] do you see any issues with this?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
