Eric Wohlstadter created ARROW-2632:
---------------------------------------
Summary: [Java] ArrowStreamWriter accumulates ArrowBlock but does
not use them
Key: ARROW-2632
URL: https://issues.apache.org/jira/browse/ARROW-2632
Project: Apache Arrow
Issue Type: Bug
Components: Java - Vectors
Reporter: Eric Wohlstadter
Fix For: 0.10.0
{{ArrowStreamWriter}} inherits from {{ArrowWriter}} the behavior of
accumulating an {{ArrowBlock}} for each {{ArrowRecordBatch}} that is written.
But this data is never used in the context of {{ArrowStreamWriter}}.
{code:java}
public abstract class ArrowWriter implements AutoCloseable {
private final List<ArrowBlock> recordBlocks = new ArrayList<>();
...
protected void writeRecordBatch(ArrowRecordBatch batch) {
...
recordBlocks.add(block);
}
}
{code}
{{writeRecordBatch}} can be overridden in {{ArrowStreamWriter}} to avoid adding
the memory overhead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
