From my time working on the arrow writers, I think that would be fine.
You could do the same thing with the dictionary blocks, as well.
As an implementation idea, it might be cleaner to add some callback
hooks, i.e. onRecordBlockWritten(), and then implement that in the
FileWriter instead of h
Hi all,
In the context of ArrowStreamWriter:
- It looks like field ArrowWriter.recordBlocks is populated and consumes
memory, e.g. in ArrowWriter.writeRecordBatch
- But the List is never used (it is used in ArrowFileWriter but
not ArrowStreamWriter)
Would it be safe for me to extend ArrowStream
