Anthony Abate created ARROW-6681:
------------------------------------
Summary: [C# -> R] - Record Batches in reverse order?
Key: ARROW-6681
URL: https://issues.apache.org/jira/browse/ARROW-6681
Project: Apache Arrow
Issue Type: New Feature
Components: C#
Affects Versions: 0.14.1
Reporter: Anthony Abate
Are 'RecordBatches' being in C# being written in reverse order?
I made a simple test which creates a single row per record batch of 0 to 99 and
attempted to read this in R. To my surprise batch(0) in R had the value 99 not 0
This may not seem like a big deal, however when dealing with 'huge' files, its
more efficient to use Record Batches / index lookup than attempting to load the
entire file into memory.
Having the order consistent within the different language / API seems only to
make sense - for now I can work around this by reversing the order before
writing.
https://github.com/apache/arrow/issues/5475
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
