[
https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685108#comment-15685108
]
Julien Le Dem commented on ARROW-384:
-------------------------------------
Here is a 3rd suggestion:
{noformat}
<metadata size: int32> <metadata> <buffers>
{noformat}
Since we probably know the size of the flatbuffer already before writing.
[~wesmckinn]: One thing I am missing is that in the context of shared memory,
buffers are not contiguous.
> Align Java and C++ RecordBatch data and metadata layout
> -------------------------------------------------------
>
> Key: ARROW-384
> URL: https://issues.apache.org/jira/browse/ARROW-384
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Julien Le Dem
>
> layout on C++ side:
> {noformat}
> <buffers> <metadata> <metadata size: int32>
> {noformat}
> and on the java side:
> {noformat}
> <metadata> <buffers>
> {noformat}
> In the file format the footer has a Block info that contains the metadata
> length.
> https://github.com/apache/arrow/blob/f082b17323354dc2af31f39c15c58b995ba08360/format/File.fbs#L36
> See:
> https://github.com/apache/arrow/pull/211#issuecomment-262080545
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
