[
https://issues.apache.org/jira/browse/ARROW-6107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900964#comment-16900964
]
Sebastien Binet commented on ARROW-6107:
----------------------------------------
ok.
(just nit-picking but to really assess the CGo overhead, one should directly
call C, not C++-via-python :P. that said, it's a nice PoC.)
SGTM.
> [Go] ipc.Writer Option to skip appending data buffers
> -----------------------------------------------------
>
> Key: ARROW-6107
> URL: https://issues.apache.org/jira/browse/ARROW-6107
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Go
> Reporter: Nick Poorman
> Priority: Minor
>
> For cases where we have a known shared memory region, it would be great if
> the ipc.Writer (and by extension ipc.Reader?) had the ability to write out
> everything but the actual buffers holding the data. That way we can still
> utilize the ipc mechanisms to communicate without having to serialize all the
> underlying data across the wire.
>
> This seems like it should be possible since the `RecordBatch` flatbuffers
> only contain the metadata and the underlying data buffers are appended later.
> We just need to skip appending the underlying data buffers.
>
> [~sbinet] thoughts?
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
