[
https://issues.apache.org/jira/browse/ARROW-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214020#comment-16214020
]
ASF GitHub Bot commented on ARROW-1522:
---------------------------------------
GitHub user pcmoritz opened a pull request:
https://github.com/apache/arrow/pull/1231
ARROW-1522: [WIP] [Python] Zero copy buffer deserialization
TODO before merge:
- [ ] Add pandas zero copy buffer read
- [ ] See if fixing the TODO about union tags makes the code cleaner
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pcmoritz/arrow buffer-serialization
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/arrow/pull/1231.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1231
----
commit 82a8c2fcf0e9b9e4ca7c8e4306841dad8cecd105
Author: Philipp Moritz <[email protected]>
Date: 2017-10-21T00:23:05Z
buffer serialization write path
commit d185c6708f366644ae6bc33cb8d7ee1bd225819d
Author: Philipp Moritz <[email protected]>
Date: 2017-10-21T16:41:25Z
add read path
----
> [C++] Support pyarrow.Buffer as built-in type in pyarrow.serialize
> ------------------------------------------------------------------
>
> Key: ARROW-1522
> URL: https://issues.apache.org/jira/browse/ARROW-1522
> Project: Apache Arrow
> Issue Type: Improvement
> Reporter: Wes McKinney
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> This will enable objects with serialized representation as large byte strings
> to avoid memory copying on read (i.e. avoiding {{PyBytes_FromStringAndSize}})
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)