[
https://issues.apache.org/jira/browse/ARROW-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uwe L. Korn updated ARROW-1715:
-------------------------------
Description: At the moment the types
{{pyarrow.Column/ChunkedArray/RecordBatch/Table}} cannot be pickled. Although
it may not be the fastest way to transport them from one process to another, it
is a very comfortable one. We should implement a {{__reduce__()}} for all of
them. For Array, this means that we need to pickle the buffers and save the
array type with them. The other classes require the pickling of the Array class
and will need to store the addditional metadata like the schema also in the
pickle data. (was: At the moment the types
{{pyarrow.Array/Column/ChunkedArray/RecordBatch/Table}} cannot be pickled.
Although it may not be the fastest way to transport them from one process to
another, it is a very comfortable one. We should implement a {{__reduce__()}}
for all of them. For Array, this means that we need to pickle the buffers and
save the array type with them. The other classes require the pickling of the
Array class and will need to store the addditional metadata like the schema
also in the pickle data.)
> [Python] Implement pickling for Column, ChunkedArray, RecordBatch, Table
> ------------------------------------------------------------------------
>
> Key: ARROW-1715
> URL: https://issues.apache.org/jira/browse/ARROW-1715
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Python
> Reporter: Wes McKinney
> Priority: Major
> Labels: beginner
> Fix For: 0.10.0
>
>
> At the moment the types {{pyarrow.Column/ChunkedArray/RecordBatch/Table}}
> cannot be pickled. Although it may not be the fastest way to transport them
> from one process to another, it is a very comfortable one. We should
> implement a {{__reduce__()}} for all of them. For Array, this means that we
> need to pickle the buffers and save the array type with them. The other
> classes require the pickling of the Array class and will need to store the
> addditional metadata like the schema also in the pickle data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
