[jira] [Updated] (ARROW-1715) [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, Table
[
https://issues.apache.org/jira/browse/ARROW-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Uwe L. Korn updated ARROW-1715:
---
Description: At the moment the types
{{pyarrow.Array/Column/ChunkedArray/RecordBatch/Table}} cannot be pickled.
Although it may not be the fastest way to transport them from one process to
another, it is a very comfortable one. We should implement a {{__reduce__()}}
for all of them. For Array, this means that we need to pickle the buffers and
save the array type with them. The other classes require the pickling of the
Array class and will need to store the addditional metadata like the schema
also in the pickle data.
> [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch,
> Table
> ---
>
> Key: ARROW-1715
> URL: https://issues.apache.org/jira/browse/ARROW-1715
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Python
>Reporter: Wes McKinney
>Priority: Major
> Labels: beginner
> Fix For: 0.10.0
>
>
> At the moment the types
> {{pyarrow.Array/Column/ChunkedArray/RecordBatch/Table}} cannot be pickled.
> Although it may not be the fastest way to transport them from one process to
> another, it is a very comfortable one. We should implement a {{__reduce__()}}
> for all of them. For Array, this means that we need to pickle the buffers and
> save the array type with them. The other classes require the pickling of the
> Array class and will need to store the addditional metadata like the schema
> also in the pickle data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (ARROW-1715) [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, Table
[ https://issues.apache.org/jira/browse/ARROW-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated ARROW-1715: --- Labels: beginner (was: ) > [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, > Table > --- > > Key: ARROW-1715 > URL: https://issues.apache.org/jira/browse/ARROW-1715 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Wes McKinney >Priority: Major > Labels: beginner > Fix For: 0.10.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-1715) [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, Table
[ https://issues.apache.org/jira/browse/ARROW-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1715: Fix Version/s: (was: 0.9.0) 0.10.0 > [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, > Table > --- > > Key: ARROW-1715 > URL: https://issues.apache.org/jira/browse/ARROW-1715 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Wes McKinney >Priority: Major > Fix For: 0.10.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (ARROW-1715) [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, Table
[ https://issues.apache.org/jira/browse/ARROW-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1715: Fix Version/s: 0.9.0 > [Python] Implement pickling for Array, Column, ChunkedArray, RecordBatch, > Table > --- > > Key: ARROW-1715 > URL: https://issues.apache.org/jira/browse/ARROW-1715 > Project: Apache Arrow > Issue Type: New Feature > Components: Python >Reporter: Wes McKinney > Fix For: 0.9.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
