[
https://issues.apache.org/jira/browse/ARROW-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193594#comment-16193594
]
Robert Nishihara commented on ARROW-1503:
-----------------------------------------
I think that's a good idea and would make things a lot more convenient. This
makes sense for pandas dataframes. The types that we're currently registering
in Ray (at
https://github.com/ray-project/ray/blob/aebe9f937451bfa10aa0f2a41bafcf4747fb60f0/python/ray/worker.py#L1045-L1076)
would probably make sense in the default serialization context. We're
currently doing it for {{collections.OrderedDict}},
{{collections.defaultdict}}, and numpy arrays with non-nice dtypes.
We could also consider supporting pytorch tensors and things like that here
(although of course we can't assume that pytorch is installed), though that
might make more sense in Ray as opposed to pyarrow.
> [Python] Add serialization callbacks for pandas objects in pyarrow.serialize
> ----------------------------------------------------------------------------
>
> Key: ARROW-1503
> URL: https://issues.apache.org/jira/browse/ARROW-1503
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: Wes McKinney
> Assignee: Wes McKinney
> Fix For: 0.8.0
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)