[
https://issues.apache.org/jira/browse/ARROW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15970570#comment-15970570
]
Wes McKinney commented on ARROW-840:
------------------------------------
Yeah, the idea is to embed basically anything that can be serialized to and
from a bytestring. So you could use pickle to do the metadata serialization,
but it would go into the IPC metadata as opaque bytes in
https://github.com/apache/arrow/blob/master/format/Schema.fbs#L250
> [Python] Provide Python API for creating user-defined data types that can
> survive Arrow IPC
> -------------------------------------------------------------------------------------------
>
> Key: ARROW-840
> URL: https://issues.apache.org/jira/browse/ARROW-840
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Python
> Reporter: Wes McKinney
>
> The user will provide:
> * Data type subclass that can indicate the physical storage type
> * "get state" and "set state" functions for serializing custom metadata to
> bytes
> * An optional function for "boxing" scalar values from the physical array
> storage
> Internally, this will build on an analogous C++ API for defining user data
> types
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)