[ 
https://issues.apache.org/jira/browse/ARROW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15970570#comment-15970570
 ] 

Wes McKinney commented on ARROW-840:
------------------------------------

Yeah, the idea is to embed basically anything that can be serialized to and 
from a bytestring. So you could use pickle to do the metadata serialization, 
but it would go into the IPC metadata as opaque bytes in 
https://github.com/apache/arrow/blob/master/format/Schema.fbs#L250

> [Python] Provide Python API for creating user-defined data types that can 
> survive Arrow IPC
> -------------------------------------------------------------------------------------------
>
>                 Key: ARROW-840
>                 URL: https://issues.apache.org/jira/browse/ARROW-840
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>            Reporter: Wes McKinney
>
> The user will provide:
> * Data type subclass that can indicate the physical storage type
> * "get state" and "set state" functions for serializing custom metadata to 
> bytes
> * An optional function for "boxing" scalar values from the physical array 
> storage
> Internally, this will build on an analogous C++ API for defining user data 
> types



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to