quinnj commented on issue #125:
URL: https://github.com/apache/arrow-julia/issues/125#issuecomment-1592007130
@ericphanson, what do you think, should we do a custom serialization for
`AbstractArray{T, N}` where `N > 1`? We could serialize `N` and what `size`
returns to be able to correctly deserialize?
The alternative, as I mentioned above, would be to try and use the official
tensor message type.
Pros of tensor message:
* official arrow way of doing tensors
Cons of tensor:
* Not all implementations support the tensor message
Pros of using extension type (metadata):
* Pretty trivial implementation (basically what @ericphanson linked to
above w/ the FlatArray type)
Cons:
* Would make non-vector AbstractArrays Julia-specific w/ their
serialization
We could probably still support the tensor message type later if we go w/
the extension type method, but it would be an explicit thing where you wrap
your matrix/array in a `Arrow.Tensor` and then write that out.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
