tustvold commented on issue #5230: URL: https://github.com/apache/arrow-datafusion/issues/5230#issuecomment-1432078169
> Any suggestions on serialization format would be appreciated! Thanks You should be able to serialize the raw row bytes directly. For example a basic idea might be, write a 4 byte magic header, e.g. `b"AROW"`, then write a `u32` as little endian containing the number of rows, then for each row write a u32 length, followed by the row bytes. Parsing it should be relatively straightforward, and can be performed using [`RowParser`](https://docs.rs/arrow-row/latest/arrow_row/struct.RowParser.html#method.parse) which can be obtained from the `RowConverter` by calling [`RowConverter::parser`](https://docs.rs/arrow-row/latest/arrow_row/struct.RowConverter.html#method.parser) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
