jaylmiller commented on issue #5230: URL: https://github.com/apache/arrow-datafusion/issues/5230#issuecomment-1432086117
> > Any suggestions on serialization format would be appreciated! Thanks > > You should be able to serialize the raw row bytes directly. For example a basic idea might be, write a 4 byte magic header, e.g. `b"AROW"` as a sanity check, then write a `u32` as little endian containing the number of rows, then for each row write a u32 length, followed by the row bytes. > > Parsing it should be relatively straightforward case of reversing the framing above, and then feeding the parsed bytes into [`RowParser`](https://docs.rs/arrow-row/latest/arrow_row/struct.RowParser.html#method.parse) which can be obtained from the `RowConverter` by calling [`RowConverter::parser`](https://docs.rs/arrow-row/latest/arrow_row/struct.RowConverter.html#method.parser) Ok perfect--I figured something it'd end up being something along those lines, but wanted to make sure I wasn't missing anything... Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
