jhorstmann commented on issue #12364: URL: https://github.com/apache/arrow-rs/issues/12364#issuecomment-7065682698
This reminds me a bit of the discussion around the now deprecated `ColumnChunk::file_offset` field (https://github.com/apache/parquet-format/pull/440). Its idea was probably to store the `ColumnMetaData` out of line, and right before the data for that column. I'm not sure if any implementation ever used it that way, but it might be the most "standard way". It's similar to Andrew's first comment, but the metadata would be per column, not for the whole file or a row group. It also contains a `key_value_metadata` field, in which additional metadata could be stored. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
