jhorstmann commented on issue #12364:
URL: https://github.com/apache/arrow-rs/issues/12364#issuecomment-7065682698

   This reminds me a bit of the discussion around the now deprecated 
`ColumnChunk::file_offset` field 
(https://github.com/apache/parquet-format/pull/440). Its idea was probably to 
store the `ColumnMetaData` out of line, and right before the data for that 
column.
   
   I'm not sure if any implementation ever used it that way, but it might be 
the most "standard way". It's similar to Andrew's first comment, but the 
metadata would be per column, not for the whole file or a row group. It also 
contains a `key_value_metadata` field, in which additional metadata could be 
stored.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to