adamreeve commented on PR #241: URL: https://github.com/apache/parquet-format/pull/241#issuecomment-4000570329
I like the new proposal. This previous proposal means readers could fall back to reading the primitive values if they don't understand the new logical type, whereas there wouldn't be a fallback path for readers that don't understand the new repetition type, but I think that's acceptable given it allows use of encodings that are better suited to the element values (eg. byte stream split for floats or maybe ALP in the future). > as each vector value has a fixed number of non-optional child elements I think the vectors themselves would be non-optional but the child elements should be allowed to be optional? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
