etseidl commented on PR #241: URL: https://github.com/apache/parquet-format/pull/241#issuecomment-4001043887
> > as each vector value has a fixed number of non-optional child elements > > I think the vectors themselves would be non-optional but the child elements should be allowed to be optional? @pitrou's proposal would increase neither the repetition nor definition levels, so that implies vectors and their elements are non-optional. If we want to allow optional vectors and elements, we'd need some kind of 3-level structure like what currently exists for lists. This would eliminate some repetition level decoding, but would still require extra definition level handling, so I wonder if we'd see as much of a decoding speed improvement. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
