rdblue edited a comment on issue #78: Collect min/max value statistics for nested structs in ParquetMetrics URL: https://github.com/apache/incubator-iceberg/issues/78#issuecomment-467519854 The reason for now is that this is how the stats and dictionary filters work. If a column has stats, then it is assumed to be at the top level. Structs are logical groupings and don't affect the meaning of a filter, so they are okay. If we want to collect stats from maps and lists, then we need to have a plan for how to use them. That means implementing more filters like `contains`, `containsKey`, or `containsValue`. Since we don't have those yet, we don't need to store the data for them.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
