alexeykudinkin commented on issue #5804: URL: https://github.com/apache/hudi/issues/5804#issuecomment-1154206281
@Reimus thanks for reporting! Internally Data Skipping is relying on Column Stats Index that currently builds statistics only for the top-level columns, and therefore Data Skipping is only able to prune based on the top-level columns. If you feel this could be generalized to all nested fields please feel free to create a feature-request or (even better!) kickstart the conversation on the dev-list and maybe kickoff the RFC process to extend this to general case of nested columns in the table as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
