ajantha-bhat commented on issue #6549: URL: https://github.com/apache/iceberg/issues/6549#issuecomment-1376687568
@huaxingao: Thanks for the proposal. I was about to implement some CALL procedure to collect stats for partition level stats. We can have a table-level NDV stats collection first and I can later improve it to collect partition-level stats. Because we have concluded that writers cannot write stats in V2 format. It needs to bump the spec version to V3. So, the only way to collect stats in V2/V1 format is via ANALYZE TABLE or CALL procedure. More info about partition level stats can be found here: https://www.mail-archive.com/[email protected]/msg03885.html Does partition-level stats help Spark-3.4 too? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
