zhoulii commented on PR #9321:
URL: https://github.com/apache/paimon/pull/9321#issuecomment-5408934951
> In what scenario do you want to speed things up? Perhaps a dedicated
partition scanner could be implemented?
The target scenario is update-time partition expiration on tables with many
partitions and files. It has to scan all manifest entries to aggregate each
partition's last file creation time, but currently materializes full entries,
including keys and statistics, causing unnecessary decoding and allocation.
A dedicated partition scanner sounds cleaner. I will explore moving the
projected aggregation there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
