JingsongLi commented on PR #6914: URL: https://github.com/apache/paimon/pull/6914#issuecomment-3747406095
Hi @wwj6591812 1. We can optimize the bucket path function (this is the performance bottleneck) and test its performance to see if the optimization effect can be achieved without pushing down the limit to scan. 2. If the performance improvement is not obvious, it is necessary to merge the two methods, postFilterManifestEntries and limitPushManifestEntries, and only keep one, postFilterManifestEntries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
