parisni commented on issue #6373: URL: https://github.com/apache/hudi/issues/6373#issuecomment-1261356640
Caching should definitely help. what about batching as merged here ? https://github.com/apache/hudi/pull/6580 On Wed, 2022-09-28 at 09:41 -0700, Alexey Kudinkin wrote: > @nsivabalan @parisni i think we need to re-think our approach to > addressing this issue at the actual root: Cleaner is taking 4h > currently b/c it relies on `HoodieBackedTableMetadata` instance that > isn't caching the reader/scanner entailing that MT will be re-parsed > every time a request is made to it (which should be avoided) > > I've created HUDI-4937 to track this. > -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
