njalan commented on issue #9812: URL: https://github.com/apache/hudi/issues/9812#issuecomment-1752044255
@ad1happy2go After remove these archive files steaming job is getting faster. But storage cluster's cpu is not getting down and it is still high because the count of http to access s3 is not reduced. Is it possible to tune it? In my case there is only job to upsert one table why it requires hundreds of s3 access for one spark streaming micro batch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
