vinothchandar commented on issue #1694: URL: https://github.com/apache/hudi/issues/1694#issuecomment-653259982
@Raghvendradubey we are getting async compaction enabled for spark structured streaming sink that should bring this down by half, since compaction wont block writing.. Can you paste the latest spark UI which shows the most expensive stage? We can work on tuning this down. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
