1032851561 commented on issue #7407: URL: https://github.com/apache/hudi/issues/7407#issuecomment-1736799984
> > > i also encountered the issue of OOM when Flink JM runs for a period of time. My usage scenario is to synchronize the entire library of Flink cdc MySQL to Hudi, with over 100 tables in one library > > > > > > Writing hudi jobs consumes a lot of jm memory, because `timeline server`, `hive sync` and `compaction` run in job manager. There was a hive sync bug that caused oom before version 0.11. > > We have enabled offline compact and offline metadata synchronization, JM with 30GB of mem, but we still have frequent ooms，hudi version：0.13.1 Every hudi table has a embed timeline server(a web server base on Javalin+jetty) by default, try to disable? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
