azagrebin opened a new pull request #11300: [FLINK-16406] Increase default value for JVM Metaspace to minimise its OutOfMemoryError URL: https://github.com/apache/flink/pull/11300 With FLIP-49 (FLINK-13980), we introduced a limit for JVM Metaspace ('taskmanager.memory.jvm-metaspace.size') when TM JVM process is started. It caused 'OutOfMemoryError: Metaspace' for some use cases after upgrading to the latest 1.10 version. In some cases, a real class loading leak has been discovered, like in FLINK-16142. Some users had to increase the default value to accommodate for their use cases (mostly from 96Mb to 256Mb). While this limit was introduced to properly plan Flink resources, especially for container environment, and to detect class loading leaks, the user experience should be as smooth as possible. One way is provide good documentation for this change (FLINK-16278). Another question is the sanity of the default value. It is still arguable what the default value should be (currently 96Mb). In general, the size depends on the use case (job user code, how many jobs are deployed in the cluster etc). This issue tries to tackle this problem by firstly increasing it to 256Mb and overall default process size to 1728Mb in flink-conf.yaml to have no impact on default sizes of other memory components.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
