[
https://issues.apache.org/jira/browse/FLINK-18156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127990#comment-17127990
]
Andrey Zagrebin edited comment on FLINK-18156 at 6/8/20, 8:05 AM:
------------------------------------------------------------------
In this case, we always considered that the overhead is derived as it is not
explicitly set. It just turned to have to be fixed as restricted by other
option values. We decided to fail fast in case any inconsistencies like this
one in user configuration to be explicit about the contracts. The min/max range
is a hard contract, only fractions are soft.
We can change a bit the error message to add hints about adjusting min/max or
other memory components to pass the check. Then user can at least do this
consciously.
was (Author: azagrebin):
In this case, we always considered that the overhead is derived as it is not
explicitly set. It just turned to have to be fixed as restricted by other
option values. We decided to fail fast in case any inconsistencies like this
one in user configuration to be explicit about the contracts. The min/max range
is a hard contract, only fractions are soft.
We can change a bit the error message to add hints about adjusting min/max or
other memory components to pass the check. The user can at least do this
consciously.
> Misleading error message if derived JVM overhead is too small
> -------------------------------------------------------------
>
> Key: FLINK-18156
> URL: https://issues.apache.org/jira/browse/FLINK-18156
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.11.0
> Reporter: Chesnay Schepler
> Priority: Major
>
> The error message says that the derived size is lower then the configured
> overhead range, but now such property was configured by the user.
> {code}
> [] - Loading configuration property: jobmanager.memory.process.size, 2000m
> [] - Loading configuration property: jobmanager.memory.heap.size, 1500m
> Exception in thread "main"
> org.apache.flink.configuration.IllegalConfigurationException: Derived JVM
> Overhead size (116.000mb (121634816 bytes)) is not in configured JVM Overhead
> range [192.000mb (201326592 bytes), 1024.000mb (107374182$ at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.sanityCheckJvmOverhead(ProcessMemoryUtils.java:171)
> at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveJvmMetaspaceAndOverheadFromTotalFlinkMemory(ProcessMemoryUtils.java:148)
> at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithExplicitInternalMemory(ProcessMemoryUtils.java:86)
> at
> org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:71)
> at
> org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
> at
> org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:92)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:66)
> at
> org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:54)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
