[
https://issues.apache.org/jira/browse/FLINK-20645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250918#comment-17250918
]
Li Wang commented on FLINK-20645:
---------------------------------
Here is the stacktrace -
{code:java}
2020-12-17 07:08:49,220 ERROR
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager
initialization failed.2020-12-17 07:08:49,220 ERROR
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager
initialization
failed.org.apache.flink.configuration.IllegalConfigurationException: Failed to
create TaskExecutorResourceSpec at
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils.resourceSpecFromConfig(TaskExecutorResourceUtils.java:72)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.startTaskManager(TaskManagerRunner.java:360)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:158)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:306)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$2(TaskManagerRunner.java:330)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_161] at
javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_161] at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1768)
~[hadoop-common-2.7.3.6.jar:?] at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:329)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:314)
[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:298)
[flink-dist_2.11-1.11.2.jar:1.11.2]Caused by:
org.apache.flink.configuration.IllegalConfigurationException: The required
configuration option Key: 'taskmanager.cpu.cores' , default: null (fallback
keys: []) is not set at
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils.checkConfigOptionIsSet(TaskExecutorResourceUtils.java:90)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils.lambda$checkTaskExecutorResourceConfigSet$0(TaskExecutorResourceUtils.java:84)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
java.util.Arrays$ArrayList.forEach(Arrays.java:3880) ~[?:1.8.0_161] at
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils.checkTaskExecutorResourceConfigSet(TaskExecutorResourceUtils.java:84)
~[flink-dist_2.11-1.11.2.jar:1.11.2] at
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils.resourceSpecFromConfig(TaskExecutorResourceUtils.java:70)
~[flink-dist_2.11-1.11.2.jar:1.11.2] ... 11 more
{code}
> Extra space typo when assembling dynamic configs
> ------------------------------------------------
>
> Key: FLINK-20645
> URL: https://issues.apache.org/jira/browse/FLINK-20645
> Project: Flink
> Issue Type: Bug
> Reporter: Li Wang
> Priority: Major
> Labels: pull-request-available
>
> while starting task manager, I got the error below
> {code:java}
> "Caused by: org.apache.flink.configuration.IllegalConfigurationException: The
> required configuration option Key: 'taskmanager.cpu.cores' , default: null
> (fallback keys: []) is not set
> {code}
>
> Checking TM starting command I got something like
> {code:java}
> -D taskmanager.memory.framework.off-heap.size=134217728b -D
> taskmanager.memory.network.max=67108864b -D
> taskmanager.memory.network.min=67108864b -D
> taskmanager.memory.framework.heap.size=134217728b -D
> taskmanager.memory.managed.size=57346620b -D taskmanager.cpu.cores=1.0 -D
> taskmanager.memory.task.heap.size=1518663108b -D
> taskmanager.memory.task.off-heap.size=0b
> {code}
> Looks like the extra spaces between "-D" and parameters causes those dynamic
> options can't be passed in correctly.
> Related code is
> [here|https://github.com/apache/flink/blob/2ad92169a4a4ffc92d32783f8777a132e1dac7c4/flink-core/src/main/java/org/apache/flink/configuration/ConfigurationUtils.java#L180]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
