[
https://issues.apache.org/jira/browse/FLINK-18438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155303#comment-17155303
]
JohnSiro commented on FLINK-18438:
----------------------------------
Hi Xintong Song,
According you advice, comment out the JVM_ARGS opt, taskexecutor now can
started up.
Pls check the taskexecutor-log:
2020-07-10 17:33:13,227 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
--------------------------------------------------------------------------------
2020-07-10 17:33:13,230 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Preconfiguration:
2020-07-10 17:33:13,230 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
TM_RESOURCES_JVM_PARAMS extraction logs:
- Loading configuration property: jobmanager.rpc.address, localhost
- Loading configuration property: jobmanager.rpc.port, 6123
- Loading configuration property: jobmanager.heap.size, 1024m
- Loading configuration property: taskmanager.memory.process.size, 2048m
- Loading configuration property: taskmanager.numberOfTaskSlots, 1
- Loading configuration property: taskmanager.memory.jvm-metaspace.size, 256m
- Loading configuration property: parallelism.default, 1
- Loading configuration property: jobmanager.execution.failover-strategy,
region
BASH_JAVA_UTILS_EXEC_RESULT:-Xmx697932173 -Xms697932173
-XX:MaxDirectMemorySize=300647712 -XX:MaxMetaspaceSize=268435456
TM_RESOURCES_DYNAMIC_CONFIGS extraction logs:
- Loading configuration property: jobmanager.rpc.address, localhost
- Loading configuration property: jobmanager.rpc.port, 6123
- Loading configuration property: jobmanager.heap.size, 1024m
- Loading configuration property: taskmanager.memory.process.size, 2048m
- Loading configuration property: taskmanager.numberOfTaskSlots, 1
- Loading configuration property: taskmanager.memory.jvm-metaspace.size, 256m
- Loading configuration property: parallelism.default, 1
- Loading configuration property: jobmanager.execution.failover-strategy,
region
BASH_JAVA_UTILS_EXEC_RESULT:-D
taskmanager.memory.framework.off-heap.size=134217728b -D
taskmanager.memory.network.max=166429984b -D
taskmanager.memory.network.min=166429984b -D
taskmanager.memory.framework.heap.size=134217728b -D
taskmanager.memory.managed.size=665719939b -D taskmanager.cpu.cores=1.0 -D
taskmanager.memory.task.heap.size=563714445b -D
taskmanager.memory.task.off-heap.size=0b
2020-07-10 17:33:13,231 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
--------------------------------------------------------------------------------
2020-07-10 17:33:13,231 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager
(Version: 1.10.1, Rev:c5915cf, Date:07.05.2020 @ 13:58:51 CST)
2020-07-10 17:33:13,241 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - OS current user: xxx
2020-07-10 17:33:13,241 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Current
Hadoop/Kerberos user: <no hadoop dependency found>
2020-07-10 17:33:13,242 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM: Java HotSpot(TM)
64-Bit Server VM - Oracle Corporation - 1.8/25.101-b13
2020-07-10 17:33:13,242 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Maximum heap size:
3614 MiBytes
2020-07-10 17:33:13,242 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JAVA_HOME: C:\Program
Files\Java\jdk1.8.0_101
2020-07-10 17:33:13,242 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - No Hadoop Dependency
available
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM Options:
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
-Dlog.file=D:\home\flink-1.10.1/log/flink-xxx-taskexecutor-6-xxx.log
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
-Dlog4j.configuration=file:D:\home\flink-1.10.1/conf/log4j.properties
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
-Dlogback.configurationFile=file:D:\home\flink-1.10.1/conf/logback.xml
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Program Arguments:
2020-07-10 17:33:13,243 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --configDir
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
D:\home\flink-1.10.1/conf
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.framework.off-heap.size=134217728b
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.network.max=166429984b
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,244 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.network.min=166429984b
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.framework.heap.size=134217728b
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.managed.size=665719939b
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.cpu.cores=1.0
2020-07-10 17:33:13,245 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.task.heap.size=563714445b
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
taskmanager.memory.task.off-heap.size=0b
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Classpath:
D:\home\flink-1.10.1\lib\flink-table_2.12-1.10.1.jar;D:\home\flink-1.10.1\lib\flink-table-blink_2.12-1.10.1.jar;D:\home\flink-1.10.1\lib\log4j-1.2.17.jar;D:\home\flink-1.10.1\lib\slf4j-log4j12-1.7.15.jar;D:\home\flink-1.10.1\lib\flink-dist_2.12-1.10.1.jar;.;.;.
2020-07-10 17:33:13,246 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
--------------------------------------------------------------------------------
2020-07-10 17:33:13,248 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Registered UNIX
signal handlers for [TERM, INT]
2020-07-10 17:33:13,253 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Cannot determine the
maximum number of open file descriptors
2020-07-10 17:33:13,279 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: jobmanager.rpc.address, localhost
2020-07-10 17:33:13,279 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: jobmanager.rpc.port, 6123
2020-07-10 17:33:13,280 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: jobmanager.heap.size, 1024m
2020-07-10 17:33:13,280 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: taskmanager.memory.process.size, 2048m
2020-07-10 17:33:13,280 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-07-10 17:33:13,280 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: taskmanager.memory.jvm-metaspace.size, 256m
2020-07-10 17:33:13,281 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: parallelism.default, 1
2020-07-10 17:33:13,281 INFO org.apache.flink.configuration.GlobalConfiguration
- Loading configuration property: jobmanager.execution.failover-strategy, region
2020-07-10 17:33:13,284 WARN org.apache.flink.core.plugin.PluginConfig - The
plugins directory [\cygdrive\d\home\flink-1.10.1\plugins] does not exist.
2020-07-10 17:33:13,408 INFO org.apache.flink.core.fs.FileSystem - Hadoop is
not in the classpath/dependencies. The extended set of supported File Systems
via Hadoop is not available.
2020-07-10 17:33:13,461 INFO
org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create
Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-07-10 17:33:13,958 INFO
org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be
created as C:\cygwin64\tmp\jaas-774773542812067329.conf.
2020-07-10 17:33:13,965 INFO org.apache.flink.runtime.security.SecurityUtils -
Cannot install HadoopSecurityContext because Hadoop cannot be found in the
Classpath.
2020-07-10 17:33:14,046 INFO org.apache.flink.configuration.Configuration -
Config uses fallback configuration key 'jobmanager.rpc.address' instead of key
'rest.address'
2020-07-10 17:33:14,063 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils
- Trying to select the network interface and address to use by connecting to
the leading JobManager.
2020-07-10 17:33:14,063 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils
- TaskManager will try to connect for PT10S before falling back to heuristics
2020-07-10 17:33:14,312 INFO org.apache.flink.runtime.net.ConnectionUtils -
Retrieved new target address localhost/127.0.0.1:6123.
2020-07-10 17:33:14,651 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager will use
hostname/address '127.0.0.1' (127.0.0.1) for communication.
2020-07-10 17:33:14,658 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor
system at 127.0.0.1:0
2020-07-10 17:33:15,517 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-07-10 17:33:15,554 INFO akka.remote.Remoting - Starting remoting
2020-07-10 17:33:15,808 INFO akka.remote.Remoting - Remoting started; listening
on addresses :[akka.tcp://[email protected]:62300]
2020-07-10 17:33:15,940 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at
akka.tcp://[email protected]:62300
2020-07-10 17:33:15,960 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter
configured, no metrics will be exposed/reported.
2020-07-10 17:33:15,963 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor
system at 127.0.0.1:0
2020-07-10 17:33:15,985 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-07-10 17:33:15,988 INFO akka.remote.Remoting - Starting remoting
2020-07-10 17:33:15,999 INFO akka.remote.Remoting - Remoting started; listening
on addresses :[akka.tcp://[email protected]:62313]
2020-07-10 17:33:16,005 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at
akka.tcp://[email protected]:62313
2020-07-10 17:33:16,012 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService -
Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/MetricQueryService_e976ffe6364e47e25a554d543e659078 .
2020-07-10 17:33:16,032 INFO org.apache.flink.runtime.blob.PermanentBlobCache -
Created BLOB cache storage directory
C:\cygwin64\tmp\blobStore-34d63d0c-97b5-41b0-9836-d9c4dfa40989
2020-07-10 17:33:16,036 INFO org.apache.flink.runtime.blob.TransientBlobCache -
Created BLOB cache storage directory
C:\cygwin64\tmp\blobStore-7a183507-54a2-4bf3-ad2e-8d22d5c516f4
2020-07-10 17:33:16,037 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager
with ResourceID: e976ffe6364e47e25a554d543e659078
2020-07-10 17:33:16,045 WARN
org.apache.flink.runtime.taskmanager.TaskManagerLocation - No hostname could be
resolved for the IP address 127.0.0.1, using IP address as host name. Local
input split assignment (such as for HDFS files) may be impacted.
2020-07-10 17:33:16,118 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file
directory 'C:\cygwin64\tmp': total 99 GB, usable 35 GB (35.35% usable)
2020-07-10 17:33:16,121 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager
uses directory C:\cygwin64\tmp\flink-io-ded802c7-c911-44c2-80be-6060b87c6bdd
for spill files.
2020-07-10 17:33:16,131 INFO
org.apache.flink.runtime.io.network.netty.NettyConfig - NettyConfig [server
address: /127.0.0.1, server port: 0, ssl enabled: false, memory segment size
(bytes): 32768, transport type: NIO, number of server threads: 1 (manual),
number of client threads: 1 (manual), server connect backlog: 0 (use Netty's
default), client connect timeout (sec): 120, send/receive buffer size (bytes):
0 (use Netty's default)]
2020-07-10 17:33:16,135 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager
uses directory
C:\cygwin64\tmp\flink-netty-shuffle-f1b25ed8-1a50-4713-9476-ae29dc7daad8 for
spill files.
2020-07-10 17:33:16,273 INFO
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 158 MB
for network buffer pool (number of memory segments: 5079, bytes per segment:
32768).
2020-07-10 17:33:16,280 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Starting the
network environment and its components.
2020-07-10 17:33:16,326 INFO
org.apache.flink.runtime.io.network.netty.NettyClient - Successful
initialization (took 45 ms).
2020-07-10 17:33:17,031 INFO
org.apache.flink.runtime.io.network.netty.NettyServer - Successful
initialization (took 704 ms). Listening on SocketAddress /127.0.0.1:62319.
2020-07-10 17:33:17,033 INFO
org.apache.flink.runtime.taskexecutor.KvStateService - Starting the kvState
service and its components.
2020-07-10 17:33:17,033 WARN
org.apache.flink.runtime.taskmanager.TaskManagerLocation - No hostname could be
resolved for the IP address 127.0.0.1, using IP address as host name. Local
input split assignment (such as for HDFS files) may be impacted.
2020-07-10 17:33:17,043 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have
a max timeout of 10000 ms
2020-07-10 17:33:17,051 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService -
Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at
akka://flink/user/taskmanager_0 .
2020-07-10 17:33:17,062 INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Start job leader
service.
2020-07-10 17:33:17,064 INFO org.apache.flink.runtime.filecache.FileCache -
User file cache uses directory
C:\cygwin64\tmp\flink-dist-cache-62d80ed8-1af4-4e0f-a3a9-6993a1622966
2020-07-10 17:33:17,065 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Connecting to ResourceManager
akka.tcp://flink@localhost:6123/user/resourcemanager(00000000000000000000000000000000).
2020-07-10 17:33:17,410 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Resolved ResourceManager address, beginning registration
2020-07-10 17:33:17,410 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Registration at ResourceManager attempt 1 (timeout=100ms)
2020-07-10 17:33:17,601 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Registration at ResourceManager attempt 2 (timeout=200ms)
2020-07-10 17:33:17,719 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Successful registration at resource manager
akka.tcp://flink@localhost:6123/user/resourcemanager under registration id
0442cd3ae446ae225fade03679c575b2.
> TaskManager start failed
> ------------------------
>
> Key: FLINK-18438
> URL: https://issues.apache.org/jira/browse/FLINK-18438
> Project: Flink
> Issue Type: Bug
> Components: Client / Job Submission
> Affects Versions: 1.10.1
> Environment: Java: java version "1.8.0_101"
> Java(TM) SE Runtime Environment (build 1.8.0_101-b13)
> Java HotSpot(TM) 64-Bit Server VM (build 25.101-b13, mixed mode)
> Flink: 1.10.1 (flink-1.10.1-bin-scala_2.12.tgz)
> OS: Windows 10 (1903) / 64-bits
> Reporter: JohnSiro
> Priority: Major
>
>
> Error: in file xxx-taskexecutor-0-xxx.out is:
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> Improperly specified VM option 'MaxMetaspaceSize=268435456 '
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
