您好,在使用flink on YARN的时候遇到了问题,寻求帮助,YARN集群搭建完成之后,运行flink命令如下:
./bin/flink run -t yarn-per-job --detached ./examples/batch/WordCount.jar
但是发现没有输出运行结果,日志如下
Executing WordCount example with default input data set.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
2021-05-08 21:53:46,561 WARN
org.apache.flink.yarn.configuration.YarnLogConfigUtil [] - The
configuration directory ('/mnt/flink-1.12.3/conf') already contains a LOG4J
config file.If you want to use logback, then please delete or rename the log
configuration file.
2021-05-08 21:53:46,611 INFO
org.apache.hadoop.yarn.client.DefaultNoHARMFailoverProxyProvider [] -
Connecting to ResourceManager at node01/172.19.0.132:8032
2021-05-08 21:53:46,925 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - No path for the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2021-05-08 21:53:47,159 INFO org.apache.hadoop.conf.Configuration
[] - resource-types.xml not found
2021-05-08 21:53:47,160 INFO
org.apache.hadoop.yarn.util.resource.ResourceUtils [] - Unable to
find 'resource-types.xml'.
2021-05-08 21:53:47,224 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - The configured JobManager memory is 1600 MB. YARN will allocate
2048 MB to make up an integer multiple of its minimum allocation memory (1024
MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The extra 448 MB
may not be used by Flink.
2021-05-08 21:53:47,224 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - The configured TaskManager memory is 1728 MB. YARN will
allocate 2048 MB to make up an integer multiple of its minimum allocation
memory (1024 MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The
extra 320 MB may not be used by Flink.
2021-05-08 21:53:47,225 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Cluster specification:
ClusterSpecification{masterMemoryMB=1600, taskManagerMemoryMB=1728,
slotsPerTaskManager=1}
2021-05-08 21:53:53,360 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Submitting application master application_1620481460888_0003
2021-05-08 21:53:53,425 INFO
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl [] - Submitted
application application_1620481460888_0003
2021-05-08 21:53:53,425 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Waiting for the cluster to be allocated
2021-05-08 21:53:53,427 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Deploying cluster, current state ACCEPTED
2021-05-08 21:54:53,548 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Deployment took more than 60 seconds. Please check if the
requested resources are available in the YARN cluster
2021-05-08 21:54:53,825 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Deployment took more than 60 seconds. Please check if the
requested resources are available in the YARN cluster
2021-05-08 21:54:54,077 INFO org.apache.flink.yarn.YarnClusterDescriptor
[] - Deployment took more than 60 seconds. Please check if the
requested resources are available in the YARN cluster
代码里输出的内容正常打印,但是没有打印结果
flink版本 1.12.3 Hadoop版本3.3.0
期望得到您的回复
[email protected]