[
https://issues.apache.org/jira/browse/FLINK-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264779#comment-17264779
]
Wu commented on FLINK-20919:
----------------------------
2021-01-14 18:47:07,826 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- not exists all special local resources,change mode from LOCAL to
MIX,path:/tmp/dist-config/search-offline
2021-01-14 18:47:07,848 WARN org.apache.hadoop.conf.DistributedConfigHelper []
- zk resouces timestamp is defective,missing:[core-site]
2021-01-14 18:47:07,849 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- fetch local resource:hdfs-site.xml
2021-01-14 18:47:07,849 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- load resources:[hdfs-site, core-site],load mode:MIX
2021-01-14 18:47:09,473 WARN
org.apache.flink.yarn.configuration.YarnLogConfigUtil [] - The configuration
directory ('/home/amy/opt/flink-1.11.2/conf') already contains a LOG4J config
file.If you want to use logback, then please delete or rename the log
configuration file.
2021-01-14 18:47:09,600 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
No path for the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2021-01-14 18:47:09,749 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
The configured JobManager memory is 4092 MB. YARN will allocate 4096 MB to make
up an integer multiple of its minimum allocation memory (1024 MB, configured
via 'yarn.scheduler.minimum-allocation-mb'). The extra 4 MB may not be used by
Flink.
2021-01-14 18:47:09,749 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
Cluster specification: ClusterSpecification\{masterMemoryMB=4092,
taskManagerMemoryMB=10240, slotsPerTaskManager=1}
2021-01-14 18:47:09,785 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- not exists all special local resources,change mode from LOCAL to
MIX,path:/tmp/dist-config/search-offline
2021-01-14 18:47:09,786 WARN org.apache.hadoop.conf.DistributedConfigHelper []
- zk resouces timestamp is defective,missing:[core-site]
2021-01-14 18:47:09,786 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- fetch local resource:hdfs-site.xml
2021-01-14 18:47:09,786 INFO org.apache.hadoop.conf.DistributedConfigHelper []
- load resources:[hdfs-site, core-site],load mode:MIX
2021-01-14 18:47:12,600 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
Submitting application master application_1604996920397_6300582
2021-01-14 18:47:14,035 INFO
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl [] - Submitted
application application_1604996920397_6300582
2021-01-14 18:47:14,036 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
Waiting for the cluster to be allocated
2021-01-14 18:47:14,036 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
Deploying cluster, current state ACCEPTED
2021-01-14 18:47:26,645 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
YARN application has been deployed successfully.
2021-01-14 18:47:26,646 INFO org.apache.flink.yarn.YarnClusterDescriptor [] -
Found Web Interface cdh-bjht-7235:23386 of application
'application_1604996920397_6300582'.
Job has been submitted with JobID 392c3279952438cb05549684ad0dc6b8
> After the flink batch job is completed, the yarn application cannot be
> completed.
> ---------------------------------------------------------------------------------
>
> Key: FLINK-20919
> URL: https://issues.apache.org/jira/browse/FLINK-20919
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.11.2
> Reporter: Wu
> Priority: Major
> Attachments: flink-Overview.png, flink-completed.png,
> flink-jobManager.png, jobmanager.log, kaLr8Coy.png
>
>
> I submit flink batch job in yarn-cluster mode. After the flink batch job is
> completed, the yarn application cannot be completed. The yarn application
> still occupies a vcore. How to automatically close the yarn application.
>
> {code:java}
> //代码占位符
> EnvironmentSettings settings =
> EnvironmentSettings.newInstance().useBlinkPlanner().inBatchMode().build();
> TableEnvironment tableEnv = TableEnvironment.create(settings);
> tableEnv.executeSql("create table file_table");
> tableEnv.executeSql("create table print_table");
> String sql = "select count(1) from file_table";
> Table table = tableEnv.sqlQuery(sql);
> tableEnv.createTemporaryView("t", table);
> tableEnv.from("t").executeInsert("print_table");
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
