???????????????????????? logback??appder??appder????????????????????(????flink????taskmanager??????????????????applicationId????????????????????????jar??????????????????appder)??????????????MDC.put(),????????????appId????appder??????????????????????????????
------------------ ???????? ------------------ ??????: "user-zh" <rjia...@163.com>; ????????: 2020??7??14??(??????) ????5:31 ??????: "user-zh@flink.apache.org"<user-zh@flink.apache.org>; ????: ?????? flink on yarn???????? ????????????Yarn?????????????????????? 1. ????rm-address/ws/v1/cluster/apps/applicationId??????amContainerLog????url????jm??url. 2. taskmanager????url????rm-address/proxy/applicationId/taskmanagers,????????taskmanager????????????????amContainerLog????containername??ip?? ????????????????????????????????????????????url?start=0&end=1024 | | jianxu | | rjia...@163.com | ??2020??07??14?? 17:07??Cayden chen<1193216...@qq.com> ?????? ???????????????????????????????????? ------------------&nbsp;????????&nbsp;------------------ ??????: "user-zh" <karma...@gmail.com&gt;; ????????:&nbsp;2020??7??14??(??????) ????5:05 ??????:&nbsp;"user-zh"<user-zh@flink.apache.org&gt;; ????:&nbsp;Re: Re: Re: flink on yarn???????? Flink??1.11????????????log4j2, log4j2????????????appender[1]???????????????????????????????????? [1] https://logging.apache.org/log4j/2.x/manual/appenders.html Best, Yangze Guo On Tue, Jul 14, 2020 at 4:46 PM nicygan <read3...@163.com&gt; wrote: &gt; &gt; ????????????????TM???????????? &gt; &gt; ????????????????????????????????????????????????????????JM?????? &gt; &gt; &gt; &gt; &gt; &gt; &gt; ?? 2020-07-14 12:35:06??"zhisheng" <zhisheng2...@gmail.com&gt; ?????? &gt; &gt;???? YARN ?? applicationId?????????????? HDFS ???????? taskmanager ???????????????????????????????????????????? &gt; &gt; &gt; &gt;Yangze Guo <karma...@gmail.com&gt; ??2020??7??14?????? ????11:58?????? &gt; &gt; &gt; &gt;&gt; Hi, ???? &gt; &gt;&gt; &gt; &gt;&gt; ??????????url?????????????????????????????????????????????? &gt; &gt;&gt; &gt; &gt;&gt; Best, &gt; &gt;&gt; Yangze Guo &gt; &gt;&gt; &gt; &gt;&gt; On Tue, Jul 14, 2020 at 8:26 AM ???? <sdlcwangson...@gmail.com&gt; wrote: &gt; &gt;&gt; &gt; &gt; &gt;&gt; &gt; ???????????? 1???? Yangze Guo ??????????????????????????tm?????????????????????????????????????????????????? &gt; &gt;&gt; &gt; &gt; &gt;&gt; &gt; Yangze Guo <karma...@gmail.com&gt; ??2020??7??13?????? ????5:03?????? &gt; &gt;&gt; &gt; &gt; &gt;&gt; &gt; &gt; 1. &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; ????????????????????????????????????tm????????????????????????????application????????????????????????trick??????????????jm??????????tm????????????NodeManager????????????url????????????container?????? &gt; &gt;&gt; &gt; &gt; 2. ??????????????????????????[1]? ??????????ck????????????????????????????job &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; [1] &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; https://ci.apache.org/projects/flink/flink-docs-master/zh/dev/task_failure_recovery.html &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; Best, &gt; &gt;&gt; &gt; &gt; Yangze Guo &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; On Mon, Jul 13, 2020 at 2:40 PM ???? <13162790...@163.com&gt; wrote: &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; ????????&nbsp; ???????????????? &gt; &gt;&gt; &gt; &gt; &gt; 1 ???????????????????? &gt; &gt;&gt; &gt; &gt; &gt; 2 ???????? per-job???? &gt; &gt;&gt; &gt; &gt; &gt; 3 ????????cdh flink.1.10 &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; ?? 2020-07-13 11:18:46??"Yangze Guo" <karma...@gmail.com&gt; ?????? &gt; &gt;&gt; &gt; &gt; &gt; &gt;Hi, &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;??????????????????????????Yarn??????????????[1] &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;??????????????????????????per-job mode [2][3] &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;[1] &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/yarn_setup.html#log-files &gt; &gt;&gt; &gt; &gt; &gt; &gt;[2] &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/#per-job-mode &gt; &gt;&gt; &gt; &gt; &gt; &gt;[3] &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/yarn_setup.html#run-a-single-flink-job-on-yarn &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;Best, &gt; &gt;&gt; &gt; &gt; &gt; &gt;Yangze Guo &gt; &gt;&gt; &gt; &gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;On Mon, Jul 13, 2020 at 10:49 AM ???? <13162790...@163.com&gt; wrote: &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; ???????????????? &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; 1 flink on yarn?????? taskmanager ?????????? ???????????????????? ???????? &gt; &gt;&gt; &gt; &gt; ??????????es???????????????????? ??????????????taskmanager ???????????????????????????? &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; 2 flink on yarn???? ??????????????taskmanager ??????????jobmanager ???????????? &gt; &gt;&gt; &gt; &gt; ?????????????????????? ??&nbsp;&nbsp; ????????task???? ???????????????? taskmanager??????jobmanager?????? &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; &gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt;