?????? flink on yarn????????

jianxu Tue, 14 Jul 2020 02:32:36 -0700


????????????Yarn??????????????????????
1. 
????rm-address/ws/v1/cluster/apps/applicationId??????amContainerLog????url????jm??url.
2. 
taskmanager????url????rm-address/proxy/applicationId/taskmanagers,????????taskmanager????????????????amContainerLog????containername??ip??



????????????????????????????????????????????url?start=0&end=1024
| |
jianxu
|
|
[email protected]
|
??2020??07??14?? 17:07??Cayden chen<[email protected]> ??????
????????????????????????????????????




------------------&nbsp;????????&nbsp;------------------
??????:                                                                         
                                               "user-zh"                        
                                                            
<[email protected]&gt;;
????????:&nbsp;2020??7??14??(??????) ????5:05
??????:&nbsp;"user-zh"<[email protected]&gt;;

????:&nbsp;Re: Re: Re: flink on yarn????????



Flink??1.11????????????log4j2, 
log4j2????????????appender[1]????????????????????????????????????

[1] https://logging.apache.org/log4j/2.x/manual/appenders.html

Best,
Yangze Guo

On Tue, Jul 14, 2020 at 4:46 PM nicygan <[email protected]&gt; wrote:
&gt;
&gt; ????????????????TM????????????
&gt;
&gt; ????????????????????????????????????????????????????????JM??????
&gt;
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; ?? 2020-07-14 12:35:06??"zhisheng" <[email protected]&gt; ??????
&gt; &gt;???? YARN ?? applicationId?????????????? HDFS ???????? taskmanager 
????????????????????????????????????????????
&gt; &gt;
&gt; &gt;Yangze Guo <[email protected]&gt; ??2020??7??14?????? ????11:58??????
&gt; &gt;
&gt; &gt;&gt; Hi, ????
&gt; &gt;&gt;
&gt; &gt;&gt; ??????????url??????????????????????????????????????????????
&gt; &gt;&gt;
&gt; &gt;&gt; Best,
&gt; &gt;&gt; Yangze Guo
&gt; &gt;&gt;
&gt; &gt;&gt; On Tue, Jul 14, 2020 at 8:26 AM ???? 
<[email protected]&gt; wrote:
&gt; &gt;&gt; &gt;
&gt; &gt;&gt; &gt; ???????????? 1???? Yangze Guo 
??????????????????????????tm??????????????????????????????????????????????????
&gt; &gt;&gt; &gt;
&gt; &gt;&gt; &gt; Yangze Guo <[email protected]&gt; ??2020??7??13?????? 
????5:03??????
&gt; &gt;&gt; &gt;
&gt; &gt;&gt; &gt; &gt; 1.
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; 
????????????????????????????????????tm????????????????????????????application????????????????????????trick??????????????jm??????????tm????????????NodeManager????????????url????????????container??????
&gt; &gt;&gt; &gt; &gt; 2. ??????????????????????????[1]? 
??????????ck????????????????????????????job
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; [1]
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; 
https://ci.apache.org/projects/flink/flink-docs-master/zh/dev/task_failure_recovery.html
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; Best,
&gt; &gt;&gt; &gt; &gt; Yangze Guo
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; On Mon, Jul 13, 2020 at 2:40 PM ???? 
<[email protected]&gt; wrote:
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; ????????&nbsp; ????????????????
&gt; &gt;&gt; &gt; &gt; &gt; 1 ????????????????????
&gt; &gt;&gt; &gt; &gt; &gt; 2 ???????? per-job????
&gt; &gt;&gt; &gt; &gt; &gt; 3 ????????cdh flink.1.10
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; ?? 2020-07-13 11:18:46??"Yangze Guo" 
<[email protected]&gt; ??????
&gt; &gt;&gt; &gt; &gt; &gt; &gt;Hi,
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;??????????????????????????Yarn??????????????[1]
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;??????????????????????????per-job mode [2][3]
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;[1]
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; 
https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/yarn_setup.html#log-files
&gt; &gt;&gt; &gt; &gt; &gt; &gt;[2]
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; 
https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/#per-job-mode
&gt; &gt;&gt; &gt; &gt; &gt; &gt;[3]
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt; 
https://ci.apache.org/projects/flink/flink-docs-master/zh/ops/deployment/yarn_setup.html#run-a-single-flink-job-on-yarn
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;Best,
&gt; &gt;&gt; &gt; &gt; &gt; &gt;Yangze Guo
&gt; &gt;&gt; &gt; &gt; &gt; &gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;On Mon, Jul 13, 2020 at 10:49 AM ???? 
<[email protected]&gt; wrote:
&gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt;
&gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; ????????????????
&gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; 1 flink on yarn?????? taskmanager 
?????????? ???????????????????? ????????
&gt; &gt;&gt; &gt; &gt; ??????????es???????????????????? 
??????????????taskmanager ????????????????????????????
&gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt; 2 flink on yarn???? 
??????????????taskmanager ??????????jobmanager ????????????
&gt; &gt;&gt; &gt; &gt; ?????????????????????? ??&nbsp;&nbsp; ????????task???? 
???????????????? taskmanager??????jobmanager??????
&gt; &gt;&gt; &gt; &gt; &gt; &gt;&gt;
&gt; &gt;&gt; &gt; &gt;
&gt; &gt;&gt;

?????? flink on yarn????????

回复