Hi Lu, When using Flink on YARN, it will rely on YARN's resource management capabilities, and Flink cannot currently limit CPU usage.
Also, what version of Flink do you use? As far as I know, since Flink 1.8, the -yn parameter will not work. Best, Vino Lu Niu <qqib...@gmail.com> 于2019年11月6日周三 下午1:29写道： > Hi, > > When run flink application in yarn mode, is there a way to limit maximum > cpu usage per TaskManager? > > I tried this application with just source and sink operator. > parallelism of source is 60 and parallelism of sink is 1. When running in > default config, there are 60 TaskManager assigned. I notice one TaskManager > process cpu usage could be 200% white the rest below 50%. > > When I set -yn = 2 (default is 1), I notice # of TaskManger dropped down > to 30. and one TaskManger process cpu usage could be 600% while the rest > below 50%. > > Tried to set yarn.containers.vcores = 2, all tasks are in start state > forever, application is not able to turn to running state. > > Best > Lu >
