Hi All, I am exploring running Flink 1.12.0 on yarn and so far I have been able to start a yarn session and submit a job. But only one Task manager spins up and even when I submit a second job which requires more resources, The job is stuck in SCHEDULED state and no additional TMs get automatically assigned. Any pointers as why this is the case? Also I have tried to specify the number of TM when starting the yarn session like below, but the session starts with only 1 TM. ./bin/yarn-session.sh —queue <queue-name> -n 4 -jm 1024 -tm 4096
The older Flink version had the -yn option in the below command but it’s missing from newer versions and I don’t see any replacement for it: ./bin/flink run -m yarn-cluster -p10 -yn 5 -yjm 1024 -ytm 4069 -yqu <queue-name> examples/batch/wordCount.jar Would appreciate ant pointers as this is not allowing me to test out HA performance on yarn. Best, Marzi