Re: Question regarding cpu limit config in Flink standalone mode

2021-05-07 Thread Fan Xie
, 2021 8:39 PM To: user@flink.apache.org Subject: Re: Question regarding cpu limit config in Flink standalone mode Hi Fan, For a java application, you cannot specify how many cpu a process should use. The JVM process will always try to use as much cpu time as it needs. The limitation can only come

Re: Question regarding cpu limit config in Flink standalone mode

2021-05-06 Thread Xintong Song
Hi Fan, For a java application, you cannot specify how many cpu a process should use. The JVM process will always try to use as much cpu time as it needs. The limitation can only come from external: hardware limit, OS scheduling, cgroups, etc. On Kubernetes, it is the pod's resource

Question regarding cpu limit config in Flink standalone mode

2021-05-06 Thread Fan Xie
Hi Flink Community, Recently I am working on an auto-scaling project that needs to dynamically adjust the cpu config of Flink standalone jobs . Our jobs will be running on standalone mode in a k8s cluster. After going through the configuration doc: