Santwana Verma created FLINK-41267:
--------------------------------------

             Summary: Cluster info fails for jobs without checkpointing, 
logging a WARN on every reconcile
                 Key: FLINK-41267
                 URL: https://issues.apache.org/jira/browse/FLINK-41267
             Project: Flink
          Issue Type: Bug
          Components: Kubernetes Operator
            Reporter: Santwana Verma


For a FlinkDeployment whose job has checkpointing disabled, which includes 
every batch job, the operator logs the following with a full stack trace on 
every reconcile:

WARN  Exception while fetching cluster info 
java.util.concurrent.ExecutionException: 
org.apache.flink.runtime.rest.util.RestClientException: [Checkpointing has not 
been enabled.]

status.clusterInfo and status.taskManager.replicas are also never updated for 
these jobs.

To report the job's state size in the cluster info, 
AbstractFlinkService.getClusterInfo requests the job's checkpoint statistics. 
For a job without checkpointing, the JobManager answers 404 "Checkpointing has 
not been enabled." populateStateSize does not handle this, so the whole 
getClusterInfo call fails. That request also has no timeout, unlike the other 
requests in getClusterInfo.

Proposed fix: when Flink gives this answer, skip the state size in 
populateStateSize and log at DEBUG. Add the Flink client timeout to that 
request, and log the same case in getLastCheckpoint at DEBUG without the stack 
trace.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to