[
https://issues.apache.org/jira/browse/FLINK-27303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528501#comment-17528501
]
Yang Wang commented on FLINK-27303:
-----------------------------------
It seems the {{FlinkConfigManager}} is not working as expected. I still could
find some residual pod template files. Please note that only one
FlinkDeployment is running. What I have done is triggering an upgrade.
BWT, the pod template files could be deleted as soon as the application/session
cluster is started successfully.
{code:java}
flink@flink-kubernetes-operator-85465d98b9-gqpzf:/$ ls -lrt /tmp/
total 44
drwxr-xr-x 2 root root 4096 Mar 29 23:12 hsperfdata_root
drwxr-xr-x 2 flink flink 4096 Apr 26 11:53 hsperfdata_flink
-rw-r--r-- 1 flink flink 936 Apr 26 11:56
flink_op_generated_podTemplate_4426150248786094723.yaml
-rw-r--r-- 1 flink flink 936 Apr 26 11:56
flink_op_generated_podTemplate_15676526370248802485.yaml
-rw-r--r-- 1 flink flink 936 Apr 26 11:56
flink_op_generated_podTemplate_1417732719016118695.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:04
flink_op_generated_podTemplate_4906388424446930059.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:04
flink_op_generated_podTemplate_1327670729741500815.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:04
flink_op_generated_podTemplate_11405044963950044885.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:18
flink_op_generated_podTemplate_15361701471858080798.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:18
flink_op_generated_podTemplate_9205802344494485904.yaml
-rw-r--r-- 1 flink flink 936 Apr 27 02:18
flink_op_generated_podTemplate_8105630178263734625.yaml
flink@flink-kubernetes-operator-85465d98b9-gqpzf:/$
flink@flink-kubernetes-operator-85465d98b9-gqpzf:/$
flink@flink-kubernetes-operator-85465d98b9-gqpzf:/$ date
Wed Apr 27 03:12:33 UTC 2022 {code}
> Flink Operator will create a large amount of temp log config files
> ------------------------------------------------------------------
>
> Key: FLINK-27303
> URL: https://issues.apache.org/jira/browse/FLINK-27303
> Project: Flink
> Issue Type: Improvement
> Components: Kubernetes Operator
> Affects Versions: kubernetes-operator-1.0.0
> Reporter: Gyula Fora
> Assignee: Gyula Fora
> Priority: Critical
> Labels: pull-request-available
> Fix For: kubernetes-operator-1.0.0
>
>
> Now we use the configbuilder in multiple different places to generate the
> effective config including observer, reconciler, validator etc.
> The effective config gerenration logic also creates temporary log config
> files (if spec logConfiguration is set) which would lead to 3-4 files
> generated in every reconcile loop for a given job. These files are not
> cleaned up until the operator restarts leading to a large amount of files.
> I believe we should change the config generation logic and only apply the
> logconfig generation logic right before flink cluster submission as that is
> the only thing affected by it.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
