Hi, we are trying to start a flink operator with a specific namespace. flink-operator version: 1.1.0
we set the following parameter : watchNamespaces: ["my-namespace"] The operator fails during installation with the following error *Caused by: io.fabric8.kubernetes.client.KubernetesClientException: * *Failure executing: GET at: https://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments <http://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments>. Message: Forbidden!Configured service account doesn't have access. * *Service account may have been revoked. flinkdeployments.flink.apache.org <http://flinkdeployments.flink.apache.org> is forbidden: User "system:serviceaccount:my-namespace:flink-operator" * *cannot list resource "flinkdeployments" in API group "flink.apache.org <http://flink.apache.org>" at the cluster scope: RBAC: clusterrole.rbac.authorization.k8s.io <http://clusterrole.rbac.authorization.k8s.io> "psp:privileged" not found.* we would expect that the list operation will take into consideration the namespace as well. Attached log file Is there any other configuration required? Thanks Sigalit
Initializing operator... Starting Operator WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance. [33m2022-08-22 14:59:07,710[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] -------------------------------------------------------------------------------- [m[33m2022-08-22 14:59:07,760[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Starting Flink Kubernetes Operator (Version: 1.1.0, Flink Version: 1.15.1, Rev:c9dec3f, Date:2022-07-20T10:44:02+02:00) [m[33m2022-08-22 14:59:07,761[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] OS current user: flink [m[33m2022-08-22 14:59:07,761[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 11/11.0.15+10 [m[33m2022-08-22 14:59:07,762[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Arch: amd64 [m[33m2022-08-22 14:59:07,768[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Maximum heap size: 6202 MiBytes [m[33m2022-08-22 14:59:07,769[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] JAVA_HOME: /usr/local/openjdk-11 [m[33m2022-08-22 14:59:07,769[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] JVM Options: [m[33m2022-08-22 14:59:07,770[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] -Dlog4j.configurationFile=/opt/flink/conf/log4j-operator.properties [m[33m2022-08-22 14:59:07,770[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Program Arguments: (none) [m[33m2022-08-22 14:59:07,770[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Classpath: ./flink-kubernetes-shaded-1.1.0.jar:./flink-kubernetes-operator-1.1.0-shaded.jar [m[33m2022-08-22 14:59:07,770[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] -------------------------------------------------------------------------------- [m[33m2022-08-22 14:59:08,016[m [36mo.a.f.k.o.c.FlinkConfigManager[m [36m[DEBUG] Loading default configuration [m[33m2022-08-22 14:59:08,075[m [36mo.a.f.k.o.c.FlinkConfigManager[m [32m[INFO ] Setting default configuration to {blob.server.port=6124, taskmanager.memory.process.size=1728m, jmx.server.port=9123, jobmanager.memory.process.size=1600m, jobmanager.rpc.port=6123, taskmanager.rpc.port=6122, queryable-state.proxy.ports=6125, parallelism.default=2, taskmanager.numberOfTaskSlots=2, kubernetes.operator.metrics.reporter.slf4j.interval=5 MINUTE, kubernetes.operator.observer.progress-check.interval=5 s, kubernetes.operator.metrics.reporter.slf4j.factory.class=org.apache.flink.metrics.slf4j.Slf4jReporterFactory, kubernetes.operator.reconciler.reschedule.interval=15 s} [m[33m2022-08-22 14:59:08,077[m [36mo.a.f.c.Configuration [m [33m[WARN ] Config uses deprecated configuration key 'kubernetes.operator.reconciler.reschedule.interval' instead of proper key 'kubernetes.operator.reconcile.interval' [m[33m2022-08-22 14:59:08,087[m [36mo.a.f.k.o.c.FlinkConfigManager[m [32m[INFO ] Enabled dynamic config updates, checking config changes every PT5M [m[33m2022-08-22 14:59:08,091[m [36mo.a.f.k.o.m.OperatorMetricUtils[m [32m[INFO ] Initializing operator metrics using conf: {blob.server.port=6124, taskmanager.memory.process.size=1728m, metrics.reporter.slf4j.interval=5 MINUTE, jmx.server.port=9123, jobmanager.memory.process.size=1600m, jobmanager.rpc.port=6123, taskmanager.rpc.port=6122, metrics.reporter.slf4j.factory.class=org.apache.flink.metrics.slf4j.Slf4jReporterFactory, queryable-state.proxy.ports=6125, parallelism.default=2, taskmanager.numberOfTaskSlots=2, kubernetes.operator.observer.progress-check.interval=5 s, kubernetes.operator.reconciler.reschedule.interval=15 s} [m[33m2022-08-22 14:59:08,153[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.datadog.DatadogHttpReporterFactory at /opt/flink/plugins/flink-metrics-datadog/flink-metrics-datadog-1.15.1.jar [m[33m2022-08-22 14:59:08,155[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.graphite.GraphiteReporterFactory at /opt/flink/plugins/flink-metrics-graphite/flink-metrics-graphite-1.15.1.jar [m[33m2022-08-22 14:59:08,157[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.slf4j.Slf4jReporterFactory at /opt/flink/plugins/flink-metrics-slf4j/flink-metrics-slf4j-1.15.1.jar [m[33m2022-08-22 14:59:08,159[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.prometheus.PrometheusReporterFactory at /opt/flink/plugins/flink-metrics-prometheus/flink-metrics-prometheus-1.15.1.jar [m[33m2022-08-22 14:59:08,160[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporterFactory at /opt/flink/plugins/flink-metrics-prometheus/flink-metrics-prometheus-1.15.1.jar [m[33m2022-08-22 14:59:08,162[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.statsd.StatsDReporterFactory at /opt/flink/plugins/flink-metrics-statsd/flink-metrics-statsd-1.15.1.jar [m[33m2022-08-22 14:59:08,164[m [36mo.a.f.r.m.ReporterSetup [m [36m[DEBUG] Found reporter factory org.apache.flink.metrics.influxdb.InfluxdbReporterFactory at /opt/flink/plugins/flink-metrics-influxdb/flink-metrics-influxdb-1.15.1.jar [m[33m2022-08-22 14:59:08,176[m [36mo.a.f.r.m.MetricRegistryImpl [m [32m[INFO ] Periodically reporting metrics in intervals of 5 min for reporter slf4j of type org.apache.flink.metrics.slf4j.Slf4jReporter. [m[33m2022-08-22 14:59:08,448[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client from Kubernetes config... [m[33m2022-08-22 14:59:08,448[m [36mi.f.k.c.Config [m [36m[DEBUG] Did not find Kubernetes config at: [/opt/flink/.kube/config]. Ignoring. [m[33m2022-08-22 14:59:08,448[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client from service account... [m[33m2022-08-22 14:59:08,449[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account host and port: 10.96.0.1:443 [m[33m2022-08-22 14:59:08,449[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt}]. [m[33m2022-08-22 14:59:08,450[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token]. [m[33m2022-08-22 14:59:08,450[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client namespace from Kubernetes service account namespace path... [m[33m2022-08-22 14:59:08,450[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace]. [m[33m2022-08-22 14:59:08,745[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client from Kubernetes config... [m[33m2022-08-22 14:59:08,745[m [36mi.f.k.c.Config [m [36m[DEBUG] Did not find Kubernetes config at: [/opt/flink/.kube/config]. Ignoring. [m[33m2022-08-22 14:59:08,745[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client from service account... [m[33m2022-08-22 14:59:08,746[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account host and port: 10.96.0.1:443 [m[33m2022-08-22 14:59:08,746[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt}]. [m[33m2022-08-22 14:59:08,746[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token]. [m[33m2022-08-22 14:59:08,746[m [36mi.f.k.c.Config [m [36m[DEBUG] Trying to configure client namespace from Kubernetes service account namespace path... [m[33m2022-08-22 14:59:08,746[m [36mi.f.k.c.Config [m [36m[DEBUG] Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace]. [m[33m2022-08-22 14:59:08,748[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Configuring operator with 5 reconciliation threads. [m[33m2022-08-22 14:59:08,781[m [36mo.a.f.c.f.FileSystem [m [32m[INFO ] Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available. [m[33m2022-08-22 14:59:08,802[m [36mo.a.f.c.f.FileSystem [m [36m[DEBUG] Loading extension file systems via services [m[33m2022-08-22 14:59:08,834[m [36mDefault ConfigurationService implementation[m [33m[WARN ] Configuration for reconciler 'flinkdeploymentcontroller' was not found. Known reconcilers: None. [m[33m2022-08-22 14:59:08,835[m [36mDefault ConfigurationService implementation[m [32m[INFO ] Created configuration for reconciler org.apache.flink.kubernetes.operator.controller.FlinkDeploymentController with name flinkdeploymentcontroller [m[33m2022-08-22 14:59:08,845[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Configuring operator to watch the following namespaces: [JOSDK_ALL_NAMESPACES]. [m[33m2022-08-22 14:59:08,847[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Configuring operator to select custom resources with the null labels. [m[33m2022-08-22 14:59:08,934[m [36mi.j.o.p.e.s.i.InformerManager [m [36m[DEBUG] Registered io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@27b71f50 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@383790cf for any namespace [m[33m2022-08-22 14:59:08,937[m [36mi.j.o.a.c.ExecutorServiceManager[m [36m[DEBUG] Initialized ExecutorServiceManager executor: class java.util.concurrent.ThreadPoolExecutor, timeout: 10 [m[33m2022-08-22 14:59:08,940[m [36mi.j.o.Operator [m [32m[INFO ] Registered reconciler: 'flinkdeploymentcontroller' for resource: 'class org.apache.flink.kubernetes.operator.crd.FlinkDeployment' for namespace(s): [all namespaces] [m[33m2022-08-22 14:59:08,946[m [36mDefault ConfigurationService implementation[m [33m[WARN ] Configuration for reconciler 'flinksessionjobcontroller' was not found. Known reconcilers: None. [m[33m2022-08-22 14:59:08,946[m [36mDefault ConfigurationService implementation[m [32m[INFO ] Created configuration for reconciler org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController with name flinksessionjobcontroller [m[33m2022-08-22 14:59:08,946[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Configuring operator to watch the following namespaces: [JOSDK_ALL_NAMESPACES]. [m[33m2022-08-22 14:59:08,946[m [36mo.a.f.k.o.FlinkOperator [m [32m[INFO ] Configuring operator to select custom resources with the null labels. [m[33m2022-08-22 14:59:08,948[m [36mi.j.o.p.e.s.i.InformerManager [m [36m[DEBUG] Registered io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@529cfee5 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@7ca0863b for any namespace [m[33m2022-08-22 14:59:08,948[m [36mi.j.o.Operator [m [32m[INFO ] Registered reconciler: 'flinksessionjobcontroller' for resource: 'class org.apache.flink.kubernetes.operator.crd.FlinkSessionJob' for namespace(s): [all namespaces] [m[33m2022-08-22 14:59:08,950[m [36mi.j.o.Operator [m [32m[INFO ] Operator SDK 3.0.3 (commit: ab111e7) built on 2022-06-24T13:23:42.000+0000 starting... [m[33m2022-08-22 14:59:08,950[m [36mi.j.o.Operator [m [32m[INFO ] Client version: 5.12.2 [m[33m2022-08-22 14:59:08,950[m [36mi.j.o.a.c.ExecutorServiceManager[m [36m[DEBUG] Already started, reusing already setup instance! [m[33m2022-08-22 14:59:08,952[m [36mi.j.o.p.Controller [m [32m[INFO ] Starting 'flinkdeploymentcontroller' controller for reconciler: org.apache.flink.kubernetes.operator.controller.FlinkDeploymentController, resource: org.apache.flink.kubernetes.operator.crd.FlinkDeployment [m[33m2022-08-22 14:59:08,953[m [36mi.j.o.p.Controller [m [32m[INFO ] Starting 'flinksessionjobcontroller' controller for reconciler: org.apache.flink.kubernetes.operator.controller.FlinkSessionJobController, resource: org.apache.flink.kubernetes.operator.crd.FlinkSessionJob [m[33m2022-08-22 14:59:08,962[m [36mi.j.o.p.e.s.i.InformerManager [m [36m[DEBUG] Registered io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@c27d163 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@57c88764 for any namespace [m[33m2022-08-22 14:59:08,967[m [36mi.j.o.p.e.s.i.InformerManager [m [36m[DEBUG] Registered io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@398ca38d -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@2f39f555 for any namespace [m[33m2022-08-22 14:59:08,969[m [36mi.j.o.p.e.s.i.InformerManager [m [36m[DEBUG] Registered io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@4f186450 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@7fab4be7 for any namespace [m[33m2022-08-22 14:59:08,980[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Starting event source ControllerResourceEventSource [m[33m2022-08-22 14:59:08,980[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Starting event source ControllerResourceEventSource [m[33m2022-08-22 14:59:08,980[m [36mi.f.k.c.i.i.DefaultSharedIndexInformer[m [36m[DEBUG] informer: ready to run resync and reflector for class org.apache.flink.kubernetes.operator.crd.FlinkDeployment with resync 0 [m[33m2022-08-22 14:59:08,981[m [36mi.f.k.c.i.i.DefaultSharedIndexInformer[m [36m[DEBUG] informer: ready to run resync and reflector for class org.apache.flink.kubernetes.operator.crd.FlinkSessionJob with resync 0 [m[33m2022-08-22 14:59:08,981[m [36mi.f.k.c.i.i.DefaultSharedIndexInformer[m [36m[DEBUG] informer#Controller: resync skipped due to 0 full resync period class org.apache.flink.kubernetes.operator.crd.FlinkDeployment [m[33m2022-08-22 14:59:08,981[m [36mi.f.k.c.i.i.DefaultSharedIndexInformer[m [36m[DEBUG] informer#Controller: resync skipped due to 0 full resync period class org.apache.flink.kubernetes.operator.crd.FlinkSessionJob [m[33m2022-08-22 14:59:09,003[m [36mi.f.k.c.i.VersionUsageUtils [m [33m[WARN ] The client is using resource type 'flinksessionjobs' with unstable version 'v1beta1' [m[33m2022-08-22 14:59:09,002[m [36mi.f.k.c.i.VersionUsageUtils [m [33m[WARN ] The client is using resource type 'flinkdeployments' with unstable version 'v1beta1' Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: --> GET https://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments h2 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Img0WmMtVUdXbzQtbF9wV0l6TlM3UmZtSk5WaTJ6UWNldHlGbEtDemg0VW8ifQ.eyJhdWQiOlsiaHR0cHM6Ly9rdWJlcm5ldGVzLmRlZmF1bHQuc3ZjLmNsdXN0ZXIubG9jYWwiXSwiZXhwIjoxNjkyNzE2MzQ1LCJpYXQiOjE2NjExODAzNDUsImlzcyI6Imh0dHBzOi8va3ViZXJuZXRlcy5kZWZhdWx0LnN2Yy5jbHVzdGVyLmxvY2FsIiwia3ViZXJuZXRlcy5pbyI6eyJuYW1lc3BhY2UiOiJub2EtZWRnZSIsInBvZCI6eyJuYW1lIjoiZmxpbmsta3ViZXJuZXRlcy1vcGVyYXRvci02NGZjZDY1NmNiLWpwbGJ6IiwidWlkIjoiYTY2NDIxZGMtMjZlOC00NTkzLWFmNzQtNGExNTg1YmYwMTg5In0sInNlcnZpY2VhY2NvdW50Ijp7Im5hbWUiOiJmbGluay1vcGVyYXRvciIsInVpZCI6IjZiYmU0NmUzLWFhN2EtNGVmMC1hNzQ5LTE5MjdhNTdmM2MyZSJ9LCJ3YXJuYWZ0ZXIiOjE2NjExODM5NTJ9LCJuYmYiOjE2NjExODAzNDUsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpub2EtZWRnZTpmbGluay1vcGVyYXRvciJ9.s1RKdGI-q6JxdZiDCDKABjyOqluT9XrCrwTuJnZ65tWtiLFYZ7vddUFELcZwoQbWrh4dpY8RpYe6s0c62tNKAs7wnY9Zm_XhJhgwqxfDgoihng9phV0muU7oFPpEGoaj30Hmzy7IK7EnZ70LwZmMyocmmYwD5zH3Hg7pp19nOfWoREYiryvucdxfZ6azuHXozYR3P6p8bOk_QZOFChSWuywAWFgPPPPu6Qfnx5TaVfpoxJiM7XaXr6N6Su0U48qMxkkWjUg-_lnv241ulPNjxEoyPPRdMZmCHQ9-2FID7V7ewvegg7M0yIYZs9pTxG7vAhyjC_Bk5rZ1ywlmCYCpaA Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Host: 10.96.0.1 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Connection: Keep-Alive Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Accept-Encoding: gzip Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: User-Agent: okhttp/3.12.12 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: --> END GET Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: --> GET https://10.96.0.1/apis/flink.apache.org/v1beta1/flinksessionjobs h2 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Authorization: Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Img0WmMtVUdXbzQtbF9wV0l6TlM3UmZtSk5WaTJ6UWNldHlGbEtDemg0VW8ifQ.eyJhdWQiOlsiaHR0cHM6Ly9rdWJlcm5ldGVzLmRlZmF1bHQuc3ZjLmNsdXN0ZXIubG9jYWwiXSwiZXhwIjoxNjkyNzE2MzQ1LCJpYXQiOjE2NjExODAzNDUsImlzcyI6Imh0dHBzOi8va3ViZXJuZXRlcy5kZWZhdWx0LnN2Yy5jbHVzdGVyLmxvY2FsIiwia3ViZXJuZXRlcy5pbyI6eyJuYW1lc3BhY2UiOiJub2EtZWRnZSIsInBvZCI6eyJuYW1lIjoiZmxpbmsta3ViZXJuZXRlcy1vcGVyYXRvci02NGZjZDY1NmNiLWpwbGJ6IiwidWlkIjoiYTY2NDIxZGMtMjZlOC00NTkzLWFmNzQtNGExNTg1YmYwMTg5In0sInNlcnZpY2VhY2NvdW50Ijp7Im5hbWUiOiJmbGluay1vcGVyYXRvciIsInVpZCI6IjZiYmU0NmUzLWFhN2EtNGVmMC1hNzQ5LTE5MjdhNTdmM2MyZSJ9LCJ3YXJuYWZ0ZXIiOjE2NjExODM5NTJ9LCJuYmYiOjE2NjExODAzNDUsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpub2EtZWRnZTpmbGluay1vcGVyYXRvciJ9.s1RKdGI-q6JxdZiDCDKABjyOqluT9XrCrwTuJnZ65tWtiLFYZ7vddUFELcZwoQbWrh4dpY8RpYe6s0c62tNKAs7wnY9Zm_XhJhgwqxfDgoihng9phV0muU7oFPpEGoaj30Hmzy7IK7EnZ70LwZmMyocmmYwD5zH3Hg7pp19nOfWoREYiryvucdxfZ6azuHXozYR3P6p8bOk_QZOFChSWuywAWFgPPPPu6Qfnx5TaVfpoxJiM7XaXr6N6Su0U48qMxkkWjUg-_lnv241ulPNjxEoyPPRdMZmCHQ9-2FID7V7ewvegg7M0yIYZs9pTxG7vAhyjC_Bk5rZ1ywlmCYCpaA Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Host: 10.96.0.1 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Connection: Keep-Alive Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Accept-Encoding: gzip Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: User-Agent: okhttp/3.12.12 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: --> END GET Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: <-- 403 https://10.96.0.1/apis/flink.apache.org/v1beta1/flinksessionjobs (37ms) Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: audit-id: 17776854-680d-43f4-a077-3a2f956e5b30 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: cache-control: no-cache, private Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: content-type: application/json Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-content-type-options: nosniff Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-kubernetes-pf-flowschema-uid: 443f5121-b71f-4e2d-85a7-9c5b0eb0b9f9 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-kubernetes-pf-prioritylevel-uid: 40f717dd-dd76-46bd-a1e7-51988188eb2c Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: content-length: 452 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: date: Mon, 22 Aug 2022 14:59:09 GMT Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: <-- 403 https://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments (44ms) Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: audit-id: 4ed9d5bd-fcf1-469c-8706-63255ad032f7 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: cache-control: no-cache, private Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: content-type: application/json Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-content-type-options: nosniff Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-kubernetes-pf-flowschema-uid: 443f5121-b71f-4e2d-85a7-9c5b0eb0b9f9 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: x-kubernetes-pf-prioritylevel-uid: 40f717dd-dd76-46bd-a1e7-51988188eb2c Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: content-length: 452 Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: date: Mon, 22 Aug 2022 14:59:09 GMT Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"flinksessionjobs.flink.apache.org is forbidden: User \"system:serviceaccount:noa-edge:flink-operator\" cannot list resource \"flinksessionjobs\" in API group \"flink.apache.org\" at the cluster scope: RBAC: clusterrole.rbac.authorization.k8s.io \"psp:privileged\" not found","reason":"Forbidden","details":{"group":"flink.apache.org","kind":"flinksessionjobs"},"code":403} Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"flinkdeployments.flink.apache.org is forbidden: User \"system:serviceaccount:noa-edge:flink-operator\" cannot list resource \"flinkdeployments\" in API group \"flink.apache.org\" at the cluster scope: RBAC: clusterrole.rbac.authorization.k8s.io \"psp:privileged\" not found","reason":"Forbidden","details":{"group":"flink.apache.org","kind":"flinkdeployments"},"code":403} Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: <-- END HTTP (452-byte body) Aug 22, 2022 2:59:09 PM okhttp3.internal.platform.Platform log INFO: <-- END HTTP (452-byte body) [m[33m2022-08-22 14:59:09,571[m [36mi.j.o.Operator [m [1;31m[ERROR] Error starting operator io.javaoperatorsdk.operator.OperatorException: Couldn't start source ControllerResourceEventSource at io.javaoperatorsdk.operator.processing.event.EventSourceManager.start(EventSourceManager.java:73) at io.javaoperatorsdk.operator.processing.Controller.start(Controller.java:305) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Unknown Source) at java.base/java.util.HashMap$ValueSpliterator.forEachRemaining(Unknown Source) at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachTask.compute(Unknown Source) at java.base/java.util.concurrent.CountedCompleter.exec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doInvoke(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.invoke(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateParallel(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(Unknown Source) at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source) at java.base/java.util.stream.ReferencePipeline.forEach(Unknown Source) at java.base/java.util.stream.ReferencePipeline$Head.forEach(Unknown Source) at io.javaoperatorsdk.operator.Operator$ControllerManager.start(Operator.java:219) at io.javaoperatorsdk.operator.Operator.start(Operator.java:100) at org.apache.flink.kubernetes.operator.FlinkOperator.run(FlinkOperator.java:182) at org.apache.flink.kubernetes.operator.FlinkOperator.main(FlinkOperator.java:187) Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. flinkdeployments.flink.apache.org is forbidden: User "system:serviceaccount:noa-edge:flink-operator" cannot list resource "flinkdeployments" in API group "flink.apache.org" at the cluster scope: RBAC: clusterrole.rbac.authorization.k8s.io "psp:privileged" not found. at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:682) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:661) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:610) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:555) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:518) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:502) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.listRequestHelper(BaseOperation.java:133) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:415) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:83) at io.fabric8.kubernetes.client.informers.cache.Reflector.listSyncAndWatch(Reflector.java:81) at io.fabric8.kubernetes.client.informers.impl.DefaultSharedIndexInformer.run(DefaultSharedIndexInformer.java:146) at io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper.start(InformerWrapper.java:36) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Unknown Source) at java.base/java.util.concurrent.ConcurrentHashMap$ValueSpliterator.forEachRemaining(Unknown Source) at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachTask.compute(Unknown Source) at java.base/java.util.concurrent.CountedCompleter.exec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doInvoke(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.invoke(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateParallel(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(Unknown Source) at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source) at java.base/java.util.stream.ReferencePipeline.forEach(Unknown Source) at java.base/java.util.stream.ReferencePipeline$Head.forEach(Unknown Source) at io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager.start(InformerManager.java:44) at io.javaoperatorsdk.operator.processing.event.source.informer.ManagedInformerEventSource.start(ManagedInformerEventSource.java:75) at io.javaoperatorsdk.operator.processing.event.source.controller.ControllerResourceEventSource.start(ControllerResourceEventSource.java:51) at io.javaoperatorsdk.operator.processing.event.NamedEventSource.start(NamedEventSource.java:20) at io.javaoperatorsdk.operator.processing.event.EventSourceManager.start(EventSourceManager.java:68) ... 18 more [m[33m2022-08-22 14:59:09,572[m [36mi.j.o.Operator [m [32m[INFO ] Operator SDK 3.0.3 is shutting down... [m[33m2022-08-22 14:59:09,573[m [36mi.j.o.Operator [m [36m[DEBUG] closing 'flinkdeploymentcontroller' Controller [m[33m2022-08-22 14:59:09,573[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source ControllerResourceEventSource [m[33m2022-08-22 14:59:09,574[m [36mi.j.o.p.e.s.i.InformerManager [m [32m[INFO ] Stopping informer io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@27b71f50 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@383790cf [m[33m2022-08-22 14:59:09,574[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source ControllerResourceEventSource [m[33m2022-08-22 14:59:09,574[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source RetryAndRescheduleTimerEventSource [m[33m2022-08-22 14:59:09,575[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source RetryAndRescheduleTimerEventSource [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#673129458 [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.s.i.InformerManager [m [32m[INFO ] Stopping informer io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@4f186450 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@7fab4be7 [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#673129458 [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#174383157 [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.s.i.InformerManager [m [32m[INFO ] Stopping informer io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@c27d163 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@57c88764 [m[33m2022-08-22 14:59:09,576[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#174383157 [m[33m2022-08-22 14:59:09,577[m [36mi.j.o.Operator [m [36m[DEBUG] closing 'flinksessionjobcontroller' Controller [m[33m2022-08-22 14:59:09,587[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source ControllerResourceEventSource [m[33m2022-08-22 14:59:09,587[m [36mi.j.o.p.e.s.i.InformerManager [m [32m[INFO ] Stopping informer io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@529cfee5 -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@7ca0863b [m[33m2022-08-22 14:59:09,595[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source ControllerResourceEventSource [m[33m2022-08-22 14:59:09,595[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source RetryAndRescheduleTimerEventSource [m[33m2022-08-22 14:59:09,595[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source RetryAndRescheduleTimerEventSource [m[33m2022-08-22 14:59:09,596[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopping event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#667850089 [m[33m2022-08-22 14:59:09,596[m [36mi.j.o.p.e.s.i.InformerManager [m [32m[INFO ] Stopping informer io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager@398ca38d -> io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper@2f39f555 [m[33m2022-08-22 14:59:09,596[m [36mi.j.o.p.e.EventSourceManager [m [36m[DEBUG] Stopped event source io.javaoperatorsdk.operator.processing.event.source.informer.InformerEventSource#667850089 [m[33m2022-08-22 14:59:09,596[m [36mi.j.o.a.c.ExecutorServiceManager[m [36m[DEBUG] Closing executor Exception in thread "main" io.javaoperatorsdk.operator.OperatorException: Couldn't start source ControllerResourceEventSource at io.javaoperatorsdk.operator.processing.event.EventSourceManager.start(EventSourceManager.java:73) at io.javaoperatorsdk.operator.processing.Controller.start(Controller.java:305) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Unknown Source) at java.base/java.util.HashMap$ValueSpliterator.forEachRemaining(Unknown Source) at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachTask.compute(Unknown Source) at java.base/java.util.concurrent.CountedCompleter.exec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doInvoke(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.invoke(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateParallel(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(Unknown Source) at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source) at java.base/java.util.stream.ReferencePipeline.forEach(Unknown Source) at java.base/java.util.stream.ReferencePipeline$Head.forEach(Unknown Source) at io.javaoperatorsdk.operator.Operator$ControllerManager.start(Operator.java:219) at io.javaoperatorsdk.operator.Operator.start(Operator.java:100) at org.apache.flink.kubernetes.operator.FlinkOperator.run(FlinkOperator.java:182) at org.apache.flink.kubernetes.operator.FlinkOperator.main(FlinkOperator.java:187) Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://10.96.0.1/apis/flink.apache.org/v1beta1/flinkdeployments. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. flinkdeployments.flink.apache.org is forbidden: User "system:serviceaccount:noa-edge:flink-operator" cannot list resource "flinkdeployments" in API group "flink.apache.org" at the cluster scope: RBAC: clusterrole.rbac.authorization.k8s.io "psp:privileged" not found. at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:682) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.requestFailure(OperationSupport.java:661) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.assertResponseCode(OperationSupport.java:610) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:555) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:518) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:502) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.listRequestHelper(BaseOperation.java:133) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:415) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:83) at io.fabric8.kubernetes.client.informers.cache.Reflector.listSyncAndWatch(Reflector.java:81) at io.fabric8.kubernetes.client.informers.impl.DefaultSharedIndexInformer.run(DefaultSharedIndexInformer.java:146) at io.javaoperatorsdk.operator.processing.event.source.informer.InformerWrapper.start(InformerWrapper.java:36) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(Unknown Source) at java.base/java.util.concurrent.ConcurrentHashMap$ValueSpliterator.forEachRemaining(Unknown Source) at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachTask.compute(Unknown Source) at java.base/java.util.concurrent.CountedCompleter.exec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.doInvoke(Unknown Source) at java.base/java.util.concurrent.ForkJoinTask.invoke(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateParallel(Unknown Source) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(Unknown Source) at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source) at java.base/java.util.stream.ReferencePipeline.forEach(Unknown Source) at java.base/java.util.stream.ReferencePipeline$Head.forEach(Unknown Source) at io.javaoperatorsdk.operator.processing.event.source.informer.InformerManager.start(InformerManager.java:44) at io.javaoperatorsdk.operator.processing.event.source.informer.ManagedInformerEventSource.start(ManagedInformerEventSource.java:75) at io.javaoperatorsdk.operator.processing.event.source.controller.ControllerResourceEventSource.start(ControllerResourceEventSource.java:51) at io.javaoperatorsdk.operator.processing.event.NamedEventSource.start(NamedEventSource.java:20) at io.javaoperatorsdk.operator.processing.event.EventSourceManager.start(EventSourceManager.java:68) ... 18 more [m[33m2022-08-22 15:04:07,743[m [36mo.a.f.k.o.c.FlinkConfigManager[m [36m[DEBUG] Checking for config update changes... [m[33m2022-08-22 15:04:07,744[m [36mo.a.f.k.o.c.FlinkConfigManager[m [36m[DEBUG] Loading default configuration [m[33m2022-08-22 15:04:07,745[m [36mo.a.f.k.o.c.FlinkConfigManager[m [32m[INFO ] Default configuration did not change, nothing to do... [m[33m2022-08-22 15:04:07,860[m [36mo.a.f.m.s.Slf4jReporter [m [32m[INFO ] =========================== Starting metrics report =========================== -- Counters ------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Failed.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.403.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.GET.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.Count: 2 -- Gauges --------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.TotalCapacity: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.CPU.Time: 6290000000 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Old Generation.Time: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.ClassLoader.ClassesUnloaded: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Used: 40077544 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Max: 6503268352 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Old Generation.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.MemoryUsed: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.TotalCapacity: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Used: 39596336 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Used: 28613064 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.MemoryUsed: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Threads.Count: 10 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.ClassLoader.ClassesLoaded: 6102 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Committed: 29671424 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Committed: 43761664 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Young Generation.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Max: -1 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Young Generation.Time: 36 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.CPU.Load: 0.0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Max: -1 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Committed: 408944640 -- Meters --------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Failed.NumPerSecond: 0.0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.NumPerSecond: 0.0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.NumPerSecond: 0.0 -- Histograms ----------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.TimeNanos: count=2, min=390996000, max=393078300, mean=3.9203715E8, stddev=1472408.4504647478, p50=3.9203715E8, p75=3.930783E8, p95=3.930783E8, p98=3.930783E8, p99=3.930783E8, p999=3.930783E8 =========================== Finished metrics report =========================== [m[33m2022-08-22 15:09:07,400[m [36mo.a.f.k.o.c.FlinkConfigManager[m [36m[DEBUG] Checking for config update changes... [m[33m2022-08-22 15:09:07,401[m [36mo.a.f.k.o.c.FlinkConfigManager[m [36m[DEBUG] Loading default configuration [m[33m2022-08-22 15:09:07,401[m [36mo.a.f.k.o.c.FlinkConfigManager[m [32m[INFO ] Default configuration did not change, nothing to do... [m[33m2022-08-22 15:09:07,521[m [36mo.a.f.m.s.Slf4jReporter [m [32m[INFO ] =========================== Starting metrics report =========================== -- Counters ------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Failed.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.403.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.GET.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.Count: 2 -- Gauges --------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.TotalCapacity: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.CPU.Time: 7130000000 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Old Generation.Time: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.ClassLoader.ClassesUnloaded: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Used: 41126120 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Max: 6503268352 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Old Generation.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.MemoryUsed: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Direct.TotalCapacity: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Used: 40069000 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Used: 28924224 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.MemoryUsed: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Threads.Count: 9 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.ClassLoader.ClassesLoaded: 6160 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Committed: 30064640 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Committed: 44417024 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Young Generation.Count: 2 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.NonHeap.Max: -1 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.GarbageCollector.G1 Young Generation.Time: 36 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Mapped.Count: 0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.CPU.Load: 3.5945985742869273E-4 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Metaspace.Max: -1 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.Status.JVM.Memory.Heap.Committed: 408944640 -- Meters --------------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.Failed.NumPerSecond: 0.0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.NumPerSecond: 0.0 flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpRequest.NumPerSecond: 0.0 -- Histograms ----------------------------------------------------------------- flink-kubernetes-operator-64fcd656cb-jplbz.k8soperator.noa-edge.flink-kubernetes-operator.system.KubeClient.HttpResponse.TimeNanos: count=2, min=390996000, max=393078300, mean=3.9203715E8, stddev=1472408.4504647478, p50=3.9203715E8, p75=3.930783E8, p95=3.930783E8, p98=3.930783E8, p99=3.930783E8, p999=3.930783E8 =========================== Finished metrics report ===========================